Mar 16 13:05:55 crc systemd[1]: Starting Kubernetes Kubelet... Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Mar 16 13:05:55 crc kubenswrapper[5030]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.778482 5030 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782509 5030 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782526 5030 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782530 5030 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782536 5030 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782540 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782544 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782562 5030 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782565 5030 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782569 5030 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782572 5030 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782575 5030 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782579 5030 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782581 5030 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782584 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782587 5030 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782590 5030 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782593 5030 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782596 5030 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782599 5030 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782608 5030 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782612 5030 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782615 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782618 5030 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782621 5030 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782624 5030 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782627 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782630 5030 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782635 5030 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782638 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782642 5030 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782645 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782648 5030 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782651 5030 feature_gate.go:328] unrecognized feature gate: Example Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782655 5030 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782658 5030 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782661 5030 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782664 5030 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782667 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782671 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782674 5030 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782678 5030 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782682 5030 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782687 5030 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782690 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782693 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782696 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782699 5030 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782702 5030 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782705 5030 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782708 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782711 5030 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782714 5030 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782716 5030 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782720 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782723 5030 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782726 5030 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782729 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782732 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782735 5030 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782737 5030 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782740 5030 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782743 5030 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782746 5030 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782749 5030 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782752 5030 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782754 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782758 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782760 5030 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782764 5030 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782767 5030 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782770 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782773 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782776 5030 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782778 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782781 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782784 5030 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782787 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782790 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782800 5030 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782803 5030 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782806 5030 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782809 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782812 5030 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782814 5030 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782817 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.782820 5030 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783151 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783156 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783159 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783162 5030 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783165 5030 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783168 5030 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783171 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783175 5030 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783178 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783181 5030 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783184 5030 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783186 5030 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783190 5030 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783193 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783203 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783207 5030 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783210 5030 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783213 5030 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783216 5030 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783219 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783222 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783225 5030 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783228 5030 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783231 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783234 5030 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783237 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783239 5030 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783242 5030 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783245 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783248 5030 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783251 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783254 5030 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783257 5030 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783260 5030 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783262 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783265 5030 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783268 5030 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783271 5030 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783274 5030 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783277 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783280 5030 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783282 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783285 5030 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783288 5030 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783291 5030 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783295 5030 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783299 5030 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783303 5030 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783307 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783310 5030 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783313 5030 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783316 5030 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783319 5030 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783323 5030 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783326 5030 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783329 5030 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783332 5030 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783334 5030 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783337 5030 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783340 5030 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783343 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783346 5030 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783349 5030 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783352 5030 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783355 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783357 5030 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783360 5030 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783363 5030 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783366 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783370 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783373 5030 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783377 5030 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783380 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783383 5030 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783388 5030 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783391 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783394 5030 feature_gate.go:328] unrecognized feature gate: Example Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783397 5030 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783402 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783405 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783408 5030 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783412 5030 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783415 5030 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783419 5030 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783422 5030 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.783426 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783828 5030 flags.go:64] FLAG: --address="0.0.0.0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783840 5030 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783848 5030 flags.go:64] FLAG: --anonymous-auth="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783853 5030 flags.go:64] FLAG: --application-metrics-count-limit="100" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783858 5030 flags.go:64] FLAG: --authentication-token-webhook="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783861 5030 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783866 5030 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783872 5030 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783875 5030 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783879 5030 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783882 5030 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783886 5030 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783889 5030 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783893 5030 flags.go:64] FLAG: --cgroup-root="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783896 5030 flags.go:64] FLAG: --cgroups-per-qos="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783899 5030 flags.go:64] FLAG: --client-ca-file="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783903 5030 flags.go:64] FLAG: --cloud-config="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783906 5030 flags.go:64] FLAG: --cloud-provider="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783909 5030 flags.go:64] FLAG: --cluster-dns="[]" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783913 5030 flags.go:64] FLAG: --cluster-domain="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783917 5030 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783920 5030 flags.go:64] FLAG: --config-dir="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783923 5030 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783927 5030 flags.go:64] FLAG: --container-log-max-files="5" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783938 5030 flags.go:64] FLAG: --container-log-max-size="10Mi" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783943 5030 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783946 5030 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783950 5030 flags.go:64] FLAG: --containerd-namespace="k8s.io" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783953 5030 flags.go:64] FLAG: --contention-profiling="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783956 5030 flags.go:64] FLAG: --cpu-cfs-quota="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783960 5030 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783963 5030 flags.go:64] FLAG: --cpu-manager-policy="none" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783966 5030 flags.go:64] FLAG: --cpu-manager-policy-options="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783971 5030 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783974 5030 flags.go:64] FLAG: --enable-controller-attach-detach="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783978 5030 flags.go:64] FLAG: --enable-debugging-handlers="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783981 5030 flags.go:64] FLAG: --enable-load-reader="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783984 5030 flags.go:64] FLAG: --enable-server="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783987 5030 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783992 5030 flags.go:64] FLAG: --event-burst="100" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783996 5030 flags.go:64] FLAG: --event-qps="50" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.783999 5030 flags.go:64] FLAG: --event-storage-age-limit="default=0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784003 5030 flags.go:64] FLAG: --event-storage-event-limit="default=0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784006 5030 flags.go:64] FLAG: --eviction-hard="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784010 5030 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784013 5030 flags.go:64] FLAG: --eviction-minimum-reclaim="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784017 5030 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784020 5030 flags.go:64] FLAG: --eviction-soft="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784023 5030 flags.go:64] FLAG: --eviction-soft-grace-period="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784027 5030 flags.go:64] FLAG: --exit-on-lock-contention="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784030 5030 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784033 5030 flags.go:64] FLAG: --experimental-mounter-path="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784037 5030 flags.go:64] FLAG: --fail-cgroupv1="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784040 5030 flags.go:64] FLAG: --fail-swap-on="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784043 5030 flags.go:64] FLAG: --feature-gates="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784047 5030 flags.go:64] FLAG: --file-check-frequency="20s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784051 5030 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784055 5030 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784060 5030 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784063 5030 flags.go:64] FLAG: --healthz-port="10248" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784067 5030 flags.go:64] FLAG: --help="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784070 5030 flags.go:64] FLAG: --hostname-override="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784073 5030 flags.go:64] FLAG: --housekeeping-interval="10s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784077 5030 flags.go:64] FLAG: --http-check-frequency="20s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784080 5030 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784083 5030 flags.go:64] FLAG: --image-credential-provider-config="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784086 5030 flags.go:64] FLAG: --image-gc-high-threshold="85" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784089 5030 flags.go:64] FLAG: --image-gc-low-threshold="80" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784092 5030 flags.go:64] FLAG: --image-service-endpoint="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784096 5030 flags.go:64] FLAG: --kernel-memcg-notification="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784099 5030 flags.go:64] FLAG: --kube-api-burst="100" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784102 5030 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784106 5030 flags.go:64] FLAG: --kube-api-qps="50" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784109 5030 flags.go:64] FLAG: --kube-reserved="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784114 5030 flags.go:64] FLAG: --kube-reserved-cgroup="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784117 5030 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784120 5030 flags.go:64] FLAG: --kubelet-cgroups="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784123 5030 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784127 5030 flags.go:64] FLAG: --lock-file="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784130 5030 flags.go:64] FLAG: --log-cadvisor-usage="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784133 5030 flags.go:64] FLAG: --log-flush-frequency="5s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784136 5030 flags.go:64] FLAG: --log-json-info-buffer-size="0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784141 5030 flags.go:64] FLAG: --log-json-split-stream="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784145 5030 flags.go:64] FLAG: --log-text-info-buffer-size="0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784148 5030 flags.go:64] FLAG: --log-text-split-stream="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784151 5030 flags.go:64] FLAG: --logging-format="text" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784154 5030 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784158 5030 flags.go:64] FLAG: --make-iptables-util-chains="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784164 5030 flags.go:64] FLAG: --manifest-url="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784167 5030 flags.go:64] FLAG: --manifest-url-header="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784171 5030 flags.go:64] FLAG: --max-housekeeping-interval="15s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784175 5030 flags.go:64] FLAG: --max-open-files="1000000" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784179 5030 flags.go:64] FLAG: --max-pods="110" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784183 5030 flags.go:64] FLAG: --maximum-dead-containers="-1" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784186 5030 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784189 5030 flags.go:64] FLAG: --memory-manager-policy="None" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784192 5030 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784195 5030 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784199 5030 flags.go:64] FLAG: --node-ip="192.168.126.11" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784203 5030 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhel" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784212 5030 flags.go:64] FLAG: --node-status-max-images="50" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784216 5030 flags.go:64] FLAG: --node-status-update-frequency="10s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784220 5030 flags.go:64] FLAG: --oom-score-adj="-999" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784223 5030 flags.go:64] FLAG: --pod-cidr="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784226 5030 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cc2b30e70040205c2536d01ae5c850be1ed2d775cf13249e50328e5085777977" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784233 5030 flags.go:64] FLAG: --pod-manifest-path="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784237 5030 flags.go:64] FLAG: --pod-max-pids="-1" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784240 5030 flags.go:64] FLAG: --pods-per-core="0" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784244 5030 flags.go:64] FLAG: --port="10250" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784247 5030 flags.go:64] FLAG: --protect-kernel-defaults="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784250 5030 flags.go:64] FLAG: --provider-id="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784253 5030 flags.go:64] FLAG: --qos-reserved="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784257 5030 flags.go:64] FLAG: --read-only-port="10255" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784260 5030 flags.go:64] FLAG: --register-node="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784263 5030 flags.go:64] FLAG: --register-schedulable="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784266 5030 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784272 5030 flags.go:64] FLAG: --registry-burst="10" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784275 5030 flags.go:64] FLAG: --registry-qps="5" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784279 5030 flags.go:64] FLAG: --reserved-cpus="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784282 5030 flags.go:64] FLAG: --reserved-memory="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784286 5030 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784291 5030 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784294 5030 flags.go:64] FLAG: --rotate-certificates="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784298 5030 flags.go:64] FLAG: --rotate-server-certificates="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784302 5030 flags.go:64] FLAG: --runonce="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784305 5030 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784308 5030 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784312 5030 flags.go:64] FLAG: --seccomp-default="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784315 5030 flags.go:64] FLAG: --serialize-image-pulls="true" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784318 5030 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784321 5030 flags.go:64] FLAG: --storage-driver-db="cadvisor" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784325 5030 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784328 5030 flags.go:64] FLAG: --storage-driver-password="root" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784331 5030 flags.go:64] FLAG: --storage-driver-secure="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784334 5030 flags.go:64] FLAG: --storage-driver-table="stats" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784338 5030 flags.go:64] FLAG: --storage-driver-user="root" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784341 5030 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784344 5030 flags.go:64] FLAG: --sync-frequency="1m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784349 5030 flags.go:64] FLAG: --system-cgroups="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784352 5030 flags.go:64] FLAG: --system-reserved="cpu=200m,ephemeral-storage=350Mi,memory=350Mi" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784357 5030 flags.go:64] FLAG: --system-reserved-cgroup="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784361 5030 flags.go:64] FLAG: --tls-cert-file="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784364 5030 flags.go:64] FLAG: --tls-cipher-suites="[]" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784368 5030 flags.go:64] FLAG: --tls-min-version="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784371 5030 flags.go:64] FLAG: --tls-private-key-file="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784374 5030 flags.go:64] FLAG: --topology-manager-policy="none" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784377 5030 flags.go:64] FLAG: --topology-manager-policy-options="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784381 5030 flags.go:64] FLAG: --topology-manager-scope="container" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784384 5030 flags.go:64] FLAG: --v="2" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784388 5030 flags.go:64] FLAG: --version="false" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784393 5030 flags.go:64] FLAG: --vmodule="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784397 5030 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.784400 5030 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784483 5030 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784488 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784491 5030 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784495 5030 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784498 5030 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784501 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784505 5030 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784508 5030 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784511 5030 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784514 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784516 5030 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784520 5030 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784523 5030 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784525 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784528 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784531 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784534 5030 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784538 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784541 5030 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784563 5030 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784566 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784569 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784572 5030 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784575 5030 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784578 5030 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784581 5030 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784584 5030 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784588 5030 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784592 5030 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784596 5030 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784599 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784602 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784607 5030 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784610 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784613 5030 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784616 5030 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784619 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784622 5030 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784626 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784629 5030 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784632 5030 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784635 5030 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784638 5030 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784641 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784645 5030 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784649 5030 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784652 5030 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784654 5030 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784657 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784662 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784665 5030 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784668 5030 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784671 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784673 5030 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784677 5030 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784680 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784682 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784685 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784688 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784691 5030 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784694 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784697 5030 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784700 5030 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784703 5030 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784707 5030 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784710 5030 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784713 5030 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784716 5030 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784719 5030 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784722 5030 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784726 5030 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784729 5030 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784732 5030 feature_gate.go:328] unrecognized feature gate: Example Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784735 5030 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784737 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784740 5030 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784743 5030 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784746 5030 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784749 5030 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784752 5030 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784755 5030 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784759 5030 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784762 5030 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784765 5030 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784768 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.784772 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.785207 5030 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.793297 5030 server.go:530] "Kubelet version" kubeletVersion="v1.33.5" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.793323 5030 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793381 5030 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793391 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793395 5030 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793399 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793403 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793406 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793411 5030 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793415 5030 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793418 5030 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793421 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793424 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793427 5030 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793430 5030 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793434 5030 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793437 5030 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793440 5030 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793443 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793446 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793449 5030 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793452 5030 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793455 5030 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793459 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793463 5030 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793466 5030 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793470 5030 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793473 5030 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793477 5030 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793480 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793483 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793486 5030 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793489 5030 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793493 5030 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793496 5030 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793499 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793502 5030 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793505 5030 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793508 5030 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793511 5030 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793514 5030 feature_gate.go:328] unrecognized feature gate: Example Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793517 5030 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793520 5030 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793523 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793526 5030 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793529 5030 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793532 5030 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793535 5030 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793538 5030 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793541 5030 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793544 5030 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793567 5030 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793572 5030 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793577 5030 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793580 5030 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793583 5030 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793586 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793590 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793593 5030 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793596 5030 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793599 5030 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793602 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793605 5030 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793608 5030 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793611 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793613 5030 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793617 5030 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793620 5030 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793623 5030 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793626 5030 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793629 5030 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793632 5030 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793635 5030 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793638 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793640 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793643 5030 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793646 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793649 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793652 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793655 5030 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793658 5030 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793661 5030 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793664 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793667 5030 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793669 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793672 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793675 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793678 5030 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.793684 5030 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793785 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793800 5030 feature_gate.go:328] unrecognized feature gate: SignatureStores Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793804 5030 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793807 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793810 5030 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793813 5030 feature_gate.go:328] unrecognized feature gate: NewOLM Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793816 5030 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793819 5030 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793822 5030 feature_gate.go:328] unrecognized feature gate: PinnedImages Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793825 5030 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793829 5030 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793833 5030 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793836 5030 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793840 5030 feature_gate.go:328] unrecognized feature gate: Example Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793843 5030 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793846 5030 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793849 5030 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793853 5030 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793856 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793860 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793863 5030 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793865 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793869 5030 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793871 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793874 5030 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793877 5030 feature_gate.go:328] unrecognized feature gate: Example2 Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793881 5030 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793884 5030 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793887 5030 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793891 5030 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793894 5030 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793897 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793900 5030 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793903 5030 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793906 5030 feature_gate.go:328] unrecognized feature gate: OVNObservability Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793909 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793912 5030 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793915 5030 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793918 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793920 5030 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793924 5030 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793927 5030 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793929 5030 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793933 5030 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793936 5030 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793939 5030 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793941 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793944 5030 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793947 5030 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793950 5030 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793953 5030 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793956 5030 feature_gate.go:328] unrecognized feature gate: GatewayAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793959 5030 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793962 5030 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793965 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793968 5030 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793971 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793974 5030 feature_gate.go:328] unrecognized feature gate: DualReplica Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793977 5030 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793981 5030 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793984 5030 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793988 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793991 5030 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793994 5030 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.793997 5030 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794000 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794003 5030 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794007 5030 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794010 5030 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794013 5030 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794015 5030 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794018 5030 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794022 5030 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794025 5030 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794028 5030 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794031 5030 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794034 5030 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794037 5030 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794040 5030 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794043 5030 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794046 5030 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794050 5030 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794053 5030 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794056 5030 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794059 5030 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Mar 16 13:05:55 crc kubenswrapper[5030]: W0316 13:05:55.794062 5030 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.794067 5030 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.794587 5030 server.go:962] "Client rotation is on, will bootstrap in background" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.796916 5030 bootstrap.go:266] "Unhandled Error" err="part of the existing bootstrap client certificate in /var/lib/kubelet/kubeconfig is expired: 2025-12-03 08:27:53 +0000 UTC" logger="UnhandledError" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.801340 5030 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.801424 5030 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.802194 5030 server.go:1019] "Starting client certificate rotation" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.802303 5030 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.802339 5030 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.814929 5030 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.816680 5030 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.816890 5030 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://api-int.crc.testing:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.825023 5030 log.go:25] "Validated CRI v1 runtime API" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.851243 5030 log.go:25] "Validated CRI v1 image API" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.852833 5030 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.855979 5030 fs.go:135] Filesystem UUIDs: map[19e76f87-96b8-4794-9744-0b33dca22d5b:/dev/vda3 2026-03-16-13-01-26-00:/dev/sr0 5eb7c122-420e-4494-80ec-41664070d7b6:/dev/vda4 7B77-95E7:/dev/vda2] Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.856001 5030 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /run/user/1000:{mountpoint:/run/user/1000 major:0 minor:44 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} /var/lib/etcd:{mountpoint:/var/lib/etcd major:0 minor:45 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.867464 5030 manager.go:217] Machine: {Timestamp:2026-03-16 13:05:55.866069795 +0000 UTC m=+0.265382361 CPUVendorID:AuthenticAMD NumCores:12 NumPhysicalCores:1 NumSockets:12 CpuFrequency:2445406 MemoryCapacity:33649926144 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:80bc4fba336e4ca1bc9d28a8be52a356 SystemUUID:55cafcc5-d327-4b26-a8f9-6f3f352fb179 BootID:7cb912b0-94fc-4f44-a6eb-070b5fb0188e Filesystems:[{Device:/run/user/1000 DeviceMajor:0 DeviceMinor:44 Capacity:3364990976 Type:vfs Inodes:821531 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6729986048 Type:vfs Inodes:819200 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16824963072 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/etcd DeviceMajor:0 DeviceMinor:45 Capacity:1073741824 Type:vfs Inodes:4107657 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16824963072 Type:vfs Inodes:4107657 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:85292941312 Type:vfs Inodes:41679680 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6545408 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:3e:00:b1:41 Speed:0 Mtu:1500} {Name:br-int MacAddress:b2:a9:9f:57:07:84 Speed:0 Mtu:1400} {Name:enp3s0 MacAddress:fa:16:3e:00:b1:41 Speed:-1 Mtu:1500} {Name:enp7s0 MacAddress:fa:16:3e:39:e4:d0 Speed:-1 Mtu:1440} {Name:enp7s0.20 MacAddress:52:54:00:11:cc:30 Speed:-1 Mtu:1436} {Name:enp7s0.21 MacAddress:52:54:00:75:6a:00 Speed:-1 Mtu:1436} {Name:enp7s0.22 MacAddress:52:54:00:6c:b5:b9 Speed:-1 Mtu:1436} {Name:eth10 MacAddress:1a:8d:92:b4:46:28 Speed:0 Mtu:1500} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:d9:00:02 Speed:0 Mtu:1400} {Name:ovs-system MacAddress:b6:3c:de:75:3f:b6 Speed:0 Mtu:1500} {Name:tap0 MacAddress:5a:94:ef:e4:0c:ee Speed:10 Mtu:1500}] Topology:[{Id:0 Memory:33649926144 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:65536 Type:Data Level:1} {Id:0 Size:65536 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:65536 Type:Data Level:1} {Id:1 Size:65536 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:65536 Type:Data Level:1} {Id:10 Size:65536 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:65536 Type:Data Level:1} {Id:11 Size:65536 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:65536 Type:Data Level:1} {Id:2 Size:65536 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:65536 Type:Data Level:1} {Id:3 Size:65536 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:65536 Type:Data Level:1} {Id:4 Size:65536 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:65536 Type:Data Level:1} {Id:5 Size:65536 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:65536 Type:Data Level:1} {Id:6 Size:65536 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:65536 Type:Data Level:1} {Id:7 Size:65536 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:65536 Type:Data Level:1} {Id:8 Size:65536 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:65536 Type:Data Level:1} {Id:9 Size:65536 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.868071 5030 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.868166 5030 manager.go:233] Version: {KernelVersion:5.14.0-570.57.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20251021-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.869512 5030 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.869557 5030 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"crc","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"200m","ephemeral-storage":"350Mi","memory":"350Mi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.869713 5030 topology_manager.go:138] "Creating topology manager with none policy" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.869722 5030 container_manager_linux.go:306] "Creating device plugin manager" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.869744 5030 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.870216 5030 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.870653 5030 state_mem.go:36] "Initialized new in-memory state store" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.871897 5030 server.go:1267] "Using root directory" path="/var/lib/kubelet" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.874711 5030 kubelet.go:491] "Attempting to sync node with API server" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.874731 5030 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.874745 5030 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.874844 5030 kubelet.go:397] "Adding apiserver pod source" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.874861 5030 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.876608 5030 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.876623 5030 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.877144 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.877195 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.878050 5030 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.878066 5030 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.880095 5030 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.5-3.rhaos4.20.gitd0ea985.el9" apiVersion="v1" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.880335 5030 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.880839 5030 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881351 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881372 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881379 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881386 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881391 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881397 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881403 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881408 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881416 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881426 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881434 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.881772 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.882178 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.882192 5030 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.883057 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 192.168.25.179:6443: connect: connection refused Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.895106 5030 watchdog_linux.go:99] "Systemd watchdog is not enabled" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.895147 5030 server.go:1295] "Started kubelet" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.895270 5030 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.895285 5030 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.895400 5030 server_v1.go:47] "podresources" method="list" useActivePods=true Mar 16 13:05:55 crc systemd[1]: Started Kubernetes Kubelet. Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.896404 5030 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.897141 5030 server.go:317] "Adding debug handlers to kubelet server" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.897265 5030 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.897448 5030 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.897172 5030 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/default/events\": dial tcp 192.168.25.179:6443: connect: connection refused" event="&Event{ObjectMeta:{crc.189d54274530b733 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.895121715 +0000 UTC m=+0.294434262,LastTimestamp:2026-03-16 13:05:55.895121715 +0000 UTC m=+0.294434262,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.898081 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="200ms" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.898206 5030 volume_manager.go:295] "The desired_state_of_world populator starts" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.898226 5030 volume_manager.go:297] "Starting Kubelet Volume Manager" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.898505 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.898540 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.898460 5030 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.901902 5030 factory.go:55] Registering systemd factory Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.901947 5030 factory.go:223] Registration of the systemd container factory successfully Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902293 5030 factory.go:153] Registering CRI-O factory Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902303 5030 factory.go:223] Registration of the crio container factory successfully Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902351 5030 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902407 5030 factory.go:103] Registering Raw factory Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902437 5030 manager.go:1196] Started watching for new ooms in manager Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.902938 5030 manager.go:319] Starting recovery of all containers Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.921150 5030 manager.go:324] Recovery completed Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.932121 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.933541 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.933597 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.933608 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.940224 5030 cpu_manager.go:222] "Starting CPU manager" policy="none" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.940243 5030 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.940263 5030 state_mem.go:36] "Initialized new in-memory state store" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.942819 5030 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.942838 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.942976 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20c5c5b4bed930554494851fe3cb2b2a" volumeName="kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.942993 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943024 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943034 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943043 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943062 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943070 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943085 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943093 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943101 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943120 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943127 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943145 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943156 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943163 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943191 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943199 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943206 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943228 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" volumeName="kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943236 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943244 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943251 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943279 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943287 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943295 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943322 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943350 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943368 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943376 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943383 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943413 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943424 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a208c9c2-333b-4b4a-be0d-bc32ec38a821" volumeName="kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943433 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943440 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943451 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943458 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943465 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943482 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ebfebf6-3ecd-458e-943f-bb25b52e2718" volumeName="kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943490 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943496 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943508 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943516 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943528 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943535 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943542 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943562 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943570 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943576 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943583 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943594 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943604 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943612 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943635 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="34177974-8d82-49d2-a763-391d0df3bbd8" volumeName="kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943642 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943650 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943663 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943673 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943680 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943689 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943697 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943711 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943717 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943725 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943735 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943741 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="34177974-8d82-49d2-a763-391d0df3bbd8" volumeName="kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943758 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943769 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943777 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" volumeName="kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943783 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943793 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943800 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" volumeName="kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943806 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943814 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" volumeName="kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943820 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7e2c886-118e-43bb-bef1-c78134de392b" volumeName="kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943837 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b638b8f4bb0070e40528db779baf6a2" volumeName="kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943844 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943851 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af41de71-79cf-4590-bbe9-9e8b848862cb" volumeName="kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943857 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943871 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943877 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee8fbd3-1f81-4666-96da-5afc70819f1a" volumeName="kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943884 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943890 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943905 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943911 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943918 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943925 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943931 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce090a97-9ab6-4c40-a719-64ff2acd9778" volumeName="kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943938 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943944 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943951 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943960 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943969 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943975 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943982 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="593a3561-7760-45c5-8f91-5aaef7475d0f" volumeName="kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943989 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.943999 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944006 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="5ebfebf6-3ecd-458e-943f-bb25b52e2718" volumeName="kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944012 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" volumeName="kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944027 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944034 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944040 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a14caf222afb62aaabdc47808b6f944" volumeName="kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944056 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944064 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f71a554-e414-4bc3-96d2-674060397afe" volumeName="kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944070 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944077 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944083 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944101 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944108 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944114 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944121 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7e2c886-118e-43bb-bef1-c78134de392b" volumeName="kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944127 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944155 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944161 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944167 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944177 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944186 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944196 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944202 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944208 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="81e39f7b-62e4-4fc9-992a-6535ce127a02" volumeName="kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944214 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc85e424-18b2-4924-920b-bd291a8c4b01" volumeName="kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944221 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944227 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944236 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944243 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944254 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" volumeName="kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944261 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944280 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944291 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944297 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944303 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944313 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944319 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944326 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944344 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b605f283-6f2e-42da-a838-54421690f7d0" volumeName="kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944377 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944383 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944420 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944446 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944483 5030 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944525 5030 status_manager.go:230] "Starting to sync pod status with apiserver" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944616 5030 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944628 5030 kubelet.go:2451] "Starting kubelet main sync loop" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944630 5030 policy_none.go:49] "None policy: Start" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944645 5030 memory_manager.go:186] "Starting memorymanager" policy="None" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944656 5030 state_mem.go:35] "Initializing new in-memory state store" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.944783 5030 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.944486 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42a11a02-47e1-488f-b270-2679d3298b0e" volumeName="kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945066 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945090 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945099 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="42a11a02-47e1-488f-b270-2679d3298b0e" volumeName="kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945108 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945117 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945126 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945135 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945158 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945167 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a14caf222afb62aaabdc47808b6f944" volumeName="kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945175 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945184 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945192 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945222 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945232 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945240 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" volumeName="kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945260 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945268 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945276 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945294 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945303 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945337 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945346 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" volumeName="kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945353 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945373 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.945382 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946322 5030 reconstruct.go:144] "Volume is marked device as uncertain and added into the actual state" volumeName="kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" deviceMountPath="/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/b1264ac67579ad07e7e9003054d44fe40dd55285a4b2f7dc74e48be1aee0868a/globalmount" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946343 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946354 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946372 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946381 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946388 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946416 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946425 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946432 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946452 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946460 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="94a6e063-3d1a-4d44-875d-185291448c31" volumeName="kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946470 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946478 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="92dfbade-90b6-4169-8c07-72cff7f2c82b" volumeName="kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946493 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ee8fbd3-1f81-4666-96da-5afc70819f1a" volumeName="kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946502 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e093be35-bb62-4843-b2e8-094545761610" volumeName="kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946510 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946517 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" volumeName="kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946524 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946532 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="301e1965-1754-483d-b6cc-bfae7038bbca" volumeName="kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946539 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="31fa8943-81cc-4750-a0b7-0fa9ab5af883" volumeName="kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946560 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946569 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946579 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946587 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f863fff9-286a-45fa-b8f0-8a86994b8440" volumeName="kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946594 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="18f80adb-c1c3-49ba-8ee4-932c851d3897" volumeName="kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946603 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946611 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="736c54fe-349c-4bb9-870a-d1c1d1c03831" volumeName="kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946620 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7df94c10-441d-4386-93a6-6730fb7bcde0" volumeName="kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946651 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="584e1f4a-8205-47d7-8efb-3afc6017c4c9" volumeName="kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946659 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="869851b9-7ffb-4af0-b166-1d8aa40a5f80" volumeName="kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946668 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e9b5059-1b3e-4067-a63d-2952cbe863af" volumeName="kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946678 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f0bc7fcb0822a2c13eb2d22cd8c0641" volumeName="kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946687 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946695 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946703 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" volumeName="kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946714 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc4541ce-7789-4670-bc75-5c2868e52ce0" volumeName="kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946723 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946731 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946739 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a208c9c2-333b-4b4a-be0d-bc32ec38a821" volumeName="kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946754 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946762 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" volumeName="kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946770 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4750666-1362-4001-abd0-6f89964cc621" volumeName="kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946778 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" volumeName="kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946785 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946793 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" volumeName="kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946800 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" volumeName="kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946808 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7afa918d-be67-40a6-803c-d3b0ae99d815" volumeName="kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946817 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="09cfa50b-4138-4585-a53e-64dd3ab73335" volumeName="kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946825 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="149b3c48-e17c-4a66-a835-d86dabf6ff13" volumeName="kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946833 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6077b63e-53a2-4f96-9d56-1ce0324e4913" volumeName="kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946841 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a555ff2e-0be6-46d5-897d-863bb92ae2b3" volumeName="kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946849 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d19cb085-0c5b-4810-b654-ce7923221d90" volumeName="kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946857 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" volumeName="kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946864 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="2325ffef-9d5b-447f-b00e-3efc429acefe" volumeName="kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946875 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="17b87002-b798-480a-8e17-83053d698239" volumeName="kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946884 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" volumeName="kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946893 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946902 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" volumeName="kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946910 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946918 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946957 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c491984c-7d4b-44aa-8c1e-d7974424fa47" volumeName="kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946965 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946973 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f65c0ac1-8bca-454d-a2e6-e35cb418beac" volumeName="kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946981 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="567683bd-0efc-4f21-b076-e28559628404" volumeName="kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946988 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="6edfcf45-925b-4eff-b940-95b6fc0b85d4" volumeName="kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.946996 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" volumeName="kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947004 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7a88189-c967-4640-879e-27665747f20c" volumeName="kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947014 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" volumeName="kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947022 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="16bdd140-dce1-464c-ab47-dd5798d1d256" volumeName="kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947030 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="af33e427-6803-48c2-a76a-dd9deb7cbf9a" volumeName="kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947037 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" volumeName="kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947045 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="c5f2bfad-70f6-4185-a3d9-81ce12720767" volumeName="kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947052 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d7e8f42f-dc0e-424b-bb56-5ec849834888" volumeName="kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947060 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="f559dfa3-3917-43a2-97f6-61ddfda10e93" volumeName="kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947068 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="0effdbcf-dd7d-404d-9d48-77536d665a5d" volumeName="kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947075 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="7599e0b6-bddf-4def-b7f2-0b32206e8651" volumeName="kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947083 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="d565531a-ff86-4608-9d19-767de01ac31b" volumeName="kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947091 5030 reconstruct.go:130] "Volume is marked as uncertain and added into the actual state" pod="" podName="01080b46-74f1-4191-8755-5152a57b3b25" volumeName="kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config" seLinuxMountContext="" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947100 5030 reconstruct.go:97] "Volume reconstruction finished" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.947105 5030 reconciler.go:26] "Reconciler: start to sync state" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.948123 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980272 5030 manager.go:341] "Starting Device Plugin manager" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.980384 5030 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980399 5030 server.go:85] "Starting device plugin registration server" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980767 5030 eviction_manager.go:189] "Eviction manager: starting control loop" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980782 5030 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980888 5030 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980978 5030 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Mar 16 13:05:55 crc kubenswrapper[5030]: I0316 13:05:55.980989 5030 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.983378 5030 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Mar 16 13:05:55 crc kubenswrapper[5030]: E0316 13:05:55.983430 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.045244 5030 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-crc","openshift-etcd/etcd-crc","openshift-kube-apiserver/kube-apiserver-crc","openshift-kube-controller-manager/kube-controller-manager-crc","openshift-kube-scheduler/openshift-kube-scheduler-crc"] Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.045394 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046044 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046076 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046086 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046579 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046710 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046758 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046956 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046983 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.046993 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047127 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047151 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047163 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047461 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047574 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047600 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047901 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047927 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.047936 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048167 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048193 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048202 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048402 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048524 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048573 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048807 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048839 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.048849 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049030 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049058 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049066 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049472 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049583 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049612 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049863 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049886 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.049895 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050052 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050077 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050086 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050364 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050387 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050726 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050753 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.050769 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.080774 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.080902 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.081256 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.081279 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.081301 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.081317 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.081656 5030 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 192.168.25.179:6443: connect: connection refused" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.086336 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.099420 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="400ms" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.103208 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.123050 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.126385 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149476 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149513 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149588 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149760 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149851 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149969 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149981 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.149996 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150043 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150057 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150071 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-kubernetes\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150084 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150120 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150168 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150258 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-ca-trust-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150292 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b638b8f4bb0070e40528db779baf6a2-tmp\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-kubernetes\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-var-run-kubernetes\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150400 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150431 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150448 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150476 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150632 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150636 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f0bc7fcb0822a2c13eb2d22cd8c0641-tmp-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.150663 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.151216 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c5c5b4bed930554494851fe3cb2b2a-tmp-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251518 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-cert-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251698 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-resource-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251712 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/0b638b8f4bb0070e40528db779baf6a2-resource-dir\") pod \"openshift-kube-scheduler-crc\" (UID: \"0b638b8f4bb0070e40528db779baf6a2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251758 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251749 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-etc-kube\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251788 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251828 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251837 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-resource-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251840 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-static-pod-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e08c320b1e9e2405e6e0107bdf7eeb4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-crc\" (UID: \"4e08c320b1e9e2405e6e0107bdf7eeb4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251870 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-usr-local-bin\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251866 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-log-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251914 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251957 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.251993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-auto-backup-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-etcd-auto-backup-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.252022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9f0bc7fcb0822a2c13eb2d22cd8c0641-cert-dir\") pod \"kube-controller-manager-crc\" (UID: \"9f0bc7fcb0822a2c13eb2d22cd8c0641\") " pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.252024 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-data-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.252044 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/20c5c5b4bed930554494851fe3cb2b2a-cert-dir\") pod \"etcd-crc\" (UID: \"20c5c5b4bed930554494851fe3cb2b2a\") " pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.282686 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.283191 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.283216 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.283225 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.283246 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.283582 5030 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 192.168.25.179:6443: connect: connection refused" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.381636 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.387095 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.404126 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: W0316 13:05:56.404410 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e08c320b1e9e2405e6e0107bdf7eeb4.slice/crio-18bc219c5988f5d06cbc7b87c014ab076779bca3a32f60e7eb4394917422dcbb WatchSource:0}: Error finding container 18bc219c5988f5d06cbc7b87c014ab076779bca3a32f60e7eb4394917422dcbb: Status 404 returned error can't find the container with id 18bc219c5988f5d06cbc7b87c014ab076779bca3a32f60e7eb4394917422dcbb Mar 16 13:05:56 crc kubenswrapper[5030]: W0316 13:05:56.406000 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0bc7fcb0822a2c13eb2d22cd8c0641.slice/crio-78b002d035b36c2fd02dc9a7e7b89b38f2f0d8064d2737de0189259a53c87683 WatchSource:0}: Error finding container 78b002d035b36c2fd02dc9a7e7b89b38f2f0d8064d2737de0189259a53c87683: Status 404 returned error can't find the container with id 78b002d035b36c2fd02dc9a7e7b89b38f2f0d8064d2737de0189259a53c87683 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.409858 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:05:56 crc kubenswrapper[5030]: W0316 13:05:56.417130 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c5c5b4bed930554494851fe3cb2b2a.slice/crio-0c89ef27695f2f2cec2701fd1997c5f9ed0395f27498697fabd2e73f8ab25b00 WatchSource:0}: Error finding container 0c89ef27695f2f2cec2701fd1997c5f9ed0395f27498697fabd2e73f8ab25b00: Status 404 returned error can't find the container with id 0c89ef27695f2f2cec2701fd1997c5f9ed0395f27498697fabd2e73f8ab25b00 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.423220 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.427219 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:05:56 crc kubenswrapper[5030]: W0316 13:05:56.434876 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a14caf222afb62aaabdc47808b6f944.slice/crio-a274451cb4b46df08ec33356f31cb322fca59041224f20bed7ee611700b99d55 WatchSource:0}: Error finding container a274451cb4b46df08ec33356f31cb322fca59041224f20bed7ee611700b99d55: Status 404 returned error can't find the container with id a274451cb4b46df08ec33356f31cb322fca59041224f20bed7ee611700b99d55 Mar 16 13:05:56 crc kubenswrapper[5030]: W0316 13:05:56.439645 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b638b8f4bb0070e40528db779baf6a2.slice/crio-07300b8b4bffd76893058a0c6a74b3f5b55a9736cea35c8a81063b644b29e6da WatchSource:0}: Error finding container 07300b8b4bffd76893058a0c6a74b3f5b55a9736cea35c8a81063b644b29e6da: Status 404 returned error can't find the container with id 07300b8b4bffd76893058a0c6a74b3f5b55a9736cea35c8a81063b644b29e6da Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.499903 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="800ms" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.684253 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.685756 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.685784 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.685795 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.685813 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.686062 5030 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 192.168.25.179:6443: connect: connection refused" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.776284 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: Get \"https://api-int.crc.testing:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.884065 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": dial tcp 192.168.25.179:6443: connect: connection refused Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.950667 5030 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee" exitCode=0 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.950724 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.950760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"0c89ef27695f2f2cec2701fd1997c5f9ed0395f27498697fabd2e73f8ab25b00"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.950864 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.951314 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.951342 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.951350 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.951504 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.952270 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.952292 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"78b002d035b36c2fd02dc9a7e7b89b38f2f0d8064d2737de0189259a53c87683"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953184 5030 generic.go:358] "Generic (PLEG): container finished" podID="4e08c320b1e9e2405e6e0107bdf7eeb4" containerID="f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b" exitCode=0 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953237 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerDied","Data":"f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953275 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerStarted","Data":"18bc219c5988f5d06cbc7b87c014ab076779bca3a32f60e7eb4394917422dcbb"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953356 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953752 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953775 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.953784 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.953945 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.954477 5030 generic.go:358] "Generic (PLEG): container finished" podID="0b638b8f4bb0070e40528db779baf6a2" containerID="5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab" exitCode=0 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.954524 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerDied","Data":"5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.954559 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"07300b8b4bffd76893058a0c6a74b3f5b55a9736cea35c8a81063b644b29e6da"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.954643 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.954979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955010 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955019 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.955166 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955297 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81" exitCode=0 Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955320 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955333 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"a274451cb4b46df08ec33356f31cb322fca59041224f20bed7ee611700b99d55"} Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955438 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955790 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955815 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.955827 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:56 crc kubenswrapper[5030]: E0316 13:05:56.955961 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.957386 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.957810 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.957838 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:56 crc kubenswrapper[5030]: I0316 13:05:56.957847 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.301110 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="1.6s" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.303634 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: Get \"https://api-int.crc.testing:6443/api/v1/services?fieldSelector=spec.clusterIP%21%3DNone&limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.364145 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://api-int.crc.testing:6443/api/v1/nodes?fieldSelector=metadata.name%3Dcrc&limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.476543 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.25.179:6443: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.486860 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.487427 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.487462 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.487473 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.487493 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.487749 5030 kubelet_node_status.go:110] "Unable to register node with API server" err="Post \"https://api-int.crc.testing:6443/api/v1/nodes\": dial tcp 192.168.25.179:6443: connect: connection refused" node="crc" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.867435 5030 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.960853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.960890 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.960901 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" event={"ID":"0b638b8f4bb0070e40528db779baf6a2","Type":"ContainerStarted","Data":"90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.961007 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.962018 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.962230 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.962240 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.962369 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.964423 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.964439 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.964448 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.964457 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965352 5030 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf" exitCode=0 Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965399 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965483 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965815 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965835 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.965843 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.965990 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972265 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972419 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972429 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972749 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972773 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.972782 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.972900 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.974189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" event={"ID":"4e08c320b1e9e2405e6e0107bdf7eeb4","Type":"ContainerStarted","Data":"41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd"} Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.974269 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.974635 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.974655 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:57 crc kubenswrapper[5030]: I0316 13:05:57.974663 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:57 crc kubenswrapper[5030]: E0316 13:05:57.974775 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.978407 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"d7da5f580449561cbf4f014df6b3df622afa18cabb9aef46ea8afb16d9e72a38"} Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.978528 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.978957 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.978984 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.978995 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:58 crc kubenswrapper[5030]: E0316 13:05:58.979159 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980383 5030 generic.go:358] "Generic (PLEG): container finished" podID="20c5c5b4bed930554494851fe3cb2b2a" containerID="5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d" exitCode=0 Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980441 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerDied","Data":"5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d"} Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980565 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980575 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980584 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.980596 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981050 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981064 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981065 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981083 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981092 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981100 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981104 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981110 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:58 crc kubenswrapper[5030]: I0316 13:05:58.981094 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:58 crc kubenswrapper[5030]: E0316 13:05:58.981294 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:58 crc kubenswrapper[5030]: E0316 13:05:58.981423 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:58 crc kubenswrapper[5030]: E0316 13:05:58.981630 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.088414 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.088893 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.088919 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.088929 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.088945 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c"} Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985747 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59"} Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93"} Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985767 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44"} Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-crc" event={"ID":"20c5c5b4bed930554494851fe3cb2b2a","Type":"ContainerStarted","Data":"b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94"} Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985839 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.985907 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986045 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986302 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986321 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986329 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:59 crc kubenswrapper[5030]: E0316 13:05:59.986466 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986647 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986675 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:05:59 crc kubenswrapper[5030]: I0316 13:05:59.986684 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:05:59 crc kubenswrapper[5030]: E0316 13:05:59.986967 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:00 crc kubenswrapper[5030]: I0316 13:06:00.637279 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:00 crc kubenswrapper[5030]: I0316 13:06:00.987282 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:00 crc kubenswrapper[5030]: I0316 13:06:00.987700 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:00 crc kubenswrapper[5030]: I0316 13:06:00.987721 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:00 crc kubenswrapper[5030]: I0316 13:06:00.987730 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:00 crc kubenswrapper[5030]: E0316 13:06:00.987979 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.705710 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.705910 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.706512 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.706535 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.706543 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:01 crc kubenswrapper[5030]: E0316 13:06:01.706788 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.989460 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.989913 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.989944 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:01 crc kubenswrapper[5030]: I0316 13:06:01.989953 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:01 crc kubenswrapper[5030]: E0316 13:06:01.990179 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.427975 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-crc" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.428131 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.428728 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.428775 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.428787 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:02 crc kubenswrapper[5030]: E0316 13:06:02.429154 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.576960 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.991622 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.992056 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.992074 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:02 crc kubenswrapper[5030]: I0316 13:06:02.992083 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:02 crc kubenswrapper[5030]: E0316 13:06:02.992305 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.413962 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.414231 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.415738 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.415773 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.415784 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:03 crc kubenswrapper[5030]: E0316 13:06:03.416068 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.419232 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.838009 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.993215 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.993510 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.994143 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.994166 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:03 crc kubenswrapper[5030]: I0316 13:06:03.994174 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:03 crc kubenswrapper[5030]: E0316 13:06:03.994384 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.340304 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-etcd/etcd-crc" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.340452 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.341353 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.341405 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.341418 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:04 crc kubenswrapper[5030]: E0316 13:06:04.341808 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.995498 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.996069 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.996102 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:04 crc kubenswrapper[5030]: I0316 13:06:04.996112 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:04 crc kubenswrapper[5030]: E0316 13:06:04.996359 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:05 crc kubenswrapper[5030]: I0316 13:06:05.553238 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:05 crc kubenswrapper[5030]: E0316 13:06:05.983584 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:05 crc kubenswrapper[5030]: I0316 13:06:05.997300 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:05 crc kubenswrapper[5030]: I0316 13:06:05.997757 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:05 crc kubenswrapper[5030]: I0316 13:06:05.997780 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:05 crc kubenswrapper[5030]: I0316 13:06:05.997790 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:05 crc kubenswrapper[5030]: E0316 13:06:05.997996 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:06 crc kubenswrapper[5030]: I0316 13:06:06.838388 5030 patch_prober.go:28] interesting pod/kube-controller-manager-crc container/cluster-policy-controller namespace/openshift-kube-controller-manager: Startup probe status=failure output="Get \"https://localhost:10357/healthz\": context deadline exceeded" start-of-body= Mar 16 13:06:06 crc kubenswrapper[5030]: I0316 13:06:06.838459 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" containerName="cluster-policy-controller" probeResult="failure" output="Get \"https://localhost:10357/healthz\": context deadline exceeded" Mar 16 13:06:07 crc kubenswrapper[5030]: E0316 13:06:07.868788 5030 certificate_manager.go:596] "Failed while requesting a signed certificate from the control plane" err="cannot create certificate signing request: Post \"https://api-int.crc.testing:6443/apis/certificates.k8s.io/v1/certificatesigningrequests\": net/http: TLS handshake timeout" logger="kubernetes.io/kube-apiserver-client-kubelet.UnhandledError" Mar 16 13:06:07 crc kubenswrapper[5030]: I0316 13:06:07.884817 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: Get "https://api-int.crc.testing:6443/apis/storage.k8s.io/v1/csinodes/crc?resourceVersion=0": net/http: TLS handshake timeout Mar 16 13:06:08 crc kubenswrapper[5030]: I0316 13:06:08.639465 5030 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 13:06:08 crc kubenswrapper[5030]: I0316 13:06:08.639518 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Mar 16 13:06:08 crc kubenswrapper[5030]: I0316 13:06:08.643520 5030 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver namespace/openshift-kube-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 13:06:08 crc kubenswrapper[5030]: I0316 13:06:08.643602 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 403" Mar 16 13:06:08 crc kubenswrapper[5030]: E0316 13:06:08.902950 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": context deadline exceeded" interval="3.2s" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.641813 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.641968 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.642931 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.642970 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.642981 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:10 crc kubenswrapper[5030]: E0316 13:06:10.643299 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:10 crc kubenswrapper[5030]: I0316 13:06:10.645412 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:11 crc kubenswrapper[5030]: I0316 13:06:11.006291 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:11 crc kubenswrapper[5030]: I0316 13:06:11.006745 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:11 crc kubenswrapper[5030]: I0316 13:06:11.006788 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:11 crc kubenswrapper[5030]: I0316 13:06:11.006799 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:11 crc kubenswrapper[5030]: E0316 13:06:11.007104 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.035696 5030 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.046179 5030 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Mar 16 13:06:12 crc kubenswrapper[5030]: E0316 13:06:12.107046 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.447162 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-crc" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.447315 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.447876 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.447907 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.447916 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:12 crc kubenswrapper[5030]: E0316 13:06:12.448237 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:12 crc kubenswrapper[5030]: I0316 13:06:12.458199 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-crc" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.009674 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.010282 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.010325 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.010336 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.010659 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.643905 5030 trace.go:236] Trace[1942823935]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 13:06:00.146) (total time: 13496ms): Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[1942823935]: ---"Objects listed" error:csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope 13496ms (13:06:13.643) Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[1942823935]: [13.496890134s] [13.496890134s] END Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.643936 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.644113 5030 trace.go:236] Trace[448397257]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 13:05:58.995) (total time: 14648ms): Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[448397257]: ---"Objects listed" error:services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope 14648ms (13:06:13.644) Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[448397257]: [14.648985344s] [14.648985344s] END Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.644129 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.644517 5030 trace.go:236] Trace[1661471322]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 13:05:58.698) (total time: 14946ms): Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[1661471322]: ---"Objects listed" error:runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope 14946ms (13:06:13.644) Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[1661471322]: [14.946174535s] [14.946174535s] END Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.644563 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.644985 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.645133 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d54274530b733 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.895121715 +0000 UTC m=+0.294434262,LastTimestamp:2026-03-16 13:05:55.895121715 +0000 UTC m=+0.294434262,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.645614 5030 trace.go:236] Trace[677777345]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (16-Mar-2026 13:06:00.062) (total time: 13583ms): Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[677777345]: ---"Objects listed" error:nodes "crc" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope 13583ms (13:06:13.645) Mar 16 13:06:13 crc kubenswrapper[5030]: Trace[677777345]: [13.583107983s] [13.583107983s] END Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.645636 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.648730 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.652022 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.655138 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.658350 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d54274a61469d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.982190237 +0000 UTC m=+0.381502785,LastTimestamp:2026-03-16 13:05:55.982190237 +0000 UTC m=+0.381502785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.661580 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.046062042 +0000 UTC m=+0.445374589,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.663617 5030 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:46034->192.168.126.11:17697: read: connection reset by peer" start-of-body= Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.663661 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:46034->192.168.126.11:17697: read: connection reset by peer" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.663895 5030 patch_prober.go:28] interesting pod/kube-apiserver-crc container/kube-apiserver-check-endpoints namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused" start-of-body= Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.663935 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" probeResult="failure" output="Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.665310 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.046081943 +0000 UTC m=+0.445394490,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.668973 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.046090367 +0000 UTC m=+0.445402914,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.673721 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.046971077 +0000 UTC m=+0.446283624,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.677019 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.046989247 +0000 UTC m=+0.446301794,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.680072 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.046996989 +0000 UTC m=+0.446309536,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.683188 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.047144185 +0000 UTC m=+0.446456732,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.686280 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.047156525 +0000 UTC m=+0.446469072,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.689316 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.047167252 +0000 UTC m=+0.446479789,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.692216 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.047915892 +0000 UTC m=+0.447228439,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.695149 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.047933109 +0000 UTC m=+0.447245656,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.698121 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.047941062 +0000 UTC m=+0.447253609,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.701108 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.048185403 +0000 UTC m=+0.447497950,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.704134 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.048198665 +0000 UTC m=+0.447511212,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.707010 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.048207168 +0000 UTC m=+0.447519715,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.709878 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.048824218 +0000 UTC m=+0.448136764,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.713724 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.048844719 +0000 UTC m=+0.448157267,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.717784 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477c0b83\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477c0b83 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node crc status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933612931 +0000 UTC m=+0.332925477,LastTimestamp:2026-03-16 13:05:56.048854066 +0000 UTC m=+0.448166612,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.720793 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477bb03b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477bb03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node crc status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933589563 +0000 UTC m=+0.332902110,LastTimestamp:2026-03-16 13:05:56.049045541 +0000 UTC m=+0.448358089,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.723813 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"crc.189d5427477be521\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{crc.189d5427477be521 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:crc,UID:crc,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node crc status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:55.933603105 +0000 UTC m=+0.332915652,LastTimestamp:2026-03-16 13:05:56.04906287 +0000 UTC m=+0.448375417,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.727363 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d542763e37ab7 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.410153655 +0000 UTC m=+0.809466202,LastTimestamp:2026-03-16 13:05:56.410153655 +0000 UTC m=+0.809466202,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.730324 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d542763e4c24c openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.410237516 +0000 UTC m=+0.809550062,LastTimestamp:2026-03-16 13:05:56.410237516 +0000 UTC m=+0.809550062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.733286 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542764903d20 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.421475616 +0000 UTC m=+0.820788163,LastTimestamp:2026-03-16 13:05:56.421475616 +0000 UTC m=+0.820788163,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.736270 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427659297db openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.438407131 +0000 UTC m=+0.837719678,LastTimestamp:2026-03-16 13:05:56.438407131 +0000 UTC m=+0.837719678,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.739329 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d542765ebbbec openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.444249068 +0000 UTC m=+0.843561614,LastTimestamp:2026-03-16 13:05:56.444249068 +0000 UTC m=+0.843561614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.742406 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d54277c5ba0f7 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Created,Message:Created container: wait-for-host-port,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.820680951 +0000 UTC m=+1.219993498,LastTimestamp:2026-03-16 13:05:56.820680951 +0000 UTC m=+1.219993498,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.745518 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54277c5c00e0 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Created,Message:Created container: kube-controller-manager,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.820705504 +0000 UTC m=+1.220018051,LastTimestamp:2026-03-16 13:05:56.820705504 +0000 UTC m=+1.220018051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.748528 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54277c98e8fa openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.824697082 +0000 UTC m=+1.224009628,LastTimestamp:2026-03-16 13:05:56.824697082 +0000 UTC m=+1.224009628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.751440 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d54277ca50793 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.825491347 +0000 UTC m=+1.224803893,LastTimestamp:2026-03-16 13:05:56.825491347 +0000 UTC m=+1.224803893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.754435 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d54277cc38ff4 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{wait-for-host-port},},Reason:Started,Message:Started container wait-for-host-port,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.82749234 +0000 UTC m=+1.226804887,LastTimestamp:2026-03-16 13:05:56.82749234 +0000 UTC m=+1.226804887,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.757397 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d54277cdcf108 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.829155592 +0000 UTC m=+1.228468140,LastTimestamp:2026-03-16 13:05:56.829155592 +0000 UTC m=+1.228468140,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.760568 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54277ce75d47 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager},},Reason:Started,Message:Started container kube-controller-manager,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.829838663 +0000 UTC m=+1.229151210,LastTimestamp:2026-03-16 13:05:56.829838663 +0000 UTC m=+1.229151210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.763529 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54277cf1c1bc openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.83051974 +0000 UTC m=+1.229832287,LastTimestamp:2026-03-16 13:05:56.83051974 +0000 UTC m=+1.229832287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.766653 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d54277d1ab543 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.833203523 +0000 UTC m=+1.232516070,LastTimestamp:2026-03-16 13:05:56.833203523 +0000 UTC m=+1.232516070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.769842 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54277d4a9df0 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.83634328 +0000 UTC m=+1.235655826,LastTimestamp:2026-03-16 13:05:56.83634328 +0000 UTC m=+1.235655826,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.772907 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d54277dea90db openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.846825691 +0000 UTC m=+1.246138237,LastTimestamp:2026-03-16 13:05:56.846825691 +0000 UTC m=+1.246138237,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.776879 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5427843456b3 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.952323763 +0000 UTC m=+1.351636310,LastTimestamp:2026-03-16 13:05:56.952323763 +0000 UTC m=+1.351636310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.780144 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d54278458bfd6 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.954709974 +0000 UTC m=+1.354022521,LastTimestamp:2026-03-16 13:05:56.954709974 +0000 UTC m=+1.354022521,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.783591 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5427847fe797 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.957276055 +0000 UTC m=+1.356588602,LastTimestamp:2026-03-16 13:05:56.957276055 +0000 UTC m=+1.356588602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.786521 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427848003b3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:56.957283251 +0000 UTC m=+1.356595799,LastTimestamp:2026-03-16 13:05:56.957283251 +0000 UTC m=+1.356595799,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.789636 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d54278de403ab openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Created,Message:Created container: kube-scheduler,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.114831787 +0000 UTC m=+1.514144323,LastTimestamp:2026-03-16 13:05:57.114831787 +0000 UTC m=+1.514144323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.792722 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d54278dec8e79 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.115391609 +0000 UTC m=+1.514704156,LastTimestamp:2026-03-16 13:05:57.115391609 +0000 UTC m=+1.514704156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.795756 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d54278def266c openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Created,Message:Created container: kube-apiserver,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.11556158 +0000 UTC m=+1.514874127,LastTimestamp:2026-03-16 13:05:57.11556158 +0000 UTC m=+1.514874127,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.804779 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54278df0ae51 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Created,Message:Created container: cluster-policy-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.115661905 +0000 UTC m=+1.514974453,LastTimestamp:2026-03-16 13:05:57.115661905 +0000 UTC m=+1.514974453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.808874 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54278e267da6 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Created,Message:Created container: etcd-ensure-env-vars,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.11918839 +0000 UTC m=+1.518500937,LastTimestamp:2026-03-16 13:05:57.11918839 +0000 UTC m=+1.518500937,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.812127 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d54278e582cc7 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler},},Reason:Started,Message:Started container kube-scheduler,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.122444487 +0000 UTC m=+1.521757034,LastTimestamp:2026-03-16 13:05:57.122444487 +0000 UTC m=+1.521757034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.815476 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d54278e661d9b openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.123358107 +0000 UTC m=+1.522670654,LastTimestamp:2026-03-16 13:05:57.123358107 +0000 UTC m=+1.522670654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.818776 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-crc.189d54278e69f546 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-crc,UID:4e08c320b1e9e2405e6e0107bdf7eeb4,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.123609926 +0000 UTC m=+1.522922464,LastTimestamp:2026-03-16 13:05:57.123609926 +0000 UTC m=+1.522922464,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.825278 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d54278e829d9b openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Started,Message:Started container kube-apiserver,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.125225883 +0000 UTC m=+1.524538431,LastTimestamp:2026-03-16 13:05:57.125225883 +0000 UTC m=+1.524538431,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.829143 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54278e8880e6 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Started,Message:Started container cluster-policy-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.12561175 +0000 UTC m=+1.524924298,LastTimestamp:2026-03-16 13:05:57.12561175 +0000 UTC m=+1.524924298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.834116 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d54278e8d6c4d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.125934157 +0000 UTC m=+1.525246704,LastTimestamp:2026-03-16 13:05:57.125934157 +0000 UTC m=+1.525246704,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.837711 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d54278e9943e6 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.126710246 +0000 UTC m=+1.526022792,LastTimestamp:2026-03-16 13:05:57.126710246 +0000 UTC m=+1.526022792,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.841139 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54278f62f31e openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-ensure-env-vars},},Reason:Started,Message:Started container etcd-ensure-env-vars,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.139927838 +0000 UTC m=+1.539240386,LastTimestamp:2026-03-16 13:05:57.139927838 +0000 UTC m=+1.539240386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.845870 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d542796a3b668 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Created,Message:Created container: kube-scheduler-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.261612648 +0000 UTC m=+1.660925195,LastTimestamp:2026-03-16 13:05:57.261612648 +0000 UTC m=+1.660925195,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.850080 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5427970a9b03 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-cert-syncer},},Reason:Started,Message:Started container kube-scheduler-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.268355843 +0000 UTC m=+1.667668390,LastTimestamp:2026-03-16 13:05:57.268355843 +0000 UTC m=+1.667668390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.851543 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d542797219233 openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.269860915 +0000 UTC m=+1.669173462,LastTimestamp:2026-03-16 13:05:57.269860915 +0000 UTC m=+1.669173462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.853041 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5427a0daaa0c openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Created,Message:Created container: kube-scheduler-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.432986124 +0000 UTC m=+1.832298671,LastTimestamp:2026-03-16 13:05:57.432986124 +0000 UTC m=+1.832298671,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.855645 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-scheduler\"" event="&Event{ObjectMeta:{openshift-kube-scheduler-crc.189d5427a15a245f openshift-kube-scheduler 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-scheduler,Name:openshift-kube-scheduler-crc,UID:0b638b8f4bb0070e40528db779baf6a2,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-scheduler-recovery-controller},},Reason:Started,Message:Started container kube-scheduler-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.441340511 +0000 UTC m=+1.840653058,LastTimestamp:2026-03-16 13:05:57.441340511 +0000 UTC m=+1.840653058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.858845 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5427a692707f openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Created,Message:Created container: kube-controller-manager-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.528916095 +0000 UTC m=+1.928228642,LastTimestamp:2026-03-16 13:05:57.528916095 +0000 UTC m=+1.928228642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.861886 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427a69f653f openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Created,Message:Created container: kube-apiserver-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.529765183 +0000 UTC m=+1.929077730,LastTimestamp:2026-03-16 13:05:57.529765183 +0000 UTC m=+1.929077730,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.864782 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427a6f6cc3d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-syncer},},Reason:Started,Message:Started container kube-apiserver-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.535493181 +0000 UTC m=+1.934805729,LastTimestamp:2026-03-16 13:05:57.535493181 +0000 UTC m=+1.934805729,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.868125 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5427a6fa96d0 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-cert-syncer},},Reason:Started,Message:Started container kube-controller-manager-cert-syncer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.535741648 +0000 UTC m=+1.935054194,LastTimestamp:2026-03-16 13:05:57.535741648 +0000 UTC m=+1.935054194,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.871440 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427a7023aa8 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.536242344 +0000 UTC m=+1.935554892,LastTimestamp:2026-03-16 13:05:57.536242344 +0000 UTC m=+1.935554892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.875093 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5427a703596b openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.536315755 +0000 UTC m=+1.935628301,LastTimestamp:2026-03-16 13:05:57.536315755 +0000 UTC m=+1.935628301,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.877988 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427aef2bea1 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Created,Message:Created container: kube-apiserver-cert-regeneration-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.669445281 +0000 UTC m=+2.068757828,LastTimestamp:2026-03-16 13:05:57.669445281 +0000 UTC m=+2.068757828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.880875 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5427af0e2938 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Created,Message:Created container: kube-controller-manager-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.67124204 +0000 UTC m=+2.070554587,LastTimestamp:2026-03-16 13:05:57.67124204 +0000 UTC m=+2.070554587,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.883894 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427af718d58 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-cert-regeneration-controller},},Reason:Started,Message:Started container kube-apiserver-cert-regeneration-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.677755736 +0000 UTC m=+2.077068283,LastTimestamp:2026-03-16 13:05:57.677755736 +0000 UTC m=+2.077068283,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.886799 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427af8087c6 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.67873735 +0000 UTC m=+2.078049886,LastTimestamp:2026-03-16 13:05:57.67873735 +0000 UTC m=+2.078049886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.890023 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5427af910978 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-controller-manager-recovery-controller},},Reason:Started,Message:Started container kube-controller-manager-recovery-controller,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.679819128 +0000 UTC m=+2.079131676,LastTimestamp:2026-03-16 13:05:57.679819128 +0000 UTC m=+2.079131676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: I0316 13:06:13.890085 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.891896 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b71c6a36 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Created,Message:Created container: kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.80639391 +0000 UTC m=+2.205706457,LastTimestamp:2026-03-16 13:05:57.80639391 +0000 UTC m=+2.205706457,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.893018 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b79660ba openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-insecure-readyz},},Reason:Started,Message:Started container kube-apiserver-insecure-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.814386874 +0000 UTC m=+2.213699421,LastTimestamp:2026-03-16 13:05:57.814386874 +0000 UTC m=+2.213699421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.895074 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b7a1177d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.815089021 +0000 UTC m=+2.214401569,LastTimestamp:2026-03-16 13:05:57.815089021 +0000 UTC m=+2.214401569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.895963 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427bfdc5bca openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.953190858 +0000 UTC m=+2.352503405,LastTimestamp:2026-03-16 13:05:57.953190858 +0000 UTC m=+2.352503405,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.898154 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5427c0b1b8cf openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.967173839 +0000 UTC m=+2.366486386,LastTimestamp:2026-03-16 13:05:57.967173839 +0000 UTC m=+2.366486386,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.899211 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427c0b64e1d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.967474205 +0000 UTC m=+2.366786751,LastTimestamp:2026-03-16 13:05:57.967474205 +0000 UTC m=+2.366786751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.901257 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5427c86e5704 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Created,Message:Created container: etcd-resources-copy,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:58.09697562 +0000 UTC m=+2.496288168,LastTimestamp:2026-03-16 13:05:58.09697562 +0000 UTC m=+2.496288168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.903703 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5427c8d87d76 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{etcd-resources-copy},},Reason:Started,Message:Started container etcd-resources-copy,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:58.103932278 +0000 UTC m=+2.503244825,LastTimestamp:2026-03-16 13:05:58.103932278 +0000 UTC m=+2.503244825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.907046 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5427fd311576 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:58.98215359 +0000 UTC m=+3.381466128,LastTimestamp:2026-03-16 13:05:58.98215359 +0000 UTC m=+3.381466128,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.910056 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542803edee6a openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Created,Message:Created container: etcdctl,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.095193194 +0000 UTC m=+3.494505742,LastTimestamp:2026-03-16 13:05:59.095193194 +0000 UTC m=+3.494505742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.913136 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5428044e5b35 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcdctl},},Reason:Started,Message:Started container etcdctl,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.101512501 +0000 UTC m=+3.500825049,LastTimestamp:2026-03-16 13:05:59.101512501 +0000 UTC m=+3.500825049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.916047 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542804583c53 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.102159955 +0000 UTC m=+3.501472502,LastTimestamp:2026-03-16 13:05:59.102159955 +0000 UTC m=+3.501472502,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.918982 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54280afb4f0c openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Created,Message:Created container: etcd,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.213510412 +0000 UTC m=+3.612822959,LastTimestamp:2026-03-16 13:05:59.213510412 +0000 UTC m=+3.612822959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.921878 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54280b7b3195 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd},},Reason:Started,Message:Started container etcd,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.221891477 +0000 UTC m=+3.621204024,LastTimestamp:2026-03-16 13:05:59.221891477 +0000 UTC m=+3.621204024,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.924841 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54280b862c27 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.222610983 +0000 UTC m=+3.621923530,LastTimestamp:2026-03-16 13:05:59.222610983 +0000 UTC m=+3.621923530,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.927795 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5428124eea44 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Created,Message:Created container: etcd-metrics,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.336430148 +0000 UTC m=+3.735742705,LastTimestamp:2026-03-16 13:05:59.336430148 +0000 UTC m=+3.735742705,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.930782 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542812c8d73b openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-metrics},},Reason:Started,Message:Started container etcd-metrics,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.344420667 +0000 UTC m=+3.743733214,LastTimestamp:2026-03-16 13:05:59.344420667 +0000 UTC m=+3.743733214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.933725 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542812d38d8a openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.345122698 +0000 UTC m=+3.744435245,LastTimestamp:2026-03-16 13:05:59.345122698 +0000 UTC m=+3.744435245,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.936808 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5428199eb3ec openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Created,Message:Created container: etcd-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.459099628 +0000 UTC m=+3.858412176,LastTimestamp:2026-03-16 13:05:59.459099628 +0000 UTC m=+3.858412176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.939714 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54281a066846 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-readyz},},Reason:Started,Message:Started container etcd-readyz,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.465896006 +0000 UTC m=+3.865208552,LastTimestamp:2026-03-16 13:05:59.465896006 +0000 UTC m=+3.865208552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.942766 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d54281a197648 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.467144776 +0000 UTC m=+3.866457323,LastTimestamp:2026-03-16 13:05:59.467144776 +0000 UTC m=+3.866457323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.945638 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d5428217516f0 openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Created,Message:Created container: etcd-rev,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.590590192 +0000 UTC m=+3.989902739,LastTimestamp:2026-03-16 13:05:59.590590192 +0000 UTC m=+3.989902739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.948489 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-etcd\"" event="&Event{ObjectMeta:{etcd-crc.189d542821eb0a5b openshift-etcd 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-etcd,Name:etcd-crc,UID:20c5c5b4bed930554494851fe3cb2b2a,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{etcd-rev},},Reason:Started,Message:Started container etcd-rev,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:59.598320219 +0000 UTC m=+3.997632756,LastTimestamp:2026-03-16 13:05:59.598320219 +0000 UTC m=+3.997632756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.952806 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event=< Mar 16 13:06:13 crc kubenswrapper[5030]: &Event{ObjectMeta:{kube-controller-manager-crc.189d5429d176509e openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:ProbeError,Message:Startup probe error: Get "https://localhost:10357/healthz": context deadline exceeded Mar 16 13:06:13 crc kubenswrapper[5030]: body: Mar 16 13:06:13 crc kubenswrapper[5030]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:06.838427806 +0000 UTC m=+11.237740353,LastTimestamp:2026-03-16 13:06:06.838427806 +0000 UTC m=+11.237740353,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 13:06:13 crc kubenswrapper[5030]: > Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.954259 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-controller-manager\"" event="&Event{ObjectMeta:{kube-controller-manager-crc.189d5429d1775188 openshift-kube-controller-manager 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-controller-manager,Name:kube-controller-manager-crc,UID:9f0bc7fcb0822a2c13eb2d22cd8c0641,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{cluster-policy-controller},},Reason:Unhealthy,Message:Startup probe failed: Get \"https://localhost:10357/healthz\": context deadline exceeded,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:06.838493576 +0000 UTC m=+11.237806124,LastTimestamp:2026-03-16 13:06:06.838493576 +0000 UTC m=+11.237806124,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.955806 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 13:06:13 crc kubenswrapper[5030]: &Event{ObjectMeta:{kube-apiserver-crc.189d542a3cd08127 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:ProbeError,Message:Startup probe error: HTTP probe failed with statuscode: 403 Mar 16 13:06:13 crc kubenswrapper[5030]: body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 13:06:13 crc kubenswrapper[5030]: Mar 16 13:06:13 crc kubenswrapper[5030]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:08.639500583 +0000 UTC m=+13.038813130,LastTimestamp:2026-03-16 13:06:08.639500583 +0000 UTC m=+13.038813130,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 13:06:13 crc kubenswrapper[5030]: > Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.957460 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542a3cd10577 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Unhealthy,Message:Startup probe failed: HTTP probe failed with statuscode: 403,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:08.639534455 +0000 UTC m=+13.038847001,LastTimestamp:2026-03-16 13:06:08.639534455 +0000 UTC m=+13.038847001,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.959978 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542a3cd08127\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 13:06:13 crc kubenswrapper[5030]: &Event{ObjectMeta:{kube-apiserver-crc.189d542a3cd08127 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:ProbeError,Message:Startup probe error: HTTP probe failed with statuscode: 403 Mar 16 13:06:13 crc kubenswrapper[5030]: body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/livez\"","reason":"Forbidden","details":{},"code":403} Mar 16 13:06:13 crc kubenswrapper[5030]: Mar 16 13:06:13 crc kubenswrapper[5030]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:08.639500583 +0000 UTC m=+13.038813130,LastTimestamp:2026-03-16 13:06:08.643578869 +0000 UTC m=+13.042891416,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 13:06:13 crc kubenswrapper[5030]: > Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.963090 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542a3cd10577\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542a3cd10577 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver},},Reason:Unhealthy,Message:Startup probe failed: HTTP probe failed with statuscode: 403,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:08.639534455 +0000 UTC m=+13.038847001,LastTimestamp:2026-03-16 13:06:08.643621176 +0000 UTC m=+13.042933723,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.966344 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 13:06:13 crc kubenswrapper[5030]: &Event{ObjectMeta:{kube-apiserver-crc.189d542b6846d960 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:ProbeError,Message:Readiness probe error: Get "https://192.168.126.11:17697/healthz": read tcp 192.168.126.11:46034->192.168.126.11:17697: read: connection reset by peer Mar 16 13:06:13 crc kubenswrapper[5030]: body: Mar 16 13:06:13 crc kubenswrapper[5030]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:13.663644 +0000 UTC m=+18.062956547,LastTimestamp:2026-03-16 13:06:13.663644 +0000 UTC m=+18.062956547,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 13:06:13 crc kubenswrapper[5030]: > Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.969257 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542b68475c15 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Unhealthy,Message:Readiness probe failed: Get \"https://192.168.126.11:17697/healthz\": read tcp 192.168.126.11:46034->192.168.126.11:17697: read: connection reset by peer,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:13.663677461 +0000 UTC m=+18.062990008,LastTimestamp:2026-03-16 13:06:13.663677461 +0000 UTC m=+18.062990008,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.972237 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event=< Mar 16 13:06:13 crc kubenswrapper[5030]: &Event{ObjectMeta:{kube-apiserver-crc.189d542b684b16ac openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:ProbeError,Message:Readiness probe error: Get "https://192.168.126.11:17697/healthz": dial tcp 192.168.126.11:17697: connect: connection refused Mar 16 13:06:13 crc kubenswrapper[5030]: body: Mar 16 13:06:13 crc kubenswrapper[5030]: ,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:13.663921836 +0000 UTC m=+18.063234383,LastTimestamp:2026-03-16 13:06:13.663921836 +0000 UTC m=+18.063234383,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,} Mar 16 13:06:13 crc kubenswrapper[5030]: > Mar 16 13:06:13 crc kubenswrapper[5030]: E0316 13:06:13.975190 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542b684b89f6 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Unhealthy,Message:Readiness probe failed: Get \"https://192.168.126.11:17697/healthz\": dial tcp 192.168.126.11:17697: connect: connection refused,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:13.66395135 +0000 UTC m=+18.063263896,LastTimestamp:2026-03-16 13:06:13.66395135 +0000 UTC m=+18.063263896,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.013046 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/0.log" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014230 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="d7da5f580449561cbf4f014df6b3df622afa18cabb9aef46ea8afb16d9e72a38" exitCode=255 Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014283 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"d7da5f580449561cbf4f014df6b3df622afa18cabb9aef46ea8afb16d9e72a38"} Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014455 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014938 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014969 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.014979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:14 crc kubenswrapper[5030]: E0316 13:06:14.015200 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.015402 5030 scope.go:117] "RemoveContainer" containerID="d7da5f580449561cbf4f014df6b3df622afa18cabb9aef46ea8afb16d9e72a38" Mar 16 13:06:14 crc kubenswrapper[5030]: E0316 13:06:14.019341 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427b7a1177d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b7a1177d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.815089021 +0000 UTC m=+2.214401569,LastTimestamp:2026-03-16 13:06:14.016179353 +0000 UTC m=+18.415491901,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:14 crc kubenswrapper[5030]: E0316 13:06:14.132876 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427bfdc5bca\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427bfdc5bca openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.953190858 +0000 UTC m=+2.352503405,LastTimestamp:2026-03-16 13:06:14.128899409 +0000 UTC m=+18.528211957,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:14 crc kubenswrapper[5030]: E0316 13:06:14.140504 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427c0b64e1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427c0b64e1d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.967474205 +0000 UTC m=+2.366786751,LastTimestamp:2026-03-16 13:06:14.136767036 +0000 UTC m=+18.536079583,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.216481 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.216682 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.217466 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.217501 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.217511 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:14 crc kubenswrapper[5030]: E0316 13:06:14.217827 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.220250 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.220362 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:06:14 crc kubenswrapper[5030]: I0316 13:06:14.887397 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.017019 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/0.log" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.018293 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.018480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689"} Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.018617 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.018964 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.018994 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.019004 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:15 crc kubenswrapper[5030]: E0316 13:06:15.019202 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.019576 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.019597 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.019604 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:15 crc kubenswrapper[5030]: E0316 13:06:15.019791 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:15 crc kubenswrapper[5030]: I0316 13:06:15.886942 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:15 crc kubenswrapper[5030]: E0316 13:06:15.983710 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.020663 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.021082 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/0.log" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022273 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689" exitCode=255 Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022341 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689"} Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022380 5030 scope.go:117] "RemoveContainer" containerID="d7da5f580449561cbf4f014df6b3df622afa18cabb9aef46ea8afb16d9e72a38" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022408 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022511 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022807 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022834 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022845 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022956 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.022993 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.023114 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.023217 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.023413 5030 scope.go:117] "RemoveContainer" containerID="b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.023611 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.028057 5030 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.846063 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.846910 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.846947 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.846958 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.846978 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.857087 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:16 crc kubenswrapper[5030]: E0316 13:06:16.874174 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:06:16 crc kubenswrapper[5030]: I0316 13:06:16.884948 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:17 crc kubenswrapper[5030]: I0316 13:06:17.024679 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 13:06:17 crc kubenswrapper[5030]: E0316 13:06:17.471176 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:06:17 crc kubenswrapper[5030]: E0316 13:06:17.500053 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:06:17 crc kubenswrapper[5030]: I0316 13:06:17.887290 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:18 crc kubenswrapper[5030]: E0316 13:06:18.510461 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:18 crc kubenswrapper[5030]: I0316 13:06:18.889247 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:19 crc kubenswrapper[5030]: E0316 13:06:19.264887 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:06:19 crc kubenswrapper[5030]: I0316 13:06:19.885540 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:20 crc kubenswrapper[5030]: I0316 13:06:20.887219 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:21 crc kubenswrapper[5030]: I0316 13:06:21.886411 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:22 crc kubenswrapper[5030]: I0316 13:06:22.886892 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.258023 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.258590 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.258630 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.258641 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.258660 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:23 crc kubenswrapper[5030]: E0316 13:06:23.264958 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:23 crc kubenswrapper[5030]: I0316 13:06:23.887167 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:24 crc kubenswrapper[5030]: I0316 13:06:24.886804 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.018831 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.019140 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.019902 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.019929 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.019939 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.020232 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.020482 5030 scope.go:117] "RemoveContainer" containerID="b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.020744 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.024158 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:25.02071442 +0000 UTC m=+29.420026967,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.114165 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.513951 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.557377 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.557787 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.558728 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.558769 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.558785 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.559054 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.559223 5030 scope.go:117] "RemoveContainer" containerID="b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.563851 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427b7a1177d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b7a1177d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.815089021 +0000 UTC m=+2.214401569,LastTimestamp:2026-03-16 13:06:25.560117949 +0000 UTC m=+29.959430495,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.692017 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427bfdc5bca\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427bfdc5bca openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Created,Message:Created container: kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.953190858 +0000 UTC m=+2.352503405,LastTimestamp:2026-03-16 13:06:25.68818727 +0000 UTC m=+30.087499816,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.699738 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427c0b64e1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427c0b64e1d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Started,Message:Started container kube-apiserver-check-endpoints,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.967474205 +0000 UTC m=+2.366786751,LastTimestamp:2026-03-16 13:06:25.695670185 +0000 UTC m=+30.094982732,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:25 crc kubenswrapper[5030]: I0316 13:06:25.887825 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:25 crc kubenswrapper[5030]: E0316 13:06:25.984103 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.044067 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.045860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6"} Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.046089 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.046537 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.046595 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.046607 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:26 crc kubenswrapper[5030]: E0316 13:06:26.046904 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:26 crc kubenswrapper[5030]: I0316 13:06:26.886477 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.049130 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.049425 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/1.log" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.050750 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" exitCode=255 Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.050798 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6"} Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.050830 5030 scope.go:117] "RemoveContainer" containerID="b7d36511afb320c66df60c103905538f7328fa02345945e3ba59f7be62261689" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.051033 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.051451 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.051483 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.051494 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:27 crc kubenswrapper[5030]: E0316 13:06:27.051760 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.051965 5030 scope.go:117] "RemoveContainer" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" Mar 16 13:06:27 crc kubenswrapper[5030]: E0316 13:06:27.052227 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:27 crc kubenswrapper[5030]: E0316 13:06:27.055827 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:27.052198852 +0000 UTC m=+31.451511399,Count:3,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:27 crc kubenswrapper[5030]: I0316 13:06:27.886567 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:27 crc kubenswrapper[5030]: E0316 13:06:27.906906 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:06:28 crc kubenswrapper[5030]: I0316 13:06:28.053837 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 13:06:28 crc kubenswrapper[5030]: E0316 13:06:28.760304 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:06:28 crc kubenswrapper[5030]: I0316 13:06:28.886622 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:29 crc kubenswrapper[5030]: E0316 13:06:29.688017 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:06:29 crc kubenswrapper[5030]: I0316 13:06:29.886593 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.265769 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.266533 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.266599 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.266610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.266634 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:30 crc kubenswrapper[5030]: E0316 13:06:30.273381 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:30 crc kubenswrapper[5030]: I0316 13:06:30.887096 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:31 crc kubenswrapper[5030]: I0316 13:06:31.886671 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:32 crc kubenswrapper[5030]: E0316 13:06:32.518162 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:32 crc kubenswrapper[5030]: I0316 13:06:32.887403 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:33 crc kubenswrapper[5030]: I0316 13:06:33.886630 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:34 crc kubenswrapper[5030]: I0316 13:06:34.886783 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.557382 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.557588 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.558262 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.558298 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.558310 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:35 crc kubenswrapper[5030]: E0316 13:06:35.558583 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.558805 5030 scope.go:117] "RemoveContainer" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" Mar 16 13:06:35 crc kubenswrapper[5030]: E0316 13:06:35.558975 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:35 crc kubenswrapper[5030]: E0316 13:06:35.562151 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:35.558947999 +0000 UTC m=+39.958260546,Count:4,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:35 crc kubenswrapper[5030]: I0316 13:06:35.887259 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:35 crc kubenswrapper[5030]: E0316 13:06:35.985298 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.046442 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.069787 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.070236 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.070262 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.070273 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:36 crc kubenswrapper[5030]: E0316 13:06:36.070577 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.070761 5030 scope.go:117] "RemoveContainer" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" Mar 16 13:06:36 crc kubenswrapper[5030]: E0316 13:06:36.070927 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:36 crc kubenswrapper[5030]: E0316 13:06:36.074058 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:36.070900751 +0000 UTC m=+40.470213298,Count:5,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:36 crc kubenswrapper[5030]: I0316 13:06:36.887547 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.274045 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.274764 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.274842 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.274862 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.274903 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:37 crc kubenswrapper[5030]: E0316 13:06:37.281654 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:37 crc kubenswrapper[5030]: I0316 13:06:37.887008 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:38 crc kubenswrapper[5030]: I0316 13:06:38.886811 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:39 crc kubenswrapper[5030]: E0316 13:06:39.522185 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:39 crc kubenswrapper[5030]: I0316 13:06:39.886820 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:40 crc kubenswrapper[5030]: I0316 13:06:40.887764 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:41 crc kubenswrapper[5030]: E0316 13:06:41.486379 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Mar 16 13:06:41 crc kubenswrapper[5030]: I0316 13:06:41.886563 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:42 crc kubenswrapper[5030]: I0316 13:06:42.886131 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:43 crc kubenswrapper[5030]: I0316 13:06:43.887523 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.282269 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.283114 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.283186 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.283201 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.283243 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:44 crc kubenswrapper[5030]: E0316 13:06:44.290528 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:44 crc kubenswrapper[5030]: I0316 13:06:44.887756 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:45 crc kubenswrapper[5030]: I0316 13:06:45.887348 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:45 crc kubenswrapper[5030]: E0316 13:06:45.986516 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:46 crc kubenswrapper[5030]: E0316 13:06:46.470907 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"crc\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Mar 16 13:06:46 crc kubenswrapper[5030]: E0316 13:06:46.525759 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:46 crc kubenswrapper[5030]: I0316 13:06:46.886864 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:47 crc kubenswrapper[5030]: I0316 13:06:47.886378 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:48 crc kubenswrapper[5030]: I0316 13:06:48.884585 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.887149 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.945904 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.946727 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.946800 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.946819 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:49 crc kubenswrapper[5030]: E0316 13:06:49.947329 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:49 crc kubenswrapper[5030]: I0316 13:06:49.947755 5030 scope.go:117] "RemoveContainer" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" Mar 16 13:06:49 crc kubenswrapper[5030]: E0316 13:06:49.952482 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d5427b7a1177d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d5427b7a1177d openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:05:57.815089021 +0000 UTC m=+2.214401569,LastTimestamp:2026-03-16 13:06:49.949009477 +0000 UTC m=+54.348322024,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.108029 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.109429 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438"} Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.109743 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.110206 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.110238 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.110249 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:50 crc kubenswrapper[5030]: E0316 13:06:50.110596 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:50 crc kubenswrapper[5030]: I0316 13:06:50.886472 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.113333 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.113828 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/2.log" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.115153 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" exitCode=255 Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.115191 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerDied","Data":"7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438"} Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.115225 5030 scope.go:117] "RemoveContainer" containerID="04631dc892e8faa1c6fb6166f2d81d347f062f79e9bd5ff1918cb44d4bdc2ed6" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.115420 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.115970 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.116007 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.116018 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:51 crc kubenswrapper[5030]: E0316 13:06:51.116291 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.116599 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:06:51 crc kubenswrapper[5030]: E0316 13:06:51.116800 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:51 crc kubenswrapper[5030]: E0316 13:06:51.120078 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:51.116769683 +0000 UTC m=+55.516082230,Count:6,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.291376 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.291915 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.291956 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.291967 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.292009 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:51 crc kubenswrapper[5030]: E0316 13:06:51.298231 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.709711 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.709859 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.710610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.710648 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.710660 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:51 crc kubenswrapper[5030]: E0316 13:06:51.710968 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:51 crc kubenswrapper[5030]: I0316 13:06:51.886821 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:52 crc kubenswrapper[5030]: I0316 13:06:52.118701 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 13:06:52 crc kubenswrapper[5030]: I0316 13:06:52.886705 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:53 crc kubenswrapper[5030]: E0316 13:06:53.529216 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="7s" Mar 16 13:06:53 crc kubenswrapper[5030]: E0316 13:06:53.586958 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Mar 16 13:06:53 crc kubenswrapper[5030]: I0316 13:06:53.885947 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:54 crc kubenswrapper[5030]: E0316 13:06:54.789863 5030 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Mar 16 13:06:54 crc kubenswrapper[5030]: I0316 13:06:54.886253 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.556620 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.556808 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.557398 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.557430 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.557439 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:55 crc kubenswrapper[5030]: E0316 13:06:55.557709 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.557933 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:06:55 crc kubenswrapper[5030]: E0316 13:06:55.558109 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:06:55 crc kubenswrapper[5030]: E0316 13:06:55.561299 5030 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-apiserver-crc.189d542bf4f0b3a3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-kube-apiserver\"" event="&Event{ObjectMeta:{kube-apiserver-crc.189d542bf4f0b3a3 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-crc,UID:3a14caf222afb62aaabdc47808b6f944,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-apiserver-check-endpoints},},Reason:BackOff,Message:Back-off restarting failed container kube-apiserver-check-endpoints in pod kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944),Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:06:16.023585699 +0000 UTC m=+20.422898246,LastTimestamp:2026-03-16 13:06:55.55807902 +0000 UTC m=+59.957391557,Count:7,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:06:55 crc kubenswrapper[5030]: I0316 13:06:55.887213 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:55 crc kubenswrapper[5030]: E0316 13:06:55.986852 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:06:56 crc kubenswrapper[5030]: I0316 13:06:56.886956 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:57 crc kubenswrapper[5030]: I0316 13:06:57.886787 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.299303 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.300309 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.300346 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.300355 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.300373 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:06:58 crc kubenswrapper[5030]: E0316 13:06:58.306371 5030 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"crc\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="crc" Mar 16 13:06:58 crc kubenswrapper[5030]: I0316 13:06:58.886819 5030 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "crc" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.349096 5030 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlzpg" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.353404 5030 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlzpg" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.389800 5030 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.802777 5030 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.944834 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.945424 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.945478 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:06:59 crc kubenswrapper[5030]: I0316 13:06:59.945491 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:06:59 crc kubenswrapper[5030]: E0316 13:06:59.945839 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.109852 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.110047 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.110693 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.110734 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.110747 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:00 crc kubenswrapper[5030]: E0316 13:07:00.111124 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.111320 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:07:00 crc kubenswrapper[5030]: E0316 13:07:00.111476 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.354994 5030 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2026-04-15 13:01:59 +0000 UTC" deadline="2026-04-10 07:20:37.818285913 +0000 UTC" Mar 16 13:07:00 crc kubenswrapper[5030]: I0316 13:07:00.355032 5030 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="594h13m37.463257278s" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.307069 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.307840 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.307888 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.307900 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.308018 5030 kubelet_node_status.go:78] "Attempting to register node" node="crc" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.316524 5030 kubelet_node_status.go:127] "Node was previously registered" node="crc" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.316892 5030 kubelet_node_status.go:81] "Successfully registered node" node="crc" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.316929 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.319332 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.319375 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.319390 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.319410 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.319422 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:05Z","lastTransitionTime":"2026-03-16T13:07:05Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.328928 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.334435 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.334477 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.334489 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.334506 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.334517 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:05Z","lastTransitionTime":"2026-03-16T13:07:05Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.341015 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.345846 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.345876 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.345886 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.345901 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.345911 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:05Z","lastTransitionTime":"2026-03-16T13:07:05Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.351994 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.357352 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.357390 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.357404 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.357417 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:05 crc kubenswrapper[5030]: I0316 13:07:05.357426 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:05Z","lastTransitionTime":"2026-03-16T13:07:05Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.366374 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:05Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.366480 5030 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.366505 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.467252 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.567506 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.668263 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.769107 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.869715 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.969928 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:05 crc kubenswrapper[5030]: E0316 13:07:05.987501 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.070911 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.171173 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.271251 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.371769 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.472751 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.573587 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.674592 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.775643 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.876081 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:06 crc kubenswrapper[5030]: E0316 13:07:06.976945 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.077134 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.178369 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.278838 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.379151 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.479670 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.580451 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.681198 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.782145 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.882320 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:07 crc kubenswrapper[5030]: E0316 13:07:07.982735 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.083055 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.184112 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.284983 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.386117 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.486778 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.587575 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.688377 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.789221 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.889513 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:08 crc kubenswrapper[5030]: E0316 13:07:08.990860 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.091707 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.192039 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.293020 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.393523 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.494310 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.595386 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.696191 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.797124 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.897695 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:09 crc kubenswrapper[5030]: E0316 13:07:09.997791 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.098075 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.198142 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.298772 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.398967 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.499648 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.600537 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.700852 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.801821 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.902769 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:10 crc kubenswrapper[5030]: I0316 13:07:10.945379 5030 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Mar 16 13:07:10 crc kubenswrapper[5030]: I0316 13:07:10.946064 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:10 crc kubenswrapper[5030]: I0316 13:07:10.946097 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:10 crc kubenswrapper[5030]: I0316 13:07:10.946109 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.946457 5030 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"crc\" not found" node="crc" Mar 16 13:07:10 crc kubenswrapper[5030]: I0316 13:07:10.946664 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:07:10 crc kubenswrapper[5030]: E0316 13:07:10.946838 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.003025 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.103258 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.203507 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.304325 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.404798 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.504854 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.605969 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.706066 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.806252 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:11 crc kubenswrapper[5030]: E0316 13:07:11.906697 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.006915 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.107261 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.207998 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.308923 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.409791 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.510400 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.610436 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.710860 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.811624 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:12 crc kubenswrapper[5030]: E0316 13:07:12.912592 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.013189 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.114092 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.214313 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.315248 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.415607 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.516492 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.616789 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.716937 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.817786 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:13 crc kubenswrapper[5030]: E0316 13:07:13.918385 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.018590 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.118651 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.219406 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.320349 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.420595 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.520892 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.621146 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.721540 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.821602 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:14 crc kubenswrapper[5030]: E0316 13:07:14.922157 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.022574 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.123277 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.224281 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.324920 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.394781 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"crc\": node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.397315 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.397348 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.397357 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.397368 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.397377 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:15Z","lastTransitionTime":"2026-03-16T13:07:15Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.403974 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.408827 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.408856 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.408864 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.408877 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.408886 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:15Z","lastTransitionTime":"2026-03-16T13:07:15Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.415282 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.419812 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.419874 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.419884 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.419897 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.419905 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:15Z","lastTransitionTime":"2026-03-16T13:07:15Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.425798 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.430201 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.430228 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.430238 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.430248 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:15 crc kubenswrapper[5030]: I0316 13:07:15.430255 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:15Z","lastTransitionTime":"2026-03-16T13:07:15Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.436033 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:15Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.436140 5030 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.436154 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.536788 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.637936 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.738169 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.838925 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.939758 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:15 crc kubenswrapper[5030]: E0316 13:07:15.987668 5030 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.040253 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.141151 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.242075 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.342808 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.443451 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.543819 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.644848 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.745284 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.845498 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:16 crc kubenswrapper[5030]: E0316 13:07:16.946080 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.046925 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.147052 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.247662 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.348092 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.448184 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.548427 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.649113 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.750242 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.851044 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:17 crc kubenswrapper[5030]: E0316 13:07:17.952016 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.053074 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.154129 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.254753 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.354827 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.455176 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.555324 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.656280 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.756714 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.857201 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:18 crc kubenswrapper[5030]: E0316 13:07:18.957731 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.057884 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.158528 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.259356 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.359681 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.460139 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.560962 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.661066 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.761576 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.861850 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:19 crc kubenswrapper[5030]: E0316 13:07:19.962351 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.063228 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.163608 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.263836 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.364259 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.465366 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.566141 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.666931 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.767601 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.867856 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:20 crc kubenswrapper[5030]: E0316 13:07:20.968488 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.069070 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.169778 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.270076 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.370798 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.471467 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.572070 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.672845 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.773854 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.874643 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:21 crc kubenswrapper[5030]: E0316 13:07:21.975338 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.076407 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.177297 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.277427 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.377784 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.478709 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.578763 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.679856 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.780766 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.881408 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:22 crc kubenswrapper[5030]: E0316 13:07:22.982296 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.082668 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.182975 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.283935 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.384396 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.484819 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.585179 5030 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"crc\" not found" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.594304 5030 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.598435 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.605432 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.686752 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.686781 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.686791 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.686804 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.686812 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:23Z","lastTransitionTime":"2026-03-16T13:07:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.705148 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.788425 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.788456 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.788466 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.788483 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.788492 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:23Z","lastTransitionTime":"2026-03-16T13:07:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.806414 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-etcd/etcd-crc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.830243 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.889630 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.889668 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.889679 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.889691 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.889701 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:23Z","lastTransitionTime":"2026-03-16T13:07:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.924141 5030 apiserver.go:52] "Watching apiserver" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.928681 5030 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.929108 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6","openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5","openshift-network-node-identity/network-node-identity-dgvkt","openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv","openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c","openshift-kube-controller-manager/kube-controller-manager-crc","openshift-multus/multus-wfwbx","openshift-network-diagnostics/network-check-target-fhkjl","openshift-dns/node-resolver-952wf","openshift-etcd/etcd-crc","openshift-image-registry/node-ca-98dmx","openshift-kube-scheduler/openshift-kube-scheduler-crc","openshift-multus/multus-additional-cni-plugins-9fvrp","openshift-ovn-kubernetes/ovnkube-node-s9mkc","openshift-machine-config-operator/kube-rbac-proxy-crio-crc","openshift-multus/network-metrics-daemon-qxdgg","openshift-network-operator/iptables-alerter-5jnd7","openshift-kube-apiserver/kube-apiserver-crc","openshift-machine-config-operator/machine-config-daemon-b7rgl"] Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.930163 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.930516 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.930597 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.930618 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.930671 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.931363 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.931529 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.931580 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.931884 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"metrics-tls\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.931901 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.932610 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"env-overrides\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.932838 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.933287 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-node-identity\"/\"network-node-identity-cert\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.933312 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.933748 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"ovnkube-identity-cm\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.933882 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.933936 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.933955 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.934256 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.935118 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tk7bt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.935454 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfwbx" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.937140 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938526 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938616 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938664 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjs74\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938707 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938787 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938888 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938973 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g6kgg\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.938977 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.939056 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.939153 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.939238 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.939506 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.940276 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941504 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941605 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwglk\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941510 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.941706 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941868 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.941869 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.942416 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.942417 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2v2m\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.942511 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.943331 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.943372 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.944823 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.947526 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-control-plane-dockercfg-nl8tp\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.948241 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-control-plane-metrics-cert\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.949343 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.950294 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:07:23 crc kubenswrapper[5030]: E0316 13:07:23.950425 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver-check-endpoints\" with CrashLoopBackOff: \"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\"" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.950460 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.950488 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.950561 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-rbac-proxy\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.950912 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-daemon-dockercfg-w9nzh\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.953675 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.953772 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"proxy-tls\"" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.960387 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.965433 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.976698 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.983491 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.988891 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.990883 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.990913 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.990922 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.990933 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.990948 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:23Z","lastTransitionTime":"2026-03-16T13:07:23Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:23 crc kubenswrapper[5030]: I0316 13:07:23.995436 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.000753 5030 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.001253 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.010769 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.015807 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.020433 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.026208 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.031878 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.036056 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037282 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037397 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5rsr\" (UniqueName: \"kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037445 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037461 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzt4w\" (UniqueName: \"kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w\") pod \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\" (UID: \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037512 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037531 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037545 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037575 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrkj\" (UniqueName: \"kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj\") pod \"42a11a02-47e1-488f-b270-2679d3298b0e\" (UID: \"42a11a02-47e1-488f-b270-2679d3298b0e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037591 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z4sw\" (UniqueName: \"kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037631 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4smf\" (UniqueName: \"kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf\") pod \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\" (UID: \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjwtd\" (UniqueName: \"kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037679 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037702 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037725 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmhf\" (UniqueName: \"kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037752 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037773 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037820 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037842 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxfcv\" (UniqueName: \"kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfzkj\" (UniqueName: \"kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj\") pod \"0effdbcf-dd7d-404d-9d48-77536d665a5d\" (UID: \"0effdbcf-dd7d-404d-9d48-77536d665a5d\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037913 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nb9c\" (UniqueName: \"kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037928 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037942 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037958 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037973 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94l9h\" (UniqueName: \"kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.037988 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038005 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26jq\" (UniqueName: \"kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038026 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr" (OuterVolumeSpecName: "kube-api-access-z5rsr") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "kube-api-access-z5rsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038033 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038080 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038100 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grwfz\" (UniqueName: \"kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038120 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038138 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4qr\" (UniqueName: \"kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038172 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddlk9\" (UniqueName: \"kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038187 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vsz9\" (UniqueName: \"kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038202 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038218 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls\") pod \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\" (UID: \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038233 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038248 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjkz\" (UniqueName: \"kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038306 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038322 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks6v2\" (UniqueName: \"kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038351 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert\") pod \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\" (UID: \"a52afe44-fb37-46ed-a1f8-bf39727a3cbe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038407 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038422 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038439 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038454 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038470 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038488 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content\") pod \"149b3c48-e17c-4a66-a835-d86dabf6ff13\" (UID: \"149b3c48-e17c-4a66-a835-d86dabf6ff13\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038519 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99zj9\" (UniqueName: \"kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038647 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038666 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038680 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038694 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038708 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038740 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twvbl\" (UniqueName: \"kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038772 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038787 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038824 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038857 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsb9b\" (UniqueName: \"kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038872 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038887 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038902 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content\") pod \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\" (UID: \"9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038933 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038947 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgx6b\" (UniqueName: \"kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b\") pod \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\" (UID: \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038976 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.038991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039005 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039039 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039054 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039069 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l87hs\" (UniqueName: \"kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs\") pod \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\" (UID: \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039123 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039139 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039172 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039188 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039218 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs\") pod \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\" (UID: \"f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039233 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls\") pod \"42a11a02-47e1-488f-b270-2679d3298b0e\" (UID: \"42a11a02-47e1-488f-b270-2679d3298b0e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039264 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039282 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039299 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039318 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039354 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfp5s\" (UniqueName: \"kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039372 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9stx\" (UniqueName: \"kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039388 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039419 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039436 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap\") pod \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\" (UID: \"869851b9-7ffb-4af0-b166-1d8aa40a5f80\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039467 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039482 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039497 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039512 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039528 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca\") pod \"736c54fe-349c-4bb9-870a-d1c1d1c03831\" (UID: \"736c54fe-349c-4bb9-870a-d1c1d1c03831\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039543 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26xrl\" (UniqueName: \"kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl\") pod \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\" (UID: \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039577 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039593 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws8zz\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039609 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dztfv\" (UniqueName: \"kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039637 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access\") pod \"d7e8f42f-dc0e-424b-bb56-5ec849834888\" (UID: \"d7e8f42f-dc0e-424b-bb56-5ec849834888\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039654 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039670 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pllx6\" (UniqueName: \"kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039687 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config\") pod \"567683bd-0efc-4f21-b076-e28559628404\" (UID: \"567683bd-0efc-4f21-b076-e28559628404\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039720 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config\") pod \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\" (UID: \"d45be74c-0d98-4d18-90e4-f7ef1b6daaf7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039736 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039753 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptkcf\" (UniqueName: \"kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039770 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images\") pod \"d565531a-ff86-4608-9d19-767de01ac31b\" (UID: \"d565531a-ff86-4608-9d19-767de01ac31b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039818 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5lgh\" (UniqueName: \"kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039853 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g8ts\" (UniqueName: \"kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts\") pod \"92dfbade-90b6-4169-8c07-72cff7f2c82b\" (UID: \"92dfbade-90b6-4169-8c07-72cff7f2c82b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm9x7\" (UniqueName: \"kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039899 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039919 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039938 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnxbn\" (UniqueName: \"kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn\") pod \"ce090a97-9ab6-4c40-a719-64ff2acd9778\" (UID: \"ce090a97-9ab6-4c40-a719-64ff2acd9778\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039960 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039977 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.039992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities\") pod \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\" (UID: \"71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040028 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hckvg\" (UniqueName: \"kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040044 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca\") pod \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\" (UID: \"5ebfebf6-3ecd-458e-943f-bb25b52e2718\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040062 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pskd\" (UniqueName: \"kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040112 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040129 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040148 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg8nc\" (UniqueName: \"kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc\") pod \"2325ffef-9d5b-447f-b00e-3efc429acefe\" (UID: \"2325ffef-9d5b-447f-b00e-3efc429acefe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040172 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040205 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert\") pod \"7599e0b6-bddf-4def-b7f2-0b32206e8651\" (UID: \"7599e0b6-bddf-4def-b7f2-0b32206e8651\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hb7m\" (UniqueName: \"kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m\") pod \"94a6e063-3d1a-4d44-875d-185291448c31\" (UID: \"94a6e063-3d1a-4d44-875d-185291448c31\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040266 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pddnv\" (UniqueName: \"kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv\") pod \"e093be35-bb62-4843-b2e8-094545761610\" (UID: \"e093be35-bb62-4843-b2e8-094545761610\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040284 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmzf\" (UniqueName: \"kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir\") pod \"f7e2c886-118e-43bb-bef1-c78134de392b\" (UID: \"f7e2c886-118e-43bb-bef1-c78134de392b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040319 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config\") pod \"c5f2bfad-70f6-4185-a3d9-81ce12720767\" (UID: \"c5f2bfad-70f6-4185-a3d9-81ce12720767\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040335 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040352 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkdh6\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040387 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040404 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lcfw\" (UniqueName: \"kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040422 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040441 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqbfk\" (UniqueName: \"kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk\") pod \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\" (UID: \"b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config\") pod \"7df94c10-441d-4386-93a6-6730fb7bcde0\" (UID: \"7df94c10-441d-4386-93a6-6730fb7bcde0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040505 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert\") pod \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\" (UID: \"a208c9c2-333b-4b4a-be0d-bc32ec38a821\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040525 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w94wk\" (UniqueName: \"kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk\") pod \"01080b46-74f1-4191-8755-5152a57b3b25\" (UID: \"01080b46-74f1-4191-8755-5152a57b3b25\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040575 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config\") pod \"c491984c-7d4b-44aa-8c1e-d7974424fa47\" (UID: \"c491984c-7d4b-44aa-8c1e-d7974424fa47\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040593 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle\") pod \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\" (UID: \"dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040611 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040639 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040658 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040715 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040734 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040753 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4tqq\" (UniqueName: \"kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq\") pod \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\" (UID: \"6ee8fbd3-1f81-4666-96da-5afc70819f1a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040772 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g4lr\" (UniqueName: \"kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr\") pod \"f7e2c886-118e-43bb-bef1-c78134de392b\" (UID: \"f7e2c886-118e-43bb-bef1-c78134de392b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040790 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle\") pod \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\" (UID: \"6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040807 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040825 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zth6t\" (UniqueName: \"kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040844 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040861 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert\") pod \"301e1965-1754-483d-b6cc-bfae7038bbca\" (UID: \"301e1965-1754-483d-b6cc-bfae7038bbca\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040878 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities\") pod \"cc85e424-18b2-4924-920b-bd291a8c4b01\" (UID: \"cc85e424-18b2-4924-920b-bd291a8c4b01\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040938 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040956 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040974 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.040991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs\") pod \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\" (UID: \"0dd0fbac-8c0d-4228-8faa-abbeedabf7db\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041008 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls\") pod \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\" (UID: \"20ce4d18-fe25-4696-ad7c-1bd2d6200a3e\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041025 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041045 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config\") pod \"81e39f7b-62e4-4fc9-992a-6535ce127a02\" (UID: \"81e39f7b-62e4-4fc9-992a-6535ce127a02\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041083 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls\") pod \"b4750666-1362-4001-abd0-6f89964cc621\" (UID: \"b4750666-1362-4001-abd0-6f89964cc621\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041125 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies\") pod \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\" (UID: \"6edfcf45-925b-4eff-b940-95b6fc0b85d4\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041167 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftwb6\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6\") pod \"9f71a554-e414-4bc3-96d2-674060397afe\" (UID: \"9f71a554-e414-4bc3-96d2-674060397afe\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tknt7\" (UniqueName: \"kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7\") pod \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\" (UID: \"584e1f4a-8205-47d7-8efb-3afc6017c4c9\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041202 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041220 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041258 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041278 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041297 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbmqg\" (UniqueName: \"kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg\") pod \"18f80adb-c1c3-49ba-8ee4-932c851d3897\" (UID: \"18f80adb-c1c3-49ba-8ee4-932c851d3897\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041321 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert\") pod \"16bdd140-dce1-464c-ab47-dd5798d1d256\" (UID: \"16bdd140-dce1-464c-ab47-dd5798d1d256\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbc2l\" (UniqueName: \"kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l\") pod \"593a3561-7760-45c5-8f91-5aaef7475d0f\" (UID: \"593a3561-7760-45c5-8f91-5aaef7475d0f\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041359 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config\") pod \"d19cb085-0c5b-4810-b654-ce7923221d90\" (UID: \"d19cb085-0c5b-4810-b654-ce7923221d90\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041378 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities\") pod \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\" (UID: \"31fa8943-81cc-4750-a0b7-0fa9ab5af883\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041396 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert\") pod \"09cfa50b-4138-4585-a53e-64dd3ab73335\" (UID: \"09cfa50b-4138-4585-a53e-64dd3ab73335\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir\") pod \"6077b63e-53a2-4f96-9d56-1ce0324e4913\" (UID: \"6077b63e-53a2-4f96-9d56-1ce0324e4913\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041469 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config\") pod \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\" (UID: \"f65c0ac1-8bca-454d-a2e6-e35cb418beac\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041489 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access\") pod \"7afa918d-be67-40a6-803c-d3b0ae99d815\" (UID: \"7afa918d-be67-40a6-803c-d3b0ae99d815\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041509 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nspp\" (UniqueName: \"kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp\") pod \"a7a88189-c967-4640-879e-27665747f20c\" (UID: \"a7a88189-c967-4640-879e-27665747f20c\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib\") pod \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\" (UID: \"af33e427-6803-48c2-a76a-dd9deb7cbf9a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041607 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rmnv\" (UniqueName: \"kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv\") pod \"b605f283-6f2e-42da-a838-54421690f7d0\" (UID: \"b605f283-6f2e-42da-a838-54421690f7d0\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041663 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client\") pod \"f559dfa3-3917-43a2-97f6-61ddfda10e93\" (UID: \"f559dfa3-3917-43a2-97f6-61ddfda10e93\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.041684 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert\") pod \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\" (UID: \"7fcc6409-8a0f-44c3-89e7-5aecd7610f8a\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042262 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042375 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w" (OuterVolumeSpecName: "kube-api-access-rzt4w") pod "a52afe44-fb37-46ed-a1f8-bf39727a3cbe" (UID: "a52afe44-fb37-46ed-a1f8-bf39727a3cbe"). InnerVolumeSpecName "kube-api-access-rzt4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq" (OuterVolumeSpecName: "kube-api-access-m26jq") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "kube-api-access-m26jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042847 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042869 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf" (OuterVolumeSpecName: "kube-api-access-6dmhf") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "kube-api-access-6dmhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042845 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042989 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b" (OuterVolumeSpecName: "kube-api-access-zsb9b") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "kube-api-access-zsb9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.042993 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043054 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043084 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca" (OuterVolumeSpecName: "etcd-service-ca") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043308 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv" (OuterVolumeSpecName: "kube-api-access-xxfcv") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "kube-api-access-xxfcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043325 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043323 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj" (OuterVolumeSpecName: "kube-api-access-mfzkj") pod "0effdbcf-dd7d-404d-9d48-77536d665a5d" (UID: "0effdbcf-dd7d-404d-9d48-77536d665a5d"). InnerVolumeSpecName "kube-api-access-mfzkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.044606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.044634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.044689 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h" (OuterVolumeSpecName: "kube-api-access-94l9h") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "kube-api-access-94l9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.045507 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.045662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd" (OuterVolumeSpecName: "kube-api-access-mjwtd") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "kube-api-access-mjwtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.045682 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key" (OuterVolumeSpecName: "signing-key") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "signing-key". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.045733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9" (OuterVolumeSpecName: "kube-api-access-ddlk9") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "kube-api-access-ddlk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.045870 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9" (OuterVolumeSpecName: "kube-api-access-9vsz9") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "kube-api-access-9vsz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046042 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043119 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config\") pod \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\" (UID: \"fc8db2c7-859d-47b3-a900-2bd0c0b2973b\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046109 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046114 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7cps\" (UniqueName: \"kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps\") pod \"af41de71-79cf-4590-bbe9-9e8b848862cb\" (UID: \"af41de71-79cf-4590-bbe9-9e8b848862cb\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046173 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046236 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config\") pod \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\" (UID: \"e1d2a42d-af1d-4054-9618-ab545e0ed8b7\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046272 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config\") pod \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\" (UID: \"a555ff2e-0be6-46d5-897d-863bb92ae2b3\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046367 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps" (OuterVolumeSpecName: "kube-api-access-d7cps") pod "af41de71-79cf-4590-bbe9-9e8b848862cb" (UID: "af41de71-79cf-4590-bbe9-9e8b848862cb"). InnerVolumeSpecName "kube-api-access-d7cps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.043172 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-kubelet\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046430 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-binary-copy\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046506 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-k8s-cni-cncf-io\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046527 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046381 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume" (OuterVolumeSpecName: "config-volume") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046360 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046600 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-conf-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046655 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.046840 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047009 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b" (OuterVolumeSpecName: "kube-api-access-pgx6b") pod "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" (UID: "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4"). InnerVolumeSpecName "kube-api-access-pgx6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047494 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz" (OuterVolumeSpecName: "kube-api-access-7jjkz") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "kube-api-access-7jjkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047703 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz" (OuterVolumeSpecName: "kube-api-access-grwfz") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "kube-api-access-grwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047784 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert" (OuterVolumeSpecName: "cert") pod "a52afe44-fb37-46ed-a1f8-bf39727a3cbe" (UID: "a52afe44-fb37-46ed-a1f8-bf39727a3cbe"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.047986 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048308 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates" (OuterVolumeSpecName: "available-featuregates") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "available-featuregates". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048437 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048495 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048527 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-multus\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048612 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/772f09fa-7db8-4626-a5ad-5c9779b8170d-rootfs\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048645 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-multus-certs\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048670 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048752 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78bd1260-3469-4a38-899e-5923bffe1b59-hosts-file\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048774 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klzfx\" (UniqueName: \"kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048823 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048850 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xz2\" (UniqueName: \"kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048877 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-cnibin\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-netns\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048925 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048946 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-bin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.048974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049006 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config" (OuterVolumeSpecName: "mcd-auth-proxy-config") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "mcd-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert" (OuterVolumeSpecName: "profile-collector-cert") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "profile-collector-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049239 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049321 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs95x\" (UniqueName: \"kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4ssz\" (UniqueName: \"kubernetes.io/projected/a5092e19-dcde-4527-bb59-cb6c408d4411-kube-api-access-h4ssz\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049427 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx" (OuterVolumeSpecName: "kube-api-access-l9stx") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "kube-api-access-l9stx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.049762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw" (OuterVolumeSpecName: "kube-api-access-9z4sw") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "kube-api-access-9z4sw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050195 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf" (OuterVolumeSpecName: "kube-api-access-ptkcf") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "kube-api-access-ptkcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050400 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050650 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config" (OuterVolumeSpecName: "config") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050690 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.050762 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-env-overrides\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.051364 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls" (OuterVolumeSpecName: "samples-operator-tls") pod "6ee8fbd3-1f81-4666-96da-5afc70819f1a" (UID: "6ee8fbd3-1f81-4666-96da-5afc70819f1a"). InnerVolumeSpecName "samples-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.051372 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts" (OuterVolumeSpecName: "kube-api-access-4g8ts") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "kube-api-access-4g8ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.051419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.051633 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.051929 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6" (OuterVolumeSpecName: "kube-api-access-pllx6") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "kube-api-access-pllx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052030 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052032 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9" (OuterVolumeSpecName: "kube-api-access-99zj9") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "kube-api-access-99zj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp" (OuterVolumeSpecName: "tmp") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052358 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh" (OuterVolumeSpecName: "kube-api-access-m5lgh") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "kube-api-access-m5lgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052455 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj" (OuterVolumeSpecName: "kube-api-access-qgrkj") pod "42a11a02-47e1-488f-b270-2679d3298b0e" (UID: "42a11a02-47e1-488f-b270-2679d3298b0e"). InnerVolumeSpecName "kube-api-access-qgrkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052614 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca" (OuterVolumeSpecName: "client-ca") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052898 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv" (OuterVolumeSpecName: "kube-api-access-dztfv") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "kube-api-access-dztfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.052966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities" (OuterVolumeSpecName: "utilities") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.053203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf" (OuterVolumeSpecName: "kube-api-access-q4smf") pod "0dd0fbac-8c0d-4228-8faa-abbeedabf7db" (UID: "0dd0fbac-8c0d-4228-8faa-abbeedabf7db"). InnerVolumeSpecName "kube-api-access-q4smf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.053290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config" (OuterVolumeSpecName: "config") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.053773 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities" (OuterVolumeSpecName: "utilities") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.053892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config" (OuterVolumeSpecName: "config") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.053977 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" (UID: "9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7" (OuterVolumeSpecName: "kube-api-access-tknt7") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "kube-api-access-tknt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054197 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054500 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-hostroot\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054558 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054558 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert" (OuterVolumeSpecName: "package-server-manager-serving-cert") pod "a208c9c2-333b-4b4a-be0d-bc32ec38a821" (UID: "a208c9c2-333b-4b4a-be0d-bc32ec38a821"). InnerVolumeSpecName "package-server-manager-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054728 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m" (OuterVolumeSpecName: "kube-api-access-4hb7m") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "kube-api-access-4hb7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.054998 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config" (OuterVolumeSpecName: "multus-daemon-config") pod "81e39f7b-62e4-4fc9-992a-6535ce127a02" (UID: "81e39f7b-62e4-4fc9-992a-6535ce127a02"). InnerVolumeSpecName "multus-daemon-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055122 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl" (OuterVolumeSpecName: "kube-api-access-26xrl") pod "a208c9c2-333b-4b4a-be0d-bc32ec38a821" (UID: "a208c9c2-333b-4b4a-be0d-bc32ec38a821"). InnerVolumeSpecName "kube-api-access-26xrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055171 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config" (OuterVolumeSpecName: "config") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055252 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca" (OuterVolumeSpecName: "serviceca") pod "5ebfebf6-3ecd-458e-943f-bb25b52e2718" (UID: "5ebfebf6-3ecd-458e-943f-bb25b52e2718"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055312 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055359 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055424 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78bd1260-3469-4a38-899e-5923bffe1b59-tmp-dir\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055458 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tjjz\" (UniqueName: \"kubernetes.io/projected/78bd1260-3469-4a38-899e-5923bffe1b59-kube-api-access-2tjjz\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055862 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtwtn\" (UniqueName: \"kubernetes.io/projected/d31a544e-cc56-4b4e-b639-91a00349a2da-kube-api-access-mtwtn\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055905 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055933 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt2j\" (UniqueName: \"kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055957 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/772f09fa-7db8-4626-a5ad-5c9779b8170d-proxy-tls\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055984 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgwk\" (UniqueName: \"kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056322 5030 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058517 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055322 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv" (OuterVolumeSpecName: "kube-api-access-pddnv") pod "e093be35-bb62-4843-b2e8-094545761610" (UID: "e093be35-bb62-4843-b2e8-094545761610"). InnerVolumeSpecName "kube-api-access-pddnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.055412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056139 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7" (OuterVolumeSpecName: "kube-api-access-hm9x7") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "kube-api-access-hm9x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056184 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs" (OuterVolumeSpecName: "webhook-certs") pod "0dd0fbac-8c0d-4228-8faa-abbeedabf7db" (UID: "0dd0fbac-8c0d-4228-8faa-abbeedabf7db"). InnerVolumeSpecName "webhook-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056227 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l" (OuterVolumeSpecName: "kube-api-access-sbc2l") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "kube-api-access-sbc2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056391 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert" (OuterVolumeSpecName: "srv-cert") pod "301e1965-1754-483d-b6cc-bfae7038bbca" (UID: "301e1965-1754-483d-b6cc-bfae7038bbca"). InnerVolumeSpecName "srv-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056529 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp" (OuterVolumeSpecName: "tmp") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056668 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk" (OuterVolumeSpecName: "kube-api-access-w94wk") pod "01080b46-74f1-4191-8755-5152a57b3b25" (UID: "01080b46-74f1-4191-8755-5152a57b3b25"). InnerVolumeSpecName "kube-api-access-w94wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056772 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057027 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config" (OuterVolumeSpecName: "config") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config" (OuterVolumeSpecName: "config") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057288 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token" (OuterVolumeSpecName: "node-bootstrap-token") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "node-bootstrap-token". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057481 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057530 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057539 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz" (OuterVolumeSpecName: "kube-api-access-ws8zz") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "kube-api-access-ws8zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057671 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "16bdd140-dce1-464c-ab47-dd5798d1d256" (UID: "16bdd140-dce1-464c-ab47-dd5798d1d256"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.056305 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp" (OuterVolumeSpecName: "tmp") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.057973 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058037 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs" (OuterVolumeSpecName: "kube-api-access-l87hs") pod "5ebfebf6-3ecd-458e-943f-bb25b52e2718" (UID: "5ebfebf6-3ecd-458e-943f-bb25b52e2718"). InnerVolumeSpecName "kube-api-access-l87hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058110 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca" (OuterVolumeSpecName: "etcd-ca") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "etcd-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058386 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058424 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config" (OuterVolumeSpecName: "config") pod "736c54fe-349c-4bb9-870a-d1c1d1c03831" (UID: "736c54fe-349c-4bb9-870a-d1c1d1c03831"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn" (OuterVolumeSpecName: "kube-api-access-xnxbn") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "kube-api-access-xnxbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058709 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert" (OuterVolumeSpecName: "apiservice-cert") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities" (OuterVolumeSpecName: "utilities") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058784 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr" (OuterVolumeSpecName: "kube-api-access-wj4qr") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "kube-api-access-wj4qr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058867 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t" (OuterVolumeSpecName: "kube-api-access-zth6t") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "kube-api-access-zth6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.058936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059008 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap" (OuterVolumeSpecName: "whereabouts-flatfile-configmap") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "whereabouts-flatfile-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059091 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7e8f42f-dc0e-424b-bb56-5ec849834888" (UID: "d7e8f42f-dc0e-424b-bb56-5ec849834888"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059170 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp" (OuterVolumeSpecName: "tmp") pod "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" (UID: "d45be74c-0d98-4d18-90e4-f7ef1b6daaf7"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059324 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp" (OuterVolumeSpecName: "tmp") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059439 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config" (OuterVolumeSpecName: "config") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059447 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert" (OuterVolumeSpecName: "ovn-control-plane-metrics-cert") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "ovn-control-plane-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059479 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-iptables-alerter-script\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059702 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2" (OuterVolumeSpecName: "kube-api-access-ks6v2") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "kube-api-access-ks6v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059795 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem" (OuterVolumeSpecName: "ca-trust-extracted-pem") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "ca-trust-extracted-pem". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy" (OuterVolumeSpecName: "cni-binary-copy") pod "869851b9-7ffb-4af0-b166-1d8aa40a5f80" (UID: "869851b9-7ffb-4af0-b166-1d8aa40a5f80"). InnerVolumeSpecName "cni-binary-copy". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.059953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config" (OuterVolumeSpecName: "console-config") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060102 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs" (OuterVolumeSpecName: "certs") pod "593a3561-7760-45c5-8f91-5aaef7475d0f" (UID: "593a3561-7760-45c5-8f91-5aaef7475d0f"). InnerVolumeSpecName "certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060132 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg" (OuterVolumeSpecName: "kube-api-access-hckvg") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "kube-api-access-hckvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060138 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060150 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c" (OuterVolumeSpecName: "kube-api-access-8nb9c") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "kube-api-access-8nb9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls" (OuterVolumeSpecName: "machine-approver-tls") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "machine-approver-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config" (OuterVolumeSpecName: "config") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060308 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images" (OuterVolumeSpecName: "images") pod "d565531a-ff86-4608-9d19-767de01ac31b" (UID: "d565531a-ff86-4608-9d19-767de01ac31b"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060321 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities" (OuterVolumeSpecName: "utilities") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls" (OuterVolumeSpecName: "image-registry-operator-tls") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "image-registry-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060311 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc" (OuterVolumeSpecName: "kube-api-access-zg8nc") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "kube-api-access-zg8nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" (UID: "7fcc6409-8a0f-44c3-89e7-5aecd7610f8a"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060370 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config" (OuterVolumeSpecName: "config") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060448 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw" (OuterVolumeSpecName: "kube-api-access-5lcfw") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "kube-api-access-5lcfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060545 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf" (OuterVolumeSpecName: "kube-api-access-nmmzf") pod "7df94c10-441d-4386-93a6-6730fb7bcde0" (UID: "7df94c10-441d-4386-93a6-6730fb7bcde0"). InnerVolumeSpecName "kube-api-access-nmmzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060801 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.060865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp" (OuterVolumeSpecName: "kube-api-access-8nspp") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "kube-api-access-8nspp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061131 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities" (OuterVolumeSpecName: "utilities") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "584e1f4a-8205-47d7-8efb-3afc6017c4c9" (UID: "584e1f4a-8205-47d7-8efb-3afc6017c4c9"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls" (OuterVolumeSpecName: "machine-api-operator-tls") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "machine-api-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061364 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e1d2a42d-af1d-4054-9618-ab545e0ed8b7" (UID: "e1d2a42d-af1d-4054-9618-ab545e0ed8b7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061431 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061438 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate" (OuterVolumeSpecName: "default-certificate") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "default-certificate". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061654 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061868 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061900 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config" (OuterVolumeSpecName: "config") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061896 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6" (OuterVolumeSpecName: "kube-api-access-ftwb6") pod "9f71a554-e414-4bc3-96d2-674060397afe" (UID: "9f71a554-e414-4bc3-96d2-674060397afe"). InnerVolumeSpecName "kube-api-access-ftwb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061950 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config" (OuterVolumeSpecName: "auth-proxy-config") pod "fc8db2c7-859d-47b3-a900-2bd0c0b2973b" (UID: "fc8db2c7-859d-47b3-a900-2bd0c0b2973b"). InnerVolumeSpecName "auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.061949 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities" (OuterVolumeSpecName: "utilities") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062095 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062141 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" (UID: "dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062154 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "567683bd-0efc-4f21-b076-e28559628404" (UID: "567683bd-0efc-4f21-b076-e28559628404"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062166 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr" (OuterVolumeSpecName: "kube-api-access-6g4lr") pod "f7e2c886-118e-43bb-bef1-c78134de392b" (UID: "f7e2c886-118e-43bb-bef1-c78134de392b"). InnerVolumeSpecName "kube-api-access-6g4lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd" (OuterVolumeSpecName: "kube-api-access-8pskd") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "kube-api-access-8pskd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062253 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062265 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk" (OuterVolumeSpecName: "kube-api-access-qqbfk") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "kube-api-access-qqbfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config" (OuterVolumeSpecName: "config") pod "7599e0b6-bddf-4def-b7f2-0b32206e8651" (UID: "7599e0b6-bddf-4def-b7f2-0b32206e8651"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062496 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls" (OuterVolumeSpecName: "control-plane-machine-set-operator-tls") pod "42a11a02-47e1-488f-b270-2679d3298b0e" (UID: "42a11a02-47e1-488f-b270-2679d3298b0e"). InnerVolumeSpecName "control-plane-machine-set-operator-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062485 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle" (OuterVolumeSpecName: "service-ca-bundle") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" (UID: "f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.062967 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities" (OuterVolumeSpecName: "utilities") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063068 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6" (OuterVolumeSpecName: "kube-api-access-tkdh6") pod "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" (UID: "20ce4d18-fe25-4696-ad7c-1bd2d6200a3e"). InnerVolumeSpecName "kube-api-access-tkdh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063764 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063806 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpbz\" (UniqueName: \"kubernetes.io/projected/772f09fa-7db8-4626-a5ad-5c9779b8170d-kube-api-access-skpbz\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063831 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-os-release\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063871 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31a544e-cc56-4b4e-b639-91a00349a2da-host\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.063889 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.063895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.063944 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.063968 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.563952817 +0000 UTC m=+88.963265364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.064001 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.56398664 +0000 UTC m=+88.963299187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.064188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp" (OuterVolumeSpecName: "tmp") pod "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" (UID: "b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.064301 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f65c0ac1-8bca-454d-a2e6-e35cb418beac" (UID: "f65c0ac1-8bca-454d-a2e6-e35cb418beac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.064659 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.564641766 +0000 UTC m=+88.963954313 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.065085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.065195 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/fc4541ce-7789-4670-bc75-5c2868e52ce0-ovnkube-identity-cm\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.066274 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc4541ce-7789-4670-bc75-5c2868e52ce0-webhook-cert\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.066785 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.066921 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "7afa918d-be67-40a6-803c-d3b0ae99d815" (UID: "7afa918d-be67-40a6-803c-d3b0ae99d815"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072583 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qb8t\" (UniqueName: \"kubernetes.io/projected/9c20ed32-4ad5-4984-9876-39b7b1ee1877-kube-api-access-4qb8t\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072617 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072685 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31a544e-cc56-4b4e-b639-91a00349a2da-serviceca\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072699 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072761 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-os-release\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/772f09fa-7db8-4626-a5ad-5c9779b8170d-mcd-auth-proxy-config\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072812 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cnibin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072826 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-daemon-config\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072909 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072928 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072944 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-system-cni-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072972 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-system-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.072992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073114 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-socket-dir-parent\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073205 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-etc-kubernetes\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073271 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnmd\" (UniqueName: \"kubernetes.io/projected/713054df-4196-45ae-8e8e-b3f526c510e9-kube-api-access-vtnmd\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cni-binary-copy\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073576 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwfz\" (UniqueName: \"kubernetes.io/projected/31fa8943-81cc-4750-a0b7-0fa9ab5af883-kube-api-access-grwfz\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073594 5030 reconciler_common.go:299] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-encryption-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073604 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4qr\" (UniqueName: \"kubernetes.io/projected/149b3c48-e17c-4a66-a835-d86dabf6ff13-kube-api-access-wj4qr\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073652 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a555ff2e-0be6-46d5-897d-863bb92ae2b3-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073662 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddlk9\" (UniqueName: \"kubernetes.io/projected/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-kube-api-access-ddlk9\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073670 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vsz9\" (UniqueName: \"kubernetes.io/projected/c491984c-7d4b-44aa-8c1e-d7974424fa47-kube-api-access-9vsz9\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073678 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073685 5030 reconciler_common.go:299] "Volume detached for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6ee8fbd3-1f81-4666-96da-5afc70819f1a-samples-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073692 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d565531a-ff86-4608-9d19-767de01ac31b-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073720 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073728 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjkz\" (UniqueName: \"kubernetes.io/projected/301e1965-1754-483d-b6cc-bfae7038bbca-kube-api-access-7jjkz\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073735 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073744 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks6v2\" (UniqueName: \"kubernetes.io/projected/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-kube-api-access-ks6v2\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073752 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073759 5030 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073766 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073773 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073800 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073809 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073816 5030 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92dfbade-90b6-4169-8c07-72cff7f2c82b-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073824 5030 reconciler_common.go:299] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073832 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99zj9\" (UniqueName: \"kubernetes.io/projected/d565531a-ff86-4608-9d19-767de01ac31b-kube-api-access-99zj9\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073840 5030 reconciler_common.go:299] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073847 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7e8f42f-dc0e-424b-bb56-5ec849834888-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073854 5030 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073880 5030 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-webhook-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073888 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01080b46-74f1-4191-8755-5152a57b3b25-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073895 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073904 5030 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073911 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073919 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073926 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073952 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsb9b\" (UniqueName: \"kubernetes.io/projected/09cfa50b-4138-4585-a53e-64dd3ab73335-kube-api-access-zsb9b\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073961 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073968 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/c5f2bfad-70f6-4185-a3d9-81ce12720767-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073976 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073984 5030 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.073992 5030 reconciler_common.go:299] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074000 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgx6b\" (UniqueName: \"kubernetes.io/projected/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-kube-api-access-pgx6b\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074007 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-metrics-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f7e2c886-118e-43bb-bef1-c78134de392b" (UID: "f7e2c886-118e-43bb-bef1-c78134de392b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074032 5030 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074041 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f80adb-c1c3-49ba-8ee4-932c851d3897-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074049 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074056 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2325ffef-9d5b-447f-b00e-3efc429acefe-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074064 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l87hs\" (UniqueName: \"kubernetes.io/projected/5ebfebf6-3ecd-458e-943f-bb25b52e2718-kube-api-access-l87hs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074071 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074079 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7599e0b6-bddf-4def-b7f2-0b32206e8651-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074088 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/736c54fe-349c-4bb9-870a-d1c1d1c03831-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074114 5030 reconciler_common.go:299] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.074615 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075103 5030 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-ca-trust-extracted-pem\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075124 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6077b63e-53a2-4f96-9d56-1ce0324e4913" (UID: "6077b63e-53a2-4f96-9d56-1ce0324e4913"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075122 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4-metrics-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075363 5030 reconciler_common.go:299] "Volume detached for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/42a11a02-47e1-488f-b270-2679d3298b0e-control-plane-machine-set-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075376 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075407 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075418 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92dfbade-90b6-4169-8c07-72cff7f2c82b-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075429 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075438 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9stx\" (UniqueName: \"kubernetes.io/projected/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-kube-api-access-l9stx\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075449 5030 reconciler_common.go:299] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-srv-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075459 5030 reconciler_common.go:299] "Volume detached for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c491984c-7d4b-44aa-8c1e-d7974424fa47-machine-api-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075467 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/567683bd-0efc-4f21-b076-e28559628404-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075475 5030 reconciler_common.go:299] "Volume detached for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-whereabouts-flatfile-configmap\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075485 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7e8f42f-dc0e-424b-bb56-5ec849834888-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075494 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7afa918d-be67-40a6-803c-d3b0ae99d815-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075502 5030 reconciler_common.go:299] "Volume detached for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-default-certificate\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075510 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075519 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26xrl\" (UniqueName: \"kubernetes.io/projected/a208c9c2-333b-4b4a-be0d-bc32ec38a821-kube-api-access-26xrl\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075527 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075535 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws8zz\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-kube-api-access-ws8zz\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075544 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dztfv\" (UniqueName: \"kubernetes.io/projected/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-kube-api-access-dztfv\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075567 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/d7e8f42f-dc0e-424b-bb56-5ec849834888-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075576 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/567683bd-0efc-4f21-b076-e28559628404-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075584 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pllx6\" (UniqueName: \"kubernetes.io/projected/81e39f7b-62e4-4fc9-992a-6535ce127a02-kube-api-access-pllx6\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075598 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075606 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075614 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/f65c0ac1-8bca-454d-a2e6-e35cb418beac-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075634 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptkcf\" (UniqueName: \"kubernetes.io/projected/7599e0b6-bddf-4def-b7f2-0b32206e8651-kube-api-access-ptkcf\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075644 5030 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/301e1965-1754-483d-b6cc-bfae7038bbca-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075652 5030 reconciler_common.go:299] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-images\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075661 5030 reconciler_common.go:299] "Volume detached for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/16bdd140-dce1-464c-ab47-dd5798d1d256-available-featuregates\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075669 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075677 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5lgh\" (UniqueName: \"kubernetes.io/projected/d19cb085-0c5b-4810-b654-ce7923221d90-kube-api-access-m5lgh\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075685 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g8ts\" (UniqueName: \"kubernetes.io/projected/92dfbade-90b6-4169-8c07-72cff7f2c82b-kube-api-access-4g8ts\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075693 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm9x7\" (UniqueName: \"kubernetes.io/projected/f559dfa3-3917-43a2-97f6-61ddfda10e93-kube-api-access-hm9x7\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075703 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7df94c10-441d-4386-93a6-6730fb7bcde0-ovn-control-plane-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075712 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnxbn\" (UniqueName: \"kubernetes.io/projected/ce090a97-9ab6-4c40-a719-64ff2acd9778-kube-api-access-xnxbn\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075721 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7afa918d-be67-40a6-803c-d3b0ae99d815-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075728 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075736 5030 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075744 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hckvg\" (UniqueName: \"kubernetes.io/projected/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-kube-api-access-hckvg\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075751 5030 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5ebfebf6-3ecd-458e-943f-bb25b52e2718-serviceca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075759 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pskd\" (UniqueName: \"kubernetes.io/projected/a555ff2e-0be6-46d5-897d-863bb92ae2b3-kube-api-access-8pskd\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075768 5030 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075777 5030 reconciler_common.go:299] "Volume detached for volume \"certs\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075785 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg8nc\" (UniqueName: \"kubernetes.io/projected/2325ffef-9d5b-447f-b00e-3efc429acefe-kube-api-access-zg8nc\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075794 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075793 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34177974-8d82-49d2-a763-391d0df3bbd8-metrics-tls\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075802 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7599e0b6-bddf-4def-b7f2-0b32206e8651-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075847 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hb7m\" (UniqueName: \"kubernetes.io/projected/94a6e063-3d1a-4d44-875d-185291448c31-kube-api-access-4hb7m\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075858 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pddnv\" (UniqueName: \"kubernetes.io/projected/e093be35-bb62-4843-b2e8-094545761610-kube-api-access-pddnv\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075867 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmzf\" (UniqueName: \"kubernetes.io/projected/7df94c10-441d-4386-93a6-6730fb7bcde0-kube-api-access-nmmzf\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075878 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkdh6\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-kube-api-access-tkdh6\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075887 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afa918d-be67-40a6-803c-d3b0ae99d815-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075897 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lcfw\" (UniqueName: \"kubernetes.io/projected/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-kube-api-access-5lcfw\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075905 5030 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075914 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqbfk\" (UniqueName: \"kubernetes.io/projected/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-kube-api-access-qqbfk\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075922 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6077b63e-53a2-4f96-9d56-1ce0324e4913-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075931 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7df94c10-441d-4386-93a6-6730fb7bcde0-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075941 5030 reconciler_common.go:299] "Volume detached for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/a208c9c2-333b-4b4a-be0d-bc32ec38a821-package-server-manager-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075952 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w94wk\" (UniqueName: \"kubernetes.io/projected/01080b46-74f1-4191-8755-5152a57b3b25-kube-api-access-w94wk\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075961 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075970 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075979 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f65c0ac1-8bca-454d-a2e6-e35cb418beac-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075986 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g4lr\" (UniqueName: \"kubernetes.io/projected/f7e2c886-118e-43bb-bef1-c78134de392b-kube-api-access-6g4lr\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.075994 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076003 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zth6t\" (UniqueName: \"kubernetes.io/projected/6077b63e-53a2-4f96-9d56-1ce0324e4913-kube-api-access-zth6t\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076012 5030 reconciler_common.go:299] "Volume detached for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/301e1965-1754-483d-b6cc-bfae7038bbca-srv-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076020 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076028 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076036 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076044 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076052 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f71a554-e414-4bc3-96d2-674060397afe-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076061 5030 reconciler_common.go:299] "Volume detached for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-webhook-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076069 5030 reconciler_common.go:299] "Volume detached for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-image-registry-operator-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076078 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a555ff2e-0be6-46d5-897d-863bb92ae2b3-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076087 5030 reconciler_common.go:299] "Volume detached for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/593a3561-7760-45c5-8f91-5aaef7475d0f-node-bootstrap-token\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076096 5030 reconciler_common.go:299] "Volume detached for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-multus-daemon-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076105 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076113 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/584e1f4a-8205-47d7-8efb-3afc6017c4c9-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076123 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftwb6\" (UniqueName: \"kubernetes.io/projected/9f71a554-e414-4bc3-96d2-674060397afe-kube-api-access-ftwb6\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076133 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tknt7\" (UniqueName: \"kubernetes.io/projected/584e1f4a-8205-47d7-8efb-3afc6017c4c9-kube-api-access-tknt7\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076141 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076148 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076156 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076166 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/16bdd140-dce1-464c-ab47-dd5798d1d256-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076175 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbc2l\" (UniqueName: \"kubernetes.io/projected/593a3561-7760-45c5-8f91-5aaef7475d0f-kube-api-access-sbc2l\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076183 5030 reconciler_common.go:299] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-encryption-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076191 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076199 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f65c0ac1-8bca-454d-a2e6-e35cb418beac-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076207 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/7afa918d-be67-40a6-803c-d3b0ae99d815-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076215 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nspp\" (UniqueName: \"kubernetes.io/projected/a7a88189-c967-4640-879e-27665747f20c-kube-api-access-8nspp\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076224 5030 reconciler_common.go:299] "Volume detached for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a-profile-collector-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076232 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076239 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7cps\" (UniqueName: \"kubernetes.io/projected/af41de71-79cf-4590-bbe9-9e8b848862cb-kube-api-access-d7cps\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076248 5030 reconciler_common.go:299] "Volume detached for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-mcd-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076257 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076265 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076274 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cc85e424-18b2-4924-920b-bd291a8c4b01-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076301 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5rsr\" (UniqueName: \"kubernetes.io/projected/af33e427-6803-48c2-a76a-dd9deb7cbf9a-kube-api-access-z5rsr\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076310 5030 reconciler_common.go:299] "Volume detached for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/fc8db2c7-859d-47b3-a900-2bd0c0b2973b-machine-approver-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076318 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzt4w\" (UniqueName: \"kubernetes.io/projected/a52afe44-fb37-46ed-a1f8-bf39727a3cbe-kube-api-access-rzt4w\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076329 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076337 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736c54fe-349c-4bb9-870a-d1c1d1c03831-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076345 5030 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/869851b9-7ffb-4af0-b166-1d8aa40a5f80-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076353 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/567683bd-0efc-4f21-b076-e28559628404-etcd-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076361 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrkj\" (UniqueName: \"kubernetes.io/projected/42a11a02-47e1-488f-b270-2679d3298b0e-kube-api-access-qgrkj\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076370 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9-service-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076379 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z4sw\" (UniqueName: \"kubernetes.io/projected/e1d2a42d-af1d-4054-9618-ab545e0ed8b7-kube-api-access-9z4sw\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076388 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4smf\" (UniqueName: \"kubernetes.io/projected/0dd0fbac-8c0d-4228-8faa-abbeedabf7db-kube-api-access-q4smf\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076396 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjwtd\" (UniqueName: \"kubernetes.io/projected/869851b9-7ffb-4af0-b166-1d8aa40a5f80-kube-api-access-mjwtd\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076405 5030 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e9b5059-1b3e-4067-a63d-2952cbe863af-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076412 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736c54fe-349c-4bb9-870a-d1c1d1c03831-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076421 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmhf\" (UniqueName: \"kubernetes.io/projected/736c54fe-349c-4bb9-870a-d1c1d1c03831-kube-api-access-6dmhf\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076430 5030 reconciler_common.go:299] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076438 5030 reconciler_common.go:299] "Volume detached for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-key\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076446 5030 reconciler_common.go:299] "Volume detached for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81e39f7b-62e4-4fc9-992a-6535ce127a02-cni-binary-copy\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076454 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076463 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxfcv\" (UniqueName: \"kubernetes.io/projected/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff-kube-api-access-xxfcv\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076462 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076471 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfzkj\" (UniqueName: \"kubernetes.io/projected/0effdbcf-dd7d-404d-9d48-77536d665a5d-kube-api-access-mfzkj\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076500 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f71a554-e414-4bc3-96d2-674060397afe-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076513 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nb9c\" (UniqueName: \"kubernetes.io/projected/6edfcf45-925b-4eff-b940-95b6fc0b85d4-kube-api-access-8nb9c\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076522 5030 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076532 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94l9h\" (UniqueName: \"kubernetes.io/projected/16bdd140-dce1-464c-ab47-dd5798d1d256-kube-api-access-94l9h\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076542 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01080b46-74f1-4191-8755-5152a57b3b25-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076567 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26jq\" (UniqueName: \"kubernetes.io/projected/567683bd-0efc-4f21-b076-e28559628404-kube-api-access-m26jq\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076576 5030 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a7a88189-c967-4640-879e-27665747f20c-apiservice-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076584 5030 reconciler_common.go:299] "Volume detached for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/d565531a-ff86-4608-9d19-767de01ac31b-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076592 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f65c0ac1-8bca-454d-a2e6-e35cb418beac-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xz2\" (UniqueName: \"kubernetes.io/projected/34177974-8d82-49d2-a763-391d0df3bbd8-kube-api-access-m7xz2\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.076851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl" (OuterVolumeSpecName: "kube-api-access-twvbl") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "kube-api-access-twvbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.077097 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt2j\" (UniqueName: \"kubernetes.io/projected/fc4541ce-7789-4670-bc75-5c2868e52ce0-kube-api-access-8nt2j\") pod \"network-node-identity-dgvkt\" (UID: \"fc4541ce-7789-4670-bc75-5c2868e52ce0\") " pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.081283 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" (UID: "71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.082057 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgwk\" (UniqueName: \"kubernetes.io/projected/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-kube-api-access-dsgwk\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.082153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config" (OuterVolumeSpecName: "config") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.082729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.082813 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "09cfa50b-4138-4585-a53e-64dd3ab73335" (UID: "09cfa50b-4138-4585-a53e-64dd3ab73335"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083349 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083388 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s" (OuterVolumeSpecName: "kube-api-access-xfp5s") pod "cc85e424-18b2-4924-920b-bd291a8c4b01" (UID: "cc85e424-18b2-4924-920b-bd291a8c4b01"). InnerVolumeSpecName "kube-api-access-xfp5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083720 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" (UID: "6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083754 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "2325ffef-9d5b-447f-b00e-3efc429acefe" (UID: "2325ffef-9d5b-447f-b00e-3efc429acefe"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083804 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls" (OuterVolumeSpecName: "metrics-tls") pod "92dfbade-90b6-4169-8c07-72cff7f2c82b" (UID: "92dfbade-90b6-4169-8c07-72cff7f2c82b"). InnerVolumeSpecName "metrics-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083854 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083864 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083877 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083881 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083894 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.083895 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083902 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.083863 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth" (OuterVolumeSpecName: "stats-auth") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "stats-auth". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.084045 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.583945953 +0000 UTC m=+88.983258500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.084074 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.584057703 +0000 UTC m=+88.983370260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084135 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities" (OuterVolumeSpecName: "utilities") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084195 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg" (OuterVolumeSpecName: "kube-api-access-wbmqg") pod "18f80adb-c1c3-49ba-8ee4-932c851d3897" (UID: "18f80adb-c1c3-49ba-8ee4-932c851d3897"). InnerVolumeSpecName "kube-api-access-wbmqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084291 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq" (OuterVolumeSpecName: "kube-api-access-d4tqq") pod "6ee8fbd3-1f81-4666-96da-5afc70819f1a" (UID: "6ee8fbd3-1f81-4666-96da-5afc70819f1a"). InnerVolumeSpecName "kube-api-access-d4tqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084414 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv" (OuterVolumeSpecName: "kube-api-access-6rmnv") pod "b605f283-6f2e-42da-a838-54421690f7d0" (UID: "b605f283-6f2e-42da-a838-54421690f7d0"). InnerVolumeSpecName "kube-api-access-6rmnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084457 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "af33e427-6803-48c2-a76a-dd9deb7cbf9a" (UID: "af33e427-6803-48c2-a76a-dd9deb7cbf9a"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084477 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca" (OuterVolumeSpecName: "client-ca") pod "a555ff2e-0be6-46d5-897d-863bb92ae2b3" (UID: "a555ff2e-0be6-46d5-897d-863bb92ae2b3"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084659 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084650 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config" (OuterVolumeSpecName: "mcc-auth-proxy-config") pod "b4750666-1362-4001-abd0-6f89964cc621" (UID: "b4750666-1362-4001-abd0-6f89964cc621"). InnerVolumeSpecName "mcc-auth-proxy-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084804 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.084825 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle" (OuterVolumeSpecName: "signing-cabundle") pod "ce090a97-9ab6-4c40-a719-64ff2acd9778" (UID: "ce090a97-9ab6-4c40-a719-64ff2acd9778"). InnerVolumeSpecName "signing-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085032 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs" (OuterVolumeSpecName: "tmpfs") pod "a7a88189-c967-4640-879e-27665747f20c" (UID: "a7a88189-c967-4640-879e-27665747f20c"). InnerVolumeSpecName "tmpfs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085114 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085945 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.085968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images" (OuterVolumeSpecName: "images") pod "c491984c-7d4b-44aa-8c1e-d7974424fa47" (UID: "c491984c-7d4b-44aa-8c1e-d7974424fa47"). InnerVolumeSpecName "images". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config" (OuterVolumeSpecName: "config") pod "c5f2bfad-70f6-4185-a3d9-81ce12720767" (UID: "c5f2bfad-70f6-4185-a3d9-81ce12720767"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "6edfcf45-925b-4eff-b940-95b6fc0b85d4" (UID: "6edfcf45-925b-4eff-b940-95b6fc0b85d4"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086260 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086338 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit" (OuterVolumeSpecName: "audit") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "audit". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086798 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f559dfa3-3917-43a2-97f6-61ddfda10e93" (UID: "f559dfa3-3917-43a2-97f6-61ddfda10e93"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086978 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config" (OuterVolumeSpecName: "config") pod "d19cb085-0c5b-4810-b654-ce7923221d90" (UID: "d19cb085-0c5b-4810-b654-ce7923221d90"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.086981 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.088484 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "149b3c48-e17c-4a66-a835-d86dabf6ff13" (UID: "149b3c48-e17c-4a66-a835-d86dabf6ff13"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.090962 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.091965 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "31fa8943-81cc-4750-a0b7-0fa9ab5af883" (UID: "31fa8943-81cc-4750-a0b7-0fa9ab5af883"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.092690 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.092714 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.092724 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.092736 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.092745 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.095661 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.102421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "94a6e063-3d1a-4d44-875d-185291448c31" (UID: "94a6e063-3d1a-4d44-875d-185291448c31"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.109740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-system-cni-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177335 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-system-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177370 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177388 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-socket-dir-parent\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-etc-kubernetes\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177433 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnmd\" (UniqueName: \"kubernetes.io/projected/713054df-4196-45ae-8e8e-b3f526c510e9-kube-api-access-vtnmd\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cni-binary-copy\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177466 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-kubelet\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177482 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177523 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177614 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-socket-dir-parent\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177671 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-etc-kubernetes\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177672 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-kubelet\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177672 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177716 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-system-cni-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177731 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-binary-copy\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-system-cni-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.177320 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cni-binary-copy\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178216 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178461 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-k8s-cni-cncf-io\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178497 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-conf-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-conf-dir\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178582 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-k8s-cni-cncf-io\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178633 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178670 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-multus\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-etc-kube\" (UniqueName: \"kubernetes.io/host-path/34177974-8d82-49d2-a763-391d0df3bbd8-host-etc-kube\") pod \"network-operator-7bdcf4f5bd-7fjxv\" (UID: \"34177974-8d82-49d2-a763-391d0df3bbd8\") " pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178703 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/772f09fa-7db8-4626-a5ad-5c9779b8170d-rootfs\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178745 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-multus-certs\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178777 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-multus\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179014 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-multus-certs\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.178867 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179038 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/772f09fa-7db8-4626-a5ad-5c9779b8170d-rootfs\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.178950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.179102 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:24.679092911 +0000 UTC m=+89.078405459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179118 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78bd1260-3469-4a38-899e-5923bffe1b59-hosts-file\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179249 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78bd1260-3469-4a38-899e-5923bffe1b59-hosts-file\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-binary-copy\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179277 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179294 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klzfx\" (UniqueName: \"kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179311 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-cnibin\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179326 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-netns\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-bin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179409 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179434 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-run-netns\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179448 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-cnibin\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179498 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-host-var-lib-cni-bin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179635 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5092e19-dcde-4527-bb59-cb6c408d4411-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179867 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179889 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179939 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179964 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs95x\" (UniqueName: \"kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179984 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4ssz\" (UniqueName: \"kubernetes.io/projected/a5092e19-dcde-4527-bb59-cb6c408d4411-kube-api-access-h4ssz\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.179997 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-hostroot\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180078 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-hostroot\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180187 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180207 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78bd1260-3469-4a38-899e-5923bffe1b59-tmp-dir\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjjz\" (UniqueName: \"kubernetes.io/projected/78bd1260-3469-4a38-899e-5923bffe1b59-kube-api-access-2tjjz\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180264 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180290 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180304 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180321 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtwtn\" (UniqueName: \"kubernetes.io/projected/d31a544e-cc56-4b4e-b639-91a00349a2da-kube-api-access-mtwtn\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/772f09fa-7db8-4626-a5ad-5c9779b8170d-proxy-tls\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180386 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skpbz\" (UniqueName: \"kubernetes.io/projected/772f09fa-7db8-4626-a5ad-5c9779b8170d-kube-api-access-skpbz\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180399 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-os-release\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180411 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31a544e-cc56-4b4e-b639-91a00349a2da-host\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180437 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qb8t\" (UniqueName: \"kubernetes.io/projected/9c20ed32-4ad5-4984-9876-39b7b1ee1877-kube-api-access-4qb8t\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180465 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180479 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31a544e-cc56-4b4e-b639-91a00349a2da-serviceca\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180493 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180507 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-os-release\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180521 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/772f09fa-7db8-4626-a5ad-5c9779b8170d-mcd-auth-proxy-config\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cnibin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180564 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-daemon-config\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180580 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180593 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180652 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31a544e-cc56-4b4e-b639-91a00349a2da-host\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180700 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180784 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180922 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.180948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181191 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c20ed32-4ad5-4984-9876-39b7b1ee1877-multus-daemon-config\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/772f09fa-7db8-4626-a5ad-5c9779b8170d-mcd-auth-proxy-config\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181228 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181246 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428b39f5-eb1c-4f65-b7a4-eeb6e84860cc-host-slash\") pod \"iptables-alerter-5jnd7\" (UID: \"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\") " pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181268 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181268 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181477 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78bd1260-3469-4a38-899e-5923bffe1b59-tmp-dir\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181746 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-cnibin\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181787 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c20ed32-4ad5-4984-9876-39b7b1ee1877-os-release\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.181815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5092e19-dcde-4527-bb59-cb6c408d4411-os-release\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.182296 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31a544e-cc56-4b4e-b639-91a00349a2da-serviceca\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183580 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183609 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfp5s\" (UniqueName: \"kubernetes.io/projected/cc85e424-18b2-4924-920b-bd291a8c4b01-kube-api-access-xfp5s\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183629 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183639 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183649 5030 reconciler_common.go:299] "Volume detached for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/18f80adb-c1c3-49ba-8ee4-932c851d3897-stats-auth\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183657 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183666 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e9b5059-1b3e-4067-a63d-2952cbe863af-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183675 5030 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-console-oauth-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183683 5030 reconciler_common.go:299] "Volume detached for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c491984c-7d4b-44aa-8c1e-d7974424fa47-images\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183691 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09cfa50b-4138-4585-a53e-64dd3ab73335-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183701 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e2c886-118e-43bb-bef1-c78134de392b-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183708 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f2bfad-70f6-4185-a3d9-81ce12720767-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183715 5030 reconciler_common.go:299] "Volume detached for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/a7a88189-c967-4640-879e-27665747f20c-tmpfs\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183725 5030 reconciler_common.go:299] "Volume detached for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/b4750666-1362-4001-abd0-6f89964cc621-mcc-auth-proxy-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183734 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d19cb085-0c5b-4810-b654-ce7923221d90-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183741 5030 reconciler_common.go:299] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-image-import-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183748 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183756 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4tqq\" (UniqueName: \"kubernetes.io/projected/6ee8fbd3-1f81-4666-96da-5afc70819f1a-kube-api-access-d4tqq\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183764 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183773 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f559dfa3-3917-43a2-97f6-61ddfda10e93-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183782 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b4750666-1362-4001-abd0-6f89964cc621-proxy-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183789 5030 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183797 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183805 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbmqg\" (UniqueName: \"kubernetes.io/projected/18f80adb-c1c3-49ba-8ee4-932c851d3897-kube-api-access-wbmqg\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183815 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/31fa8943-81cc-4750-a0b7-0fa9ab5af883-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183822 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09cfa50b-4138-4585-a53e-64dd3ab73335-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183830 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6077b63e-53a2-4f96-9d56-1ce0324e4913-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183837 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/a555ff2e-0be6-46d5-897d-863bb92ae2b3-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183844 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183852 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rmnv\" (UniqueName: \"kubernetes.io/projected/b605f283-6f2e-42da-a838-54421690f7d0-kube-api-access-6rmnv\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183859 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/f559dfa3-3917-43a2-97f6-61ddfda10e93-etcd-client\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183866 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5f2bfad-70f6-4185-a3d9-81ce12720767-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183874 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2325ffef-9d5b-447f-b00e-3efc429acefe-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183882 5030 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e9b5059-1b3e-4067-a63d-2952cbe863af-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183890 5030 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e9b5059-1b3e-4067-a63d-2952cbe863af-registry-certificates\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183897 5030 reconciler_common.go:299] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-audit\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183904 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/149b3c48-e17c-4a66-a835-d86dabf6ff13-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183913 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f2bfad-70f6-4185-a3d9-81ce12720767-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183921 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b605f283-6f2e-42da-a838-54421690f7d0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183928 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twvbl\" (UniqueName: \"kubernetes.io/projected/b4750666-1362-4001-abd0-6f89964cc621-kube-api-access-twvbl\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183937 5030 reconciler_common.go:299] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d19cb085-0c5b-4810-b654-ce7923221d90-etcd-serving-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183944 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/6edfcf45-925b-4eff-b940-95b6fc0b85d4-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183952 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/94a6e063-3d1a-4d44-875d-185291448c31-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183962 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92dfbade-90b6-4169-8c07-72cff7f2c82b-metrics-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183969 5030 reconciler_common.go:299] "Volume detached for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce090a97-9ab6-4c40-a719-64ff2acd9778-signing-cabundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183977 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/af33e427-6803-48c2-a76a-dd9deb7cbf9a-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.183998 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.185448 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/772f09fa-7db8-4626-a5ad-5c9779b8170d-proxy-tls\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.192022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnmd\" (UniqueName: \"kubernetes.io/projected/713054df-4196-45ae-8e8e-b3f526c510e9-kube-api-access-vtnmd\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.195492 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.195581 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.195660 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.195717 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.195766 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.196737 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4ssz\" (UniqueName: \"kubernetes.io/projected/a5092e19-dcde-4527-bb59-cb6c408d4411-kube-api-access-h4ssz\") pod \"multus-additional-cni-plugins-9fvrp\" (UID: \"a5092e19-dcde-4527-bb59-cb6c408d4411\") " pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.197247 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpbz\" (UniqueName: \"kubernetes.io/projected/772f09fa-7db8-4626-a5ad-5c9779b8170d-kube-api-access-skpbz\") pod \"machine-config-daemon-b7rgl\" (UID: \"772f09fa-7db8-4626-a5ad-5c9779b8170d\") " pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.197385 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjjz\" (UniqueName: \"kubernetes.io/projected/78bd1260-3469-4a38-899e-5923bffe1b59-kube-api-access-2tjjz\") pod \"node-resolver-952wf\" (UID: \"78bd1260-3469-4a38-899e-5923bffe1b59\") " pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.197478 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs95x\" (UniqueName: \"kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x\") pod \"ovnkube-node-s9mkc\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.197923 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klzfx\" (UniqueName: \"kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx\") pod \"ovnkube-control-plane-57b78d8988-8ch6c\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.198961 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtwtn\" (UniqueName: \"kubernetes.io/projected/d31a544e-cc56-4b4e-b639-91a00349a2da-kube-api-access-mtwtn\") pod \"node-ca-98dmx\" (UID: \"d31a544e-cc56-4b4e-b639-91a00349a2da\") " pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.199122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qb8t\" (UniqueName: \"kubernetes.io/projected/9c20ed32-4ad5-4984-9876-39b7b1ee1877-kube-api-access-4qb8t\") pod \"multus-wfwbx\" (UID: \"9c20ed32-4ad5-4984-9876-39b7b1ee1877\") " pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.240976 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.247056 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-dgvkt" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.251695 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5jnd7" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.253983 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:network-operator,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:24 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ -f /etc/kubernetes/apiserver-url.env ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: source /etc/kubernetes/apiserver-url.env Mar 16 13:07:24 crc kubenswrapper[5030]: else Mar 16 13:07:24 crc kubenswrapper[5030]: echo "Error: /etc/kubernetes/apiserver-url.env is missing" Mar 16 13:07:24 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: exec /usr/bin/cluster-network-operator start --listen=0.0.0.0:9104 Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:cno,HostPort:9104,ContainerPort:9104,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:RELEASE_VERSION,Value:4.20.1,ValueFrom:nil,},EnvVar{Name:KUBE_PROXY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:951276a60f15185a05902cf1ec49b6db3e4f049ec638828b336aed496f8dfc45,ValueFrom:nil,},EnvVar{Name:KUBE_RBAC_PROXY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,ValueFrom:nil,},EnvVar{Name:MULTUS_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05,ValueFrom:nil,},EnvVar{Name:MULTUS_ADMISSION_CONTROLLER_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b5000f8f055fd8f734ef74afbd9bd5333a38345cbc4959ddaad728b8394bccd4,ValueFrom:nil,},EnvVar{Name:CNI_PLUGINS_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d,ValueFrom:nil,},EnvVar{Name:BOND_CNI_PLUGIN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782,ValueFrom:nil,},EnvVar{Name:WHEREABOUTS_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0,ValueFrom:nil,},EnvVar{Name:ROUTE_OVERRRIDE_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4,ValueFrom:nil,},EnvVar{Name:MULTUS_NETWORKPOLICY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be136d591a0eeb3f7bedf04aabb5481a23b6645316d5cef3cd5be1787344c2b5,ValueFrom:nil,},EnvVar{Name:OVN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,ValueFrom:nil,},EnvVar{Name:OVN_NB_RAFT_ELECTION_TIMER,Value:10,ValueFrom:nil,},EnvVar{Name:OVN_SB_RAFT_ELECTION_TIMER,Value:16,ValueFrom:nil,},EnvVar{Name:OVN_NORTHD_PROBE_INTERVAL,Value:10000,ValueFrom:nil,},EnvVar{Name:OVN_CONTROLLER_INACTIVITY_PROBE,Value:180000,ValueFrom:nil,},EnvVar{Name:OVN_NB_INACTIVITY_PROBE,Value:60000,ValueFrom:nil,},EnvVar{Name:EGRESS_ROUTER_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a,ValueFrom:nil,},EnvVar{Name:NETWORK_METRICS_DAEMON_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14,ValueFrom:nil,},EnvVar{Name:NETWORK_CHECK_SOURCE_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:NETWORK_CHECK_TARGET_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:NETWORK_OPERATOR_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:CLOUD_NETWORK_CONFIG_CONTROLLER_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91997a073272252cac9cd31915ec74217637c55d1abc725107c6eb677ddddc9b,ValueFrom:nil,},EnvVar{Name:CLI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,ValueFrom:nil,},EnvVar{Name:FRR_K8S_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6a974f04d4aefdb39bf2d4649b24e7e0e87685afa3d07ca46234f1a0c5688e4b,ValueFrom:nil,},EnvVar{Name:NETWORKING_CONSOLE_PLUGIN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4,ValueFrom:nil,},EnvVar{Name:POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:host-etc-kube,ReadOnly:true,MountPath:/etc/kubernetes,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:metrics-tls,ReadOnly:false,MountPath:/var/run/secrets/serving-cert,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-m7xz2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-operator-7bdcf4f5bd-7fjxv_openshift-network-operator(34177974-8d82-49d2-a763-391d0df3bbd8): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.255239 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"network-operator\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" podUID="34177974-8d82-49d2-a763-391d0df3bbd8" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.258769 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-952wf" Mar 16 13:07:24 crc kubenswrapper[5030]: W0316 13:07:24.259463 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4541ce_7789_4670_bc75_5c2868e52ce0.slice/crio-9658b4fbe5f203cefe6da5ab33df8f139c7acc1eb3fe8069de29ce5285635890 WatchSource:0}: Error finding container 9658b4fbe5f203cefe6da5ab33df8f139c7acc1eb3fe8069de29ce5285635890: Status 404 returned error can't find the container with id 9658b4fbe5f203cefe6da5ab33df8f139c7acc1eb3fe8069de29ce5285635890 Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.261711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfwbx" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.265298 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:webhook,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:24 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: # OVN-K will try to remove hybrid overlay node annotations even when the hybrid overlay is not enabled. Mar 16 13:07:24 crc kubenswrapper[5030]: # https://github.com/ovn-org/ovn-kubernetes/blob/ac6820df0b338a246f10f412cd5ec903bd234694/go-controller/pkg/ovn/master.go#L791 Mar 16 13:07:24 crc kubenswrapper[5030]: ho_enable="--enable-hybrid-overlay" Mar 16 13:07:24 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - network-node-identity - start webhook" Mar 16 13:07:24 crc kubenswrapper[5030]: # extra-allowed-user: service account `ovn-kubernetes-control-plane` Mar 16 13:07:24 crc kubenswrapper[5030]: # sets pod annotations in multi-homing layer3 network controller (cluster-manager) Mar 16 13:07:24 crc kubenswrapper[5030]: exec /usr/bin/ovnkube-identity --k8s-apiserver=https://api-int.crc.testing:6443 \ Mar 16 13:07:24 crc kubenswrapper[5030]: --webhook-cert-dir="/etc/webhook-cert" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --webhook-host=127.0.0.1 \ Mar 16 13:07:24 crc kubenswrapper[5030]: --webhook-port=9743 \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${ho_enable} \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-interconnect \ Mar 16 13:07:24 crc kubenswrapper[5030]: --disable-approver \ Mar 16 13:07:24 crc kubenswrapper[5030]: --extra-allowed-user="system:serviceaccount:openshift-ovn-kubernetes:ovn-kubernetes-control-plane" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --wait-for-kubernetes-api=200s \ Mar 16 13:07:24 crc kubenswrapper[5030]: --pod-admission-conditions="/var/run/ovnkube-identity-config/additional-pod-admission-cond.json" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --loglevel="${LOGLEVEL}" Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOGLEVEL,Value:2,ValueFrom:nil,},EnvVar{Name:KUBERNETES_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:webhook-cert,ReadOnly:false,MountPath:/etc/webhook-cert/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovnkube-identity-cm,ReadOnly:false,MountPath:/var/run/ovnkube-identity-config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-8nt2j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000500000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-node-identity-dgvkt_openshift-network-node-identity(fc4541ce-7789-4670-bc75-5c2868e52ce0): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.266428 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-98dmx" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.267847 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:approver,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:24 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - network-node-identity - start approver" Mar 16 13:07:24 crc kubenswrapper[5030]: exec /usr/bin/ovnkube-identity --k8s-apiserver=https://api-int.crc.testing:6443 \ Mar 16 13:07:24 crc kubenswrapper[5030]: --disable-webhook \ Mar 16 13:07:24 crc kubenswrapper[5030]: --csr-acceptance-conditions="/var/run/ovnkube-identity-config/additional-cert-acceptance-cond.json" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --loglevel="${LOGLEVEL}" Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOGLEVEL,Value:4,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovnkube-identity-cm,ReadOnly:false,MountPath:/var/run/ovnkube-identity-config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-8nt2j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000500000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-node-identity-dgvkt_openshift-network-node-identity(fc4541ce-7789-4670-bc75-5c2868e52ce0): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.267903 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:iptables-alerter,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,Command:[/iptables-alerter/iptables-alerter.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONTAINER_RUNTIME_ENDPOINT,Value:unix:///run/crio/crio.sock,ValueFrom:nil,},EnvVar{Name:ALERTER_POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{68157440 0} {} 65Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:iptables-alerter-script,ReadOnly:false,MountPath:/iptables-alerter,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-slash,ReadOnly:true,MountPath:/host,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dsgwk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod iptables-alerter-5jnd7_openshift-network-operator(428b39f5-eb1c-4f65-b7a4-eeb6e84860cc): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.269007 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-network-operator/iptables-alerter-5jnd7" podUID="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.269030 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"webhook\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"approver\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-network-node-identity/network-node-identity-dgvkt" podUID="fc4541ce-7789-4670-bc75-5c2868e52ce0" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.271778 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.276703 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:24 crc kubenswrapper[5030]: W0316 13:07:24.278099 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c20ed32_4ad5_4984_9876_39b7b1ee1877.slice/crio-24dc3db184e26d882fddf85b301e812b419629af5741dd817247f4f3a7c8efb2 WatchSource:0}: Error finding container 24dc3db184e26d882fddf85b301e812b419629af5741dd817247f4f3a7c8efb2: Status 404 returned error can't find the container with id 24dc3db184e26d882fddf85b301e812b419629af5741dd817247f4f3a7c8efb2 Mar 16 13:07:24 crc kubenswrapper[5030]: W0316 13:07:24.279637 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31a544e_cc56_4b4e_b639_91a00349a2da.slice/crio-c1a38bf6cb23ff333498bee30d1c6389636f32ea078e71818fc98c286e9ea51b WatchSource:0}: Error finding container c1a38bf6cb23ff333498bee30d1c6389636f32ea078e71818fc98c286e9ea51b: Status 404 returned error can't find the container with id c1a38bf6cb23ff333498bee30d1c6389636f32ea078e71818fc98c286e9ea51b Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.279694 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:dns-node-resolver,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:24 crc kubenswrapper[5030]: set -uo pipefail Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: trap 'jobs -p | xargs kill || true; wait; exit 0' TERM Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: OPENSHIFT_MARKER="openshift-generated-node-resolver" Mar 16 13:07:24 crc kubenswrapper[5030]: HOSTS_FILE="/etc/hosts" Mar 16 13:07:24 crc kubenswrapper[5030]: TEMP_FILE="/tmp/hosts.tmp" Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: IFS=', ' read -r -a services <<< "${SERVICES}" Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # Make a temporary file with the old hosts file's attributes. Mar 16 13:07:24 crc kubenswrapper[5030]: if ! cp -f --attributes-only "${HOSTS_FILE}" "${TEMP_FILE}"; then Mar 16 13:07:24 crc kubenswrapper[5030]: echo "Failed to preserve hosts file. Exiting." Mar 16 13:07:24 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: while true; do Mar 16 13:07:24 crc kubenswrapper[5030]: declare -A svc_ips Mar 16 13:07:24 crc kubenswrapper[5030]: for svc in "${services[@]}"; do Mar 16 13:07:24 crc kubenswrapper[5030]: # Fetch service IP from cluster dns if present. We make several tries Mar 16 13:07:24 crc kubenswrapper[5030]: # to do it: IPv4, IPv6, IPv4 over TCP and IPv6 over TCP. The two last ones Mar 16 13:07:24 crc kubenswrapper[5030]: # are for deployments with Kuryr on older OpenStack (OSP13) - those do not Mar 16 13:07:24 crc kubenswrapper[5030]: # support UDP loadbalancers and require reaching DNS through TCP. Mar 16 13:07:24 crc kubenswrapper[5030]: cmds=('dig -t A @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:24 crc kubenswrapper[5030]: 'dig -t AAAA @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:24 crc kubenswrapper[5030]: 'dig -t A +tcp +retry=0 @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:24 crc kubenswrapper[5030]: 'dig -t AAAA +tcp +retry=0 @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"') Mar 16 13:07:24 crc kubenswrapper[5030]: for i in ${!cmds[*]} Mar 16 13:07:24 crc kubenswrapper[5030]: do Mar 16 13:07:24 crc kubenswrapper[5030]: ips=($(eval "${cmds[i]}")) Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "$?" -eq 0 && "${#ips[@]}" -ne 0 ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: svc_ips["${svc}"]="${ips[@]}" Mar 16 13:07:24 crc kubenswrapper[5030]: break Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # Update /etc/hosts only if we get valid service IPs Mar 16 13:07:24 crc kubenswrapper[5030]: # We will not update /etc/hosts when there is coredns service outage or api unavailability Mar 16 13:07:24 crc kubenswrapper[5030]: # Stale entries could exist in /etc/hosts if the service is deleted Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ -n "${svc_ips[*]-}" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: # Build a new hosts file from /etc/hosts with our custom entries filtered out Mar 16 13:07:24 crc kubenswrapper[5030]: if ! sed --silent "/# ${OPENSHIFT_MARKER}/d; w ${TEMP_FILE}" "${HOSTS_FILE}"; then Mar 16 13:07:24 crc kubenswrapper[5030]: # Only continue rebuilding the hosts entries if its original content is preserved Mar 16 13:07:24 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:24 crc kubenswrapper[5030]: continue Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # Append resolver entries for services Mar 16 13:07:24 crc kubenswrapper[5030]: rc=0 Mar 16 13:07:24 crc kubenswrapper[5030]: for svc in "${!svc_ips[@]}"; do Mar 16 13:07:24 crc kubenswrapper[5030]: for ip in ${svc_ips[${svc}]}; do Mar 16 13:07:24 crc kubenswrapper[5030]: echo "${ip} ${svc} ${svc}.${CLUSTER_DOMAIN} # ${OPENSHIFT_MARKER}" >> "${TEMP_FILE}" || rc=$? Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ $rc -ne 0 ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:24 crc kubenswrapper[5030]: continue Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # TODO: Update /etc/hosts atomically to avoid any inconsistent behavior Mar 16 13:07:24 crc kubenswrapper[5030]: # Replace /etc/hosts with our modified version if needed Mar 16 13:07:24 crc kubenswrapper[5030]: cmp "${TEMP_FILE}" "${HOSTS_FILE}" || cp -f "${TEMP_FILE}" "${HOSTS_FILE}" Mar 16 13:07:24 crc kubenswrapper[5030]: # TEMP_FILE is not removed to avoid file create/delete and attributes copy churn Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:24 crc kubenswrapper[5030]: unset svc_ips Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:SERVICES,Value:image-registry.openshift-image-registry.svc,ValueFrom:nil,},EnvVar{Name:NAMESERVER,Value:10.217.4.10,ValueFrom:nil,},EnvVar{Name:CLUSTER_DOMAIN,Value:cluster.local,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{22020096 0} {} 21Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:hosts-file,ReadOnly:false,MountPath:/etc/hosts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2tjjz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod node-resolver-952wf_openshift-dns(78bd1260-3469-4a38-899e-5923bffe1b59): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.280376 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:kube-multus,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05,Command:[/bin/bash -ec --],Args:[MULTUS_DAEMON_OPT="" Mar 16 13:07:24 crc kubenswrapper[5030]: /entrypoint/cnibincopy.sh; exec /usr/src/multus-cni/bin/multus-daemon $MULTUS_DAEMON_OPT Mar 16 13:07:24 crc kubenswrapper[5030]: ],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:RHEL8_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/rhel8/bin/,ValueFrom:nil,},EnvVar{Name:RHEL9_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/rhel9/bin/,ValueFrom:nil,},EnvVar{Name:DEFAULT_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/bin/,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:6443,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:api-int.crc.testing,ValueFrom:nil,},EnvVar{Name:MULTUS_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:K8S_NODE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{68157440 0} {} 65Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-binary-copy,ReadOnly:false,MountPath:/entrypoint,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:os-release,ReadOnly:false,MountPath:/host/etc/os-release,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:system-cni-dir,ReadOnly:false,MountPath:/host/etc/cni/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-cni-dir,ReadOnly:false,MountPath:/host/run/multus/cni/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cnibin,ReadOnly:false,MountPath:/host/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-socket-dir-parent,ReadOnly:false,MountPath:/host/run/multus,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-k8s-cni-cncf-io,ReadOnly:false,MountPath:/run/k8s.cni.cncf.io,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-netns,ReadOnly:false,MountPath:/run/netns,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-cni-bin,ReadOnly:false,MountPath:/var/lib/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-cni-multus,ReadOnly:false,MountPath:/var/lib/cni/multus,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-kubelet,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:hostroot,ReadOnly:false,MountPath:/hostroot,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-conf-dir,ReadOnly:false,MountPath:/etc/cni/multus/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-daemon-config,ReadOnly:true,MountPath:/etc/cni/net.d/multus.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-multus-certs,ReadOnly:false,MountPath:/etc/cni/multus/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:etc-kubernetes,ReadOnly:false,MountPath:/etc/kubernetes,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4qb8t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod multus-wfwbx_openshift-multus(9c20ed32-4ad5-4984-9876-39b7b1ee1877): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.280807 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-dns/node-resolver-952wf" podUID="78bd1260-3469-4a38-899e-5923bffe1b59" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.282120 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-multus/multus-wfwbx" podUID="9c20ed32-4ad5-4984-9876-39b7b1ee1877" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.282161 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.283966 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:node-ca,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418,Command:[/bin/sh -c trap 'jobs -p | xargs -r kill; echo shutting down node-ca; exit 0' TERM Mar 16 13:07:24 crc kubenswrapper[5030]: while [ true ]; Mar 16 13:07:24 crc kubenswrapper[5030]: do Mar 16 13:07:24 crc kubenswrapper[5030]: for f in $(ls /tmp/serviceca); do Mar 16 13:07:24 crc kubenswrapper[5030]: echo $f Mar 16 13:07:24 crc kubenswrapper[5030]: ca_file_path="/tmp/serviceca/${f}" Mar 16 13:07:24 crc kubenswrapper[5030]: f=$(echo $f | sed -r 's/(.*)\.\./\1:/') Mar 16 13:07:24 crc kubenswrapper[5030]: reg_dir_path="/etc/docker/certs.d/${f}" Mar 16 13:07:24 crc kubenswrapper[5030]: if [ -e "${reg_dir_path}" ]; then Mar 16 13:07:24 crc kubenswrapper[5030]: cp -u $ca_file_path $reg_dir_path/ca.crt Mar 16 13:07:24 crc kubenswrapper[5030]: else Mar 16 13:07:24 crc kubenswrapper[5030]: mkdir $reg_dir_path Mar 16 13:07:24 crc kubenswrapper[5030]: cp $ca_file_path $reg_dir_path/ca.crt Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: for d in $(ls /etc/docker/certs.d); do Mar 16 13:07:24 crc kubenswrapper[5030]: echo $d Mar 16 13:07:24 crc kubenswrapper[5030]: dp=$(echo $d | sed -r 's/(.*):/\1\.\./') Mar 16 13:07:24 crc kubenswrapper[5030]: reg_conf_path="/tmp/serviceca/${dp}" Mar 16 13:07:24 crc kubenswrapper[5030]: if [ ! -e "${reg_conf_path}" ]; then Mar 16 13:07:24 crc kubenswrapper[5030]: rm -rf /etc/docker/certs.d/$d Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: sleep 60 & wait ${!} Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{10485760 0} {} 10Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:serviceca,ReadOnly:false,MountPath:/tmp/serviceca,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host,ReadOnly:false,MountPath:/etc/docker/certs.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mtwtn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:*1001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod node-ca-98dmx_openshift-image-registry(d31a544e-cc56-4b4e-b639-91a00349a2da): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: W0316 13:07:24.284286 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5092e19_dcde_4527_bb59_cb6c408d4411.slice/crio-e34a9ee14b420786ecfc51968e8b0b72ca056acd0abafb8aeea72ec276f64c3c WatchSource:0}: Error finding container e34a9ee14b420786ecfc51968e8b0b72ca056acd0abafb8aeea72ec276f64c3c: Status 404 returned error can't find the container with id e34a9ee14b420786ecfc51968e8b0b72ca056acd0abafb8aeea72ec276f64c3c Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.285025 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-image-registry/node-ca-98dmx" podUID="d31a544e-cc56-4b4e-b639-91a00349a2da" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.286169 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.288378 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="init container &Container{Name:egress-router-binary-copy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a,Command:[/entrypoint/cnibincopy.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:RHEL8_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/rhel8/bin/,ValueFrom:nil,},EnvVar{Name:RHEL9_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/rhel9/bin/,ValueFrom:nil,},EnvVar{Name:DEFAULT_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/bin/,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-binary-copy,ReadOnly:false,MountPath:/entrypoint,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cnibin,ReadOnly:false,MountPath:/host/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:os-release,ReadOnly:true,MountPath:/host/etc/os-release,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-h4ssz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod multus-additional-cni-plugins-9fvrp_openshift-multus(a5092e19-dcde-4527-bb59-cb6c408d4411): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.289523 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" podUID="a5092e19-dcde-4527-bb59-cb6c408d4411" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.292482 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: init container &Container{Name:kubecfg-setup,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c cat << EOF > /etc/ovn/kubeconfig Mar 16 13:07:24 crc kubenswrapper[5030]: apiVersion: v1 Mar 16 13:07:24 crc kubenswrapper[5030]: clusters: Mar 16 13:07:24 crc kubenswrapper[5030]: - cluster: Mar 16 13:07:24 crc kubenswrapper[5030]: certificate-authority: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt Mar 16 13:07:24 crc kubenswrapper[5030]: server: https://api-int.crc.testing:6443 Mar 16 13:07:24 crc kubenswrapper[5030]: name: default-cluster Mar 16 13:07:24 crc kubenswrapper[5030]: contexts: Mar 16 13:07:24 crc kubenswrapper[5030]: - context: Mar 16 13:07:24 crc kubenswrapper[5030]: cluster: default-cluster Mar 16 13:07:24 crc kubenswrapper[5030]: namespace: default Mar 16 13:07:24 crc kubenswrapper[5030]: user: default-auth Mar 16 13:07:24 crc kubenswrapper[5030]: name: default-context Mar 16 13:07:24 crc kubenswrapper[5030]: current-context: default-context Mar 16 13:07:24 crc kubenswrapper[5030]: kind: Config Mar 16 13:07:24 crc kubenswrapper[5030]: preferences: {} Mar 16 13:07:24 crc kubenswrapper[5030]: users: Mar 16 13:07:24 crc kubenswrapper[5030]: - name: default-auth Mar 16 13:07:24 crc kubenswrapper[5030]: user: Mar 16 13:07:24 crc kubenswrapper[5030]: client-certificate: /etc/ovn/ovnkube-node-certs/ovnkube-client-current.pem Mar 16 13:07:24 crc kubenswrapper[5030]: client-key: /etc/ovn/ovnkube-node-certs/ovnkube-client-current.pem Mar 16 13:07:24 crc kubenswrapper[5030]: EOF Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:etc-openvswitch,ReadOnly:false,MountPath:/etc/ovn/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-xs95x,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-node-s9mkc_openshift-ovn-kubernetes(92122bee-3681-4341-b3d4-f23c56fb9a6d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: W0316 13:07:24.292497 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3e8bdc_a01d_4a4e_8f3a_0e82826daace.slice/crio-d21aca5e4ad97f7b7d01349ee1470ae0fd67ffddca410ec1549d5ae6fbcf03be WatchSource:0}: Error finding container d21aca5e4ad97f7b7d01349ee1470ae0fd67ffddca410ec1549d5ae6fbcf03be: Status 404 returned error can't find the container with id d21aca5e4ad97f7b7d01349ee1470ae0fd67ffddca410ec1549d5ae6fbcf03be Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.293528 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kubecfg-setup\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.294610 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:kube-rbac-proxy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:24 crc kubenswrapper[5030]: set -euo pipefail Mar 16 13:07:24 crc kubenswrapper[5030]: TLS_PK=/etc/pki/tls/metrics-cert/tls.key Mar 16 13:07:24 crc kubenswrapper[5030]: TLS_CERT=/etc/pki/tls/metrics-cert/tls.crt Mar 16 13:07:24 crc kubenswrapper[5030]: # As the secret mount is optional we must wait for the files to be present. Mar 16 13:07:24 crc kubenswrapper[5030]: # The service is created in monitor.yaml and this is created in sdn.yaml. Mar 16 13:07:24 crc kubenswrapper[5030]: TS=$(date +%s) Mar 16 13:07:24 crc kubenswrapper[5030]: WARN_TS=$(( ${TS} + $(( 20 * 60)) )) Mar 16 13:07:24 crc kubenswrapper[5030]: HAS_LOGGED_INFO=0 Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: log_missing_certs(){ Mar 16 13:07:24 crc kubenswrapper[5030]: CUR_TS=$(date +%s) Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "${CUR_TS}" -gt "WARN_TS" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: echo $(date -Iseconds) WARN: ovn-control-plane-metrics-cert not mounted after 20 minutes. Mar 16 13:07:24 crc kubenswrapper[5030]: elif [[ "${HAS_LOGGED_INFO}" -eq 0 ]] ; then Mar 16 13:07:24 crc kubenswrapper[5030]: echo $(date -Iseconds) INFO: ovn-control-plane-metrics-cert not mounted. Waiting 20 minutes. Mar 16 13:07:24 crc kubenswrapper[5030]: HAS_LOGGED_INFO=1 Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: } Mar 16 13:07:24 crc kubenswrapper[5030]: while [[ ! -f "${TLS_PK}" || ! -f "${TLS_CERT}" ]] ; do Mar 16 13:07:24 crc kubenswrapper[5030]: log_missing_certs Mar 16 13:07:24 crc kubenswrapper[5030]: sleep 5 Mar 16 13:07:24 crc kubenswrapper[5030]: done Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: echo $(date -Iseconds) INFO: ovn-control-plane-metrics-certs mounted, starting kube-rbac-proxy Mar 16 13:07:24 crc kubenswrapper[5030]: exec /usr/bin/kube-rbac-proxy \ Mar 16 13:07:24 crc kubenswrapper[5030]: --logtostderr \ Mar 16 13:07:24 crc kubenswrapper[5030]: --secure-listen-address=:9108 \ Mar 16 13:07:24 crc kubenswrapper[5030]: --tls-cipher-suites=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256 \ Mar 16 13:07:24 crc kubenswrapper[5030]: --upstream=http://127.0.0.1:29108/ \ Mar 16 13:07:24 crc kubenswrapper[5030]: --tls-private-key-file=${TLS_PK} \ Mar 16 13:07:24 crc kubenswrapper[5030]: --tls-cert-file=${TLS_CERT} Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:9108,ContainerPort:9108,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{20971520 0} {} 20Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:ovn-control-plane-metrics-cert,ReadOnly:true,MountPath:/etc/pki/tls/metrics-cert,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-klzfx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-control-plane-57b78d8988-8ch6c_openshift-ovn-kubernetes(de3e8bdc-a01d-4a4e-8f3a-0e82826daace): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.296951 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.296982 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.296992 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.297004 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.297012 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.297172 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:24 crc kubenswrapper[5030]: container &Container{Name:ovnkube-cluster-manager,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:24 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v4_join_subnet_opt= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v4_join_subnet_opt="--gateway-v4-join-subnet " Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v6_join_subnet_opt= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v6_join_subnet_opt="--gateway-v6-join-subnet " Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v4_transit_switch_subnet_opt= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v4_transit_switch_subnet_opt="--cluster-manager-v4-transit-switch-subnet " Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v6_transit_switch_subnet_opt= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: ovn_v6_transit_switch_subnet_opt="--cluster-manager-v6-transit-switch-subnet " Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: dns_name_resolver_enabled_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: dns_name_resolver_enabled_flag="--enable-dns-name-resolver" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: persistent_ips_enabled_flag="--enable-persistent-ips" Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # This is needed so that converting clusters from GA to TP Mar 16 13:07:24 crc kubenswrapper[5030]: # will rollout control plane pods as well Mar 16 13:07:24 crc kubenswrapper[5030]: network_segmentation_enabled_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: multi_network_enabled_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: multi_network_enabled_flag="--enable-multi-network" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "true" != "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: multi_network_enabled_flag="--enable-multi-network" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: network_segmentation_enabled_flag="--enable-network-segmentation" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: route_advertisements_enable_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: route_advertisements_enable_flag="--enable-route-advertisements" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: preconfigured_udn_addresses_enable_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: preconfigured_udn_addresses_enable_flag="--enable-preconfigured-udn-addresses" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # Enable multi-network policy if configured (control-plane always full mode) Mar 16 13:07:24 crc kubenswrapper[5030]: multi_network_policy_enabled_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: multi_network_policy_enabled_flag="--enable-multi-networkpolicy" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: # Enable admin network policy if configured (control-plane always full mode) Mar 16 13:07:24 crc kubenswrapper[5030]: admin_network_policy_enabled_flag= Mar 16 13:07:24 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:24 crc kubenswrapper[5030]: admin_network_policy_enabled_flag="--enable-admin-network-policy" Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: if [ "shared" == "shared" ]; then Mar 16 13:07:24 crc kubenswrapper[5030]: gateway_mode_flags="--gateway-mode shared" Mar 16 13:07:24 crc kubenswrapper[5030]: elif [ "shared" == "local" ]; then Mar 16 13:07:24 crc kubenswrapper[5030]: gateway_mode_flags="--gateway-mode local" Mar 16 13:07:24 crc kubenswrapper[5030]: else Mar 16 13:07:24 crc kubenswrapper[5030]: echo "Invalid OVN_GATEWAY_MODE: \"shared\". Must be \"local\" or \"shared\"." Mar 16 13:07:24 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:24 crc kubenswrapper[5030]: fi Mar 16 13:07:24 crc kubenswrapper[5030]: Mar 16 13:07:24 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - ovnkube-control-plane - start ovnkube --init-cluster-manager ${K8S_NODE}" Mar 16 13:07:24 crc kubenswrapper[5030]: exec /usr/bin/ovnkube \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-interconnect \ Mar 16 13:07:24 crc kubenswrapper[5030]: --init-cluster-manager "${K8S_NODE}" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --config-file=/run/ovnkube-config/ovnkube.conf \ Mar 16 13:07:24 crc kubenswrapper[5030]: --loglevel "${OVN_KUBE_LOG_LEVEL}" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --metrics-bind-address "127.0.0.1:29108" \ Mar 16 13:07:24 crc kubenswrapper[5030]: --metrics-enable-pprof \ Mar 16 13:07:24 crc kubenswrapper[5030]: --metrics-enable-config-duration \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${ovn_v4_join_subnet_opt} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${ovn_v6_join_subnet_opt} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${ovn_v4_transit_switch_subnet_opt} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${ovn_v6_transit_switch_subnet_opt} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${dns_name_resolver_enabled_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${persistent_ips_enabled_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${multi_network_enabled_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${network_segmentation_enabled_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${gateway_mode_flags} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${route_advertisements_enable_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${preconfigured_udn_addresses_enable_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-egress-ip=true \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-egress-firewall=true \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-egress-qos=true \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-egress-service=true \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-multicast \ Mar 16 13:07:24 crc kubenswrapper[5030]: --enable-multi-external-gateway=true \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${multi_network_policy_enabled_flag} \ Mar 16 13:07:24 crc kubenswrapper[5030]: ${admin_network_policy_enabled_flag} Mar 16 13:07:24 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics-port,HostPort:29108,ContainerPort:29108,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:OVN_KUBE_LOG_LEVEL,Value:4,ValueFrom:nil,},EnvVar{Name:K8S_NODE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{314572800 0} {} 300Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:ovnkube-config,ReadOnly:false,MountPath:/run/ovnkube-config/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-klzfx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-control-plane-57b78d8988-8ch6c_openshift-ovn-kubernetes(de3e8bdc-a01d-4a4e-8f3a-0e82826daace): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:24 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.298307 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"kube-rbac-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"ovnkube-cluster-manager\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.299464 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:machine-config-daemon,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115,Command:[/usr/bin/machine-config-daemon],Args:[start --payload-version=4.20.1],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:health,HostPort:8798,ContainerPort:8798,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:rootfs,ReadOnly:false,MountPath:/rootfs,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-skpbz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/health,Port:{0 8798 },Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:120,TimeoutSeconds:1,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*false,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.302002 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,Command:[],Args:[--secure-listen-address=0.0.0.0:9001 --config-file=/etc/kube-rbac-proxy/config-file.yaml --tls-cipher-suites=TLS_AES_128_GCM_SHA256,TLS_AES_256_GCM_SHA384,TLS_CHACHA20_POLY1305_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 --tls-min-version=VersionTLS12 --upstream=http://127.0.0.1:8797 --logtostderr=true --tls-cert-file=/etc/tls/private/tls.crt --tls-private-key-file=/etc/tls/private/tls.key],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9001,ContainerPort:9001,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proxy-tls,ReadOnly:false,MountPath:/etc/tls/private,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:mcd-auth-proxy-config,ReadOnly:false,MountPath:/etc/kube-rbac-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-skpbz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.303357 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"machine-config-daemon\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.398586 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.398659 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.398673 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.398688 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.398698 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.500146 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.500178 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.500187 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.500198 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.500206 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.585748 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.585832 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.585851 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.585873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.585893 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.585935 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.58591847 +0000 UTC m=+89.985231017 (durationBeforeRetry 1s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.585978 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.585981 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.585977 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586005 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586023 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586043 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586029 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586090 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586014 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.586005935 +0000 UTC m=+89.985318492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586147 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.586133184 +0000 UTC m=+89.985445732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586160 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.586154224 +0000 UTC m=+89.985466771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.586170 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.586164513 +0000 UTC m=+89.985477051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.601990 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.602021 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.602030 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.602042 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.602050 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.686857 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.686930 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: E0316 13:07:24.686958 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:25.686950721 +0000 UTC m=+90.086263258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.703508 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.703534 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.703573 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.703585 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.703592 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.805160 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.805185 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.805195 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.805206 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.805214 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.906321 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.906363 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.906373 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.906386 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:24 crc kubenswrapper[5030]: I0316 13:07:24.906393 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:24Z","lastTransitionTime":"2026-03-16T13:07:24Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.007825 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.007858 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.007868 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.007879 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.007888 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.108863 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.108906 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.108915 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.108926 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.108933 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.180597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"9658b4fbe5f203cefe6da5ab33df8f139c7acc1eb3fe8069de29ce5285635890"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.181488 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"313cd5794af67451ee6452a689e51e26b7d3c5a9ad007f2ac4a66ac73443a06c"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.182006 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:webhook,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:25 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: # OVN-K will try to remove hybrid overlay node annotations even when the hybrid overlay is not enabled. Mar 16 13:07:25 crc kubenswrapper[5030]: # https://github.com/ovn-org/ovn-kubernetes/blob/ac6820df0b338a246f10f412cd5ec903bd234694/go-controller/pkg/ovn/master.go#L791 Mar 16 13:07:25 crc kubenswrapper[5030]: ho_enable="--enable-hybrid-overlay" Mar 16 13:07:25 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - network-node-identity - start webhook" Mar 16 13:07:25 crc kubenswrapper[5030]: # extra-allowed-user: service account `ovn-kubernetes-control-plane` Mar 16 13:07:25 crc kubenswrapper[5030]: # sets pod annotations in multi-homing layer3 network controller (cluster-manager) Mar 16 13:07:25 crc kubenswrapper[5030]: exec /usr/bin/ovnkube-identity --k8s-apiserver=https://api-int.crc.testing:6443 \ Mar 16 13:07:25 crc kubenswrapper[5030]: --webhook-cert-dir="/etc/webhook-cert" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --webhook-host=127.0.0.1 \ Mar 16 13:07:25 crc kubenswrapper[5030]: --webhook-port=9743 \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${ho_enable} \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-interconnect \ Mar 16 13:07:25 crc kubenswrapper[5030]: --disable-approver \ Mar 16 13:07:25 crc kubenswrapper[5030]: --extra-allowed-user="system:serviceaccount:openshift-ovn-kubernetes:ovn-kubernetes-control-plane" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --wait-for-kubernetes-api=200s \ Mar 16 13:07:25 crc kubenswrapper[5030]: --pod-admission-conditions="/var/run/ovnkube-identity-config/additional-pod-admission-cond.json" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --loglevel="${LOGLEVEL}" Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOGLEVEL,Value:2,ValueFrom:nil,},EnvVar{Name:KUBERNETES_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:webhook-cert,ReadOnly:false,MountPath:/etc/webhook-cert/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovnkube-identity-cm,ReadOnly:false,MountPath:/var/run/ovnkube-identity-config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-8nt2j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000500000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-node-identity-dgvkt_openshift-network-node-identity(fc4541ce-7789-4670-bc75-5c2868e52ce0): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.183250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98dmx" event={"ID":"d31a544e-cc56-4b4e-b639-91a00349a2da","Type":"ContainerStarted","Data":"c1a38bf6cb23ff333498bee30d1c6389636f32ea078e71818fc98c286e9ea51b"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.183725 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:machine-config-daemon,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115,Command:[/usr/bin/machine-config-daemon],Args:[start --payload-version=4.20.1],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:health,HostPort:8798,ContainerPort:8798,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:rootfs,ReadOnly:false,MountPath:/rootfs,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-skpbz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/health,Port:{0 8798 },Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:120,TimeoutSeconds:1,PeriodSeconds:30,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*false,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.184585 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" event={"ID":"34177974-8d82-49d2-a763-391d0df3bbd8","Type":"ContainerStarted","Data":"de6591eff76d3cde6ad539a4175ecf8d4f76f0156d9daa53dd9df1bc2adb2522"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.185264 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:node-ca,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418,Command:[/bin/sh -c trap 'jobs -p | xargs -r kill; echo shutting down node-ca; exit 0' TERM Mar 16 13:07:25 crc kubenswrapper[5030]: while [ true ]; Mar 16 13:07:25 crc kubenswrapper[5030]: do Mar 16 13:07:25 crc kubenswrapper[5030]: for f in $(ls /tmp/serviceca); do Mar 16 13:07:25 crc kubenswrapper[5030]: echo $f Mar 16 13:07:25 crc kubenswrapper[5030]: ca_file_path="/tmp/serviceca/${f}" Mar 16 13:07:25 crc kubenswrapper[5030]: f=$(echo $f | sed -r 's/(.*)\.\./\1:/') Mar 16 13:07:25 crc kubenswrapper[5030]: reg_dir_path="/etc/docker/certs.d/${f}" Mar 16 13:07:25 crc kubenswrapper[5030]: if [ -e "${reg_dir_path}" ]; then Mar 16 13:07:25 crc kubenswrapper[5030]: cp -u $ca_file_path $reg_dir_path/ca.crt Mar 16 13:07:25 crc kubenswrapper[5030]: else Mar 16 13:07:25 crc kubenswrapper[5030]: mkdir $reg_dir_path Mar 16 13:07:25 crc kubenswrapper[5030]: cp $ca_file_path $reg_dir_path/ca.crt Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: for d in $(ls /etc/docker/certs.d); do Mar 16 13:07:25 crc kubenswrapper[5030]: echo $d Mar 16 13:07:25 crc kubenswrapper[5030]: dp=$(echo $d | sed -r 's/(.*):/\1\.\./') Mar 16 13:07:25 crc kubenswrapper[5030]: reg_conf_path="/tmp/serviceca/${dp}" Mar 16 13:07:25 crc kubenswrapper[5030]: if [ ! -e "${reg_conf_path}" ]; then Mar 16 13:07:25 crc kubenswrapper[5030]: rm -rf /etc/docker/certs.d/$d Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: sleep 60 & wait ${!} Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{10485760 0} {} 10Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:serviceca,ReadOnly:false,MountPath:/tmp/serviceca,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host,ReadOnly:false,MountPath:/etc/docker/certs.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-mtwtn,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:*1001,RunAsNonRoot:*true,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:*0,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod node-ca-98dmx_openshift-image-registry(d31a544e-cc56-4b4e-b639-91a00349a2da): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.185410 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:kube-rbac-proxy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,Command:[],Args:[--secure-listen-address=0.0.0.0:9001 --config-file=/etc/kube-rbac-proxy/config-file.yaml --tls-cipher-suites=TLS_AES_128_GCM_SHA256,TLS_AES_256_GCM_SHA384,TLS_CHACHA20_POLY1305_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 --tls-min-version=VersionTLS12 --upstream=http://127.0.0.1:8797 --logtostderr=true --tls-cert-file=/etc/tls/private/tls.crt --tls-private-key-file=/etc/tls/private/tls.key],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:9001,ContainerPort:9001,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{20 -3} {} 20m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:proxy-tls,ReadOnly:false,MountPath:/etc/tls/private,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:mcd-auth-proxy-config,ReadOnly:false,MountPath:/etc/kube-rbac-proxy,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-skpbz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.185757 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:approver,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:25 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - network-node-identity - start approver" Mar 16 13:07:25 crc kubenswrapper[5030]: exec /usr/bin/ovnkube-identity --k8s-apiserver=https://api-int.crc.testing:6443 \ Mar 16 13:07:25 crc kubenswrapper[5030]: --disable-webhook \ Mar 16 13:07:25 crc kubenswrapper[5030]: --csr-acceptance-conditions="/var/run/ovnkube-identity-config/additional-cert-acceptance-cond.json" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --loglevel="${LOGLEVEL}" Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LOGLEVEL,Value:4,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovnkube-identity-cm,ReadOnly:false,MountPath:/var/run/ovnkube-identity-config,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-8nt2j,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000500000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-node-identity-dgvkt_openshift-network-node-identity(fc4541ce-7789-4670-bc75-5c2868e52ce0): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.186097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"c4b1837df76c6a42c84bf8b8f86cb1d7b4a7f8ac0256d844c0ce1c060b131f0e"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.186353 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-image-registry/node-ca-98dmx" podUID="d31a544e-cc56-4b4e-b639-91a00349a2da" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.187025 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"webhook\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"approver\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-network-node-identity/network-node-identity-dgvkt" podUID="fc4541ce-7789-4670-bc75-5c2868e52ce0" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.187075 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"machine-config-daemon\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"kube-rbac-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.187620 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:network-operator,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:25 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ -f /etc/kubernetes/apiserver-url.env ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: source /etc/kubernetes/apiserver-url.env Mar 16 13:07:25 crc kubenswrapper[5030]: else Mar 16 13:07:25 crc kubenswrapper[5030]: echo "Error: /etc/kubernetes/apiserver-url.env is missing" Mar 16 13:07:25 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: exec /usr/bin/cluster-network-operator start --listen=0.0.0.0:9104 Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:cno,HostPort:9104,ContainerPort:9104,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:RELEASE_VERSION,Value:4.20.1,ValueFrom:nil,},EnvVar{Name:KUBE_PROXY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:951276a60f15185a05902cf1ec49b6db3e4f049ec638828b336aed496f8dfc45,ValueFrom:nil,},EnvVar{Name:KUBE_RBAC_PROXY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,ValueFrom:nil,},EnvVar{Name:MULTUS_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05,ValueFrom:nil,},EnvVar{Name:MULTUS_ADMISSION_CONTROLLER_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b5000f8f055fd8f734ef74afbd9bd5333a38345cbc4959ddaad728b8394bccd4,ValueFrom:nil,},EnvVar{Name:CNI_PLUGINS_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d,ValueFrom:nil,},EnvVar{Name:BOND_CNI_PLUGIN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782,ValueFrom:nil,},EnvVar{Name:WHEREABOUTS_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0,ValueFrom:nil,},EnvVar{Name:ROUTE_OVERRRIDE_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4,ValueFrom:nil,},EnvVar{Name:MULTUS_NETWORKPOLICY_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be136d591a0eeb3f7bedf04aabb5481a23b6645316d5cef3cd5be1787344c2b5,ValueFrom:nil,},EnvVar{Name:OVN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,ValueFrom:nil,},EnvVar{Name:OVN_NB_RAFT_ELECTION_TIMER,Value:10,ValueFrom:nil,},EnvVar{Name:OVN_SB_RAFT_ELECTION_TIMER,Value:16,ValueFrom:nil,},EnvVar{Name:OVN_NORTHD_PROBE_INTERVAL,Value:10000,ValueFrom:nil,},EnvVar{Name:OVN_CONTROLLER_INACTIVITY_PROBE,Value:180000,ValueFrom:nil,},EnvVar{Name:OVN_NB_INACTIVITY_PROBE,Value:60000,ValueFrom:nil,},EnvVar{Name:EGRESS_ROUTER_CNI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a,ValueFrom:nil,},EnvVar{Name:NETWORK_METRICS_DAEMON_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14,ValueFrom:nil,},EnvVar{Name:NETWORK_CHECK_SOURCE_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:NETWORK_CHECK_TARGET_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:NETWORK_OPERATOR_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b,ValueFrom:nil,},EnvVar{Name:CLOUD_NETWORK_CONFIG_CONTROLLER_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:91997a073272252cac9cd31915ec74217637c55d1abc725107c6eb677ddddc9b,ValueFrom:nil,},EnvVar{Name:CLI_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,ValueFrom:nil,},EnvVar{Name:FRR_K8S_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6a974f04d4aefdb39bf2d4649b24e7e0e87685afa3d07ca46234f1a0c5688e4b,ValueFrom:nil,},EnvVar{Name:NETWORKING_CONSOLE_PLUGIN_IMAGE,Value:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4,ValueFrom:nil,},EnvVar{Name:POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{52428800 0} {} 50Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:host-etc-kube,ReadOnly:true,MountPath:/etc/kubernetes,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:metrics-tls,ReadOnly:false,MountPath:/var/run/secrets/serving-cert,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-m7xz2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod network-operator-7bdcf4f5bd-7fjxv_openshift-network-operator(34177974-8d82-49d2-a763-391d0df3bbd8): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.187950 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: init container &Container{Name:kubecfg-setup,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c cat << EOF > /etc/ovn/kubeconfig Mar 16 13:07:25 crc kubenswrapper[5030]: apiVersion: v1 Mar 16 13:07:25 crc kubenswrapper[5030]: clusters: Mar 16 13:07:25 crc kubenswrapper[5030]: - cluster: Mar 16 13:07:25 crc kubenswrapper[5030]: certificate-authority: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt Mar 16 13:07:25 crc kubenswrapper[5030]: server: https://api-int.crc.testing:6443 Mar 16 13:07:25 crc kubenswrapper[5030]: name: default-cluster Mar 16 13:07:25 crc kubenswrapper[5030]: contexts: Mar 16 13:07:25 crc kubenswrapper[5030]: - context: Mar 16 13:07:25 crc kubenswrapper[5030]: cluster: default-cluster Mar 16 13:07:25 crc kubenswrapper[5030]: namespace: default Mar 16 13:07:25 crc kubenswrapper[5030]: user: default-auth Mar 16 13:07:25 crc kubenswrapper[5030]: name: default-context Mar 16 13:07:25 crc kubenswrapper[5030]: current-context: default-context Mar 16 13:07:25 crc kubenswrapper[5030]: kind: Config Mar 16 13:07:25 crc kubenswrapper[5030]: preferences: {} Mar 16 13:07:25 crc kubenswrapper[5030]: users: Mar 16 13:07:25 crc kubenswrapper[5030]: - name: default-auth Mar 16 13:07:25 crc kubenswrapper[5030]: user: Mar 16 13:07:25 crc kubenswrapper[5030]: client-certificate: /etc/ovn/ovnkube-node-certs/ovnkube-client-current.pem Mar 16 13:07:25 crc kubenswrapper[5030]: client-key: /etc/ovn/ovnkube-node-certs/ovnkube-client-current.pem Mar 16 13:07:25 crc kubenswrapper[5030]: EOF Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:etc-openvswitch,ReadOnly:false,MountPath:/etc/ovn/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-xs95x,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-node-s9mkc_openshift-ovn-kubernetes(92122bee-3681-4341-b3d4-f23c56fb9a6d): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.188688 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"network-operator\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" podUID="34177974-8d82-49d2-a763-391d0df3bbd8" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.190120 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kubecfg-setup\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.190355 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.190711 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerStarted","Data":"e34a9ee14b420786ecfc51968e8b0b72ca056acd0abafb8aeea72ec276f64c3c"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.191279 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfwbx" event={"ID":"9c20ed32-4ad5-4984-9876-39b7b1ee1877","Type":"ContainerStarted","Data":"24dc3db184e26d882fddf85b301e812b419629af5741dd817247f4f3a7c8efb2"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.191674 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="init container &Container{Name:egress-router-binary-copy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a,Command:[/entrypoint/cnibincopy.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:RHEL8_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/rhel8/bin/,ValueFrom:nil,},EnvVar{Name:RHEL9_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/rhel9/bin/,ValueFrom:nil,},EnvVar{Name:DEFAULT_SOURCE_DIRECTORY,Value:/usr/src/egress-router-cni/bin/,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-binary-copy,ReadOnly:false,MountPath:/entrypoint,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cnibin,ReadOnly:false,MountPath:/host/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:os-release,ReadOnly:true,MountPath:/host/etc/os-release,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-h4ssz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod multus-additional-cni-plugins-9fvrp_openshift-multus(a5092e19-dcde-4527-bb59-cb6c408d4411): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.192309 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:kube-multus,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05,Command:[/bin/bash -ec --],Args:[MULTUS_DAEMON_OPT="" Mar 16 13:07:25 crc kubenswrapper[5030]: /entrypoint/cnibincopy.sh; exec /usr/src/multus-cni/bin/multus-daemon $MULTUS_DAEMON_OPT Mar 16 13:07:25 crc kubenswrapper[5030]: ],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:RHEL8_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/rhel8/bin/,ValueFrom:nil,},EnvVar{Name:RHEL9_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/rhel9/bin/,ValueFrom:nil,},EnvVar{Name:DEFAULT_SOURCE_DIRECTORY,Value:/usr/src/multus-cni/bin/,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_PORT,Value:6443,ValueFrom:nil,},EnvVar{Name:KUBERNETES_SERVICE_HOST,Value:api-int.crc.testing,ValueFrom:nil,},EnvVar{Name:MULTUS_NODE_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:K8S_NODE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{68157440 0} {} 65Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:cni-binary-copy,ReadOnly:false,MountPath:/entrypoint,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:os-release,ReadOnly:false,MountPath:/host/etc/os-release,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:system-cni-dir,ReadOnly:false,MountPath:/host/etc/cni/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-cni-dir,ReadOnly:false,MountPath:/host/run/multus/cni/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:cnibin,ReadOnly:false,MountPath:/host/opt/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-socket-dir-parent,ReadOnly:false,MountPath:/host/run/multus,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-k8s-cni-cncf-io,ReadOnly:false,MountPath:/run/k8s.cni.cncf.io,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-netns,ReadOnly:false,MountPath:/run/netns,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-cni-bin,ReadOnly:false,MountPath:/var/lib/cni/bin,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-cni-multus,ReadOnly:false,MountPath:/var/lib/cni/multus,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-var-lib-kubelet,ReadOnly:false,MountPath:/var/lib/kubelet,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:hostroot,ReadOnly:false,MountPath:/hostroot,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-conf-dir,ReadOnly:false,MountPath:/etc/cni/multus/net.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:multus-daemon-config,ReadOnly:true,MountPath:/etc/cni/net.d/multus.d,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-run-multus-certs,ReadOnly:false,MountPath:/etc/cni/multus/certs,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:etc-kubernetes,ReadOnly:false,MountPath:/etc/kubernetes,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-4qb8t,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod multus-wfwbx_openshift-multus(9c20ed32-4ad5-4984-9876-39b7b1ee1877): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.192731 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" podUID="a5092e19-dcde-4527-bb59-cb6c408d4411" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.192873 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" event={"ID":"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc","Type":"ContainerStarted","Data":"81aca51ddec312a49d7da32033d413e914085385cccae9502dd91b2315aeb322"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.193358 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-multus/multus-wfwbx" podUID="9c20ed32-4ad5-4984-9876-39b7b1ee1877" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.193530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerStarted","Data":"d21aca5e4ad97f7b7d01349ee1470ae0fd67ffddca410ec1549d5ae6fbcf03be"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.194506 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-952wf" event={"ID":"78bd1260-3469-4a38-899e-5923bffe1b59","Type":"ContainerStarted","Data":"1e7976a3a2337df9da316262eb0c670b62b21597148cbab57f7caf61d6f3f559"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.194977 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:iptables-alerter,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,Command:[/iptables-alerter/iptables-alerter.sh],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONTAINER_RUNTIME_ENDPOINT,Value:unix:///run/crio/crio.sock,ValueFrom:nil,},EnvVar{Name:ALERTER_POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{68157440 0} {} 65Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:iptables-alerter-script,ReadOnly:false,MountPath:/iptables-alerter,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:host-slash,ReadOnly:true,MountPath:/host,SubPath:,MountPropagation:*HostToContainer,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-dsgwk,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod iptables-alerter-5jnd7_openshift-network-operator(428b39f5-eb1c-4f65-b7a4-eeb6e84860cc): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars" logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.195078 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:kube-rbac-proxy,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:25 crc kubenswrapper[5030]: set -euo pipefail Mar 16 13:07:25 crc kubenswrapper[5030]: TLS_PK=/etc/pki/tls/metrics-cert/tls.key Mar 16 13:07:25 crc kubenswrapper[5030]: TLS_CERT=/etc/pki/tls/metrics-cert/tls.crt Mar 16 13:07:25 crc kubenswrapper[5030]: # As the secret mount is optional we must wait for the files to be present. Mar 16 13:07:25 crc kubenswrapper[5030]: # The service is created in monitor.yaml and this is created in sdn.yaml. Mar 16 13:07:25 crc kubenswrapper[5030]: TS=$(date +%s) Mar 16 13:07:25 crc kubenswrapper[5030]: WARN_TS=$(( ${TS} + $(( 20 * 60)) )) Mar 16 13:07:25 crc kubenswrapper[5030]: HAS_LOGGED_INFO=0 Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: log_missing_certs(){ Mar 16 13:07:25 crc kubenswrapper[5030]: CUR_TS=$(date +%s) Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "${CUR_TS}" -gt "WARN_TS" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: echo $(date -Iseconds) WARN: ovn-control-plane-metrics-cert not mounted after 20 minutes. Mar 16 13:07:25 crc kubenswrapper[5030]: elif [[ "${HAS_LOGGED_INFO}" -eq 0 ]] ; then Mar 16 13:07:25 crc kubenswrapper[5030]: echo $(date -Iseconds) INFO: ovn-control-plane-metrics-cert not mounted. Waiting 20 minutes. Mar 16 13:07:25 crc kubenswrapper[5030]: HAS_LOGGED_INFO=1 Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: } Mar 16 13:07:25 crc kubenswrapper[5030]: while [[ ! -f "${TLS_PK}" || ! -f "${TLS_CERT}" ]] ; do Mar 16 13:07:25 crc kubenswrapper[5030]: log_missing_certs Mar 16 13:07:25 crc kubenswrapper[5030]: sleep 5 Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: echo $(date -Iseconds) INFO: ovn-control-plane-metrics-certs mounted, starting kube-rbac-proxy Mar 16 13:07:25 crc kubenswrapper[5030]: exec /usr/bin/kube-rbac-proxy \ Mar 16 13:07:25 crc kubenswrapper[5030]: --logtostderr \ Mar 16 13:07:25 crc kubenswrapper[5030]: --secure-listen-address=:9108 \ Mar 16 13:07:25 crc kubenswrapper[5030]: --tls-cipher-suites=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256 \ Mar 16 13:07:25 crc kubenswrapper[5030]: --upstream=http://127.0.0.1:29108/ \ Mar 16 13:07:25 crc kubenswrapper[5030]: --tls-private-key-file=${TLS_PK} \ Mar 16 13:07:25 crc kubenswrapper[5030]: --tls-cert-file=${TLS_CERT} Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:https,HostPort:9108,ContainerPort:9108,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{20971520 0} {} 20Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:ovn-control-plane-metrics-cert,ReadOnly:true,MountPath:/etc/pki/tls/metrics-cert,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-klzfx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-control-plane-57b78d8988-8ch6c_openshift-ovn-kubernetes(de3e8bdc-a01d-4a4e-8f3a-0e82826daace): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.195798 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:dns-node-resolver,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e,Command:[/bin/bash -c #!/bin/bash Mar 16 13:07:25 crc kubenswrapper[5030]: set -uo pipefail Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: trap 'jobs -p | xargs kill || true; wait; exit 0' TERM Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: OPENSHIFT_MARKER="openshift-generated-node-resolver" Mar 16 13:07:25 crc kubenswrapper[5030]: HOSTS_FILE="/etc/hosts" Mar 16 13:07:25 crc kubenswrapper[5030]: TEMP_FILE="/tmp/hosts.tmp" Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: IFS=', ' read -r -a services <<< "${SERVICES}" Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # Make a temporary file with the old hosts file's attributes. Mar 16 13:07:25 crc kubenswrapper[5030]: if ! cp -f --attributes-only "${HOSTS_FILE}" "${TEMP_FILE}"; then Mar 16 13:07:25 crc kubenswrapper[5030]: echo "Failed to preserve hosts file. Exiting." Mar 16 13:07:25 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: while true; do Mar 16 13:07:25 crc kubenswrapper[5030]: declare -A svc_ips Mar 16 13:07:25 crc kubenswrapper[5030]: for svc in "${services[@]}"; do Mar 16 13:07:25 crc kubenswrapper[5030]: # Fetch service IP from cluster dns if present. We make several tries Mar 16 13:07:25 crc kubenswrapper[5030]: # to do it: IPv4, IPv6, IPv4 over TCP and IPv6 over TCP. The two last ones Mar 16 13:07:25 crc kubenswrapper[5030]: # are for deployments with Kuryr on older OpenStack (OSP13) - those do not Mar 16 13:07:25 crc kubenswrapper[5030]: # support UDP loadbalancers and require reaching DNS through TCP. Mar 16 13:07:25 crc kubenswrapper[5030]: cmds=('dig -t A @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:25 crc kubenswrapper[5030]: 'dig -t AAAA @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:25 crc kubenswrapper[5030]: 'dig -t A +tcp +retry=0 @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"' Mar 16 13:07:25 crc kubenswrapper[5030]: 'dig -t AAAA +tcp +retry=0 @"${NAMESERVER}" +short "${svc}.${CLUSTER_DOMAIN}"|grep -v "^;"') Mar 16 13:07:25 crc kubenswrapper[5030]: for i in ${!cmds[*]} Mar 16 13:07:25 crc kubenswrapper[5030]: do Mar 16 13:07:25 crc kubenswrapper[5030]: ips=($(eval "${cmds[i]}")) Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "$?" -eq 0 && "${#ips[@]}" -ne 0 ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: svc_ips["${svc}"]="${ips[@]}" Mar 16 13:07:25 crc kubenswrapper[5030]: break Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # Update /etc/hosts only if we get valid service IPs Mar 16 13:07:25 crc kubenswrapper[5030]: # We will not update /etc/hosts when there is coredns service outage or api unavailability Mar 16 13:07:25 crc kubenswrapper[5030]: # Stale entries could exist in /etc/hosts if the service is deleted Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ -n "${svc_ips[*]-}" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: # Build a new hosts file from /etc/hosts with our custom entries filtered out Mar 16 13:07:25 crc kubenswrapper[5030]: if ! sed --silent "/# ${OPENSHIFT_MARKER}/d; w ${TEMP_FILE}" "${HOSTS_FILE}"; then Mar 16 13:07:25 crc kubenswrapper[5030]: # Only continue rebuilding the hosts entries if its original content is preserved Mar 16 13:07:25 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:25 crc kubenswrapper[5030]: continue Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # Append resolver entries for services Mar 16 13:07:25 crc kubenswrapper[5030]: rc=0 Mar 16 13:07:25 crc kubenswrapper[5030]: for svc in "${!svc_ips[@]}"; do Mar 16 13:07:25 crc kubenswrapper[5030]: for ip in ${svc_ips[${svc}]}; do Mar 16 13:07:25 crc kubenswrapper[5030]: echo "${ip} ${svc} ${svc}.${CLUSTER_DOMAIN} # ${OPENSHIFT_MARKER}" >> "${TEMP_FILE}" || rc=$? Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ $rc -ne 0 ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:25 crc kubenswrapper[5030]: continue Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # TODO: Update /etc/hosts atomically to avoid any inconsistent behavior Mar 16 13:07:25 crc kubenswrapper[5030]: # Replace /etc/hosts with our modified version if needed Mar 16 13:07:25 crc kubenswrapper[5030]: cmp "${TEMP_FILE}" "${HOSTS_FILE}" || cp -f "${TEMP_FILE}" "${HOSTS_FILE}" Mar 16 13:07:25 crc kubenswrapper[5030]: # TEMP_FILE is not removed to avoid file create/delete and attributes copy churn Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: sleep 60 & wait Mar 16 13:07:25 crc kubenswrapper[5030]: unset svc_ips Mar 16 13:07:25 crc kubenswrapper[5030]: done Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:SERVICES,Value:image-registry.openshift-image-registry.svc,ValueFrom:nil,},EnvVar{Name:NAMESERVER,Value:10.217.4.10,ValueFrom:nil,},EnvVar{Name:CLUSTER_DOMAIN,Value:cluster.local,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{22020096 0} {} 21Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:hosts-file,ReadOnly:false,MountPath:/etc/hosts,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:tmp-dir,ReadOnly:false,MountPath:/tmp,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-2tjjz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*true,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:*true,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod node-resolver-952wf_openshift-dns(78bd1260-3469-4a38-899e-5923bffe1b59): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.196202 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-network-operator/iptables-alerter-5jnd7" podUID="428b39f5-eb1c-4f65-b7a4-eeb6e84860cc" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.196510 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.196942 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"" pod="openshift-dns/node-resolver-952wf" podUID="78bd1260-3469-4a38-899e-5923bffe1b59" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.197503 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:07:25 crc kubenswrapper[5030]: container &Container{Name:ovnkube-cluster-manager,Image:quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122,Command:[/bin/bash -c set -xe Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ -f "/env/_master" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: set -o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: source "/env/_master" Mar 16 13:07:25 crc kubenswrapper[5030]: set +o allexport Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v4_join_subnet_opt= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v4_join_subnet_opt="--gateway-v4-join-subnet " Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v6_join_subnet_opt= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v6_join_subnet_opt="--gateway-v6-join-subnet " Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v4_transit_switch_subnet_opt= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v4_transit_switch_subnet_opt="--cluster-manager-v4-transit-switch-subnet " Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v6_transit_switch_subnet_opt= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "" != "" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: ovn_v6_transit_switch_subnet_opt="--cluster-manager-v6-transit-switch-subnet " Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: dns_name_resolver_enabled_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: dns_name_resolver_enabled_flag="--enable-dns-name-resolver" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: persistent_ips_enabled_flag="--enable-persistent-ips" Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # This is needed so that converting clusters from GA to TP Mar 16 13:07:25 crc kubenswrapper[5030]: # will rollout control plane pods as well Mar 16 13:07:25 crc kubenswrapper[5030]: network_segmentation_enabled_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: multi_network_enabled_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: multi_network_enabled_flag="--enable-multi-network" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "true" != "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: multi_network_enabled_flag="--enable-multi-network" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: network_segmentation_enabled_flag="--enable-network-segmentation" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: route_advertisements_enable_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: route_advertisements_enable_flag="--enable-route-advertisements" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: preconfigured_udn_addresses_enable_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: preconfigured_udn_addresses_enable_flag="--enable-preconfigured-udn-addresses" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # Enable multi-network policy if configured (control-plane always full mode) Mar 16 13:07:25 crc kubenswrapper[5030]: multi_network_policy_enabled_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "false" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: multi_network_policy_enabled_flag="--enable-multi-networkpolicy" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: # Enable admin network policy if configured (control-plane always full mode) Mar 16 13:07:25 crc kubenswrapper[5030]: admin_network_policy_enabled_flag= Mar 16 13:07:25 crc kubenswrapper[5030]: if [[ "true" == "true" ]]; then Mar 16 13:07:25 crc kubenswrapper[5030]: admin_network_policy_enabled_flag="--enable-admin-network-policy" Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: if [ "shared" == "shared" ]; then Mar 16 13:07:25 crc kubenswrapper[5030]: gateway_mode_flags="--gateway-mode shared" Mar 16 13:07:25 crc kubenswrapper[5030]: elif [ "shared" == "local" ]; then Mar 16 13:07:25 crc kubenswrapper[5030]: gateway_mode_flags="--gateway-mode local" Mar 16 13:07:25 crc kubenswrapper[5030]: else Mar 16 13:07:25 crc kubenswrapper[5030]: echo "Invalid OVN_GATEWAY_MODE: \"shared\". Must be \"local\" or \"shared\"." Mar 16 13:07:25 crc kubenswrapper[5030]: exit 1 Mar 16 13:07:25 crc kubenswrapper[5030]: fi Mar 16 13:07:25 crc kubenswrapper[5030]: Mar 16 13:07:25 crc kubenswrapper[5030]: echo "I$(date "+%m%d %H:%M:%S.%N") - ovnkube-control-plane - start ovnkube --init-cluster-manager ${K8S_NODE}" Mar 16 13:07:25 crc kubenswrapper[5030]: exec /usr/bin/ovnkube \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-interconnect \ Mar 16 13:07:25 crc kubenswrapper[5030]: --init-cluster-manager "${K8S_NODE}" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --config-file=/run/ovnkube-config/ovnkube.conf \ Mar 16 13:07:25 crc kubenswrapper[5030]: --loglevel "${OVN_KUBE_LOG_LEVEL}" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --metrics-bind-address "127.0.0.1:29108" \ Mar 16 13:07:25 crc kubenswrapper[5030]: --metrics-enable-pprof \ Mar 16 13:07:25 crc kubenswrapper[5030]: --metrics-enable-config-duration \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${ovn_v4_join_subnet_opt} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${ovn_v6_join_subnet_opt} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${ovn_v4_transit_switch_subnet_opt} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${ovn_v6_transit_switch_subnet_opt} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${dns_name_resolver_enabled_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${persistent_ips_enabled_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${multi_network_enabled_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${network_segmentation_enabled_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${gateway_mode_flags} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${route_advertisements_enable_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${preconfigured_udn_addresses_enable_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-egress-ip=true \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-egress-firewall=true \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-egress-qos=true \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-egress-service=true \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-multicast \ Mar 16 13:07:25 crc kubenswrapper[5030]: --enable-multi-external-gateway=true \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${multi_network_policy_enabled_flag} \ Mar 16 13:07:25 crc kubenswrapper[5030]: ${admin_network_policy_enabled_flag} Mar 16 13:07:25 crc kubenswrapper[5030]: ],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics-port,HostPort:29108,ContainerPort:29108,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:OVN_KUBE_LOG_LEVEL,Value:4,ValueFrom:nil,},EnvVar{Name:K8S_NODE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:spec.nodeName,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:POD_NAME,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.name,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{314572800 0} {} 300Mi BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:ovnkube-config,ReadOnly:false,MountPath:/run/ovnkube-config/,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:env-overrides,ReadOnly:false,MountPath:/env,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-klzfx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:FallbackToLogsOnError,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ovnkube-control-plane-57b78d8988-8ch6c_openshift-ovn-kubernetes(de3e8bdc-a01d-4a4e-8f3a-0e82826daace): CreateContainerConfigError: services have not yet been read at least once, cannot construct envvars Mar 16 13:07:25 crc kubenswrapper[5030]: > logger="UnhandledError" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.198579 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"kube-rbac-proxy\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\", failed to \"StartContainer\" for \"ovnkube-cluster-manager\" with CreateContainerConfigError: \"services have not yet been read at least once, cannot construct envvars\"]" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.206543 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.210024 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.210047 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.210079 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.210091 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.210100 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.211665 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.216779 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.222342 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.228422 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.233256 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.239103 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.244123 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.250805 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.257495 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.263157 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.267434 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.274317 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.279420 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.290934 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.297247 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.302141 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.307071 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.311138 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.311168 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.311179 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.311191 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.311201 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.318541 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.324450 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.329441 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.335708 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.341412 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.350492 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.355293 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.359925 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.366046 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.371829 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.376095 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.381912 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.387259 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.394668 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.407207 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.412975 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.413123 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.413150 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.413163 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.413177 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.413189 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.417617 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.424495 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.515408 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.515442 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.515453 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.515463 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.515471 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.594871 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.594951 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.594972 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595007 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.594989365 +0000 UTC m=+91.994301912 (durationBeforeRetry 2s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.595029 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595047 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595054 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595082 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.595074486 +0000 UTC m=+91.994387032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595113 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.595056 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595126 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595143 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595116 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.595098 +0000 UTC m=+91.994410547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595189 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.595181277 +0000 UTC m=+91.994493834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595220 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595248 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595457 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.595516 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.595500188 +0000 UTC m=+91.994812745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.617247 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.617280 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.617292 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.617307 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.617319 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.639320 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.639343 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.639351 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.639363 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.639371 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.645181 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"},\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.647036 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.647065 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.647075 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.647086 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.647094 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.652607 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"},\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.654431 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.654458 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.654469 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.654481 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.654489 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.659855 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"},\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.661603 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.661641 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.661653 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.661663 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.661670 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.666974 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"},\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.668588 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.668649 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.668659 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.668669 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.668675 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.674507 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"},\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.674643 5030 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.695810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.695878 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.695928 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:27.695914696 +0000 UTC m=+92.095227243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.718621 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.718665 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.718674 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.718685 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.718693 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.819884 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.819907 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.819917 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.819927 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.819935 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.921241 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.921273 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.921286 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.921298 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.921319 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:25Z","lastTransitionTime":"2026-03-16T13:07:25Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.946174 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.946200 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.946229 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.946306 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.946369 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.946462 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.947258 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:25 crc kubenswrapper[5030]: E0316 13:07:25.947331 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.949129 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01080b46-74f1-4191-8755-5152a57b3b25" path="/var/lib/kubelet/pods/01080b46-74f1-4191-8755-5152a57b3b25/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.949967 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09cfa50b-4138-4585-a53e-64dd3ab73335" path="/var/lib/kubelet/pods/09cfa50b-4138-4585-a53e-64dd3ab73335/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.951567 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd0fbac-8c0d-4228-8faa-abbeedabf7db" path="/var/lib/kubelet/pods/0dd0fbac-8c0d-4228-8faa-abbeedabf7db/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.952927 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0effdbcf-dd7d-404d-9d48-77536d665a5d" path="/var/lib/kubelet/pods/0effdbcf-dd7d-404d-9d48-77536d665a5d/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.955425 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="149b3c48-e17c-4a66-a835-d86dabf6ff13" path="/var/lib/kubelet/pods/149b3c48-e17c-4a66-a835-d86dabf6ff13/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.955501 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.957653 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16bdd140-dce1-464c-ab47-dd5798d1d256" path="/var/lib/kubelet/pods/16bdd140-dce1-464c-ab47-dd5798d1d256/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.959025 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f80adb-c1c3-49ba-8ee4-932c851d3897" path="/var/lib/kubelet/pods/18f80adb-c1c3-49ba-8ee4-932c851d3897/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.959983 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20ce4d18-fe25-4696-ad7c-1bd2d6200a3e" path="/var/lib/kubelet/pods/20ce4d18-fe25-4696-ad7c-1bd2d6200a3e/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.960545 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2325ffef-9d5b-447f-b00e-3efc429acefe" path="/var/lib/kubelet/pods/2325ffef-9d5b-447f-b00e-3efc429acefe/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.961653 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="301e1965-1754-483d-b6cc-bfae7038bbca" path="/var/lib/kubelet/pods/301e1965-1754-483d-b6cc-bfae7038bbca/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.961891 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.962598 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fa8943-81cc-4750-a0b7-0fa9ab5af883" path="/var/lib/kubelet/pods/31fa8943-81cc-4750-a0b7-0fa9ab5af883/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.963986 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a11a02-47e1-488f-b270-2679d3298b0e" path="/var/lib/kubelet/pods/42a11a02-47e1-488f-b270-2679d3298b0e/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.964883 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567683bd-0efc-4f21-b076-e28559628404" path="/var/lib/kubelet/pods/567683bd-0efc-4f21-b076-e28559628404/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.966317 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="584e1f4a-8205-47d7-8efb-3afc6017c4c9" path="/var/lib/kubelet/pods/584e1f4a-8205-47d7-8efb-3afc6017c4c9/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.966747 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593a3561-7760-45c5-8f91-5aaef7475d0f" path="/var/lib/kubelet/pods/593a3561-7760-45c5-8f91-5aaef7475d0f/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.967866 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebfebf6-3ecd-458e-943f-bb25b52e2718" path="/var/lib/kubelet/pods/5ebfebf6-3ecd-458e-943f-bb25b52e2718/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.968464 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6077b63e-53a2-4f96-9d56-1ce0324e4913" path="/var/lib/kubelet/pods/6077b63e-53a2-4f96-9d56-1ce0324e4913/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.968468 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.969862 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca" path="/var/lib/kubelet/pods/6a81eec9-f29e-49a0-a15a-f2f5bd2d95ca/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.970849 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6edfcf45-925b-4eff-b940-95b6fc0b85d4" path="/var/lib/kubelet/pods/6edfcf45-925b-4eff-b940-95b6fc0b85d4/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.971893 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee8fbd3-1f81-4666-96da-5afc70819f1a" path="/var/lib/kubelet/pods/6ee8fbd3-1f81-4666-96da-5afc70819f1a/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.973127 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a" path="/var/lib/kubelet/pods/71c8ffbe-59c6-4e7d-aa1a-bbd315b3414a/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.974240 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.975171 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="736c54fe-349c-4bb9-870a-d1c1d1c03831" path="/var/lib/kubelet/pods/736c54fe-349c-4bb9-870a-d1c1d1c03831/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.975885 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7599e0b6-bddf-4def-b7f2-0b32206e8651" path="/var/lib/kubelet/pods/7599e0b6-bddf-4def-b7f2-0b32206e8651/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.976864 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7afa918d-be67-40a6-803c-d3b0ae99d815" path="/var/lib/kubelet/pods/7afa918d-be67-40a6-803c-d3b0ae99d815/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.977896 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7df94c10-441d-4386-93a6-6730fb7bcde0" path="/var/lib/kubelet/pods/7df94c10-441d-4386-93a6-6730fb7bcde0/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.979010 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fcc6409-8a0f-44c3-89e7-5aecd7610f8a" path="/var/lib/kubelet/pods/7fcc6409-8a0f-44c3-89e7-5aecd7610f8a/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.979902 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e39f7b-62e4-4fc9-992a-6535ce127a02" path="/var/lib/kubelet/pods/81e39f7b-62e4-4fc9-992a-6535ce127a02/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.980486 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869851b9-7ffb-4af0-b166-1d8aa40a5f80" path="/var/lib/kubelet/pods/869851b9-7ffb-4af0-b166-1d8aa40a5f80/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.982617 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff" path="/var/lib/kubelet/pods/9276f8f5-2f24-48e1-ab6d-1aab0d8ec3ff/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.983084 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92dfbade-90b6-4169-8c07-72cff7f2c82b" path="/var/lib/kubelet/pods/92dfbade-90b6-4169-8c07-72cff7f2c82b/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.984451 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a6e063-3d1a-4d44-875d-185291448c31" path="/var/lib/kubelet/pods/94a6e063-3d1a-4d44-875d-185291448c31/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.984718 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.985565 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f71a554-e414-4bc3-96d2-674060397afe" path="/var/lib/kubelet/pods/9f71a554-e414-4bc3-96d2-674060397afe/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.987714 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a208c9c2-333b-4b4a-be0d-bc32ec38a821" path="/var/lib/kubelet/pods/a208c9c2-333b-4b4a-be0d-bc32ec38a821/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.988750 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a52afe44-fb37-46ed-a1f8-bf39727a3cbe" path="/var/lib/kubelet/pods/a52afe44-fb37-46ed-a1f8-bf39727a3cbe/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.989879 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.989923 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a555ff2e-0be6-46d5-897d-863bb92ae2b3" path="/var/lib/kubelet/pods/a555ff2e-0be6-46d5-897d-863bb92ae2b3/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.990356 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7a88189-c967-4640-879e-27665747f20c" path="/var/lib/kubelet/pods/a7a88189-c967-4640-879e-27665747f20c/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.991047 5030 kubelet_volumes.go:152] "Cleaned up orphaned volume subpath from pod" podUID="af33e427-6803-48c2-a76a-dd9deb7cbf9a" path="/var/lib/kubelet/pods/af33e427-6803-48c2-a76a-dd9deb7cbf9a/volume-subpaths/run-systemd/ovnkube-controller/6" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.991485 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af33e427-6803-48c2-a76a-dd9deb7cbf9a" path="/var/lib/kubelet/pods/af33e427-6803-48c2-a76a-dd9deb7cbf9a/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.994108 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af41de71-79cf-4590-bbe9-9e8b848862cb" path="/var/lib/kubelet/pods/af41de71-79cf-4590-bbe9-9e8b848862cb/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.996051 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a" path="/var/lib/kubelet/pods/b05a4c1d-fa93-4d3d-b6e5-235473e1ae2a/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.996113 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.997690 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4750666-1362-4001-abd0-6f89964cc621" path="/var/lib/kubelet/pods/b4750666-1362-4001-abd0-6f89964cc621/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.998929 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b605f283-6f2e-42da-a838-54421690f7d0" path="/var/lib/kubelet/pods/b605f283-6f2e-42da-a838-54421690f7d0/volumes" Mar 16 13:07:25 crc kubenswrapper[5030]: I0316 13:07:25.999371 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c491984c-7d4b-44aa-8c1e-d7974424fa47" path="/var/lib/kubelet/pods/c491984c-7d4b-44aa-8c1e-d7974424fa47/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.000751 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f2bfad-70f6-4185-a3d9-81ce12720767" path="/var/lib/kubelet/pods/c5f2bfad-70f6-4185-a3d9-81ce12720767/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.001397 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc85e424-18b2-4924-920b-bd291a8c4b01" path="/var/lib/kubelet/pods/cc85e424-18b2-4924-920b-bd291a8c4b01/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.001885 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce090a97-9ab6-4c40-a719-64ff2acd9778" path="/var/lib/kubelet/pods/ce090a97-9ab6-4c40-a719-64ff2acd9778/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.003071 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19cb085-0c5b-4810-b654-ce7923221d90" path="/var/lib/kubelet/pods/d19cb085-0c5b-4810-b654-ce7923221d90/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.004033 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d45be74c-0d98-4d18-90e4-f7ef1b6daaf7" path="/var/lib/kubelet/pods/d45be74c-0d98-4d18-90e4-f7ef1b6daaf7/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.005439 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d565531a-ff86-4608-9d19-767de01ac31b" path="/var/lib/kubelet/pods/d565531a-ff86-4608-9d19-767de01ac31b/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.006274 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e8f42f-dc0e-424b-bb56-5ec849834888" path="/var/lib/kubelet/pods/d7e8f42f-dc0e-424b-bb56-5ec849834888/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.006568 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.007251 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9" path="/var/lib/kubelet/pods/dcd10325-9ba5-4a3b-8e4a-e57e3bf210f9/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.008261 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e093be35-bb62-4843-b2e8-094545761610" path="/var/lib/kubelet/pods/e093be35-bb62-4843-b2e8-094545761610/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.009857 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d2a42d-af1d-4054-9618-ab545e0ed8b7" path="/var/lib/kubelet/pods/e1d2a42d-af1d-4054-9618-ab545e0ed8b7/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.010868 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f559dfa3-3917-43a2-97f6-61ddfda10e93" path="/var/lib/kubelet/pods/f559dfa3-3917-43a2-97f6-61ddfda10e93/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.013417 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65c0ac1-8bca-454d-a2e6-e35cb418beac" path="/var/lib/kubelet/pods/f65c0ac1-8bca-454d-a2e6-e35cb418beac/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.014209 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4" path="/var/lib/kubelet/pods/f7648cbb-48eb-4ba8-87ec-eb096b8fa1e4/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.014529 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.016117 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e2c886-118e-43bb-bef1-c78134de392b" path="/var/lib/kubelet/pods/f7e2c886-118e-43bb-bef1-c78134de392b/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.017194 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8db2c7-859d-47b3-a900-2bd0c0b2973b" path="/var/lib/kubelet/pods/fc8db2c7-859d-47b3-a900-2bd0c0b2973b/volumes" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022516 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022716 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022752 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022765 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022778 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.022787 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.029858 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.037131 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.045060 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.053679 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.060348 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.064790 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.071867 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.077048 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.088454 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.124835 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.124871 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.124882 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.124899 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.124908 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.226112 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.226139 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.226148 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.226159 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.226167 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.327932 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.327959 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.327970 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.327979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.327986 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.429978 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.430014 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.430024 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.430038 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.430048 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.531175 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.531209 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.531241 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.531256 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.531264 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.633029 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.633052 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.633061 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.633072 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.633080 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.734081 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.734109 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.734118 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.734130 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.734138 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.765113 5030 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.835707 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.835774 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.835786 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.835813 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.835827 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.937957 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.937996 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.938008 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.938021 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:26 crc kubenswrapper[5030]: I0316 13:07:26.938030 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:26Z","lastTransitionTime":"2026-03-16T13:07:26Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.040139 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.040175 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.040190 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.040203 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.040211 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.142150 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.142178 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.142187 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.142199 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.142208 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.243373 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.243410 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.243421 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.243437 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.243448 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.345347 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.345383 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.345392 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.345403 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.345411 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.447740 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.447780 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.447797 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.447814 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.447866 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.549233 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.549292 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.549305 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.549317 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.549326 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.610224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610370 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.610414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610460 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.610425797 +0000 UTC m=+96.009738354 (durationBeforeRetry 4s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.610509 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.610579 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.610614 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610687 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.610665479 +0000 UTC m=+96.009978026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610811 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610846 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610868 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610887 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610900 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610908 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.610898429 +0000 UTC m=+96.010210975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610951 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.610928665 +0000 UTC m=+96.010241212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610848 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.610983 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.611038 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.611027512 +0000 UTC m=+96.010340069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.651118 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.651157 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.651167 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.651183 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.651193 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.711187 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.711314 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.711362 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:31.711348662 +0000 UTC m=+96.110661199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.752495 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.752518 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.752529 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.752539 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.752575 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.854540 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.854597 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.854607 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.854617 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.854628 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.946662 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.946802 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.946889 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.946791 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.946833 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.947202 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.947265 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:27 crc kubenswrapper[5030]: E0316 13:07:27.947314 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.956196 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.956222 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.956232 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.956243 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:27 crc kubenswrapper[5030]: I0316 13:07:27.956252 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:27Z","lastTransitionTime":"2026-03-16T13:07:27Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.058039 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.058148 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.058234 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.058311 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.058384 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.159864 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.159897 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.159909 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.159921 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.159930 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.261218 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.261244 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.261252 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.261263 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.261272 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.363050 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.363076 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.363085 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.363096 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.363105 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.465079 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.465117 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.465128 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.465141 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.465150 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.567173 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.567200 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.567211 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.567221 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.567228 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.669307 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.669338 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.669349 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.669362 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.669370 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.770478 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.770503 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.770514 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.770523 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.770531 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.872293 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.872340 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.872350 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.872364 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.872374 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.973974 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.974009 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.974021 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.974034 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:28 crc kubenswrapper[5030]: I0316 13:07:28.974044 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:28Z","lastTransitionTime":"2026-03-16T13:07:28Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.075889 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.075931 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.075940 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.075954 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.075964 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.178075 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.178129 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.178141 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.178157 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.178169 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.280008 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.280048 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.280059 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.280072 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.280082 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.381593 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.381644 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.381666 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.381690 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.381705 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.482942 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.482980 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.482991 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.483007 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.483017 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.584342 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.584397 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.584407 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.584442 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.584451 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.686544 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.686586 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.686599 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.686610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.686618 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.788325 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.788389 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.788407 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.788428 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.788444 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.890413 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.890462 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.890472 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.890483 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.890492 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.945892 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.945913 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:29 crc kubenswrapper[5030]: E0316 13:07:29.946003 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.946078 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:29 crc kubenswrapper[5030]: E0316 13:07:29.946237 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:29 crc kubenswrapper[5030]: E0316 13:07:29.946328 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.946377 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:29 crc kubenswrapper[5030]: E0316 13:07:29.946465 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.991755 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.991848 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.991922 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.991977 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:29 crc kubenswrapper[5030]: I0316 13:07:29.992039 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:29Z","lastTransitionTime":"2026-03-16T13:07:29Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.093270 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.093303 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.093314 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.093347 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.093356 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.195507 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.195564 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.195576 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.195592 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.195603 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.296761 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.296790 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.296802 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.296815 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.296824 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.399470 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.399627 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.399706 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.399774 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.399912 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.501402 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.501507 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.501589 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.501687 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.501746 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.602890 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.603195 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.603250 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.603301 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.603356 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.704519 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.704641 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.704729 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.704807 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.704861 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.806045 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.806076 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.806088 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.806102 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.806111 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.907700 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.907753 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.907764 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.907775 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:30 crc kubenswrapper[5030]: I0316 13:07:30.907784 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:30Z","lastTransitionTime":"2026-03-16T13:07:30Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.009857 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.009917 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.009932 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.009952 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.009968 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.112109 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.112139 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.112166 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.112181 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.112190 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.213523 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.213568 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.213579 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.213590 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.213598 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.314800 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.314835 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.314846 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.314861 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.314873 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.416784 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.416885 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.416953 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.417017 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.417068 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.518807 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.518936 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.518999 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.519062 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.519130 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.620784 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.620806 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.620814 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.620824 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.620831 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.645262 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.645322 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.645361 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.645380 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.645403 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645508 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645528 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645537 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645597 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.64558447 +0000 UTC m=+104.044897017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645640 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.645634123 +0000 UTC m=+104.044946670 (durationBeforeRetry 8s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645689 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645697 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645704 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645722 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.64571723 +0000 UTC m=+104.045029777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645758 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645776 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.645771121 +0000 UTC m=+104.045083668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645824 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.645844 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.645837958 +0000 UTC m=+104.045150504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.722174 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.722281 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.722337 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.722405 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.722465 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.746782 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.746965 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.747036 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:39.747022566 +0000 UTC m=+104.146335113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.824584 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.824615 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.824633 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.824682 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.824690 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.926718 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.926814 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.926894 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.926962 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.927024 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:31Z","lastTransitionTime":"2026-03-16T13:07:31Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.945088 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.945126 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.945220 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.945294 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.945421 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:31 crc kubenswrapper[5030]: I0316 13:07:31.945487 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.945710 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:31 crc kubenswrapper[5030]: E0316 13:07:31.945571 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.028841 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.028877 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.028907 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.028920 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.028930 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.130076 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.130139 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.130152 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.130162 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.130169 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.231931 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.231957 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.231965 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.231977 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.231984 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.333282 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.333315 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.333326 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.333339 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.333348 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.435161 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.435202 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.435215 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.435229 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.435239 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.536581 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.536616 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.536628 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.536640 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.536649 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.638115 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.638144 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.638154 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.638165 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.638173 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.739937 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.739963 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.739972 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.739983 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.739991 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.841812 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.841840 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.841850 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.841860 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.841867 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.942852 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.942872 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.942881 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.942891 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:32 crc kubenswrapper[5030]: I0316 13:07:32.942900 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:32Z","lastTransitionTime":"2026-03-16T13:07:32Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.044062 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.044196 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.044274 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.044350 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.044413 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.145291 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.145317 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.145327 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.145338 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.145345 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.247111 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.247195 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.247259 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.247313 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.247381 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.349277 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.349315 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.349324 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.349335 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.349345 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.450595 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.450619 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.450631 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.450662 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.450680 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.552517 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.552540 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.552577 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.552588 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.552596 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.654838 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.654861 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.654871 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.654881 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.654888 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.756369 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.756432 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.756444 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.756454 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.756461 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.857944 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.857975 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.857985 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.857997 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.858006 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.945610 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:33 crc kubenswrapper[5030]: E0316 13:07:33.945713 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.945819 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.945860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.945922 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:33 crc kubenswrapper[5030]: E0316 13:07:33.946015 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:33 crc kubenswrapper[5030]: E0316 13:07:33.946111 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:33 crc kubenswrapper[5030]: E0316 13:07:33.946253 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.959488 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.959513 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.959523 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.959537 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:33 crc kubenswrapper[5030]: I0316 13:07:33.959566 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:33Z","lastTransitionTime":"2026-03-16T13:07:33Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.061006 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.061134 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.061225 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.061299 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.061358 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.162667 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.162716 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.162729 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.162743 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.162753 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.263661 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.263703 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.263716 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.263728 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.263735 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.364537 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.364588 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.364599 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.364612 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.364621 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.465610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.465636 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.465645 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.465655 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.465662 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.567082 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.567107 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.567124 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.567134 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.567141 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.668700 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.668729 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.668738 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.668749 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.668757 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.769942 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.769970 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.769979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.769989 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.770000 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.871130 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.871179 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.871191 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.871202 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.871213 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.972980 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.973003 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.973011 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.973035 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:34 crc kubenswrapper[5030]: I0316 13:07:34.973043 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:34Z","lastTransitionTime":"2026-03-16T13:07:34Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.073957 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.073983 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.073993 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.074005 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.074014 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.175216 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.175248 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.175258 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.175273 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.175281 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.277145 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.277183 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.277193 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.277204 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.277211 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.378402 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.378434 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.378443 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.378454 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.378462 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.480267 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.480293 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.480302 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.480312 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.480319 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.581664 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.581695 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.581704 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.581731 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.581740 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.683215 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.683242 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.683252 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.683280 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.683288 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.784727 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.784754 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.784763 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.784774 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.784781 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.885724 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.886150 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.886189 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.886206 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.886223 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.944904 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.944938 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.944980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.945239 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.945248 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.945326 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.945385 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.945497 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.952753 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.957494 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.964481 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.969926 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.981328 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.982030 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.982057 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.982066 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.982079 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.982087 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.987838 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.988221 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.989717 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.989739 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.989750 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.989760 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.989769 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.994296 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: E0316 13:07:35.997363 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.999149 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.999172 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.999183 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.999194 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:35 crc kubenswrapper[5030]: I0316 13:07:35.999202 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:35Z","lastTransitionTime":"2026-03-16T13:07:35Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.000653 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: E0316 13:07:36.004630 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:35Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006256 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006603 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006628 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006638 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006649 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.006657 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: E0316 13:07:36.012071 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.013934 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.013968 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.013981 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.013993 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.014001 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.018072 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: E0316 13:07:36.019911 5030 kubelet_node_status.go:597] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"allocatable\\\":{\\\"cpu\\\":\\\"11800m\\\",\\\"ephemeral-storage\\\":\\\"76396645454\\\",\\\"memory\\\":\\\"32400456Ki\\\"},\\\"capacity\\\":{\\\"cpu\\\":\\\"12\\\",\\\"ephemeral-storage\\\":\\\"83293888Ki\\\",\\\"memory\\\":\\\"32861256Ki\\\"},\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has sufficient memory available\\\",\\\"reason\\\":\\\"KubeletHasSufficientMemory\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has no disk pressure\\\",\\\"reason\\\":\\\"KubeletHasNoDiskPressure\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"kubelet has sufficient PID available\\\",\\\"reason\\\":\\\"KubeletHasSufficientPID\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:36Z\\\",\\\"message\\\":\\\"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?\\\",\\\"reason\\\":\\\"KubeletNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c8a088031661d94022418e93fb63744c38e1c4cff93ea3b95c096a290c2b7a3\\\"],\\\"sizeBytes\\\":2981840865},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\"],\\\"sizeBytes\\\":1641503854},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:286bb0beab328954b0a86b7f066fd5a843b462d6acb2812df7ec788015cd32d4\\\",\\\"registry.redhat.io/redhat/redhat-operator-index@sha256:be02784ed82978c399102be1c6c9f2ca441be4d984e0fd7100c155dd4417ebbf\\\",\\\"registry.redhat.io/redhat/redhat-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1597684406},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\"],\\\"sizeBytes\\\":1261384762},{\\\"names\\\":[\\\"registry.redhat.io/redhat/community-operator-index@sha256:0d50962980a5aeecae2d99c98913fb0f46940164e41de0af2ba0e3dafe0d9017\\\",\\\"registry.redhat.io/redhat/community-operator-index@sha256:8d607fb6cc75ca36bca1e0a9c5bea5d1919b75db20733df69c64c8a10ee8083d\\\",\\\"registry.redhat.io/redhat/community-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1224304325},{\\\"names\\\":[\\\"registry.redhat.io/redhat/certified-operator-index@sha256:541db5b20a3d2199602b3b5ac80f09ea31498034e9ae3841238b03a39150f0d7\\\",\\\"registry.redhat.io/redhat/certified-operator-index@sha256:a4c5df55584cba56f00004a090923a5c6de2071add5eb1672a5e20aa646aad8c\\\",\\\"registry.redhat.io/redhat/certified-operator-index:v4.20\\\"],\\\"sizeBytes\\\":1126957757},{\\\"names\\\":[\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:b1c859067d6b7b785ab4977ed7137c5b3bb257234f7d7737a1d2836cef1576b5\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index@sha256:df08951924aa23b2333436a1d04b2dba56c366bb4f09d39ae3aedb980e4fb909\\\",\\\"registry.redhat.io/redhat/redhat-marketplace-index:v4.20\\\"],\\\"sizeBytes\\\":1079537324},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\"],\\\"sizeBytes\\\":1052707833},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8d1a1e4abe0326c3af89e9eaa4b7449dd2d5b6f9403c677e19b00b24947b1df9\\\"],\\\"sizeBytes\\\":989392005},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2b1fc3d5bb4944cbd5b23b87566d7ba24b1b66f5a0465f76bcc05023191cc47\\\"],\\\"sizeBytes\\\":971668163},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\"],\\\"sizeBytes\\\":969078739},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7e3d6c8802ae53d6aecf38aa7b560d7892193806bdeb3d7c1637fac77c47fd1f\\\"],\\\"sizeBytes\\\":876488654},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\"],\\\"sizeBytes\\\":847332502},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:36c4867005702f0c4cbfcfa33f18a98596a6c9b1340b633c85ccef84a0c4f889\\\"],\\\"sizeBytes\\\":769516783},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\"],\\\"sizeBytes\\\":721591926},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\"],\\\"sizeBytes\\\":646867625},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\"],\\\"sizeBytes\\\":638910445},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae245c97fc463e876c3024efb806fa8f4efb13b3f06f1bdd3e7e1447f5a5dce4\\\"],\\\"sizeBytes\\\":617699779},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d4926e304011637ca9df370a193896d685f0f3ffabbec234ec827abdbeb083f9\\\"],\\\"sizeBytes\\\":607756695},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\"],\\\"sizeBytes\\\":584721741},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\"],\\\"sizeBytes\\\":545674969},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:574d49b89604b8e8103abf57feee77812fe8cf441eafc17fdff95d57ca80645e\\\"],\\\"sizeBytes\\\":542463064},{\\\"names\\\":[\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\"],\\\"sizeBytes\\\":539380592},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9506bdcf97d5200cf2cf4cdf110aebafdd141a24f6589bf1e1cfe27bb7fc1ed2\\\"],\\\"sizeBytes\\\":533027808},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\"],\\\"sizeBytes\\\":528200501},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\"],\\\"sizeBytes\\\":527774342},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e5e8108294b086fdb797365e5a46badba9b3d866bdcddc8460a51e05a253753d\\\"],\\\"sizeBytes\\\":526632426},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5827f6ae3beb4853192e02cc18890467bd251b33070f36f9a105991e7e6d3c9b\\\"],\\\"sizeBytes\\\":522490210},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:66c8fe5d45ff249643dae75185dd2787ea1b0ae87d5699a8222149c07689557c\\\"],\\\"sizeBytes\\\":520141094},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:baf975b6944f2844860c440636e0d4b80b2fdc473d30f32ae7d6989f2fc2b135\\\"],\\\"sizeBytes\\\":519815758},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:765cf9c3ebf4df049ebc022beaaf52f52852cf89fb802034536ad91dd45db807\\\"],\\\"sizeBytes\\\":519539350},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:52e442bc8198ac925caff87ddd35b3107b7375d5afc9c2eb041ca4e79db72c6f\\\"],\\\"sizeBytes\\\":518690683},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:43b0e0b7e1955ee905e48799a62f50b8a8df553190415ce1f5550375c2507ca5\\\"],\\\"sizeBytes\\\":518251952},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:977a316fa3598eb575a4477dafc09bbf06fad21c4ec2867052225d74f2a9f366\\\"],\\\"sizeBytes\\\":511136541},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\"],\\\"sizeBytes\\\":510122097},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dbd8603d717c26901bcf9731b1e0392ae4bc08a270ed1eeb45839e44bed9607d\\\"],\\\"sizeBytes\\\":508941917},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\"],\\\"sizeBytes\\\":508318343},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a726c68cebc9b08edd734a8bae5150ae5950f7734fe9b9c2a6e0d06f21cc095\\\"],\\\"sizeBytes\\\":498380948},{\\\"names\\\":[\\\"quay.io/crcont/ocp-release@sha256:82501261b9c63012ba3b83fe4d6703c0af5eb9c9151670eb90ae480b9507d761\\\"],\\\"sizeBytes\\\":497232440},{\\\"names\\\":[\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:4e4239621caed0b0d9132d167403631e9af86be9a395977f013e201ead281bb4\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:c0b1bec73fdb6853eb3bd9e9733aee2d760ca09a33cfd94adf9ab7b706e83fa9\\\",\\\"registry.redhat.io/openshift4/ose-csi-external-provisioner:latest\\\"],\\\"sizeBytes\\\":491224335},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b0f7abf2f97afd1127d9245d764338c6047bac1711b2cee43112570a85946360\\\"],\\\"sizeBytes\\\":490381192},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:21b12ff0c81c1d535e7c31aff3a73b1e9ca763e5f88037f59ade0dfab6ed8946\\\"],\\\"sizeBytes\\\":482632652},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:036ed6efe4cb5f5b90ee7f9ef5297c8591b8d67aa36b3c58b4fc5417622a140c\\\"],\\\"sizeBytes\\\":477561861},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0fe5a041a2b99d736e82f1b4a6cd9792c5e23ded475e9f0742cd19234070f989\\\"],\\\"sizeBytes\\\":475327956},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\"],\\\"sizeBytes\\\":475137830},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2599f32933f5fea6066ede54ad8f6150adb7bd9067892f251d5913121d5c630d\\\"],\\\"sizeBytes\\\":472771950},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:651bbe9d418f49c2c889d731df67cf5d88dff59dc03f5a1b5d4c8bb3ae001f1a\\\"],\\\"sizeBytes\\\":469976318},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4fe612a1572df462d6a4b664a10bc2e6cad239648acbf8c0303f8fca5d2596c0\\\"],\\\"sizeBytes\\\":468393024},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a5bb05344dd2296077f5066e908ede0eea23f5a12fb78ef86a9513c88d3faaca\\\"],\\\"sizeBytes\\\":464375011},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\"],\\\"sizeBytes\\\":462844959}],\\\"nodeInfo\\\":{\\\"bootID\\\":\\\"7cb912b0-94fc-4f44-a6eb-070b5fb0188e\\\",\\\"systemUUID\\\":\\\"55cafcc5-d327-4b26-a8f9-6f3f352fb179\\\"}}}\" for node \"crc\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/node?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: E0316 13:07:36.020023 5030 kubelet_node_status.go:584] "Unable to update node status" err="update node status exceeds retry count" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.020782 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.020845 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.020860 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.020872 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.020881 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.023942 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.028989 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.034739 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.042741 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.047428 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.053237 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.058704 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.065624 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":3,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"back-off 40s restarting failed container=kube-apiserver-check-endpoints pod=kube-apiserver-crc_openshift-kube-apiserver(3a14caf222afb62aaabdc47808b6f944)\\\",\\\"reason\\\":\\\"CrashLoopBackOff\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.072315 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.122893 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.122921 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.122932 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.122945 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.122954 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.224045 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.224082 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.224094 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.224108 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.224119 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.325430 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.325456 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.325464 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.325473 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.325481 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.427143 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.427181 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.427193 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.427206 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.427215 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.529151 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.529245 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.529320 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.529390 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.529443 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.630801 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.630830 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.630841 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.630861 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.630871 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.732666 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.732710 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.732720 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.732730 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.732738 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.799275 5030 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.834493 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.834517 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.834526 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.834538 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.834546 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.936319 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.936474 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.936544 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.936640 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.936715 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:36Z","lastTransitionTime":"2026-03-16T13:07:36Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:36 crc kubenswrapper[5030]: I0316 13:07:36.946094 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.038959 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.039004 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.039015 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.039029 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.039041 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.141768 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.141817 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.141827 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.141844 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.141856 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.221927 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.223365 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"3a14caf222afb62aaabdc47808b6f944","Type":"ContainerStarted","Data":"d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.223838 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.224546 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" event={"ID":"34177974-8d82-49d2-a763-391d0df3bbd8","Type":"ContainerStarted","Data":"7fd73b9a7c815cc65851d1fa5e901fe68560e5c6916accc2079af883b1f9ab44"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.236849 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.243415 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.243444 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.243454 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.243467 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.243475 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.244682 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.251382 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.257832 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-operator]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":false,\\\"restartCount\\\":5,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.263647 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.272532 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.277124 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.281644 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.287224 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.293253 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.298251 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.304461 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.309561 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.316491 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":4,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.322898 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.329471 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.333860 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.340603 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345063 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345097 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345108 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345121 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345132 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.345951 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.353846 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":4,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.360208 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.366178 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.370938 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.377719 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.383026 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.393787 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.399750 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.405214 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.411236 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7fd73b9a7c815cc65851d1fa5e901fe68560e5c6916accc2079af883b1f9ab44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.420428 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.433435 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [kubecfg-setup]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.439752 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.445028 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.447037 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.447068 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.447079 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.447091 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.447101 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.452208 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.459102 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.464525 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.470995 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.477077 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.548592 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.548643 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.548655 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.548668 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.548676 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.650112 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.650147 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.650158 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.650171 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.650182 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.751856 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.751905 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.751916 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.751931 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.751941 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.853627 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.853651 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.853659 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.853670 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.853678 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.945607 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:37 crc kubenswrapper[5030]: E0316 13:07:37.945846 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.946001 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:37 crc kubenswrapper[5030]: E0316 13:07:37.946065 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.946122 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:37 crc kubenswrapper[5030]: E0316 13:07:37.946247 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.946283 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:37 crc kubenswrapper[5030]: E0316 13:07:37.946335 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.955244 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.955297 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.955308 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.955319 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:37 crc kubenswrapper[5030]: I0316 13:07:37.955330 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:37Z","lastTransitionTime":"2026-03-16T13:07:37Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.056987 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.057021 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.057034 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.057048 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.057057 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.159480 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.159517 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.159527 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.159542 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.159569 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.226952 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" exitCode=0 Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.227005 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.229109 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerStarted","Data":"9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.230370 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"73e8a1492822fe5491a7af7d1a846326e8b59453be8c7df288f5a4f265c3b72a"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.230399 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.237659 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7fd73b9a7c815cc65851d1fa5e901fe68560e5c6916accc2079af883b1f9ab44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.244993 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.254365 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.258707 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.261264 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.261300 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.261310 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.261337 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.261347 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.264561 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.270382 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.276378 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.281257 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.290512 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.297610 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.310664 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":4,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.317880 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.323482 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.328347 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.337859 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.345765 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [machine-config-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.361474 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.362625 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.362666 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.362676 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.362705 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.362715 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.369729 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.377057 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.382196 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.387468 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.393322 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.400832 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.409406 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.416464 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.421896 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.429604 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":4,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.437089 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.443824 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.448442 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.455714 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [egress-router-binary-copy cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":false,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.462523 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://73e8a1492822fe5491a7af7d1a846326e8b59453be8c7df288f5a4f265c3b72a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.464760 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.464792 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.464804 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.464817 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.464825 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.475611 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.482203 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.488679 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.495357 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7fd73b9a7c815cc65851d1fa5e901fe68560e5c6916accc2079af883b1f9ab44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.501229 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.511497 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.567836 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.567872 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.567882 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.567897 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.567910 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.669422 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.669521 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.669630 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.669714 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.669784 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.771366 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.771394 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.771403 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.771416 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.771424 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.872358 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.872401 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.872412 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.872428 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.872437 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.975728 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.975781 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.975799 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.975824 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:38 crc kubenswrapper[5030]: I0316 13:07:38.975833 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:38Z","lastTransitionTime":"2026-03-16T13:07:38Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.078403 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.078577 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.078588 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.078607 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.078617 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.180243 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.180276 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.180287 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.180301 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.180311 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235835 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235844 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235852 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.235860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.236773 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d" exitCode=0 Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.236856 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.238825 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-952wf" event={"ID":"78bd1260-3469-4a38-899e-5923bffe1b59","Type":"ContainerStarted","Data":"72ac4f61469f5fbbfe1ca22390f6f7fc48db5e6ef840583d474569e7d634b831"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.244799 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"e7dfbadc21f5c9dc930dd9c6f97e2152fe91d872f0b292aae36e0890436210b2"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.244823 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" event={"ID":"fc4541ce-7789-4670-bc75-5c2868e52ce0","Type":"ContainerStarted","Data":"40ebb7bf9f9db00918568f8c02c87e6375d4f558415ec5a74aecdb237d996e40"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.245240 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-rbac-proxy ovnkube-cluster-manager]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-control-plane-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-cluster-manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-klzfx\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-control-plane-57b78d8988-8ch6c\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.255025 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"35794383-12ee-45b9-b4b5-e9653ba4f6f2\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-apiserver-check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"265m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-bundle-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-regeneration-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438\\\",\\\"exitCode\\\":255,\\\"finishedAt\\\":\\\"2026-03-16T13:06:50Z\\\",\\\"message\\\":\\\"vvar.go:172] \\\\\\\"Feature gate default state\\\\\\\" feature=\\\\\\\"InOrderInformers\\\\\\\" enabled=true\\\\nW0316 13:06:50.374294 1 builder.go:272] unable to get owner reference (falling back to namespace): pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\nI0316 13:06:50.374437 1 builder.go:304] check-endpoints version v0.0.0-unknown-c3d9642-c3d9642\\\\nI0316 13:06:50.375008 1 dynamic_serving_content.go:116] \\\\\\\"Loaded a new cert/key pair\\\\\\\" name=\\\\\\\"serving-cert::/tmp/serving-cert-2899512416/tls.crt::/tmp/serving-cert-2899512416/tls.key\\\\\\\"\\\\nI0316 13:06:50.741579 1 requestheader_controller.go:255] Loaded a new request header values for RequestHeaderAuthRequestController\\\\nI0316 13:06:50.744178 1 maxinflight.go:139] \\\\\\\"Initialized nonMutatingChan\\\\\\\" len=400\\\\nI0316 13:06:50.744195 1 maxinflight.go:145] \\\\\\\"Initialized mutatingChan\\\\\\\" len=200\\\\nI0316 13:06:50.744222 1 maxinflight.go:116] \\\\\\\"Set denominator for readonly requests\\\\\\\" limit=400\\\\nI0316 13:06:50.744227 1 maxinflight.go:120] \\\\\\\"Set denominator for mutating requests\\\\\\\" limit=200\\\\nI0316 13:06:50.747224 1 secure_serving.go:57] Forcing use of http/1.1 only\\\\nW0316 13:06:50.747247 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.\\\\nI0316 13:06:50.747247 1 genericapiserver.go:546] MuxAndDiscoveryComplete has all endpoints registered and discovery information is complete\\\\nW0316 13:06:50.747253 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.\\\\nW0316 13:06:50.747295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.\\\\nW0316 13:06:50.747299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.\\\\nW0316 13:06:50.747302 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.\\\\nW0316 13:06:50.747305 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.\\\\nF0316 13:06:50.748622 1 cmd.go:182] pods \\\\\\\"kube-apiserver-crc\\\\\\\" not found\\\\n\\\",\\\"reason\\\":\\\"Error\\\",\\\"startedAt\\\":\\\"2026-03-16T13:06:50Z\\\"}},\\\"name\\\":\\\"kube-apiserver-check-endpoints\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":4,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-apiserver-insecure-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/kube-apiserver\\\",\\\"name\\\":\\\"audit-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-apiserver\"/\"kube-apiserver-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.266240 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cd5369e3-8eb2-471a-82b0-7f919265b0ff\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:14Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://afc702329e34fae4a18bc2794e3a529dfc2ed61c646bb1b5cc5366d456471c54\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7c6a47106effd9e9a41131e2bf6c832b80cd77b3439334f760b35b0729f2fb00\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cluster-policy-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"60m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://95930e38b3ab5be6e0141ba69fd634a279a8ad1047524d16c87fe54e83b8e10f\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://c05111b7795c6743ec25430a6d3eb6eea34d7b65338981a4d0a535ece4b4c030\\\",\\\"image\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"imageID\\\":\\\"quay.io/crcont/openshift-crc-cluster-kube-controller-manager-operator@sha256:f69b9cc9b9cfde726109a9e12b80a3eefa472d7e29159df0fbc7143c48983cd6\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-controller-manager-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem\\\",\\\"name\\\":\\\"ca-trust-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/kubernetes\\\",\\\"name\\\":\\\"var-run-kubernetes\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-controller-manager\"/\"kube-controller-manager-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.272621 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0c056de0-55d1-45d5-83d2-46f885f123b1\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:51Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://90982aac65f23c00cadf88a7f9d1b28b305509f73d68a76eaaf6298553e69b14\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://d92ea45118a1420b7546b94b27abc946d53bf89ef9157d420c12eaa4b0ba8779\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-cert-syncer\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://cc66c04892953ddab9036ecf7561d6a2a65f4dbb9cd27df37577926fda34fb97\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e504172345491d90bbbf1e7e45488e73073f4c6d7c2355245871051596fc85db\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-scheduler-recovery-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a46fa8feeea5d04fd602559027f8bacc97e12bbf8e33793dca08e812e1f8825\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"wait-for-host-port\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"15m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5c1035ed3c170e733789c3114b402e2f91073429d31ab3d1e06063cb9503ebab\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-kube-scheduler\"/\"openshift-kube-scheduler-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.277244 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-image-registry/node-ca-98dmx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31a544e-cc56-4b4e-b639-91a00349a2da\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [node-ca]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcb03ccba25366bbdf74cbab6738e7ef1f97f62760886ec445a40cdf29b60418\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"node-ca\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/serviceca\\\",\\\"name\\\":\\\"serviceca\\\"},{\\\"mountPath\\\":\\\"/etc/docker/certs.d\\\",\\\"name\\\":\\\"host\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mtwtn\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-image-registry\"/\"node-ca-98dmx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.281950 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.281981 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.281992 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.282004 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.282012 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.285247 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a5092e19-dcde-4527-bb59-cb6c408d4411\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with incomplete status: [cni-plugins bond-cni-plugin routeoverride-cni whereabouts-cni-bincopy whereabouts-cni]\\\",\\\"reason\\\":\\\"ContainersNotInitialized\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus-additional-cni-plugins]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5a2a7b3c2f1598189d8880e6aa15ab11a65b201f25012f77ba41e7487a60729a\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://9577a2d388bc5e6fb04cc61cb649c61494eb7eb46c60b73dfce4d93b1e46ba1d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b55c029f731ebbde3c5580eef98a588264f4d6a8ae667805c9521dd1ecf1d5d\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6efa070ceb93cc5fc2e76eab6d9c96ac3c4f8812085d0b6eb6e3f513b5bac782\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3454e762466e22e2a893650b9781823558bc6fdfda2aa4188aff3cb819014c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be2edaed22535093bdb486afe5960ff4f3b0bd96f88dc1753b584cc28184a0b0\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-h4ssz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-9fvrp\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.292420 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"772f09fa-7db8-4626-a5ad-5c9779b8170d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://73e8a1492822fe5491a7af7d1a846326e8b59453be8c7df288f5a4f265c3b72a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"proxy-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"mcd-auth-proxy-config\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9414357f9345a841e0565265700ecc6637f846c83bd5908dbb7b306432465115\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"machine-config-daemon\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/rootfs\\\",\\\"name\\\":\\\"rootfs\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-skpbz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"machine-config-daemon-b7rgl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.304454 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-etcd/etcd-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1c89f7cd-ad21-40eb-9491-ef7c879bd3dd\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:06:12Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://de5a58c5f0e85856ab74e5938c3f8b6fb6455191598ddf0f8b521292c6c33e44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"300m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://6d94565ec29ac7cd4aecc9e454e69df28227e394b59b902af6350cdf130e1c93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"40m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7efd40896b97e426d591861669f2f4feed4ffbaa4bdc63bfb13a1b3c1b28ce59\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-readyz\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd/\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://11cbf39f7c6b92f01359340169c92b03dac4d7ff33c2b57b0e6c273bf77b834c\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf05b9b2ba66351a6c59f4259fb377f62237a00af3b4f0b95f64409e2f25770e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-rev\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/etcd\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://b2d186e4a95542a7b1c52dd0bff3f4e66db7dc0db8a0d7f706f1ad49771bcf94\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcdctl\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:59Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/manifests\\\",\\\"name\\\":\\\"static-pod-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd/\\\",\\\"name\\\":\\\"data-dir\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4ccaa780123be0d2add4fbdd75de4047a232658c66132f87225e328337a831ee\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/log/etcd\\\",\\\"name\\\":\\\"log-dir\\\"},{\\\"mountPath\\\":\\\"/var/lib/etcd-auto-backup\\\",\\\"name\\\":\\\"etcd-auto-backup-dir\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-ensure-env-vars\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://220e361a5d7061917ec47bde742874591d39b40771c124de6c566a70e7083fcf\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}}},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"},\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9e388ee2b3562b6267447cbcc4b95ca7a61bf361840d36a682480da671b83612\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"etcd-resources-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"60Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://5eaa4177e8fade31ee69751f2b5a46c8198d0eb707fd23bd156b01194919a54d\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:58Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:58Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-resources\\\",\\\"name\\\":\\\"resource-dir\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes/static-pod-certs\\\",\\\"name\\\":\\\"cert-dir\\\"},{\\\"mountPath\\\":\\\"/usr/local/bin\\\",\\\"name\\\":\\\"usr-local-bin\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-etcd\"/\"etcd-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.310817 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-node-identity/network-node-identity-dgvkt" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fc4541ce-7789-4670-bc75-5c2868e52ce0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [webhook approver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"approver\\\",\\\"ready\\\":false,\\\"restartCount\\\":6,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"webhook\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/webhook-cert/\\\",\\\"name\\\":\\\"webhook-cert\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/ovnkube-identity-config\\\",\\\"name\\\":\\\"ovnkube-identity-cm\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8nt2j\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-node-identity\"/\"network-node-identity-dgvkt\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.317983 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [iptables-alerter]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"iptables-alerter\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/iptables-alerter\\\",\\\"name\\\":\\\"iptables-alerter-script\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dsgwk\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"iptables-alerter-5jnd7\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.324706 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-operator/network-operator-7bdcf4f5bd-7fjxv" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"34177974-8d82-49d2-a763-391d0df3bbd8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:37Z\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://7fd73b9a7c815cc65851d1fa5e901fe68560e5c6916accc2079af883b1f9ab44\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-operator\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:37Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"host-etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/serving-cert\\\",\\\"name\\\":\\\"metrics-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-m7xz2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-network-operator\"/\"network-operator-7bdcf4f5bd-7fjxv\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.330536 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17b87002-b798-480a-8e17-83053d698239\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-check-target-container]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"network-check-target-container\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-gwt8b\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-target-fhkjl\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.346776 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92122bee-3681-4341-b3d4-f23c56fb9a6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [ovn-controller ovn-acl-logging kube-rbac-proxy-node kube-rbac-proxy-ovn-metrics northd nbdb sbdb ovnkube-controller]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:174629230f874ae7d9ceda909ef45aced0cc8b21537851a0aceca55b0685b122\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kubecfg-setup\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:07:38Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:07:38Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xs95x\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-s9mkc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.359753 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"713054df-4196-45ae-8e8e-b3f526c510e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [network-metrics-daemon kube-rbac-proxy]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/metrics\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:49b34ce0d25eec7a6077f4bf21bf7d4e64e598d28785a20b9ee3594423b7de14\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"network-metrics-daemon\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vtnmd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"network-metrics-daemon-qxdgg\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.372819 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"91a04d36-7ad9-4e9a-ba11-eaca52cfceec\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:57Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://41d2338143db1982e9938570a0d88327c9629d76256bd44b58531b1df43cfebd\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-crio\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"20m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:05:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kube\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"var-lib-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"},\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16d5a229c172bde2f4238e8a88602fd6351d80b262f35484740a979d8b3567a5\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"setup\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"50Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://f28140b2cda7c502686a7ec5b76859473ccf257baa087c4289458a812451b26b\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-03-16T13:05:56Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-03-16T13:05:56Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var\\\",\\\"name\\\":\\\"var-lib-kubelet\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:05:56Z\\\"}}\" for pod \"openshift-machine-config-operator\"/\"kube-rbac-proxy-crio-crc\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.384056 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.384100 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.384110 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.384123 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.384131 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.385439 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.392116 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.397084 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [dns-node-resolver]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.404226 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-multus/multus-wfwbx" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c20ed32-4ad5-4984-9876-39b7b1ee1877\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [kube-multus]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:85f1323d589d7af13b096b1f9b438b9dfe08f3fab37534e2780e6490a665bf05\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"message\\\":\\\"services have not yet been read at least once, cannot construct envvars\\\",\\\"reason\\\":\\\"CreateContainerConfigError\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/run/multus/cni/net.d\\\",\\\"name\\\":\\\"multus-cni-dir\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/run/multus\\\",\\\"name\\\":\\\"multus-socket-dir-parent\\\"},{\\\"mountPath\\\":\\\"/run/k8s.cni.cncf.io\\\",\\\"name\\\":\\\"host-run-k8s-cni-cncf-io\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/bin\\\",\\\"name\\\":\\\"host-var-lib-cni-bin\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/multus\\\",\\\"name\\\":\\\"host-var-lib-cni-multus\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-var-lib-kubelet\\\"},{\\\"mountPath\\\":\\\"/hostroot\\\",\\\"name\\\":\\\"hostroot\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/net.d\\\",\\\"name\\\":\\\"multus-conf-dir\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d/multus.d\\\",\\\"name\\\":\\\"multus-daemon-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/cni/multus/certs\\\",\\\"name\\\":\\\"host-run-multus-certs\\\"},{\\\"mountPath\\\":\\\"/etc/kubernetes\\\",\\\"name\\\":\\\"etc-kubernetes\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4qb8t\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-multus\"/\"multus-wfwbx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.411984 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f863fff9-286a-45fa-b8f0-8a86994b8440\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [check-endpoints]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a8581a82ba5c8343a743aa302c4848249d8c32a9f2cd10fa68d89d835a1bdf8b\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"check-endpoints\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-l7w75\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-diagnostics\"/\"network-check-source-5bb8f5cd97-xdvz5\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.418957 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"message\\\":\\\"containers with unready status: [networking-console-plugin]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fbdfe828b092b23e6d4480daf3e0216aada6debaf1ef1b314a0a31e73ebf13c4\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{\\\"terminated\\\":{\\\"exitCode\\\":137,\\\"finishedAt\\\":null,\\\"message\\\":\\\"The container could not be located when the pod was deleted. The container used to be Running\\\",\\\"reason\\\":\\\"ContainerStatusUnknown\\\",\\\"startedAt\\\":null}},\\\"name\\\":\\\"networking-console-plugin\\\",\\\"ready\\\":false,\\\"restartCount\\\":4,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/cert\\\",\\\"name\\\":\\\"networking-console-plugin-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/nginx/nginx.conf\\\",\\\"name\\\":\\\"nginx-conf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":null,\\\"podIPs\\\":null}}\" for pod \"openshift-network-console\"/\"networking-console-plugin-5ff7774fd9-nljh6\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.423963 5030 status_manager.go:919] "Failed to update status for pod" pod="openshift-dns/node-resolver-952wf" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"78bd1260-3469-4a38-899e-5923bffe1b59\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:25Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:23Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:39Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:07:39Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"21Mi\\\"},\\\"containerID\\\":\\\"cri-o://72ac4f61469f5fbbfe1ca22390f6f7fc48db5e6ef840583d474569e7d634b831\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5c5d7468f6838b6a714482e62ea956659212f3415ec8f69989f75eb6d8744a6e\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"dns-node-resolver\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"5m\\\",\\\"memory\\\":\\\"21Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-03-16T13:07:39Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/hosts\\\",\\\"name\\\":\\\"hosts-file\\\"},{\\\"mountPath\\\":\\\"/tmp\\\",\\\"name\\\":\\\"tmp-dir\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-2tjjz\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"192.168.126.11\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:07:23Z\\\"}}\" for pod \"openshift-dns\"/\"node-resolver-952wf\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://127.0.0.1:9743/pod?timeout=10s\": dial tcp 127.0.0.1:9743: connect: connection refused" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.464037 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-crc" podStartSLOduration=16.464020187 podStartE2EDuration="16.464020187s" podCreationTimestamp="2026-03-16 13:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.46346944 +0000 UTC m=+103.862781987" watchObservedRunningTime="2026-03-16 13:07:39.464020187 +0000 UTC m=+103.863332735" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.478506 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-crc" podStartSLOduration=16.47848869 podStartE2EDuration="16.47848869s" podCreationTimestamp="2026-03-16 13:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.477954974 +0000 UTC m=+103.877267522" watchObservedRunningTime="2026-03-16 13:07:39.47848869 +0000 UTC m=+103.877801237" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.486719 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.486754 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.486765 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.486777 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.486787 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.487896 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-crc" podStartSLOduration=16.487883629 podStartE2EDuration="16.487883629s" podCreationTimestamp="2026-03-16 13:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.487664867 +0000 UTC m=+103.886977414" watchObservedRunningTime="2026-03-16 13:07:39.487883629 +0000 UTC m=+103.887196176" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.516920 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podStartSLOduration=83.516902518 podStartE2EDuration="1m23.516902518s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.516404028 +0000 UTC m=+103.915716575" watchObservedRunningTime="2026-03-16 13:07:39.516902518 +0000 UTC m=+103.916215075" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.534898 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-crc" podStartSLOduration=16.534884524 podStartE2EDuration="16.534884524s" podCreationTimestamp="2026-03-16 13:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.534459813 +0000 UTC m=+103.933772361" watchObservedRunningTime="2026-03-16 13:07:39.534884524 +0000 UTC m=+103.934197071" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.588571 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.588612 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.588621 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.588634 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.588642 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.645271 5030 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.690569 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.690606 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.690615 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.690628 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.690639 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.709890 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.709978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.710000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710045 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.710023272 +0000 UTC m=+120.109335820 (durationBeforeRetry 16s). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710073 5030 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710085 5030 configmap.go:193] Couldn't get configMap openshift-network-console/networking-console-plugin: object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.710113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710120 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.710107682 +0000 UTC m=+120.109420229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin-cert" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710149 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf podName:6a9ae5f6-97bd-46ac-bafa-ca1b4452a141 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.710132298 +0000 UTC m=+120.109444855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "nginx-conf" (UniqueName: "kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf") pod "networking-console-plugin-5ff7774fd9-nljh6" (UID: "6a9ae5f6-97bd-46ac-bafa-ca1b4452a141") : object "openshift-network-console"/"networking-console-plugin" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710203 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710214 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710223 5030 projected.go:194] Error preparing data for projected volume kube-api-access-l7w75 for pod openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.710198 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710254 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75 podName:f863fff9-286a-45fa-b8f0-8a86994b8440 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.710247294 +0000 UTC m=+120.109559842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l7w75" (UniqueName: "kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75") pod "network-check-source-5bb8f5cd97-xdvz5" (UID: "f863fff9-286a-45fa-b8f0-8a86994b8440") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710271 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710284 5030 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710294 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gwt8b for pod openshift-network-diagnostics/network-check-target-fhkjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.710333 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b podName:17b87002-b798-480a-8e17-83053d698239 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.710325222 +0000 UTC m=+120.109637769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwt8b" (UniqueName: "kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b") pod "network-check-target-fhkjl" (UID: "17b87002-b798-480a-8e17-83053d698239") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.791711 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.791759 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.791769 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.791781 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.791789 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.809508 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-crc" podStartSLOduration=16.809496174 podStartE2EDuration="16.809496174s" podCreationTimestamp="2026-03-16 13:07:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:39.809050715 +0000 UTC m=+104.208363263" watchObservedRunningTime="2026-03-16 13:07:39.809496174 +0000 UTC m=+104.208808712" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.811614 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.811713 5030 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.811761 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs podName:713054df-4196-45ae-8e8e-b3f526c510e9 nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.811751487 +0000 UTC m=+120.211064034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs") pod "network-metrics-daemon-qxdgg" (UID: "713054df-4196-45ae-8e8e-b3f526c510e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.894108 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.894144 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.894153 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.894166 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.894174 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.945764 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.945807 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.945888 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.945976 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.946042 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.946404 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.947051 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:39 crc kubenswrapper[5030]: E0316 13:07:39.947102 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.998781 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.999020 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.999030 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.999043 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:39 crc kubenswrapper[5030]: I0316 13:07:39.999054 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:39Z","lastTransitionTime":"2026-03-16T13:07:39Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.105671 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.105719 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.105729 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.105741 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.105750 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.207991 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.208049 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.208068 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.208084 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.208095 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.249232 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfwbx" event={"ID":"9c20ed32-4ad5-4984-9876-39b7b1ee1877","Type":"ContainerStarted","Data":"7fd0ae08df8136e826c22242fcc455535fef29ba9eeab95e5c9aad2fdae70382"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.251122 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerStarted","Data":"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.251180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerStarted","Data":"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.253451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-98dmx" event={"ID":"d31a544e-cc56-4b4e-b639-91a00349a2da","Type":"ContainerStarted","Data":"8801aa6fbe3289dd2bcf6a6189afec0fc0abadd72c32ec92612e915cebef0b81"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.255419 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="fa3e358f6e8d8d56c29a4a536835bb9c7a1f0454ca436f48a2e3aeb1fecf17e8" exitCode=0 Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.255486 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"fa3e358f6e8d8d56c29a4a536835bb9c7a1f0454ca436f48a2e3aeb1fecf17e8"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.287090 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-952wf" podStartSLOduration=84.287076774 podStartE2EDuration="1m24.287076774s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:40.287023614 +0000 UTC m=+104.686336161" watchObservedRunningTime="2026-03-16 13:07:40.287076774 +0000 UTC m=+104.686389321" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.309652 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.309709 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.309722 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.309740 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.309750 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.316105 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" podStartSLOduration=84.316090575 podStartE2EDuration="1m24.316090575s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:40.315686854 +0000 UTC m=+104.714999400" watchObservedRunningTime="2026-03-16 13:07:40.316090575 +0000 UTC m=+104.715403121" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.316223 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-wfwbx" podStartSLOduration=84.316219447 podStartE2EDuration="1m24.316219447s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:40.301781782 +0000 UTC m=+104.701094329" watchObservedRunningTime="2026-03-16 13:07:40.316219447 +0000 UTC m=+104.715531994" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.323318 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-98dmx" podStartSLOduration=84.323300424 podStartE2EDuration="1m24.323300424s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:40.323196579 +0000 UTC m=+104.722509126" watchObservedRunningTime="2026-03-16 13:07:40.323300424 +0000 UTC m=+104.722612972" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.414821 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.414853 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.414863 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.414877 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.414888 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.517126 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.517162 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.517173 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.517185 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.517194 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.619118 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.619142 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.619151 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.619161 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.619170 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.720731 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.720767 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.720777 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.720790 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.720799 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.822906 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.822934 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.822943 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.822952 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.822960 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.924143 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.924185 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.924198 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.924211 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:40 crc kubenswrapper[5030]: I0316 13:07:40.924223 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:40Z","lastTransitionTime":"2026-03-16T13:07:40Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.025584 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.025621 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.025630 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.025641 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.025651 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.127016 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.127047 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.127056 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.127068 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.127077 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.228421 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.228455 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.228464 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.228475 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.228483 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.258955 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="0a4c08b2513d55be5a077d0539e654a01dcbfae162cec685fee58a936e3831a4" exitCode=0 Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.258995 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"0a4c08b2513d55be5a077d0539e654a01dcbfae162cec685fee58a936e3831a4"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.332178 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.332234 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.332249 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.332276 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.332290 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.434350 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.434388 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.434399 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.434413 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.434423 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.535844 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.535884 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.535894 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.535908 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.535918 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.637268 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.637305 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.637315 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.637329 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.637338 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.738924 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.738941 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.738950 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.738959 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.738966 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.840388 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.840414 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.840424 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.840434 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.840442 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.941635 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.941669 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.941682 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.941693 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.941701 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:41Z","lastTransitionTime":"2026-03-16T13:07:41Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.945000 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.945034 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.945122 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:41 crc kubenswrapper[5030]: E0316 13:07:41.945125 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:41 crc kubenswrapper[5030]: E0316 13:07:41.945196 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:41 crc kubenswrapper[5030]: E0316 13:07:41.945256 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:41 crc kubenswrapper[5030]: I0316 13:07:41.945290 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:41 crc kubenswrapper[5030]: E0316 13:07:41.945358 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.043901 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.043934 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.043943 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.043955 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.043963 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.145497 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.145530 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.145540 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.145573 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.145582 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.246618 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.246659 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.246672 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.246689 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.246702 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.269168 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.270757 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="c198e64bc76553c8f11ade34e9acdf24aa671eaff1ad5650505fa6a6a52ab9da" exitCode=0 Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.270804 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"c198e64bc76553c8f11ade34e9acdf24aa671eaff1ad5650505fa6a6a52ab9da"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.348663 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.348703 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.348725 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.348739 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.348748 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.450135 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.450185 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.450197 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.450213 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.450228 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.552576 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.552616 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.552627 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.552643 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.552654 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.654457 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.654486 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.654495 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.654507 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.654516 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.756484 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.756521 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.756544 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.756586 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.756597 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.857759 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.857798 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.857808 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.857821 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.857829 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.960174 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.960358 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.960368 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.960379 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:42 crc kubenswrapper[5030]: I0316 13:07:42.960387 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:42Z","lastTransitionTime":"2026-03-16T13:07:42Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.061876 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.061915 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.061926 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.061939 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.061952 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.164325 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.164368 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.164381 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.164394 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.164406 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.265543 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.265595 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.265607 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.265622 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.265633 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.275745 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="4c3b39ca3e855a365475cab8e4624997eddc262b9a4c272fd19a39bb297b770a" exitCode=0 Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.275814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"4c3b39ca3e855a365475cab8e4624997eddc262b9a4c272fd19a39bb297b770a"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.277073 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5jnd7" event={"ID":"428b39f5-eb1c-4f65-b7a4-eeb6e84860cc","Type":"ContainerStarted","Data":"428f87e5e5403bafafed267fa71d46bc0bd5020c3d3f76579d89d7326f932040"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.368178 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.368225 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.368238 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.368252 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.368263 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.469800 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.469835 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.469845 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.469859 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.469870 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.571078 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.571186 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.571245 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.571312 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.571369 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.672544 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.672591 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.672601 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.672619 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.672627 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.774336 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.774371 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.774382 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.774398 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.774409 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.876214 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.876242 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.876251 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.876264 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.876272 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.944841 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.944880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.944898 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:43 crc kubenswrapper[5030]: E0316 13:07:43.944958 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:43 crc kubenswrapper[5030]: E0316 13:07:43.945119 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:43 crc kubenswrapper[5030]: E0316 13:07:43.945213 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.945243 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:43 crc kubenswrapper[5030]: E0316 13:07:43.945350 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.977979 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.978013 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.978025 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.978040 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:43 crc kubenswrapper[5030]: I0316 13:07:43.978051 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:43Z","lastTransitionTime":"2026-03-16T13:07:43Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.080199 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.080223 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.080231 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.080241 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.080249 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.182143 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.182182 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.182191 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.182202 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.182209 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.282386 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerStarted","Data":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.282753 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.282889 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.282917 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.283989 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.284019 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.284030 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.284041 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.284051 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.291571 5030 generic.go:358] "Generic (PLEG): container finished" podID="a5092e19-dcde-4527-bb59-cb6c408d4411" containerID="5c14b221f398311eb00cfcf83d2976fb6958e36ed812baedc0b9b8a0306c4707" exitCode=0 Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.291640 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerDied","Data":"5c14b221f398311eb00cfcf83d2976fb6958e36ed812baedc0b9b8a0306c4707"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.304529 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.305880 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.307104 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podStartSLOduration=88.307094747 podStartE2EDuration="1m28.307094747s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:44.306023267 +0000 UTC m=+108.705335813" watchObservedRunningTime="2026-03-16 13:07:44.307094747 +0000 UTC m=+108.706407294" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.386246 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.386306 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.386318 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.386339 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.386354 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.488932 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.488972 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.488982 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.488999 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.489010 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.590546 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.590602 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.590612 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.590626 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.590635 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.691811 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.691849 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.691861 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.691877 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.691887 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.793277 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.793308 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.793318 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.793330 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.793338 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.895370 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.895414 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.895423 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.895439 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.895450 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.997194 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.997232 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.997242 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.997256 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:44 crc kubenswrapper[5030]: I0316 13:07:44.997268 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:44Z","lastTransitionTime":"2026-03-16T13:07:44Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.098799 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.098834 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.098844 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.098871 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.098882 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.165898 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qxdgg"] Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.166023 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:45 crc kubenswrapper[5030]: E0316 13:07:45.166099 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.200895 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.200926 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.200938 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.200950 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.200974 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.301442 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" event={"ID":"a5092e19-dcde-4527-bb59-cb6c408d4411","Type":"ContainerStarted","Data":"f465135018908ec66f8c0737c39809619870e2b520c8c5a30a71f9cf12184fd3"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.304184 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.304228 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.304240 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.304251 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.304261 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.320322 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9fvrp" podStartSLOduration=89.320305735 podStartE2EDuration="1m29.320305735s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:45.318694118 +0000 UTC m=+109.718006665" watchObservedRunningTime="2026-03-16 13:07:45.320305735 +0000 UTC m=+109.719618283" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.406192 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.406225 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.406235 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.406251 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.406261 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.507573 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.507610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.507620 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.507633 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.507641 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.608964 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.608999 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.609010 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.609021 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.609030 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.711867 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.711936 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.711948 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.711961 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.712178 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.814112 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.814161 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.814171 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.814187 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.814204 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.916304 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.916363 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.916378 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.916397 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.916410 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:45Z","lastTransitionTime":"2026-03-16T13:07:45Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.946702 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.946816 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:45 crc kubenswrapper[5030]: I0316 13:07:45.946792 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:45 crc kubenswrapper[5030]: E0316 13:07:45.946996 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:45 crc kubenswrapper[5030]: E0316 13:07:45.947259 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:45 crc kubenswrapper[5030]: E0316 13:07:45.947133 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.019475 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.019627 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.019706 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.019810 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.019888 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:46Z","lastTransitionTime":"2026-03-16T13:07:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.121089 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.121128 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.121137 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.121152 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.121163 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:46Z","lastTransitionTime":"2026-03-16T13:07:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.222538 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.222610 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.222622 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.222638 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.222647 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:46Z","lastTransitionTime":"2026-03-16T13:07:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.263899 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientMemory" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.263944 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasNoDiskPressure" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.263958 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeHasSufficientPID" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.263972 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeNotReady" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.263983 5030 setters.go:618] "Node became not ready" node="crc" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-03-16T13:07:46Z","lastTransitionTime":"2026-03-16T13:07:46Z","reason":"KubeletNotReady","message":"container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?"} Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.293054 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54"] Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.295980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.297152 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"openshift-service-ca.crt\"" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.297210 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"kube-root-ca.crt\"" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.298630 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"cluster-version-operator-serving-cert\"" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.298992 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"default-dockercfg-hqpm5\"" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.370066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.370089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.370110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.370137 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.370408 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.470951 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.470988 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471019 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-cvo-updatepayloads\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-cvo-updatepayloads\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471044 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471092 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471181 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ssl-certs\" (UniqueName: \"kubernetes.io/host-path/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-etc-ssl-certs\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.471881 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-service-ca\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.478364 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-serving-cert\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.485104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/01115bf8-4be6-470d-9b27-9cd0a70bfd6d-kube-api-access\") pod \"cluster-version-operator-7c9b9cfd6-hjv54\" (UID: \"01115bf8-4be6-470d-9b27-9cd0a70bfd6d\") " pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.605891 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" Mar 16 13:07:46 crc kubenswrapper[5030]: W0316 13:07:46.619090 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01115bf8_4be6_470d_9b27_9cd0a70bfd6d.slice/crio-8efb65a649116acf2d0eb6529164eb7428ec165f78d6a3196f49a318a9c35e5f WatchSource:0}: Error finding container 8efb65a649116acf2d0eb6529164eb7428ec165f78d6a3196f49a318a9c35e5f: Status 404 returned error can't find the container with id 8efb65a649116acf2d0eb6529164eb7428ec165f78d6a3196f49a318a9c35e5f Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.945751 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:46 crc kubenswrapper[5030]: E0316 13:07:46.945884 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qxdgg" podUID="713054df-4196-45ae-8e8e-b3f526c510e9" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.959645 5030 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Mar 16 13:07:46 crc kubenswrapper[5030]: I0316 13:07:46.965464 5030 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.307196 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" event={"ID":"01115bf8-4be6-470d-9b27-9cd0a70bfd6d","Type":"ContainerStarted","Data":"9254f74fa52745c650941cb7b2e6652e64f6db13acb330b9358851ca65ea50ca"} Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.307252 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" event={"ID":"01115bf8-4be6-470d-9b27-9cd0a70bfd6d","Type":"ContainerStarted","Data":"8efb65a649116acf2d0eb6529164eb7428ec165f78d6a3196f49a318a9c35e5f"} Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.326863 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-version/cluster-version-operator-7c9b9cfd6-hjv54" podStartSLOduration=91.326842953 podStartE2EDuration="1m31.326842953s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:47.326230088 +0000 UTC m=+111.725542635" watchObservedRunningTime="2026-03-16 13:07:47.326842953 +0000 UTC m=+111.726155500" Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.945102 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.945150 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:47 crc kubenswrapper[5030]: I0316 13:07:47.945119 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:47 crc kubenswrapper[5030]: E0316 13:07:47.945308 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" podUID="f863fff9-286a-45fa-b8f0-8a86994b8440" Mar 16 13:07:47 crc kubenswrapper[5030]: E0316 13:07:47.945429 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fhkjl" podUID="17b87002-b798-480a-8e17-83053d698239" Mar 16 13:07:47 crc kubenswrapper[5030]: E0316 13:07:47.945532 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" podUID="6a9ae5f6-97bd-46ac-bafa-ca1b4452a141" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.234831 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.870625 5030 kubelet_node_status.go:736] "Recording event message for node" node="crc" event="NodeReady" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.870834 5030 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.896120 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.899009 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-f7gz7"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.899169 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.900786 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.900959 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.902208 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.902360 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.903464 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.903841 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.903996 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904053 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904302 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"etcd-client\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904514 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-dockercfg-tnfx9\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904592 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904645 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"encryption-config-1\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904843 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.904957 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"openshift-apiserver-sa-dockercfg-4zqgh\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.905007 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-machine-approver/machine-approver-54c688565-29gbc"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.906143 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"audit-1\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.906620 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-67c89758df-cbknd"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907185 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"audit-1\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907374 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907537 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907663 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"trusted-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907724 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"oauth-apiserver-sa-dockercfg-qqw4z\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907881 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"image-import-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.907999 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.908073 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.908146 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.908155 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.909886 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-zlj8v"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.910048 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.911594 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.912758 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.913933 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-service-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.915840 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.916142 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.916396 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"etcd-serving-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.916524 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-serving-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.916807 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.916988 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917100 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917231 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917428 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-s5fxv"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917687 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-client\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917833 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-dockercfg-4vdnc\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.917971 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.918090 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"metrics-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.918208 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.919453 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-747b44746d-plw2x"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.919621 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.922728 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.922416 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.924424 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.924562 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.926142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.926701 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.926948 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927321 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927505 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-rbac-proxy\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927524 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-images\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927681 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"encryption-config-1\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927700 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-rbac-proxy\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927796 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927896 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927934 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.927953 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.928108 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.928254 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.928488 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-dockercfg-bf7fj\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.930287 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.930825 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941110 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-client\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941274 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941387 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-sa-dockercfg-wzhvk\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941569 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mdwwj\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941758 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941798 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmhxf\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941941 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.941983 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.942145 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.942195 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.942310 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.942211 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.951533 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.951578 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-dockercfg-6n5ln\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.951536 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"service-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.951725 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.951872 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952206 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952304 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kl6m8\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952386 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"dns-operator-dockercfg-wbbsn\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952577 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952690 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952868 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-config\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.952988 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.953200 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.955276 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.956797 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.957106 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.957679 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.957828 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.957955 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.958085 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-dockercfg-6tbpn\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.958170 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-dockercfg-6c46w\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.958287 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.958391 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.958516 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.960296 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.961032 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"trusted-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.962217 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"trusted-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.963215 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.963237 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.963540 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"audit\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.963796 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964060 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-login\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964077 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8n29\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964098 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964286 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-provider-selection\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964404 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-cliconfig\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.964807 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.965351 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.966179 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.966440 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.966631 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-session\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.967132 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-idp-0-file-data\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.967370 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.967600 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.967677 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.968715 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-error\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.968892 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-router-certs\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969144 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"kube-root-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969272 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-service-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969436 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-serving-cert\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969666 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-controller-dockercfg-xnj77\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969724 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mcc-proxy-tls\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.969774 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"oauth-openshift-dockercfg-d2bf2\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.973228 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.985341 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.986081 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm"] Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.986353 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.988214 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.990924 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-trusted-ca-bundle\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.990967 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992622 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-metrics-tls\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992657 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl7l\" (UniqueName: \"kubernetes.io/projected/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-kube-api-access-hbl7l\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992680 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlrp7\" (UniqueName: \"kubernetes.io/projected/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-kube-api-access-jlrp7\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992787 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-config\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.992834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-tmp-dir\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.996762 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-ocp-branding-template\"" Mar 16 13:07:48 crc kubenswrapper[5030]: I0316 13:07:48.996850 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-f2vgj"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.003880 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.006647 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.007643 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.012463 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-h29jz"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.013190 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.014728 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.015143 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.015502 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.022351 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.022811 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.024968 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68cf44c8b8-6hwhj"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.025148 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.025249 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-dockercfg-jcmfj\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.032669 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.041581 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.043615 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.043938 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.044051 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.055995 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.056616 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-74545575db-hl62p"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.058701 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.058862 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.060484 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.060637 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.060656 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-config\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.062246 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.062352 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.064441 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.064619 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.066338 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.066465 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.068536 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.068628 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.070143 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.070271 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.071985 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072008 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072019 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-f7gz7"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072029 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-67c89758df-cbknd"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072037 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072046 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-zlj8v"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072055 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072063 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-s5fxv"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072072 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072080 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072090 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072100 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072111 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072115 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072120 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072307 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072319 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.072329 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-tq7cq"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074736 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074768 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074779 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074786 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074794 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074802 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074810 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-74545575db-hl62p"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074818 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074826 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074834 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-747b44746d-plw2x"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074842 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-tq7cq"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074849 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-f2vgj"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074857 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074864 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074871 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074879 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-h29jz"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074887 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074893 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074900 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074906 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.074914 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sxs7j"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.075623 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.077071 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-674tp"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.077161 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.078659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.078680 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxs7j"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.078688 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-bldz2"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.078864 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.080395 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.081353 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094195 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-config\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-tmp-dir\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-metrics-tls\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094321 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl7l\" (UniqueName: \"kubernetes.io/projected/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-kube-api-access-hbl7l\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094340 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlrp7\" (UniqueName: \"kubernetes.io/projected/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-kube-api-access-jlrp7\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.094976 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-config\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.095052 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-tmp-dir\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.101919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-metrics-tls\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.103373 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8dkm8\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.104718 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-serving-cert\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.108147 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzhdr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.112753 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzhdr"] Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.112880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.121157 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.143286 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"config\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.167353 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.180714 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"client-ca\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.200997 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.220938 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"route-controller-manager-sa-dockercfg-mmcpt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.240877 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.263599 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.282210 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.301283 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.321084 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.381349 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"packageserver-service-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.401040 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serviceaccount-dockercfg-4gqzj\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.421227 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kknhg\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.441025 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.460671 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.481355 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.500725 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.521305 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.540353 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"config-operator-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.560832 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"openshift-config-operator-dockercfg-sjn6s\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.581213 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.600319 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-images\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.620435 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-dockercfg-sw6nc\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.640522 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mco-proxy-tls\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.660673 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"package-server-manager-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.680578 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ac-dockercfg-gj7jx\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.700352 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-admission-controller-secret\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.720249 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-dockercfg-2wbn2\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.741083 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-scheduler-operator-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.760666 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-config\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.780289 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.800578 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"catalog-operator-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.820955 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"pprof-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.841358 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serving-cert\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.860804 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-certs-default\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.881077 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kw8fx\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.901158 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.921127 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.940543 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.946711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.946730 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.946860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.960494 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Mar 16 13:07:49 crc kubenswrapper[5030]: I0316 13:07:49.981072 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.000372 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"cluster-image-registry-operator-dockercfg-ntnd7\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.020158 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-operator-tls\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.040441 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bgxvm\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.060130 5030 request.go:752] "Waited before sending request" delay="1.001040769s" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://api-int.crc.testing:6443/api/v1/namespaces/openshift-service-ca/secrets?fieldSelector=metadata.name%3Dsigning-key&limit=500&resourceVersion=0" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.060999 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.081347 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.100636 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.120497 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.140780 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"ingress-operator-dockercfg-74nwh\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.161290 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.180511 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"metrics-tls\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.200213 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.224800 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"trusted-ca\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.241164 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.260317 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.280719 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.300960 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2h6bs\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.321245 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.340835 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.360474 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.380713 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.400875 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-dockercfg-2cfkp\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.420854 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-metrics\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.444640 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"marketplace-trusted-ca\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.461152 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.480576 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.500326 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bjqfd\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.520469 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.540896 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.561148 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.581195 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-dockercfg-gnx66\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.600569 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-tls\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.620702 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"openshift-controller-manager-sa-dockercfg-djmfg\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.641047 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"config\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.666898 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-global-ca\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.680979 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"serving-cert\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.700146 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.721172 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.741291 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"client-ca\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.760803 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"hostpath-provisioner\"/\"csi-hostpath-provisioner-sa-dockercfg-7dcws\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.780329 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"kube-root-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.800892 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"openshift-service-ca.crt\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.821323 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kpvmz\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.840697 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.860911 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.880126 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-sysctl-allowlist\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.900608 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-dockercfg-dzw6b\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.921251 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"node-bootstrapper-token\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.940918 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-tls\"" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.974668 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlrp7\" (UniqueName: \"kubernetes.io/projected/e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd-kube-api-access-jlrp7\") pod \"openshift-apiserver-operator-846cbfc458-5pbgx\" (UID: \"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd\") " pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:50 crc kubenswrapper[5030]: I0316 13:07:50.993011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl7l\" (UniqueName: \"kubernetes.io/projected/023c2ca8-9ec5-4ab5-b50a-cd114ee3c793-kube-api-access-hbl7l\") pod \"dns-operator-799b87ffcd-zlj8v\" (UID: \"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793\") " pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.000448 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.020784 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pgs7\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.041094 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.060477 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.079869 5030 request.go:752] "Waited before sending request" delay="1.730404968s" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://api-int.crc.testing:6443/api/v1/namespaces/openshift-dns-operator/pods/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111810 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111859 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-config\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.111990 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8nt\" (UniqueName: \"kubernetes.io/projected/02b06f20-f46e-4bbc-bbb0-128997bff4ea-kube-api-access-8b8nt\") pod \"migrator-866fcbc849-9c4tk\" (UID: \"02b06f20-f46e-4bbc-bbb0-128997bff4ea\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192438f9-d116-4b9b-9e87-f6b4e9475ca4-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112053 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit-dir\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112103 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7rsb\" (UniqueName: \"kubernetes.io/projected/c9f3be91-73a7-4d14-8d2f-86da802e4900-kube-api-access-h7rsb\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112121 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112141 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c448f389-3194-4d8e-87d8-e0846247aff5-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112216 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112269 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4wj\" (UniqueName: \"kubernetes.io/projected/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-kube-api-access-lq4wj\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112312 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/8c1e52c8-858e-45e4-a861-ac850209ce6d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112335 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvwl5\" (UniqueName: \"kubernetes.io/projected/8c1e52c8-858e-45e4-a861-ac850209ce6d-kube-api-access-zvwl5\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112367 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-serving-cert\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112383 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c448f389-3194-4d8e-87d8-e0846247aff5-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112398 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-client\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112417 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c448f389-3194-4d8e-87d8-e0846247aff5-config\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-trusted-ca-bundle\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112451 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptjgd\" (UniqueName: \"kubernetes.io/projected/f2296980-434a-4483-8883-6a838cc800f4-kube-api-access-ptjgd\") pod \"downloads-747b44746d-plw2x\" (UID: \"f2296980-434a-4483-8883-6a838cc800f4\") " pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-kube-api-access\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112518 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrx8d\" (UniqueName: \"kubernetes.io/projected/c448f389-3194-4d8e-87d8-e0846247aff5-kube-api-access-wrx8d\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112581 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112628 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-config\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112660 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112679 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-serving-cert\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112706 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26wzs\" (UniqueName: \"kubernetes.io/projected/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-kube-api-access-26wzs\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112722 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112741 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112770 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-config\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-encryption-config\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112806 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-auth-proxy-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112822 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9h52\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz9qz\" (UniqueName: \"kubernetes.io/projected/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-kube-api-access-xz9qz\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-serving-cert\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mp4\" (UniqueName: \"kubernetes.io/projected/c169fbed-7785-4866-9576-b973e87f6130-kube-api-access-65mp4\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.112995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-serving-cert\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-etcd-client\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113045 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnlp8\" (UniqueName: \"kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113071 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-trusted-ca\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113114 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-etcd-serving-ca\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113131 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-image-import-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113144 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-serving-cert\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113157 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-service-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-node-pullsecrets\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113262 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113280 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113345 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85jq\" (UniqueName: \"kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113360 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-config\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c1e52c8-858e-45e4-a861-ac850209ce6d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113408 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113466 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-tmp-dir\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113533 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113570 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-images\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113588 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192438f9-d116-4b9b-9e87-f6b4e9475ca4-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113605 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-audit-policies\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113618 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c169fbed-7785-4866-9576-b973e87f6130-audit-dir\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113680 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac2478-4b8a-40c5-b88f-5a470c217b89-tmp-dir\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113734 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thlzj\" (UniqueName: \"kubernetes.io/projected/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-kube-api-access-thlzj\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.113740 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.613727248 +0000 UTC m=+116.013039796 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113806 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-encryption-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113823 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9f3be91-73a7-4d14-8d2f-86da802e4900-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113853 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-config\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113894 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t74df\" (UniqueName: \"kubernetes.io/projected/95ac2478-4b8a-40c5-b88f-5a470c217b89-kube-api-access-t74df\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-machine-approver-tls\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.113983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114012 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-client\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-serving-cert\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpf78\" (UniqueName: \"kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114101 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xs5g\" (UniqueName: \"kubernetes.io/projected/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-kube-api-access-7xs5g\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114129 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192438f9-d116-4b9b-9e87-f6b4e9475ca4-config\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114150 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/192438f9-d116-4b9b-9e87-f6b4e9475ca4-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.114164 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.121576 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.128641 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.140818 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.161140 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.167354 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.181107 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215151 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.215380 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.715357557 +0000 UTC m=+116.114670104 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-registration-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215451 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqhp\" (UniqueName: \"kubernetes.io/projected/04371676-8de0-4cac-9246-3ba85ab6ec1b-kube-api-access-nwqhp\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdt5\" (UniqueName: \"kubernetes.io/projected/f2df72d4-9559-472f-9a2d-611919176b34-kube-api-access-zfdt5\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xs5g\" (UniqueName: \"kubernetes.io/projected/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-kube-api-access-7xs5g\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215783 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192438f9-d116-4b9b-9e87-f6b4e9475ca4-config\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215803 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215841 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215857 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04371676-8de0-4cac-9246-3ba85ab6ec1b-serving-cert\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-tmp-dir\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215901 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.215919 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216422 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/192438f9-d116-4b9b-9e87-f6b4e9475ca4-config\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216782 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-certs\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-config\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216841 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8nt\" (UniqueName: \"kubernetes.io/projected/02b06f20-f46e-4bbc-bbb0-128997bff4ea-kube-api-access-8b8nt\") pod \"migrator-866fcbc849-9c4tk\" (UID: \"02b06f20-f46e-4bbc-bbb0-128997bff4ea\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216858 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192438f9-d116-4b9b-9e87-f6b4e9475ca4-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216890 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-node-bootstrap-token\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216904 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9755f02f-1a2f-4844-a346-ef17fe95535c-cert\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7rsb\" (UniqueName: \"kubernetes.io/projected/c9f3be91-73a7-4d14-8d2f-86da802e4900-kube-api-access-h7rsb\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216939 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c448f389-3194-4d8e-87d8-e0846247aff5-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6050a028-e057-4537-b148-82acb6e42774-config\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.216989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/6be2dd5f-e697-404b-882a-16668347c323-tmpfs\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217007 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217023 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c448f389-3194-4d8e-87d8-e0846247aff5-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9zc\" (UniqueName: \"kubernetes.io/projected/fc143e43-fd08-456b-b440-751251cd3a72-kube-api-access-bc9zc\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217054 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-stats-auth\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217093 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-apiservice-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217127 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217144 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-serving-cert\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217161 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217175 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217189 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-encryption-config\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-images\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217220 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz9qz\" (UniqueName: \"kubernetes.io/projected/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-kube-api-access-xz9qz\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-serving-cert\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217283 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65mp4\" (UniqueName: \"kubernetes.io/projected/c169fbed-7785-4866-9576-b973e87f6130-kube-api-access-65mp4\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqwv\" (UniqueName: \"kubernetes.io/projected/9e25b438-8403-4ede-bb95-4c48c10acd65-kube-api-access-dcqwv\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df652\" (UniqueName: \"kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217368 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217383 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-csi-data-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217412 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04371676-8de0-4cac-9246-3ba85ab6ec1b-config\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217429 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-serving-cert\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217431 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217443 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-etcd-client\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r869z\" (UniqueName: \"kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217489 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217507 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2df72d4-9559-472f-9a2d-611919176b34-signing-key\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8wqd\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-kube-api-access-f8wqd\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217537 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzncs\" (UniqueName: \"kubernetes.io/projected/33758395-6171-4b56-ae2d-1b99f16ee69f-kube-api-access-qzncs\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217571 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-image-import-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-serving-cert\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217603 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217619 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-srv-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-srv-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217652 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-node-pullsecrets\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217681 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217696 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217710 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217714 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217725 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d85jq\" (UniqueName: \"kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c1e52c8-858e-45e4-a861-ac850209ce6d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192438f9-d116-4b9b-9e87-f6b4e9475ca4-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217801 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-audit-policies\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thlzj\" (UniqueName: \"kubernetes.io/projected/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-kube-api-access-thlzj\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217834 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-machine-approver-tls\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217879 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217896 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217911 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-images\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217925 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217940 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217956 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2df72d4-9559-472f-9a2d-611919176b34-signing-cabundle\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.217988 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42qs\" (UniqueName: \"kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218006 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218034 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218055 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xzsq\" (UniqueName: \"kubernetes.io/projected/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-kube-api-access-2xzsq\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218116 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-client\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218135 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-serving-cert\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218151 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2j7h\" (UniqueName: \"kubernetes.io/projected/a9951d15-be29-4c09-aa01-fcaf695cb4d4-kube-api-access-f2j7h\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218180 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218206 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5949311d-c4a9-401d-a809-ffcd9f76d61d-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpf78\" (UniqueName: \"kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/192438f9-d116-4b9b-9e87-f6b4e9475ca4-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218249 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/fc143e43-fd08-456b-b440-751251cd3a72-tmpfs\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218264 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-socket-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218280 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-plugins-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjc5\" (UniqueName: \"kubernetes.io/projected/d6a67ee1-697d-4340-9064-c24e0dbd080b-kube-api-access-gvjc5\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218315 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-config\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218345 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218346 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-audit-policies\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218362 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8wt\" (UniqueName: \"kubernetes.io/projected/bae16743-6485-49ce-a9e0-110ebe079f08-kube-api-access-cj8wt\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218383 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit-dir\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hmgt\" (UniqueName: \"kubernetes.io/projected/6050a028-e057-4537-b148-82acb6e42774-kube-api-access-2hmgt\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218425 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218442 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218458 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e25b438-8403-4ede-bb95-4c48c10acd65-service-ca-bundle\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218477 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gsz5\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-kube-api-access-6gsz5\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218508 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-trusted-ca-bundle\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4wj\" (UniqueName: \"kubernetes.io/projected/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-kube-api-access-lq4wj\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/8c1e52c8-858e-45e4-a861-ac850209ce6d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218582 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/bae16743-6485-49ce-a9e0-110ebe079f08-webhook-certs\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218598 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwg9\" (UniqueName: \"kubernetes.io/projected/9755f02f-1a2f-4844-a346-ef17fe95535c-kube-api-access-2rwg9\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218617 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218634 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvwl5\" (UniqueName: \"kubernetes.io/projected/8c1e52c8-858e-45e4-a861-ac850209ce6d-kube-api-access-zvwl5\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218650 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-serving-cert\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218667 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-client\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218684 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949311d-c4a9-401d-a809-ffcd9f76d61d-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218765 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c448f389-3194-4d8e-87d8-e0846247aff5-config\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218804 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-trusted-ca-bundle\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218820 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptjgd\" (UniqueName: \"kubernetes.io/projected/f2296980-434a-4483-8883-6a838cc800f4-kube-api-access-ptjgd\") pod \"downloads-747b44746d-plw2x\" (UID: \"f2296980-434a-4483-8883-6a838cc800f4\") " pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-kube-api-access\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218895 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrx8d\" (UniqueName: \"kubernetes.io/projected/c448f389-3194-4d8e-87d8-e0846247aff5-kube-api-access-wrx8d\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218912 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-config\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218928 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-default-certificate\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218957 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6050a028-e057-4537-b148-82acb6e42774-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218975 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sghcw\" (UniqueName: \"kubernetes.io/projected/6be2dd5f-e697-404b-882a-16668347c323-kube-api-access-sghcw\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.218992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219015 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-26wzs\" (UniqueName: \"kubernetes.io/projected/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-kube-api-access-26wzs\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219030 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-config\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219045 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219062 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/33758395-6171-4b56-ae2d-1b99f16ee69f-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219078 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-auth-proxy-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9h52\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219148 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-mountpoint-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219164 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219186 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-metrics-certs\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219202 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-metrics-tls\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219243 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219260 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-tmpfs\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219275 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-webhook-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219290 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219319 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnlp8\" (UniqueName: \"kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219337 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219353 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-trusted-ca\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wk92\" (UniqueName: \"kubernetes.io/projected/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-kube-api-access-7wk92\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219392 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-available-featuregates\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-etcd-serving-ca\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219436 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-service-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219452 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-tmp\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219468 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/87aa0d49-02c3-402a-942d-d4247fa5e87e-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t74df\" (UniqueName: \"kubernetes.io/projected/95ac2478-4b8a-40c5-b88f-5a470c217b89-kube-api-access-t74df\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219521 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219538 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-config\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219607 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzdbs\" (UniqueName: \"kubernetes.io/projected/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-kube-api-access-wzdbs\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-tmp-dir\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9b4\" (UniqueName: \"kubernetes.io/projected/87aa0d49-02c3-402a-942d-d4247fa5e87e-kube-api-access-qq9b4\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219673 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-serving-cert\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219712 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c169fbed-7785-4866-9576-b973e87f6130-audit-dir\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219771 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac2478-4b8a-40c5-b88f-5a470c217b89-tmp-dir\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-profile-collector-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkgd\" (UniqueName: \"kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219821 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-config-volume\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wq8\" (UniqueName: \"kubernetes.io/projected/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-kube-api-access-g4wq8\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219876 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-encryption-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9f3be91-73a7-4d14-8d2f-86da802e4900-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.219911 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-config\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.220016 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-trusted-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.220379 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-config\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.220685 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.720672606 +0000 UTC m=+116.119985153 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221455 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-serving-cert\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221478 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c448f389-3194-4d8e-87d8-e0846247aff5-tmp\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221542 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221764 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/192438f9-d116-4b9b-9e87-f6b4e9475ca4-tmp-dir\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.221992 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.222387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.223545 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.223578 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.223654 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-node-pullsecrets\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.224964 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.225141 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-encryption-config\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.225408 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.225952 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-images\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-image-import-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226470 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226698 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c169fbed-7785-4866-9576-b973e87f6130-audit-dir\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226742 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-config\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226764 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-service-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-service-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.226923 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8c1e52c8-858e-45e4-a861-ac850209ce6d-proxy-tls\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.227256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-ca\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-ca\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.227506 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac2478-4b8a-40c5-b88f-5a470c217b89-tmp-dir\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.228626 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-auth-proxy-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.229090 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c9f3be91-73a7-4d14-8d2f-86da802e4900-config\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.229359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-tmp-dir\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.229631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-service-ca-bundle\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.229957 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.230478 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.230622 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.230862 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit-dir\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.230980 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-serving-ca\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231033 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"machine-approver-tls\" (UniqueName: \"kubernetes.io/secret/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-machine-approver-tls\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231045 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-serving-cert\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231474 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c448f389-3194-4d8e-87d8-e0846247aff5-config\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-trusted-ca-bundle\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231535 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mcc-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/8c1e52c8-858e-45e4-a861-ac850209ce6d-mcc-auth-proxy-config\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231589 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-serving-cert\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231910 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-config\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.231943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/c169fbed-7785-4866-9576-b973e87f6130-etcd-serving-ca\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232079 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95ac2478-4b8a-40c5-b88f-5a470c217b89-config\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232572 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232639 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232702 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232827 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-encryption-config\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.232912 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233231 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/c169fbed-7785-4866-9576-b973e87f6130-etcd-client\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233386 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233412 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-trusted-ca\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233687 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-audit\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.233772 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c448f389-3194-4d8e-87d8-e0846247aff5-serving-cert\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.234057 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.234067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-config\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.234101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.234378 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.235788 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-serving-cert\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236039 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-samples-operator-tls\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236048 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/192438f9-d116-4b9b-9e87-f6b4e9475ca4-serving-cert\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-serving-cert\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"machine-api-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9f3be91-73a7-4d14-8d2f-86da802e4900-machine-api-operator-tls\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.236961 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.237936 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-serving-cert\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.238106 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-etcd-client\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.238208 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/95ac2478-4b8a-40c5-b88f-5a470c217b89-etcd-client\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.254539 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xs5g\" (UniqueName: \"kubernetes.io/projected/6f45c8c5-9fd3-40a3-895d-996e82dba7e9-kube-api-access-7xs5g\") pod \"console-operator-67c89758df-cbknd\" (UID: \"6f45c8c5-9fd3-40a3-895d-996e82dba7e9\") " pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.269966 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns-operator/dns-operator-799b87ffcd-zlj8v"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.274657 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85jq\" (UniqueName: \"kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq\") pod \"route-controller-manager-776cdc94d6-9x8lz\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.290265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.296231 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thlzj\" (UniqueName: \"kubernetes.io/projected/847e826f-b0cf-4fe3-a6c8-9f5a69517a0b-kube-api-access-thlzj\") pod \"machine-approver-54c688565-29gbc\" (UID: \"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b\") " pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.312733 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.320663 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.320800 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.820782559 +0000 UTC m=+116.220095106 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321050 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r869z\" (UniqueName: \"kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321070 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2df72d4-9559-472f-9a2d-611919176b34-signing-key\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8wqd\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-kube-api-access-f8wqd\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzncs\" (UniqueName: \"kubernetes.io/projected/33758395-6171-4b56-ae2d-1b99f16ee69f-kube-api-access-qzncs\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-srv-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321143 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-srv-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321190 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321226 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321244 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2df72d4-9559-472f-9a2d-611919176b34-signing-cabundle\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321276 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s42qs\" (UniqueName: \"kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xzsq\" (UniqueName: \"kubernetes.io/projected/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-kube-api-access-2xzsq\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321322 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2j7h\" (UniqueName: \"kubernetes.io/projected/a9951d15-be29-4c09-aa01-fcaf695cb4d4-kube-api-access-f2j7h\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321337 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321382 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5949311d-c4a9-401d-a809-ffcd9f76d61d-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/fc143e43-fd08-456b-b440-751251cd3a72-tmpfs\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-socket-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321432 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-plugins-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjc5\" (UniqueName: \"kubernetes.io/projected/d6a67ee1-697d-4340-9064-c24e0dbd080b-kube-api-access-gvjc5\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321472 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8wt\" (UniqueName: \"kubernetes.io/projected/bae16743-6485-49ce-a9e0-110ebe079f08-kube-api-access-cj8wt\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321490 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hmgt\" (UniqueName: \"kubernetes.io/projected/6050a028-e057-4537-b148-82acb6e42774-kube-api-access-2hmgt\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321509 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e25b438-8403-4ede-bb95-4c48c10acd65-service-ca-bundle\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gsz5\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-kube-api-access-6gsz5\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321563 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/bae16743-6485-49ce-a9e0-110ebe079f08-webhook-certs\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321581 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwg9\" (UniqueName: \"kubernetes.io/projected/9755f02f-1a2f-4844-a346-ef17fe95535c-kube-api-access-2rwg9\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321601 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949311d-c4a9-401d-a809-ffcd9f76d61d-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.321640 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-default-certificate\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6050a028-e057-4537-b148-82acb6e42774-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sghcw\" (UniqueName: \"kubernetes.io/projected/6be2dd5f-e697-404b-882a-16668347c323-kube-api-access-sghcw\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322463 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/33758395-6171-4b56-ae2d-1b99f16ee69f-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322543 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-mountpoint-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322610 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-metrics-certs\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322630 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-metrics-tls\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322647 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-tmpfs\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322683 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-webhook-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322727 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322773 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wk92\" (UniqueName: \"kubernetes.io/projected/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-kube-api-access-7wk92\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322791 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-available-featuregates\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322815 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-tmp\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322833 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/87aa0d49-02c3-402a-942d-d4247fa5e87e-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322856 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzdbs\" (UniqueName: \"kubernetes.io/projected/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-kube-api-access-wzdbs\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9b4\" (UniqueName: \"kubernetes.io/projected/87aa0d49-02c3-402a-942d-d4247fa5e87e-kube-api-access-qq9b4\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322901 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-serving-cert\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-profile-collector-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322963 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkgd\" (UniqueName: \"kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-config-volume\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322995 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323012 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wq8\" (UniqueName: \"kubernetes.io/projected/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-kube-api-access-g4wq8\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323034 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-registration-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323054 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqhp\" (UniqueName: \"kubernetes.io/projected/04371676-8de0-4cac-9246-3ba85ab6ec1b-kube-api-access-nwqhp\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdt5\" (UniqueName: \"kubernetes.io/projected/f2df72d4-9559-472f-9a2d-611919176b34-kube-api-access-zfdt5\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323121 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04371676-8de0-4cac-9246-3ba85ab6ec1b-serving-cert\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-tmp-dir\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323152 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-certs\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323203 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-config\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323234 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-node-bootstrap-token\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323248 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9755f02f-1a2f-4844-a346-ef17fe95535c-cert\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6050a028-e057-4537-b148-82acb6e42774-config\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323289 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/6be2dd5f-e697-404b-882a-16668347c323-tmpfs\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323310 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323330 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9zc\" (UniqueName: \"kubernetes.io/projected/fc143e43-fd08-456b-b440-751251cd3a72-kube-api-access-bc9zc\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323346 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323363 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-stats-auth\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323382 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-apiservice-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323411 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-images\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323435 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqwv\" (UniqueName: \"kubernetes.io/projected/9e25b438-8403-4ede-bb95-4c48c10acd65-kube-api-access-dcqwv\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df652\" (UniqueName: \"kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-csi-data-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.323523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04371676-8de0-4cac-9246-3ba85ab6ec1b-config\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.324040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04371676-8de0-4cac-9246-3ba85ab6ec1b-config\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.324454 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.325118 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.325355 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-profile-collector-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.325458 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/6be2dd5f-e697-404b-882a-16668347c323-srv-cert\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.326130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-metrics-tls\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.326347 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e25b438-8403-4ede-bb95-4c48c10acd65-service-ca-bundle\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.327019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"srv-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-srv-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.327114 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f2df72d4-9559-472f-9a2d-611919176b34-signing-cabundle\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.327378 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-tmp\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.327432 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted-pem\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-ca-trust-extracted-pem\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.327617 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.827604489 +0000 UTC m=+116.226917035 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.328322 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.328601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6050a028-e057-4537-b148-82acb6e42774-serving-cert\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330351 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-tmpfs\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-proxy-tls\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"mountpoint-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-mountpoint-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330649 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-apiservice-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330686 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-node-bootstrap-token\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.330971 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331055 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/bae16743-6485-49ce-a9e0-110ebe079f08-webhook-certs\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331203 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-config-volume\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-registration-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331608 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-default-certificate\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.331848 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"csi-data-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-csi-data-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332039 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"images\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-images\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.322601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" event={"ID":"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd","Type":"ContainerStarted","Data":"3e8e58127d060267086fe62e29eecac88b99778ee60665eec6efaa7a7e4d5dbd"} Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" event={"ID":"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793","Type":"ContainerStarted","Data":"56bb92102edc5778bb1449522da9d50b939ea892693fd4def760d39b77cc4de1"} Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332372 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f2df72d4-9559-472f-9a2d-611919176b34-signing-key\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332486 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/6be2dd5f-e697-404b-882a-16668347c323-tmpfs\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332308 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.332799 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333044 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-auth-proxy-config\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333045 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333451 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6050a028-e057-4537-b148-82acb6e42774-config\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333642 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5949311d-c4a9-401d-a809-ffcd9f76d61d-tmp\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmpfs\" (UniqueName: \"kubernetes.io/empty-dir/fc143e43-fd08-456b-b440-751251cd3a72-tmpfs\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-socket-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.333915 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-dir\" (UniqueName: \"kubernetes.io/host-path/d6a67ee1-697d-4340-9064-c24e0dbd080b-plugins-dir\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-tmp-dir\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334161 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"available-featuregates\" (UniqueName: \"kubernetes.io/empty-dir/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-available-featuregates\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-config\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334586 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-trusted-ca\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-serving-cert\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.334907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-stats-auth\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.335157 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5949311d-c4a9-401d-a809-ffcd9f76d61d-trusted-ca\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.337209 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-serving-cert\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.337327 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949311d-c4a9-401d-a809-ffcd9f76d61d-image-registry-operator-tls\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.337958 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9e25b438-8403-4ede-bb95-4c48c10acd65-metrics-certs\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.337977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9755f02f-1a2f-4844-a346-ef17fe95535c-cert\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.338047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"profile-collector-cert\" (UniqueName: \"kubernetes.io/secret/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-profile-collector-cert\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.338432 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8nt\" (UniqueName: \"kubernetes.io/projected/02b06f20-f46e-4bbc-bbb0-128997bff4ea-kube-api-access-8b8nt\") pod \"migrator-866fcbc849-9c4tk\" (UID: \"02b06f20-f46e-4bbc-bbb0-128997bff4ea\") " pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.338475 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/a9951d15-be29-4c09-aa01-fcaf695cb4d4-certs\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.339010 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.339092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"control-plane-machine-set-operator-tls\" (UniqueName: \"kubernetes.io/secret/87aa0d49-02c3-402a-942d-d4247fa5e87e-control-plane-machine-set-operator-tls\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.339374 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"package-server-manager-serving-cert\" (UniqueName: \"kubernetes.io/secret/33758395-6171-4b56-ae2d-1b99f16ee69f-package-server-manager-serving-cert\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.339528 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc143e43-fd08-456b-b440-751251cd3a72-webhook-cert\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.339852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-metrics-tls\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.340034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.341206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04371676-8de0-4cac-9246-3ba85ab6ec1b-serving-cert\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.352000 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7rsb\" (UniqueName: \"kubernetes.io/projected/c9f3be91-73a7-4d14-8d2f-86da802e4900-kube-api-access-h7rsb\") pod \"machine-api-operator-755bb95488-s5fxv\" (UID: \"c9f3be91-73a7-4d14-8d2f-86da802e4900\") " pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.371489 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz9qz\" (UniqueName: \"kubernetes.io/projected/bfb7cdaa-4776-49a6-87ad-40d85a6a36f5-kube-api-access-xz9qz\") pod \"authentication-operator-7f5c659b84-kr5jr\" (UID: \"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5\") " pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.372523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.391449 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.414095 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mp4\" (UniqueName: \"kubernetes.io/projected/c169fbed-7785-4866-9576-b973e87f6130-kube-api-access-65mp4\") pod \"apiserver-8596bd845d-qp2nr\" (UID: \"c169fbed-7785-4866-9576-b973e87f6130\") " pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.422863 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.424544 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.425328 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:51.92531089 +0000 UTC m=+116.324623437 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.434342 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26wzs\" (UniqueName: \"kubernetes.io/projected/d92828d4-abf1-4fd1-aa08-3ee5ffe26743-kube-api-access-26wzs\") pod \"apiserver-9ddfb9f55-f7gz7\" (UID: \"d92828d4-abf1-4fd1-aa08-3ee5ffe26743\") " pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.438174 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.456253 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t74df\" (UniqueName: \"kubernetes.io/projected/95ac2478-4b8a-40c5-b88f-5a470c217b89-kube-api-access-t74df\") pod \"etcd-operator-69b85846b6-vz7z7\" (UID: \"95ac2478-4b8a-40c5-b88f-5a470c217b89\") " pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.460207 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.475867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpf78\" (UniqueName: \"kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78\") pod \"oauth-openshift-66458b6674-xnmxt\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.484588 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.494894 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9h52\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.513466 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-67c89758df-cbknd"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.515271 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.516100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/192438f9-d116-4b9b-9e87-f6b4e9475ca4-kube-api-access\") pod \"kube-controller-manager-operator-69d5f845f8-25vvr\" (UID: \"192438f9-d116-4b9b-9e87-f6b4e9475ca4\") " pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.526674 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.527265 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.027240744 +0000 UTC m=+116.426553291 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.541477 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnlp8\" (UniqueName: \"kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8\") pod \"console-64d44f6ddf-7mr2q\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.555604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4wj\" (UniqueName: \"kubernetes.io/projected/fed97f4d-1948-4c94-9e96-4a1c71ef6a07-kube-api-access-lq4wj\") pod \"cluster-samples-operator-6b564684c8-sdcbz\" (UID: \"fed97f4d-1948-4c94-9e96-4a1c71ef6a07\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.580343 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptjgd\" (UniqueName: \"kubernetes.io/projected/f2296980-434a-4483-8883-6a838cc800f4-kube-api-access-ptjgd\") pod \"downloads-747b44746d-plw2x\" (UID: \"f2296980-434a-4483-8883-6a838cc800f4\") " pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.591661 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.593600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrx8d\" (UniqueName: \"kubernetes.io/projected/c448f389-3194-4d8e-87d8-e0846247aff5-kube-api-access-wrx8d\") pod \"openshift-controller-manager-operator-686468bdd5-t46qw\" (UID: \"c448f389-3194-4d8e-87d8-e0846247aff5\") " pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.607752 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/machine-api-operator-755bb95488-s5fxv"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.614288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvwl5\" (UniqueName: \"kubernetes.io/projected/8c1e52c8-858e-45e4-a861-ac850209ce6d-kube-api-access-zvwl5\") pod \"machine-config-controller-f9cdd68f7-6psp9\" (UID: \"8c1e52c8-858e-45e4-a861-ac850209ce6d\") " pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.614475 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.625834 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.627575 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.628098 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.128077126 +0000 UTC m=+116.527389674 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.635305 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62-kube-api-access\") pod \"kube-apiserver-operator-575994946d-8kbzc\" (UID: \"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62\") " pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.641032 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.651392 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.655564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2j7h\" (UniqueName: \"kubernetes.io/projected/a9951d15-be29-4c09-aa01-fcaf695cb4d4-kube-api-access-f2j7h\") pod \"machine-config-server-bldz2\" (UID: \"a9951d15-be29-4c09-aa01-fcaf695cb4d4\") " pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.658031 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.663406 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-bldz2" Mar 16 13:07:51 crc kubenswrapper[5030]: W0316 13:07:51.673569 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb7cdaa_4776_49a6_87ad_40d85a6a36f5.slice/crio-d2d54685b5b78cbf967d012075087edcf9e3d7ca2feb5ea585ea12fdb0a65999 WatchSource:0}: Error finding container d2d54685b5b78cbf967d012075087edcf9e3d7ca2feb5ea585ea12fdb0a65999: Status 404 returned error can't find the container with id d2d54685b5b78cbf967d012075087edcf9e3d7ca2feb5ea585ea12fdb0a65999 Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.673735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8wqd\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-kube-api-access-f8wqd\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.697050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzncs\" (UniqueName: \"kubernetes.io/projected/33758395-6171-4b56-ae2d-1b99f16ee69f-kube-api-access-qzncs\") pod \"package-server-manager-77f986bd66-c67zb\" (UID: \"33758395-6171-4b56-ae2d-1b99f16ee69f\") " pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.707984 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.731403 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r869z\" (UniqueName: \"kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z\") pod \"collect-profiles-29561100-c546r\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.738735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42qs\" (UniqueName: \"kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs\") pod \"controller-manager-65b6cccf98-9s6k9\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.743329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.743718 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.243706251 +0000 UTC m=+116.643018799 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.752174 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.752243 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.753578 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.764490 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xzsq\" (UniqueName: \"kubernetes.io/projected/a6c2ab61-00b1-4cbf-a1ec-643d554e8a58-kube-api-access-2xzsq\") pod \"dns-default-sxs7j\" (UID: \"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58\") " pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.767663 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.774237 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjc5\" (UniqueName: \"kubernetes.io/projected/d6a67ee1-697d-4340-9064-c24e0dbd080b-kube-api-access-gvjc5\") pod \"csi-hostpathplugin-tq7cq\" (UID: \"d6a67ee1-697d-4340-9064-c24e0dbd080b\") " pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.789964 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.797182 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.802185 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.816531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkgd\" (UniqueName: \"kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd\") pod \"marketplace-operator-547dbd544d-pmsrq\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.823985 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gsz5\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-kube-api-access-6gsz5\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.835788 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8wt\" (UniqueName: \"kubernetes.io/projected/bae16743-6485-49ce-a9e0-110ebe079f08-kube-api-access-cj8wt\") pod \"multus-admission-controller-69db94689b-h29jz\" (UID: \"bae16743-6485-49ce-a9e0-110ebe079f08\") " pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.846059 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.846430 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.849632 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.849920 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.349906916 +0000 UTC m=+116.749219463 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.861846 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hmgt\" (UniqueName: \"kubernetes.io/projected/6050a028-e057-4537-b148-82acb6e42774-kube-api-access-2hmgt\") pod \"kube-storage-version-migrator-operator-565b79b866-cmlsr\" (UID: \"6050a028-e057-4537-b148-82acb6e42774\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.867372 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.876974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwg9\" (UniqueName: \"kubernetes.io/projected/9755f02f-1a2f-4844-a346-ef17fe95535c-kube-api-access-2rwg9\") pod \"ingress-canary-gzhdr\" (UID: \"9755f02f-1a2f-4844-a346-ef17fe95535c\") " pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.894615 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.899184 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.916790 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.918476 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/fae3fc75-a8d1-4d8f-be36-4eeb9506738a-kube-api-access\") pod \"openshift-kube-scheduler-operator-54f497555d-fdr9t\" (UID: \"fae3fc75-a8d1-4d8f-be36-4eeb9506738a\") " pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.926052 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr"] Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.928053 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.932491 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sghcw\" (UniqueName: \"kubernetes.io/projected/6be2dd5f-e697-404b-882a-16668347c323-kube-api-access-sghcw\") pod \"catalog-operator-75ff9f647d-2ftbn\" (UID: \"6be2dd5f-e697-404b-882a-16668347c323\") " pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.934952 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5949311d-c4a9-401d-a809-ffcd9f76d61d-bound-sa-token\") pod \"cluster-image-registry-operator-86c45576b9-ps9vm\" (UID: \"5949311d-c4a9-401d-a809-ffcd9f76d61d\") " pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.945103 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.949746 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.951397 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:51 crc kubenswrapper[5030]: E0316 13:07:51.951845 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.451830457 +0000 UTC m=+116.851143004 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.967472 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqwv\" (UniqueName: \"kubernetes.io/projected/9e25b438-8403-4ede-bb95-4c48c10acd65-kube-api-access-dcqwv\") pod \"router-default-68cf44c8b8-6hwhj\" (UID: \"9e25b438-8403-4ede-bb95-4c48c10acd65\") " pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:51 crc kubenswrapper[5030]: W0316 13:07:51.967683 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc169fbed_7785_4866_9576_b973e87f6130.slice/crio-403956291f6f2259a72fe686278a5843846a3e85291f2e074a9f1e8732142005 WatchSource:0}: Error finding container 403956291f6f2259a72fe686278a5843846a3e85291f2e074a9f1e8732142005: Status 404 returned error can't find the container with id 403956291f6f2259a72fe686278a5843846a3e85291f2e074a9f1e8732142005 Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.967721 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzhdr" Mar 16 13:07:51 crc kubenswrapper[5030]: I0316 13:07:51.987164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ec24af0-7340-4ec1-9a4e-0bea8c17d87f-bound-sa-token\") pod \"ingress-operator-6b9cb4dbcf-ccklg\" (UID: \"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f\") " pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.000829 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wq8\" (UniqueName: \"kubernetes.io/projected/2ec6f3d9-44b9-4e97-8659-ea963c7909dd-kube-api-access-g4wq8\") pod \"machine-config-operator-67c9d58cbb-msncm\" (UID: \"2ec6f3d9-44b9-4e97-8659-ea963c7909dd\") " pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.016346 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9b4\" (UniqueName: \"kubernetes.io/projected/87aa0d49-02c3-402a-942d-d4247fa5e87e-kube-api-access-qq9b4\") pod \"control-plane-machine-set-operator-75ffdb6fcd-p5pmg\" (UID: \"87aa0d49-02c3-402a-942d-d4247fa5e87e\") " pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.038052 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzdbs\" (UniqueName: \"kubernetes.io/projected/5aa22c0b-cbb2-4044-94fc-f34f2a22ca92-kube-api-access-wzdbs\") pod \"openshift-config-operator-5777786469-f2vgj\" (UID: \"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92\") " pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.054971 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.056069 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.556045849 +0000 UTC m=+116.955358395 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.056186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.057436 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.557424868 +0000 UTC m=+116.956737415 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.066449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqhp\" (UniqueName: \"kubernetes.io/projected/04371676-8de0-4cac-9246-3ba85ab6ec1b-kube-api-access-nwqhp\") pod \"service-ca-operator-5b9c976747-ktnzd\" (UID: \"04371676-8de0-4cac-9246-3ba85ab6ec1b\") " pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.076450 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdt5\" (UniqueName: \"kubernetes.io/projected/f2df72d4-9559-472f-9a2d-611919176b34-kube-api-access-zfdt5\") pod \"service-ca-74545575db-hl62p\" (UID: \"f2df72d4-9559-472f-9a2d-611919176b34\") " pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.102833 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df652\" (UniqueName: \"kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652\") pod \"cni-sysctl-allowlist-ds-674tp\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.118650 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wk92\" (UniqueName: \"kubernetes.io/projected/ea65d07b-f121-4fa9-92c9-a1829a09e8ef-kube-api-access-7wk92\") pod \"olm-operator-5cdf44d969-66pgw\" (UID: \"ea65d07b-f121-4fa9-92c9-a1829a09e8ef\") " pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.130563 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.135413 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.145635 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9zc\" (UniqueName: \"kubernetes.io/projected/fc143e43-fd08-456b-b440-751251cd3a72-kube-api-access-bc9zc\") pod \"packageserver-7d4fc7d867-8s7hc\" (UID: \"fc143e43-fd08-456b-b440-751251cd3a72\") " pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.153691 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.159564 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.164360 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.165057 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.665024529 +0000 UTC m=+117.064337076 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.165252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.165748 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.665738496 +0000 UTC m=+117.065051042 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.168191 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.168750 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-9ddfb9f55-f7gz7"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.172205 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.174409 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.182192 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-74545575db-hl62p" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.188132 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.216351 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.222056 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.255751 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.267378 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.267720 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.767705789 +0000 UTC m=+117.167018336 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.327802 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.338099 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" event={"ID":"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793","Type":"ContainerStarted","Data":"74f55151e419082017187b92c857bc441ef026e386955a2837a729b2a44c1f64"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.338313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" event={"ID":"023c2ca8-9ec5-4ab5-b50a-cd114ee3c793","Type":"ContainerStarted","Data":"7b007a0732a6c2b1f7b5f1ec7c9905cf9cb2a687c274d73d36141a92e051b556"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.339455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" event={"ID":"192438f9-d116-4b9b-9e87-f6b4e9475ca4","Type":"ContainerStarted","Data":"dc9e6aa5fe779f380c8de5e46513bdf34d952a51e43d7324437cff830cfb56b7"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.343033 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.343062 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.348052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" event={"ID":"02b06f20-f46e-4bbc-bbb0-128997bff4ea","Type":"ContainerStarted","Data":"1d469f6771978d03af5a7e16290159cca12feb2facdd2b28b99e7eda7c5aa6b4"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.348082 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" event={"ID":"02b06f20-f46e-4bbc-bbb0-128997bff4ea","Type":"ContainerStarted","Data":"8cb6354f5d4b3831603369ab0437383ba1a6239de983bfd8b0dfb4616d18a862"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.348093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" event={"ID":"02b06f20-f46e-4bbc-bbb0-128997bff4ea","Type":"ContainerStarted","Data":"ac140eaedb35d1e89072f2e92df9b755a7085e2015ad026baa74e2951ffbc3f2"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.349289 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-67c89758df-cbknd" event={"ID":"6f45c8c5-9fd3-40a3-895d-996e82dba7e9","Type":"ContainerStarted","Data":"ad85f0c5447528771922321808d98644e42bb277d991390ec9db081a581c321c"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.349314 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-67c89758df-cbknd" event={"ID":"6f45c8c5-9fd3-40a3-895d-996e82dba7e9","Type":"ContainerStarted","Data":"706e6664d3293c66bcfc9a7e6e4d0dd532a1d2078cdb86690348b53fb1d3c0de"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.349682 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.353519 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-bldz2" event={"ID":"a9951d15-be29-4c09-aa01-fcaf695cb4d4","Type":"ContainerStarted","Data":"a9fca5c80eb10663b9ccc558ef839ba2b8a04c3ac61c8435b2a783f5e411b5ec"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.353562 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-bldz2" event={"ID":"a9951d15-be29-4c09-aa01-fcaf695cb4d4","Type":"ContainerStarted","Data":"3cf12bd4076dcb1ba09cd6cf26b6c584fb86ed73ec989cce694ed773ceb2a3da"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.355363 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" event={"ID":"e38bef32-3ddc-4d2c-93ca-cd077f7ecfcd","Type":"ContainerStarted","Data":"bfdb3f2e8e7705058cd6c66d3e3794f00b035cea826bb55128a3d4f9a4c5bbca"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.363010 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" event={"ID":"f1c067b0-58fd-45c4-a2c1-28a7692be3be","Type":"ContainerStarted","Data":"8a35084e47062032b6b7ceedd41ee0e4f4c07e964e6e4cac97e4399598f57ce0"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.363302 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.370301 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.371443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" event={"ID":"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b","Type":"ContainerStarted","Data":"93fffa4079d0b48cc39764f2f6324ea4f456c7ea371a2fbc2bd4127c67e90091"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.371513 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" event={"ID":"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b","Type":"ContainerStarted","Data":"311f41ecef0c4bf4bc7da6e32c9fb0a32671f346ef777689e821b869c397561f"} Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.371848 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.87183132 +0000 UTC m=+117.271143868 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.376018 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" event={"ID":"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5","Type":"ContainerStarted","Data":"b301c434a8309cf1d82fa3b1a8d9f4ff7301396f4abb05952c15029f4f90f206"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.376057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" event={"ID":"bfb7cdaa-4776-49a6-87ad-40d85a6a36f5","Type":"ContainerStarted","Data":"d2d54685b5b78cbf967d012075087edcf9e3d7ca2feb5ea585ea12fdb0a65999"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.381184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" event={"ID":"c9f3be91-73a7-4d14-8d2f-86da802e4900","Type":"ContainerStarted","Data":"692e53f9b512209a9235f5a0f4f02363312e94e2919dbcb84ddf4062c1af049b"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.381214 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" event={"ID":"c9f3be91-73a7-4d14-8d2f-86da802e4900","Type":"ContainerStarted","Data":"941e57cccf028998253a3b2d838d2eee4f6011aa56df7a43ebc2139c8b162a26"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.384365 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" event={"ID":"d92828d4-abf1-4fd1-aa08-3ee5ffe26743","Type":"ContainerStarted","Data":"8e0db4e6eedb911e1e3f585bf757c5da84115ffc29f37c1ee2df5a459e9b53ca"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.389601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" event={"ID":"c169fbed-7785-4866-9576-b973e87f6130","Type":"ContainerStarted","Data":"403956291f6f2259a72fe686278a5843846a3e85291f2e074a9f1e8732142005"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.390718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" event={"ID":"54b0f14b-7261-4621-abc8-e8e62848ea0d","Type":"ContainerStarted","Data":"58d4db4e86f4b9b12ac35359d6ea6f7e59f84a25a912db33ccefbc7e022cb080"} Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.423226 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-747b44746d-plw2x"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.424172 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.425326 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.441862 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.471937 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.472084 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.972046101 +0000 UTC m=+117.371358649 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.472583 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.473500 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:52.973484372 +0000 UTC m=+117.372796920 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.536986 5030 patch_prober.go:28] interesting pod/console-operator-67c89758df-cbknd container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.217.0.9:8443/readyz\": dial tcp 10.217.0.9:8443: connect: connection refused" start-of-body= Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.539034 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-67c89758df-cbknd" podUID="6f45c8c5-9fd3-40a3-895d-996e82dba7e9" containerName="console-operator" probeResult="failure" output="Get \"https://10.217.0.9:8443/readyz\": dial tcp 10.217.0.9:8443: connect: connection refused" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.548870 5030 patch_prober.go:28] interesting pod/route-controller-manager-776cdc94d6-9x8lz container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" start-of-body= Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.548920 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.217.0.22:8443/healthz\": dial tcp 10.217.0.22:8443: connect: connection refused" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.578786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.579188 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.079142334 +0000 UTC m=+117.478454881 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: W0316 13:07:52.623230 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bac7d2a_a90e_4c1e_bd8b_ca5c07c00a62.slice/crio-69139f49d9ffc8b40f4e3df60b4c4b261a3a6f8d11bba485d4f8bfa20c14f11f WatchSource:0}: Error finding container 69139f49d9ffc8b40f4e3df60b4c4b261a3a6f8d11bba485d4f8bfa20c14f11f: Status 404 returned error can't find the container with id 69139f49d9ffc8b40f4e3df60b4c4b261a3a6f8d11bba485d4f8bfa20c14f11f Mar 16 13:07:52 crc kubenswrapper[5030]: W0316 13:07:52.634632 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ac2478_4b8a_40c5_b88f_5a470c217b89.slice/crio-e5430394fd50b0360a2b4d520426bff31495169f511ac7b4f3fc1be0e9dfb470 WatchSource:0}: Error finding container e5430394fd50b0360a2b4d520426bff31495169f511ac7b4f3fc1be0e9dfb470: Status 404 returned error can't find the container with id e5430394fd50b0360a2b4d520426bff31495169f511ac7b4f3fc1be0e9dfb470 Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.661214 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.661564 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver-operator/openshift-apiserver-operator-846cbfc458-5pbgx" podStartSLOduration=96.661524701 podStartE2EDuration="1m36.661524701s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:52.658365145 +0000 UTC m=+117.057677692" watchObservedRunningTime="2026-03-16 13:07:52.661524701 +0000 UTC m=+117.060837238" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.680104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.680566 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.180539353 +0000 UTC m=+117.579851900 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.731734 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns-operator/dns-operator-799b87ffcd-zlj8v" podStartSLOduration=96.731715618 podStartE2EDuration="1m36.731715618s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:52.729378583 +0000 UTC m=+117.128691130" watchObservedRunningTime="2026-03-16 13:07:52.731715618 +0000 UTC m=+117.131028164" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.749438 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.763437 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/multus-admission-controller-69db94689b-h29jz"] Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.786135 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.786282 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.286261184 +0000 UTC m=+117.685573731 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.786785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.787036 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.287026786 +0000 UTC m=+117.686339334 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.887398 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.887476 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.387458116 +0000 UTC m=+117.786770663 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.887835 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.888161 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.388153998 +0000 UTC m=+117.787466545 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.937297 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" podStartSLOduration=96.937280219 podStartE2EDuration="1m36.937280219s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:52.936898078 +0000 UTC m=+117.336210625" watchObservedRunningTime="2026-03-16 13:07:52.937280219 +0000 UTC m=+117.336592765" Mar 16 13:07:52 crc kubenswrapper[5030]: I0316 13:07:52.993568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:52 crc kubenswrapper[5030]: E0316 13:07:52.993905 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.493890366 +0000 UTC m=+117.893202913 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.031498 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.043015 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzhdr"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.084961 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.094992 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.095236 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.595224096 +0000 UTC m=+117.994536642 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.185633 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.191521 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.191571 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["hostpath-provisioner/csi-hostpathplugin-tq7cq"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.196635 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.197101 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.197402 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.697389072 +0000 UTC m=+118.096701619 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.208648 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.211571 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.214503 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sxs7j"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.216521 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication-operator/authentication-operator-7f5c659b84-kr5jr" podStartSLOduration=97.216506398 podStartE2EDuration="1m37.216506398s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:53.215963565 +0000 UTC m=+117.615276112" watchObservedRunningTime="2026-03-16 13:07:53.216506398 +0000 UTC m=+117.615818945" Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.225770 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6050a028_e057_4537_b148_82acb6e42774.slice/crio-a402bcc322276397cc58b23cd646d58f6f161d6682cdf290d65360da1482dd5e WatchSource:0}: Error finding container a402bcc322276397cc58b23cd646d58f6f161d6682cdf290d65360da1482dd5e: Status 404 returned error can't find the container with id a402bcc322276397cc58b23cd646d58f6f161d6682cdf290d65360da1482dd5e Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.274314 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5141b8bf_7a03_4e30_af39_f8690d31097b.slice/crio-f9eaddef222446e53ba5c03f5c384aa9169fefdda0a42859c8bb1e740b6a42e5 WatchSource:0}: Error finding container f9eaddef222446e53ba5c03f5c384aa9169fefdda0a42859c8bb1e740b6a42e5: Status 404 returned error can't find the container with id f9eaddef222446e53ba5c03f5c384aa9169fefdda0a42859c8bb1e740b6a42e5 Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.298957 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.299736 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.799705544 +0000 UTC m=+118.199018091 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.330979 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6a67ee1_697d_4340_9064_c24e0dbd080b.slice/crio-2de957a7741b746e43683e867deb1e69ecefbd91d338a5ea42c4bfae484537ad WatchSource:0}: Error finding container 2de957a7741b746e43683e867deb1e69ecefbd91d338a5ea42c4bfae484537ad: Status 404 returned error can't find the container with id 2de957a7741b746e43683e867deb1e69ecefbd91d338a5ea42c4bfae484537ad Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.370995 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c2ab61_00b1_4cbf_a1ec_643d554e8a58.slice/crio-5760e79a6e2604fd139aa63c33125c66152ee15506315458d60b3a4bd26039f9 WatchSource:0}: Error finding container 5760e79a6e2604fd139aa63c33125c66152ee15506315458d60b3a4bd26039f9: Status 404 returned error can't find the container with id 5760e79a6e2604fd139aa63c33125c66152ee15506315458d60b3a4bd26039f9 Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.379969 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae3fc75_a8d1_4d8f_be36_4eeb9506738a.slice/crio-b366b20aecd84785fb24ea80120ff6816bcbea2967a7fbc77bee902d06dda5db WatchSource:0}: Error finding container b366b20aecd84785fb24ea80120ff6816bcbea2967a7fbc77bee902d06dda5db: Status 404 returned error can't find the container with id b366b20aecd84785fb24ea80120ff6816bcbea2967a7fbc77bee902d06dda5db Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.387743 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57580: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.389341 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.400448 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.400570 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.900533641 +0000 UTC m=+118.299846189 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.400995 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.401286 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:53.901278315 +0000 UTC m=+118.300590861 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.417021 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" event={"ID":"c9f3be91-73a7-4d14-8d2f-86da802e4900","Type":"ContainerStarted","Data":"2aa7dc14d8bd69033857e501d7817470ad09a29fdef2ac3adad8cd07182070b7"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.418841 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.419239 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-67c89758df-cbknd" podStartSLOduration=97.419170781 podStartE2EDuration="1m37.419170781s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:53.411382371 +0000 UTC m=+117.810694918" watchObservedRunningTime="2026-03-16 13:07:53.419170781 +0000 UTC m=+117.818483329" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.423479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" event={"ID":"5949311d-c4a9-401d-a809-ffcd9f76d61d","Type":"ContainerStarted","Data":"9b6061722f8cf2ec8cf086b0fea826a64c0bd6ce240a33e79d8933b6c1016b1e"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.425598 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" event={"ID":"9e25b438-8403-4ede-bb95-4c48c10acd65","Type":"ContainerStarted","Data":"2c3904cc5f37630b50457d1f92bbd8a143e14f269922a1509a98dacd288408d4"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.425618 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" event={"ID":"9e25b438-8403-4ede-bb95-4c48c10acd65","Type":"ContainerStarted","Data":"009ded417d9ea2b3b901eec9a7a6ab732fe6b749d85cf701c10a468a843c66ef"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.428479 5030 generic.go:358] "Generic (PLEG): container finished" podID="d92828d4-abf1-4fd1-aa08-3ee5ffe26743" containerID="aec85106d3fd5219b3c8c754d329b07f6677b474a9760afaf622d8e6e2f82504" exitCode=0 Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.428573 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" event={"ID":"d92828d4-abf1-4fd1-aa08-3ee5ffe26743","Type":"ContainerDied","Data":"aec85106d3fd5219b3c8c754d329b07f6677b474a9760afaf622d8e6e2f82504"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.433568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" event={"ID":"2ec6f3d9-44b9-4e97-8659-ea963c7909dd","Type":"ContainerStarted","Data":"4b4c0c3fedd2c297d659f21280144116140933bd856da7ef7108f30a21c4034d"} Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.434036 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc143e43_fd08_456b_b440_751251cd3a72.slice/crio-71e5e6010a95a9aca781af3dcbc9a6a48f57da58d0ba6b198088ee084f361d21 WatchSource:0}: Error finding container 71e5e6010a95a9aca781af3dcbc9a6a48f57da58d0ba6b198088ee084f361d21: Status 404 returned error can't find the container with id 71e5e6010a95a9aca781af3dcbc9a6a48f57da58d0ba6b198088ee084f361d21 Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.435560 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxs7j" event={"ID":"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58","Type":"ContainerStarted","Data":"5760e79a6e2604fd139aa63c33125c66152ee15506315458d60b3a4bd26039f9"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.462956 5030 generic.go:358] "Generic (PLEG): container finished" podID="c169fbed-7785-4866-9576-b973e87f6130" containerID="6b2997f8ac594895282b37659682400f8029078d2f733f1d44f67d6ae3219e2c" exitCode=0 Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.463056 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" event={"ID":"c169fbed-7785-4866-9576-b973e87f6130","Type":"ContainerDied","Data":"6b2997f8ac594895282b37659682400f8029078d2f733f1d44f67d6ae3219e2c"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.471325 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" event={"ID":"54b0f14b-7261-4621-abc8-e8e62848ea0d","Type":"ContainerStarted","Data":"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.472058 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.477331 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" event={"ID":"6eaab042-d448-4ec2-9baf-d50c84c73d7c","Type":"ContainerStarted","Data":"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.477368 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" event={"ID":"6eaab042-d448-4ec2-9baf-d50c84c73d7c","Type":"ContainerStarted","Data":"22d4a8a24778d947d3744e3affe61d478a7fc1b1f4969b26fb855034cd36bcba"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.480341 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.481878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" event={"ID":"d6a67ee1-697d-4340-9064-c24e0dbd080b","Type":"ContainerStarted","Data":"2de957a7741b746e43683e867deb1e69ecefbd91d338a5ea42c4bfae484537ad"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.484688 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" event={"ID":"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62","Type":"ContainerStarted","Data":"69139f49d9ffc8b40f4e3df60b4c4b261a3a6f8d11bba485d4f8bfa20c14f11f"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.490091 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57596: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.505482 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.506614 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.006596886 +0000 UTC m=+118.405909433 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.506698 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" event={"ID":"192438f9-d116-4b9b-9e87-f6b4e9475ca4","Type":"ContainerStarted","Data":"bfb3b11e47c43c9ec4a8e532c707c87c59bd58a77c2962bf56b576117a719304"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.519076 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" event={"ID":"6050a028-e057-4537-b148-82acb6e42774","Type":"ContainerStarted","Data":"a402bcc322276397cc58b23cd646d58f6f161d6682cdf290d65360da1482dd5e"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.523446 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" event={"ID":"33758395-6171-4b56-ae2d-1b99f16ee69f","Type":"ContainerStarted","Data":"f59a3c4da573d54b669810b8fe934767fb7ad64d7c9afc74d62e062fe042e55a"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.525296 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.533773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" event={"ID":"fae3fc75-a8d1-4d8f-be36-4eeb9506738a","Type":"ContainerStarted","Data":"b366b20aecd84785fb24ea80120ff6816bcbea2967a7fbc77bee902d06dda5db"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.535909 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.541196 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-7mr2q" event={"ID":"6c8ad577-d0d0-440d-bcd7-b85ed839114b","Type":"ContainerStarted","Data":"5719d082ee8e38a2cce2d089c3c826cf44351da3cc905c0df3143b4165be1d8a"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.544207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" event={"ID":"c448f389-3194-4d8e-87d8-e0846247aff5","Type":"ContainerStarted","Data":"784a6792ffb4a93a92752c350b179ad751d553a711f6a23013033bf91def7de2"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.544239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" event={"ID":"c448f389-3194-4d8e-87d8-e0846247aff5","Type":"ContainerStarted","Data":"579d3ac6ca533d5eaa93acf383f36961bb821a6d46231e937b2220c102bf9097"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.544723 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-74545575db-hl62p"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.546757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerStarted","Data":"f9eaddef222446e53ba5c03f5c384aa9169fefdda0a42859c8bb1e740b6a42e5"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.551973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" event={"ID":"8c1e52c8-858e-45e4-a861-ac850209ce6d","Type":"ContainerStarted","Data":"815e65e7dff13ffbedef44b020e9244fa0bc3204a4d7a896d2cee466ffc702c0"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.551998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" event={"ID":"8c1e52c8-858e-45e4-a861-ac850209ce6d","Type":"ContainerStarted","Data":"8eb86f1b30e0ea7d0511c25d97060eed9e6f133c685f90473275c7f67e2e0669"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.556036 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" event={"ID":"fed97f4d-1948-4c94-9e96-4a1c71ef6a07","Type":"ContainerStarted","Data":"cda3f19b1169ae2f8f1ff781af640bc48d81cadb78211ca625659334ee088628"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.566953 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" event={"ID":"f1c067b0-58fd-45c4-a2c1-28a7692be3be","Type":"ContainerStarted","Data":"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.573271 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" event={"ID":"a2912358-9fb0-4563-8c1a-fd845a33c91d","Type":"ContainerStarted","Data":"f1cfc1ae5e6ba10fc140f1837d8a599b3a03ce996a51faa876b156e03d18e0de"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.574045 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.574924 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzhdr" event={"ID":"9755f02f-1a2f-4844-a346-ef17fe95535c","Type":"ContainerStarted","Data":"96b3fb083797a3838c9f425b810cb8caf0390826d7d3a0523917c1942f61f431"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.578317 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" event={"ID":"00dfada3-100e-4894-bab4-77f210aa0f67","Type":"ContainerStarted","Data":"c736b7dfcdf187b5ca48e97a4fa7b98a02a877fd155a7bd30c195d32c91da6ce"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.583195 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" event={"ID":"bae16743-6485-49ce-a9e0-110ebe079f08","Type":"ContainerStarted","Data":"e74e557fb4aef1f9adc314bcee7e68b58b2103ffe1fd952c02214dbe3ab3ba74"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.584902 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57606: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.591475 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.597956 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.600835 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-config-operator/openshift-config-operator-5777786469-f2vgj"] Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.606814 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.613777 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.113750175 +0000 UTC m=+118.513062722 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.626197 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" event={"ID":"847e826f-b0cf-4fe3-a6c8-9f5a69517a0b","Type":"ContainerStarted","Data":"20a3b3356a6eece33a783b2a9c3843babff260523d86ef89ec774a9b7068adbf"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.635182 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-747b44746d-plw2x" event={"ID":"f2296980-434a-4483-8883-6a838cc800f4","Type":"ContainerStarted","Data":"f459ade8b6d41c70b9cdc61db307a26c39588b25f675040f44697e2526ce25d4"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.635228 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-747b44746d-plw2x" event={"ID":"f2296980-434a-4483-8883-6a838cc800f4","Type":"ContainerStarted","Data":"bca30b3909603470d9b19e80c239e3ee5eedcd189c9c32cc157ea1c5edb948c9"} Mar 16 13:07:53 crc kubenswrapper[5030]: W0316 13:07:53.635301 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2df72d4_9559_472f_9a2d_611919176b34.slice/crio-72d28d52f5198b390f3cd8c6a435d0a4382c1d80baf3f9810fe50c34e199a739 WatchSource:0}: Error finding container 72d28d52f5198b390f3cd8c6a435d0a4382c1d80baf3f9810fe50c34e199a739: Status 404 returned error can't find the container with id 72d28d52f5198b390f3cd8c6a435d0a4382c1d80baf3f9810fe50c34e199a739 Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.635613 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.638178 5030 patch_prober.go:28] interesting pod/downloads-747b44746d-plw2x container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" start-of-body= Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.638223 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-plw2x" podUID="f2296980-434a-4483-8883-6a838cc800f4" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.646294 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-bldz2" podStartSLOduration=4.646284261 podStartE2EDuration="4.646284261s" podCreationTimestamp="2026-03-16 13:07:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:53.645436112 +0000 UTC m=+118.044748659" watchObservedRunningTime="2026-03-16 13:07:53.646284261 +0000 UTC m=+118.045596808" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.648058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" event={"ID":"95ac2478-4b8a-40c5-b88f-5a470c217b89","Type":"ContainerStarted","Data":"e5430394fd50b0360a2b4d520426bff31495169f511ac7b4f3fc1be0e9dfb470"} Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.659487 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-67c89758df-cbknd" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.688635 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57614: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.708514 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.708834 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.208811562 +0000 UTC m=+118.608124109 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.710432 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.711072 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.211055642 +0000 UTC m=+118.610368189 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.771331 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-machine-approver/machine-approver-54c688565-29gbc" podStartSLOduration=97.771317353 podStartE2EDuration="1m37.771317353s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:53.770415563 +0000 UTC m=+118.169728109" watchObservedRunningTime="2026-03-16 13:07:53.771317353 +0000 UTC m=+118.170629900" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.788216 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57630: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.811161 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.812373 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.312356729 +0000 UTC m=+118.711669277 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.876891 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.897758 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57638: no serving certificate available for the kubelet" Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.913418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:53 crc kubenswrapper[5030]: E0316 13:07:53.913783 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.413760752 +0000 UTC m=+118.813073290 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:53 crc kubenswrapper[5030]: I0316 13:07:53.971614 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-866fcbc849-9c4tk" podStartSLOduration=97.971598725 podStartE2EDuration="1m37.971598725s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:53.971091148 +0000 UTC m=+118.370403695" watchObservedRunningTime="2026-03-16 13:07:53.971598725 +0000 UTC m=+118.370911272" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.011036 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" podStartSLOduration=6.011021625 podStartE2EDuration="6.011021625s" podCreationTimestamp="2026-03-16 13:07:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.010494181 +0000 UTC m=+118.409806728" watchObservedRunningTime="2026-03-16 13:07:54.011021625 +0000 UTC m=+118.410334172" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.014139 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.014272 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.514255781 +0000 UTC m=+118.913568328 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.014601 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.015054 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.515047945 +0000 UTC m=+118.914360492 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.098425 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57646: no serving certificate available for the kubelet" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.116392 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.116806 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.61678791 +0000 UTC m=+119.016100457 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.141462 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" podStartSLOduration=98.141444667 podStartE2EDuration="1m38.141444667s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.140122274 +0000 UTC m=+118.539434821" watchObservedRunningTime="2026-03-16 13:07:54.141444667 +0000 UTC m=+118.540757214" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.174019 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.174911 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-747b44746d-plw2x" podStartSLOduration=98.174889219 podStartE2EDuration="1m38.174889219s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.172658033 +0000 UTC m=+118.571970580" watchObservedRunningTime="2026-03-16 13:07:54.174889219 +0000 UTC m=+118.574201765" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.187151 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:54 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:54 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:54 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.187210 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.220746 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podStartSLOduration=98.220729526 podStartE2EDuration="1m38.220729526s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.219894211 +0000 UTC m=+118.619206768" watchObservedRunningTime="2026-03-16 13:07:54.220729526 +0000 UTC m=+118.620042063" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.223374 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.223713 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.723700646 +0000 UTC m=+119.123013193 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.269940 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager-operator/kube-controller-manager-operator-69d5f845f8-25vvr" podStartSLOduration=98.269923764 podStartE2EDuration="1m38.269923764s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.258451089 +0000 UTC m=+118.657763636" watchObservedRunningTime="2026-03-16 13:07:54.269923764 +0000 UTC m=+118.669236311" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.324785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.327989 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.825396859 +0000 UTC m=+119.224709406 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.345633 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/machine-api-operator-755bb95488-s5fxv" podStartSLOduration=98.345612996 podStartE2EDuration="1m38.345612996s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.34429959 +0000 UTC m=+118.743612137" watchObservedRunningTime="2026-03-16 13:07:54.345612996 +0000 UTC m=+118.744925543" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.348131 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager-operator/openshift-controller-manager-operator-686468bdd5-t46qw" podStartSLOduration=98.348122406 podStartE2EDuration="1m38.348122406s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.312053447 +0000 UTC m=+118.711365993" watchObservedRunningTime="2026-03-16 13:07:54.348122406 +0000 UTC m=+118.747435043" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.390121 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" podStartSLOduration=98.390101254 podStartE2EDuration="1m38.390101254s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.388896182 +0000 UTC m=+118.788208749" watchObservedRunningTime="2026-03-16 13:07:54.390101254 +0000 UTC m=+118.789413801" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.426588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.426891 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:54.926879379 +0000 UTC m=+119.326191926 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.460512 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57658: no serving certificate available for the kubelet" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.532496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.532871 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.032849168 +0000 UTC m=+119.432161715 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.637195 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.637562 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.137534575 +0000 UTC m=+119.536847122 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.721596 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" event={"ID":"87aa0d49-02c3-402a-942d-d4247fa5e87e","Type":"ContainerStarted","Data":"907d063046cfdeb1262f4ee6ed961bf641820f4c02bc17e6868a049d3ded94f6"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.722107 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" event={"ID":"87aa0d49-02c3-402a-942d-d4247fa5e87e","Type":"ContainerStarted","Data":"d9acdd03603df37640350b94ce814dfb8e9c42ab45f826003eec7aff053f8d4a"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.727077 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" event={"ID":"bae16743-6485-49ce-a9e0-110ebe079f08","Type":"ContainerStarted","Data":"27cbabc28bad5a19d0cf91992cd72e122bbad315263b722bc578254c8b64a0c1"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.745256 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.745567 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.245535122 +0000 UTC m=+119.644847669 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.747110 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-api/control-plane-machine-set-operator-75ffdb6fcd-p5pmg" podStartSLOduration=98.747101163 podStartE2EDuration="1m38.747101163s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.744757906 +0000 UTC m=+119.144070454" watchObservedRunningTime="2026-03-16 13:07:54.747101163 +0000 UTC m=+119.146413710" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.780783 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" event={"ID":"2ec6f3d9-44b9-4e97-8659-ea963c7909dd","Type":"ContainerStarted","Data":"479484330c4444c107291b02193e4e0b0b3475042c87f5be6d32199ae6ef574a"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.780826 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" event={"ID":"2ec6f3d9-44b9-4e97-8659-ea963c7909dd","Type":"ContainerStarted","Data":"384ce5c1e697c6a86791290ff94f3453f818a5eeb8656c743cd4c2dbd4df6e09"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.800004 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-74545575db-hl62p" event={"ID":"f2df72d4-9559-472f-9a2d-611919176b34","Type":"ContainerStarted","Data":"72d28d52f5198b390f3cd8c6a435d0a4382c1d80baf3f9810fe50c34e199a739"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.833375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" event={"ID":"6be2dd5f-e697-404b-882a-16668347c323","Type":"ContainerStarted","Data":"9e92fb47a402cc3587ab6efa633f376af39049810061288c8d8755f45fc3b6c8"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.833732 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" event={"ID":"6be2dd5f-e697-404b-882a-16668347c323","Type":"ContainerStarted","Data":"5895e93685d2bd11f5fd9c7de73569f7d5cb214d43c7bcd3545ac3ee8aeea7ec"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.834864 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.836504 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-operator-67c9d58cbb-msncm" podStartSLOduration=98.836493304 podStartE2EDuration="1m38.836493304s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.805845724 +0000 UTC m=+119.205158272" watchObservedRunningTime="2026-03-16 13:07:54.836493304 +0000 UTC m=+119.235805851" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.842274 5030 patch_prober.go:28] interesting pod/catalog-operator-75ff9f647d-2ftbn container/catalog-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.19:8443/healthz\": dial tcp 10.217.0.19:8443: connect: connection refused" start-of-body= Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.842314 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" podUID="6be2dd5f-e697-404b-882a-16668347c323" containerName="catalog-operator" probeResult="failure" output="Get \"https://10.217.0.19:8443/healthz\": dial tcp 10.217.0.19:8443: connect: connection refused" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.846269 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-74545575db-hl62p" podStartSLOduration=98.846261496 podStartE2EDuration="1m38.846261496s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.835182012 +0000 UTC m=+119.234494560" watchObservedRunningTime="2026-03-16 13:07:54.846261496 +0000 UTC m=+119.245574044" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.846456 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.847639 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.34762129 +0000 UTC m=+119.746933837 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.848942 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" event={"ID":"33758395-6171-4b56-ae2d-1b99f16ee69f","Type":"ContainerStarted","Data":"445afeb2ab141d30c15d7b67c80c90abb8534564bf415899828040ff9324eb41"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.849485 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.857922 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" podStartSLOduration=98.857909532 podStartE2EDuration="1m38.857909532s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.856866627 +0000 UTC m=+119.256179164" watchObservedRunningTime="2026-03-16 13:07:54.857909532 +0000 UTC m=+119.257222080" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.887481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" event={"ID":"ea65d07b-f121-4fa9-92c9-a1829a09e8ef","Type":"ContainerStarted","Data":"193b3b928b61d98867ccc63392c2d9f31ebe7883fe5aeae911ef14413e815597"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.887522 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" event={"ID":"ea65d07b-f121-4fa9-92c9-a1829a09e8ef","Type":"ContainerStarted","Data":"acfb631e780ba4555aceae8eaa06c0fce9cb6fc9ad21fff35bae49ac36413a68"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.892113 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.904163 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" podStartSLOduration=98.904150224 podStartE2EDuration="1m38.904150224s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.892930365 +0000 UTC m=+119.292242912" watchObservedRunningTime="2026-03-16 13:07:54.904150224 +0000 UTC m=+119.303462772" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.906762 5030 patch_prober.go:28] interesting pod/olm-operator-5cdf44d969-66pgw container/olm-operator namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.21:8443/healthz\": dial tcp 10.217.0.21:8443: connect: connection refused" start-of-body= Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.906814 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" podUID="ea65d07b-f121-4fa9-92c9-a1829a09e8ef" containerName="olm-operator" probeResult="failure" output="Get \"https://10.217.0.21:8443/healthz\": dial tcp 10.217.0.21:8443: connect: connection refused" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.913718 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" podStartSLOduration=98.913696468 podStartE2EDuration="1m38.913696468s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:54.913629161 +0000 UTC m=+119.312941709" watchObservedRunningTime="2026-03-16 13:07:54.913696468 +0000 UTC m=+119.313009015" Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.926095 5030 generic.go:358] "Generic (PLEG): container finished" podID="5aa22c0b-cbb2-4044-94fc-f34f2a22ca92" containerID="06eef76eb9f9ce2f1c3f327515aa0318b9e4797478afdf6ebf453c445b00b061" exitCode=0 Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.926186 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" event={"ID":"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92","Type":"ContainerDied","Data":"06eef76eb9f9ce2f1c3f327515aa0318b9e4797478afdf6ebf453c445b00b061"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.926211 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" event={"ID":"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92","Type":"ContainerStarted","Data":"0908bbbc54b3b25ce1346a5f03894ce1affab5ea06d5a4438930ac3cdff8086f"} Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.948502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.948671 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.448651698 +0000 UTC m=+119.847964245 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:54 crc kubenswrapper[5030]: I0316 13:07:54.948894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:54 crc kubenswrapper[5030]: E0316 13:07:54.951006 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.450995926 +0000 UTC m=+119.850308473 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.010756 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-7mr2q" event={"ID":"6c8ad577-d0d0-440d-bcd7-b85ed839114b","Type":"ContainerStarted","Data":"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.021288 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" podStartSLOduration=99.021274548 podStartE2EDuration="1m39.021274548s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.019167226 +0000 UTC m=+119.418479773" watchObservedRunningTime="2026-03-16 13:07:55.021274548 +0000 UTC m=+119.420587096" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.032346 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" event={"ID":"fed97f4d-1948-4c94-9e96-4a1c71ef6a07","Type":"ContainerStarted","Data":"a3f279dfd46db855359a2bd805a95c18d575cbb6bd15f956e9f730eec3f04dee"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.032504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" event={"ID":"fed97f4d-1948-4c94-9e96-4a1c71ef6a07","Type":"ContainerStarted","Data":"513b999deeacd2ddfe8f8f30ecfd8fb3fb10f1f33be0ebfebf5950d6f591b340"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.050707 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.052271 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.552255977 +0000 UTC m=+119.951568524 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.065471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" event={"ID":"a2912358-9fb0-4563-8c1a-fd845a33c91d","Type":"ContainerStarted","Data":"82eb0ec799d35803aeaf894e7c558bb44e80a29cc62dd4356b93943aaf3e64d8"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.081280 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6b564684c8-sdcbz" podStartSLOduration=99.081269507 podStartE2EDuration="1m39.081269507s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.080907594 +0000 UTC m=+119.480220142" watchObservedRunningTime="2026-03-16 13:07:55.081269507 +0000 UTC m=+119.480582054" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.081867 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzhdr" event={"ID":"9755f02f-1a2f-4844-a346-ef17fe95535c","Type":"ContainerStarted","Data":"40d53c034a8a14c14fd6cbacdfaa4364e5a211b30dcac8d54d34e10bc6392182"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.082950 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64d44f6ddf-7mr2q" podStartSLOduration=99.082943672 podStartE2EDuration="1m39.082943672s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.043931176 +0000 UTC m=+119.443243723" watchObservedRunningTime="2026-03-16 13:07:55.082943672 +0000 UTC m=+119.482256219" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.108072 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" podStartSLOduration=99.108063652 podStartE2EDuration="1m39.108063652s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.105396395 +0000 UTC m=+119.504708942" watchObservedRunningTime="2026-03-16 13:07:55.108063652 +0000 UTC m=+119.507376199" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.109295 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" event={"ID":"00dfada3-100e-4894-bab4-77f210aa0f67","Type":"ContainerStarted","Data":"5542a2ff45cfadaf858ab8df9f6c2c21a134cbbb25879dfd6c66f0cc930418c5"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.109885 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.116064 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-etcd-operator/etcd-operator-69b85846b6-vz7z7" event={"ID":"95ac2478-4b8a-40c5-b88f-5a470c217b89","Type":"ContainerStarted","Data":"b77b526adaba237ba310cf57e67a424b40889a7b31cb757546936628bfb40edd"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.117383 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.127877 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzhdr" podStartSLOduration=6.127861421 podStartE2EDuration="6.127861421s" podCreationTimestamp="2026-03-16 13:07:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.127041325 +0000 UTC m=+119.526353872" watchObservedRunningTime="2026-03-16 13:07:55.127861421 +0000 UTC m=+119.527173968" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.130205 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxs7j" event={"ID":"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58","Type":"ContainerStarted","Data":"fe4b8bfa8f92818ea3eb6465335d763d3755c6c8ab4e17a3211a1b5d8bb6e924"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.130870 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sxs7j" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.140518 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" event={"ID":"fc143e43-fd08-456b-b440-751251cd3a72","Type":"ContainerStarted","Data":"2f15996addaf617b683ce85a0bf425e8fa136a0e7eba659f6735aa42a91bb7b4"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.140744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" event={"ID":"fc143e43-fd08-456b-b440-751251cd3a72","Type":"ContainerStarted","Data":"71e5e6010a95a9aca781af3dcbc9a6a48f57da58d0ba6b198088ee084f361d21"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.141573 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.158159 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.159440 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" podStartSLOduration=99.159430005 podStartE2EDuration="1m39.159430005s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.141905563 +0000 UTC m=+119.541218109" watchObservedRunningTime="2026-03-16 13:07:55.159430005 +0000 UTC m=+119.558742553" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.161006 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.660984296 +0000 UTC m=+120.060296843 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.164039 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" event={"ID":"5949311d-c4a9-401d-a809-ffcd9f76d61d","Type":"ContainerStarted","Data":"d6256a68903b520270c30799ca0bd377d19fa9c401078ac59cbf46a7b94d135c"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.180124 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57660: no serving certificate available for the kubelet" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.180844 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" podStartSLOduration=99.180828 podStartE2EDuration="1m39.180828s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.178939491 +0000 UTC m=+119.578252037" watchObservedRunningTime="2026-03-16 13:07:55.180828 +0000 UTC m=+119.580140547" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.183991 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:55 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:55 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:55 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.184035 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.212905 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" event={"ID":"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f","Type":"ContainerStarted","Data":"6e7069375f492fdcae3012ee321929dd3030ded2799df5867cca3f94f6d54f73"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.212946 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" event={"ID":"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f","Type":"ContainerStarted","Data":"be247ded4c5481b259d578bb4c14fa2a60b3a9b5a3ac63d4f61b2a5e6dc71ff7"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.222922 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" event={"ID":"4bac7d2a-a90e-4c1e-bd8b-ca5c07c00a62","Type":"ContainerStarted","Data":"8072a95d23c4366584a727e713fda7e9b2c3db586a24afb81c4672c698aceed8"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.230101 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/cluster-image-registry-operator-86c45576b9-ps9vm" podStartSLOduration=99.230085428 podStartE2EDuration="1m39.230085428s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.227658744 +0000 UTC m=+119.626971291" watchObservedRunningTime="2026-03-16 13:07:55.230085428 +0000 UTC m=+119.629397976" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.230383 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-sxs7j" podStartSLOduration=7.230379382 podStartE2EDuration="7.230379382s" podCreationTimestamp="2026-03-16 13:07:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.20811254 +0000 UTC m=+119.607425087" watchObservedRunningTime="2026-03-16 13:07:55.230379382 +0000 UTC m=+119.629692020" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.234310 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" event={"ID":"6050a028-e057-4537-b148-82acb6e42774","Type":"ContainerStarted","Data":"2ce8801dd680b9d7731f6088d004582e36ab1bb758e2f7558ffef37676f974f4"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.236875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" event={"ID":"04371676-8de0-4cac-9246-3ba85ab6ec1b","Type":"ContainerStarted","Data":"4431470de1de04827d905055740e187fa2e0fac0c9d8aba809b6f70d91782989"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.236905 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" event={"ID":"04371676-8de0-4cac-9246-3ba85ab6ec1b","Type":"ContainerStarted","Data":"2a1e26301bd2518c3f8f886f7ab2b87502f357f1ccb924e20cc4ad84dd0354fb"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.255012 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" podStartSLOduration=99.254986085 podStartE2EDuration="1m39.254986085s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.252472998 +0000 UTC m=+119.651785545" watchObservedRunningTime="2026-03-16 13:07:55.254986085 +0000 UTC m=+119.654298632" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.283871 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerStarted","Data":"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.284991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.286054 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.290526 5030 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-pmsrq container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.40:8080/healthz\": dial tcp 10.217.0.40:8080: connect: connection refused" start-of-body= Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.290903 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.790855457 +0000 UTC m=+120.190168004 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.291023 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.40:8080/healthz\": dial tcp 10.217.0.40:8080: connect: connection refused" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.292619 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver-operator/kube-apiserver-operator-575994946d-8kbzc" podStartSLOduration=99.292599885 podStartE2EDuration="1m39.292599885s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.28387526 +0000 UTC m=+119.683187807" watchObservedRunningTime="2026-03-16 13:07:55.292599885 +0000 UTC m=+119.691912432" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.311217 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" event={"ID":"8c1e52c8-858e-45e4-a861-ac850209ce6d","Type":"ContainerStarted","Data":"ab27e1e64a2032d525fae54c91e9d7e6c56392236a08aa054d71d0615c30f792"} Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.318280 5030 patch_prober.go:28] interesting pod/downloads-747b44746d-plw2x container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" start-of-body= Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.318323 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-plw2x" podUID="f2296980-434a-4483-8883-6a838cc800f4" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.333241 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565b79b866-cmlsr" podStartSLOduration=99.333231505 podStartE2EDuration="1m39.333231505s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.331866872 +0000 UTC m=+119.731179419" watchObservedRunningTime="2026-03-16 13:07:55.333231505 +0000 UTC m=+119.732544052" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.339460 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.396691 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5b9c976747-ktnzd" podStartSLOduration=99.396675423 podStartE2EDuration="1m39.396675423s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.365800385 +0000 UTC m=+119.765112932" watchObservedRunningTime="2026-03-16 13:07:55.396675423 +0000 UTC m=+119.795987970" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.402003 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.404961 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:55.904942647 +0000 UTC m=+120.304255194 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.431914 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-controller-f9cdd68f7-6psp9" podStartSLOduration=99.431897546 podStartE2EDuration="1m39.431897546s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.398102052 +0000 UTC m=+119.797414600" watchObservedRunningTime="2026-03-16 13:07:55.431897546 +0000 UTC m=+119.831210092" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.432798 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" podStartSLOduration=99.432793715 podStartE2EDuration="1m39.432793715s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:55.431604443 +0000 UTC m=+119.830916990" watchObservedRunningTime="2026-03-16 13:07:55.432793715 +0000 UTC m=+119.832106252" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.505463 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.505675 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.005654825 +0000 UTC m=+120.404967372 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.506158 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.509126 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.00911133 +0000 UTC m=+120.408423877 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.607924 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.608287 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.108269289 +0000 UTC m=+120.507581836 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.709136 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.709635 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.209613488 +0000 UTC m=+120.608926035 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.809842 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.810137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.810165 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.810236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.810263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.810746 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.310720711 +0000 UTC m=+120.710033258 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.811645 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-nginx-conf\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.816206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwt8b\" (UniqueName: \"kubernetes.io/projected/17b87002-b798-480a-8e17-83053d698239-kube-api-access-gwt8b\") pod \"network-check-target-fhkjl\" (UID: \"17b87002-b798-480a-8e17-83053d698239\") " pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.822008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a9ae5f6-97bd-46ac-bafa-ca1b4452a141-networking-console-plugin-cert\") pod \"networking-console-plugin-5ff7774fd9-nljh6\" (UID: \"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141\") " pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.823071 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7w75\" (UniqueName: \"kubernetes.io/projected/f863fff9-286a-45fa-b8f0-8a86994b8440-kube-api-access-l7w75\") pod \"network-check-source-5bb8f5cd97-xdvz5\" (UID: \"f863fff9-286a-45fa-b8f0-8a86994b8440\") " pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.912600 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.912857 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:55 crc kubenswrapper[5030]: E0316 13:07:55.913156 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.413143043 +0000 UTC m=+120.812455590 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.914526 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.939397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/713054df-4196-45ae-8e8e-b3f526c510e9-metrics-certs\") pod \"network-metrics-daemon-qxdgg\" (UID: \"713054df-4196-45ae-8e8e-b3f526c510e9\") " pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.956240 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-674tp"] Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.957627 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.964735 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.971231 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.980308 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8n29\"" Mar 16 13:07:55 crc kubenswrapper[5030]: I0316 13:07:55.988378 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qxdgg" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.015262 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.015807 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.515787863 +0000 UTC m=+120.915100411 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.118023 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.118312 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.618300365 +0000 UTC m=+121.017612912 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.141614 5030 patch_prober.go:28] interesting pod/packageserver-7d4fc7d867-8s7hc container/packageserver namespace/openshift-operator-lifecycle-manager: Readiness probe status=failure output="Get \"https://10.217.0.17:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.141683 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" podUID="fc143e43-fd08-456b-b440-751251cd3a72" containerName="packageserver" probeResult="failure" output="Get \"https://10.217.0.17:5443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.219836 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.220247 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.720232624 +0000 UTC m=+121.119545201 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.319271 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" event={"ID":"33758395-6171-4b56-ae2d-1b99f16ee69f","Type":"ContainerStarted","Data":"ceddba2db477d34c0e73def8968ff98940bb3a40af6bf6db7c44733e14e2c509"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.323630 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.324383 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.824366752 +0000 UTC m=+121.223679299 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.325183 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" event={"ID":"5aa22c0b-cbb2-4044-94fc-f34f2a22ca92","Type":"ContainerStarted","Data":"6903554f7c14291392681476997f5a335814f81c8aa8ec56bc4a80c886dccea0"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.325774 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.332698 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:56 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:56 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:56 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.332771 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.335266 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler-operator/openshift-kube-scheduler-operator-54f497555d-fdr9t" event={"ID":"fae3fc75-a8d1-4d8f-be36-4eeb9506738a","Type":"ContainerStarted","Data":"5cb08d7c5612061f4a6a8230a271568b92654a0c64c452e8767878b43d4f1b1d"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.337409 5030 generic.go:358] "Generic (PLEG): container finished" podID="a2912358-9fb0-4563-8c1a-fd845a33c91d" containerID="82eb0ec799d35803aeaf894e7c558bb44e80a29cc62dd4356b93943aaf3e64d8" exitCode=0 Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.337490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" event={"ID":"a2912358-9fb0-4563-8c1a-fd845a33c91d","Type":"ContainerDied","Data":"82eb0ec799d35803aeaf894e7c558bb44e80a29cc62dd4356b93943aaf3e64d8"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.342505 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sxs7j" event={"ID":"a6c2ab61-00b1-4cbf-a1ec-643d554e8a58","Type":"ContainerStarted","Data":"2a7657d97c34b8ffbbf62cc3917d333140b9d0dad64aa1afff0b969643966c27"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.350433 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" podStartSLOduration=100.350416695 podStartE2EDuration="1m40.350416695s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:56.348444518 +0000 UTC m=+120.747757064" watchObservedRunningTime="2026-03-16 13:07:56.350416695 +0000 UTC m=+120.749729242" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.360975 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-operator/ingress-operator-6b9cb4dbcf-ccklg" event={"ID":"5ec24af0-7340-4ec1-9a4e-0bea8c17d87f","Type":"ContainerStarted","Data":"2b10ef7d517a74e1d04c0fdd46f17b4575b4ac83f2cb84187489e8b3fe5d2187"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.377878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" event={"ID":"c169fbed-7785-4866-9576-b973e87f6130","Type":"ContainerStarted","Data":"2ac1570713759d563c7d6d8bfb1c53948a11add5c8d2ea537fa4e2ade5b2f39d"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.429090 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.430709 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:56.930688925 +0000 UTC m=+121.330001472 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.444041 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" event={"ID":"bae16743-6485-49ce-a9e0-110ebe079f08","Type":"ContainerStarted","Data":"b3ba4c62714588dd79f0dbb83ac19b052b4f8eaec8fd0e69bc71e62b07d6fc00"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.478734 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" podStartSLOduration=100.478707327 podStartE2EDuration="1m40.478707327s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:56.404890455 +0000 UTC m=+120.804203003" watchObservedRunningTime="2026-03-16 13:07:56.478707327 +0000 UTC m=+120.878019874" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.482665 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-admission-controller-69db94689b-h29jz" podStartSLOduration=100.48265613 podStartE2EDuration="1m40.48265613s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:56.477001782 +0000 UTC m=+120.876314329" watchObservedRunningTime="2026-03-16 13:07:56.48265613 +0000 UTC m=+120.881968678" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.485160 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" event={"ID":"d92828d4-abf1-4fd1-aa08-3ee5ffe26743","Type":"ContainerStarted","Data":"11db952ddca236e2cc216534096c816369ad916fc34bf99a162a4525cbe149d2"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.485217 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" event={"ID":"d92828d4-abf1-4fd1-aa08-3ee5ffe26743","Type":"ContainerStarted","Data":"89eeab894c8f9374c50a42db849b31f279aedd2f4152154612b1ff137c9341ca"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.505290 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57672: no serving certificate available for the kubelet" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.506321 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-74545575db-hl62p" event={"ID":"f2df72d4-9559-472f-9a2d-611919176b34","Type":"ContainerStarted","Data":"6f36c6e3be7a63bfebbc9d583d0e73876eac99cb3bf9eebbf3edb33f6a767180"} Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.510857 5030 patch_prober.go:28] interesting pod/downloads-747b44746d-plw2x container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" start-of-body= Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.510908 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-747b44746d-plw2x" podUID="f2296980-434a-4483-8883-6a838cc800f4" containerName="download-server" probeResult="failure" output="Get \"http://10.217.0.32:8080/\": dial tcp 10.217.0.32:8080: connect: connection refused" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.511587 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/packageserver-7d4fc7d867-8s7hc" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.516930 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.523856 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/catalog-operator-75ff9f647d-2ftbn" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.529185 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/olm-operator-5cdf44d969-66pgw" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.532636 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.543045 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.043029311 +0000 UTC m=+121.442341859 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.559682 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" podStartSLOduration=100.559663926 podStartE2EDuration="1m40.559663926s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:56.528086456 +0000 UTC m=+120.927399002" watchObservedRunningTime="2026-03-16 13:07:56.559663926 +0000 UTC m=+120.958976474" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.626919 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.627143 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.667818 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.668204 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.168189553 +0000 UTC m=+121.567502101 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.668258 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.668475 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.672325 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.677185 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: W0316 13:07:56.687090 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713054df_4196_45ae_8e8e_b3f526c510e9.slice/crio-5cefde1fc898fcf4703b70e1d68017690d44db0a4c4c854efdf7bd60198b748a WatchSource:0}: Error finding container 5cefde1fc898fcf4703b70e1d68017690d44db0a4c4c854efdf7bd60198b748a: Status 404 returned error can't find the container with id 5cefde1fc898fcf4703b70e1d68017690d44db0a4c4c854efdf7bd60198b748a Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.687103 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.688291 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qxdgg"] Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.724939 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.770254 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.770301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.770352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgf8h\" (UniqueName: \"kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.770558 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.770871 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.270855755 +0000 UTC m=+121.670168302 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.829353 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.844103 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.844392 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.850285 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.852651 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.871585 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.871836 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.871862 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.871893 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgf8h\" (UniqueName: \"kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.872240 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.372214723 +0000 UTC m=+121.771527269 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.872430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.872534 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.891647 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgf8h\" (UniqueName: \"kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h\") pod \"certified-operators-gdkft\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.973501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.973613 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.973640 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:56 crc kubenswrapper[5030]: I0316 13:07:56.973680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:56 crc kubenswrapper[5030]: E0316 13:07:56.974073 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.474054726 +0000 UTC m=+121.873367273 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.005311 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.010678 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.015568 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.017935 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078233 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078356 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078442 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5f2m\" (UniqueName: \"kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078515 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.078843 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.578820555 +0000 UTC m=+121.978133103 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.078970 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.079094 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.121228 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99\") pod \"community-operators-dmpzv\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.171731 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.172254 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:57 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:57 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:57 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.172422 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.179318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.179370 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.179407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.179438 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f2m\" (UniqueName: \"kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.179806 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.679769059 +0000 UTC m=+122.079081606 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.180001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.180034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.199151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5f2m\" (UniqueName: \"kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m\") pod \"certified-operators-6pjlx\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.209445 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.219062 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.222676 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.281601 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.281799 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8fm5\" (UniqueName: \"kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.281854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.281898 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.282006 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.781992365 +0000 UTC m=+122.181304913 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.283163 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:07:57 crc kubenswrapper[5030]: W0316 13:07:57.305459 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd1741f_617e_4120_a3f5_3c972b198c2c.slice/crio-bd255c42f19e5866377bf2fead05beddee1804cb834f91bf73ef90df5cdf2c7e WatchSource:0}: Error finding container bd255c42f19e5866377bf2fead05beddee1804cb834f91bf73ef90df5cdf2c7e: Status 404 returned error can't find the container with id bd255c42f19e5866377bf2fead05beddee1804cb834f91bf73ef90df5cdf2c7e Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.344565 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.383822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.383870 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.383930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.383973 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8fm5\" (UniqueName: \"kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.384506 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.884493386 +0000 UTC m=+122.283805932 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.384588 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.384807 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.406247 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8fm5\" (UniqueName: \"kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5\") pod \"community-operators-k4gzs\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.442610 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.475659 5030 patch_prober.go:28] interesting pod/apiserver-9ddfb9f55-f7gz7 container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]log ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]etcd ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/start-apiserver-admission-initializer ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/generic-apiserver-start-informers ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/max-in-flight-filter ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/storage-object-count-tracker-hook ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/image.openshift.io-apiserver-caches ok Mar 16 13:07:57 crc kubenswrapper[5030]: [-]poststarthook/authorization.openshift.io-bootstrapclusterroles failed: reason withheld Mar 16 13:07:57 crc kubenswrapper[5030]: [-]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa failed: reason withheld Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/project.openshift.io-projectcache ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/openshift.io-startinformers ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/openshift.io-restmapperupdater ok Mar 16 13:07:57 crc kubenswrapper[5030]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Mar 16 13:07:57 crc kubenswrapper[5030]: livez check failed Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.475704 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" podUID="d92828d4-abf1-4fd1-aa08-3ee5ffe26743" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.484400 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.484800 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:57.984777757 +0000 UTC m=+122.384090304 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.520383 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" event={"ID":"f863fff9-286a-45fa-b8f0-8a86994b8440","Type":"ContainerStarted","Data":"9ab6b8f82e87874d0d5251ceffab550099af1e39366d60558d82823f39da68a7"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.520625 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-5bb8f5cd97-xdvz5" event={"ID":"f863fff9-286a-45fa-b8f0-8a86994b8440","Type":"ContainerStarted","Data":"d91723f092549f04617dd6822a4894a0f4dd2aa4978a19a8e2e2bc771f465f9a"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.525834 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerStarted","Data":"aed20761daeacae3921e2b49a37f06f1ad7517fae2bc8c7888badd8a0af1a564"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.528386 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" event={"ID":"17b87002-b798-480a-8e17-83053d698239","Type":"ContainerStarted","Data":"8c6a31cdb5f7e38270a90c2bc676137ffbd5d1c67a81ddda9e6a5f528f19816d"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.528411 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fhkjl" event={"ID":"17b87002-b798-480a-8e17-83053d698239","Type":"ContainerStarted","Data":"66d4c8e533438a18babe29bfcb55d3d6f1346f4addc57e16cbc6bd88e3768795"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.528854 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.534540 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" event={"ID":"d6a67ee1-697d-4340-9064-c24e0dbd080b","Type":"ContainerStarted","Data":"0582df9fa96e0e5ef4730d4f651e503f4e1b5732281e7795a1cbfa661df34c16"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.535141 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.541289 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" event={"ID":"713054df-4196-45ae-8e8e-b3f526c510e9","Type":"ContainerStarted","Data":"81439d4157d395a8b0474d1ee51dc2ab768f751ec4ca46da5c1ba53a0f2cdf44"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.541313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" event={"ID":"713054df-4196-45ae-8e8e-b3f526c510e9","Type":"ContainerStarted","Data":"5cefde1fc898fcf4703b70e1d68017690d44db0a4c4c854efdf7bd60198b748a"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.575682 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" event={"ID":"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141","Type":"ContainerStarted","Data":"5c41974d8a41c0fa73bfbe444d17e7c5311cacfe384d17798b5cfdb49cd7de99"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.576538 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5ff7774fd9-nljh6" event={"ID":"6a9ae5f6-97bd-46ac-bafa-ca1b4452a141","Type":"ContainerStarted","Data":"de7f897c7c1797b010c763ff1cf6c49c8d0a8e792d0e0755ad5fb8c0106352be"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.585670 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerStarted","Data":"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.585699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerStarted","Data":"bd255c42f19e5866377bf2fead05beddee1804cb834f91bf73ef90df5cdf2c7e"} Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.585833 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" containerID="cri-o://8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" gracePeriod=30 Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.595021 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.596438 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.096417614 +0000 UTC m=+122.495730161 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.617237 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-8596bd845d-qp2nr" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.657874 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.696417 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.696733 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.196707817 +0000 UTC m=+122.596020363 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.701727 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.701990 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.201978742 +0000 UTC m=+122.601291289 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.804344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.804649 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.304630866 +0000 UTC m=+122.703943414 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.841629 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:07:57 crc kubenswrapper[5030]: W0316 13:07:57.881594 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14fcd4f_8619_4f51_a74e_f168d486c636.slice/crio-dd3112614fac0f71b7f0ed80c300d2e3fa65c3b48cd7b836cf95abe557960e1e WatchSource:0}: Error finding container dd3112614fac0f71b7f0ed80c300d2e3fa65c3b48cd7b836cf95abe557960e1e: Status 404 returned error can't find the container with id dd3112614fac0f71b7f0ed80c300d2e3fa65c3b48cd7b836cf95abe557960e1e Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.884203 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:57 crc kubenswrapper[5030]: I0316 13:07:57.905699 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:57 crc kubenswrapper[5030]: E0316 13:07:57.906055 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.406038826 +0000 UTC m=+122.805351374 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.006610 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r869z\" (UniqueName: \"kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z\") pod \"a2912358-9fb0-4563-8c1a-fd845a33c91d\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.006650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume\") pod \"a2912358-9fb0-4563-8c1a-fd845a33c91d\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.006758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.006849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume\") pod \"a2912358-9fb0-4563-8c1a-fd845a33c91d\" (UID: \"a2912358-9fb0-4563-8c1a-fd845a33c91d\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.007286 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.507264372 +0000 UTC m=+122.906576919 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.007400 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume" (OuterVolumeSpecName: "config-volume") pod "a2912358-9fb0-4563-8c1a-fd845a33c91d" (UID: "a2912358-9fb0-4563-8c1a-fd845a33c91d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.012268 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z" (OuterVolumeSpecName: "kube-api-access-r869z") pod "a2912358-9fb0-4563-8c1a-fd845a33c91d" (UID: "a2912358-9fb0-4563-8c1a-fd845a33c91d"). InnerVolumeSpecName "kube-api-access-r869z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.012357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "a2912358-9fb0-4563-8c1a-fd845a33c91d" (UID: "a2912358-9fb0-4563-8c1a-fd845a33c91d"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.107660 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.107759 5030 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2912358-9fb0-4563-8c1a-fd845a33c91d-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.107771 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r869z\" (UniqueName: \"kubernetes.io/projected/a2912358-9fb0-4563-8c1a-fd845a33c91d-kube-api-access-r869z\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.107782 5030 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/a2912358-9fb0-4563-8c1a-fd845a33c91d-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.108054 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.608042735 +0000 UTC m=+123.007355282 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.173868 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:58 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:58 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:58 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.173920 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.209122 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.209290 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.709274473 +0000 UTC m=+123.108587020 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.209374 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.209618 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.709611447 +0000 UTC m=+123.108923985 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.310011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.310576 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.81054293 +0000 UTC m=+123.209855477 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.411379 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.411669 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:58.911657095 +0000 UTC m=+123.310969642 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.412166 5030 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.512834 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.513070 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.01305183 +0000 UTC m=+123.412364376 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.610938 5030 generic.go:358] "Generic (PLEG): container finished" podID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerID="91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e" exitCode=0 Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.611097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerDied","Data":"91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.611146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerStarted","Data":"9fd8df4b31078aa1ae5d84a398357d1328a3db0c96ab72493f90829586c05688"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.614025 5030 generic.go:358] "Generic (PLEG): container finished" podID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerID="602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f" exitCode=0 Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.614114 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.614118 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerDied","Data":"602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.614146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerStarted","Data":"dd3112614fac0f71b7f0ed80c300d2e3fa65c3b48cd7b836cf95abe557960e1e"} Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.614992 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.114975552 +0000 UTC m=+123.514288099 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.617156 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerID="7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634" exitCode=0 Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.617224 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerDied","Data":"7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.621070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" event={"ID":"d6a67ee1-697d-4340-9064-c24e0dbd080b","Type":"ContainerStarted","Data":"02a887892cea2435880e7d6a3ac0304c28933dc1535e6d444202b08df6abddc7"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.621106 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" event={"ID":"d6a67ee1-697d-4340-9064-c24e0dbd080b","Type":"ContainerStarted","Data":"41e11097398c34d67e663eb71fff9b2f08b57666e02dcd8322ff5c1c944206d1"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.623994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qxdgg" event={"ID":"713054df-4196-45ae-8e8e-b3f526c510e9","Type":"ContainerStarted","Data":"03df5c31102bd73e47f6e5621d451f3118eb7f818ed38e7d36273b60bec81bca"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.625892 5030 generic.go:358] "Generic (PLEG): container finished" podID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerID="da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101" exitCode=0 Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.626022 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerDied","Data":"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.631983 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.632023 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r" event={"ID":"a2912358-9fb0-4563-8c1a-fd845a33c91d","Type":"ContainerDied","Data":"f1cfc1ae5e6ba10fc140f1837d8a599b3a03ce996a51faa876b156e03d18e0de"} Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.632041 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1cfc1ae5e6ba10fc140f1837d8a599b3a03ce996a51faa876b156e03d18e0de" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.667027 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qxdgg" podStartSLOduration=102.667018531 podStartE2EDuration="1m42.667018531s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:58.666089881 +0000 UTC m=+123.065402428" watchObservedRunningTime="2026-03-16 13:07:58.667018531 +0000 UTC m=+123.066331078" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.723312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.723821 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.223781346 +0000 UTC m=+123.623093893 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.725295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.725736 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.225700183 +0000 UTC m=+123.625012730 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.801825 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.802574 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2912358-9fb0-4563-8c1a-fd845a33c91d" containerName="collect-profiles" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.802596 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2912358-9fb0-4563-8c1a-fd845a33c91d" containerName="collect-profiles" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.802718 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2912358-9fb0-4563-8c1a-fd845a33c91d" containerName="collect-profiles" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.806272 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.808442 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.812003 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.829157 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.829312 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.329288052 +0000 UTC m=+123.728600599 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.830072 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.830467 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.330452717 +0000 UTC m=+123.729765264 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.931976 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.932184 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.432148119 +0000 UTC m=+123.831460666 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.932667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsqtb\" (UniqueName: \"kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.932741 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.932861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:58 crc kubenswrapper[5030]: I0316 13:07:58.932974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:58 crc kubenswrapper[5030]: E0316 13:07:58.933279 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName: nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.43326275 +0000 UTC m=+123.832575297 (durationBeforeRetry 500ms). Error: MountVolume.MountDevice failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "image-registry-66587d64c8-9j2ww" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf") : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.034795 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.035091 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.035196 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsqtb\" (UniqueName: \"kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.035245 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: E0316 13:07:59.035359 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2 podName:9e9b5059-1b3e-4067-a63d-2952cbe863af nodeName:}" failed. No retries permitted until 2026-03-16 13:07:59.535317979 +0000 UTC m=+123.934630526 (durationBeforeRetry 500ms). Error: UnmountVolume.TearDown failed for volume "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (UniqueName: "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af") : kubernetes.io/csi: Unmounter.TearDownAt failed to get CSI client: driver name kubevirt.io.hostpath-provisioner not found in the list of registered CSI drivers Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.035618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.035666 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.052756 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsqtb\" (UniqueName: \"kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb\") pod \"redhat-marketplace-tdlk4\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.057630 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.061686 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.063621 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler\"/\"installer-sa-dockercfg-qpkss\"" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.063984 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler\"/\"kube-root-ca.crt\"" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.066028 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.068957 5030 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/kubevirt.io.hostpath-provisioner-reg.sock","Timestamp":"2026-03-16T13:07:58.412178428Z","UUID":"b431fb34-ef7c-4495-af97-03125bc9daf9","Handler":null,"Name":"","Endpoint":""} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.072573 5030 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: kubevirt.io.hostpath-provisioner endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock versions: 1.0.0 Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.072624 5030 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: kubevirt.io.hostpath-provisioner at endpoint: /var/lib/kubelet/plugins/csi-hostpath/csi.sock Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.098215 5030 ???:1] "http: TLS handshake error from 192.168.126.11:57676: no serving certificate available for the kubelet" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.118509 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.137325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.137417 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.137441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.139679 5030 csi_attacher.go:373] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.139767 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/kubevirt.io.hostpath-provisioner/b1264ac67579ad07e7e9003054d44fe40dd55285a4b2f7dc74e48be1aee0868a/globalmount\"" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.171810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-66587d64c8-9j2ww\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.172346 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:07:59 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:07:59 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:07:59 crc kubenswrapper[5030]: healthz check failed Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.172432 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.205811 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.213543 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.213744 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.239038 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"9e9b5059-1b3e-4067-a63d-2952cbe863af\" (UID: \"9e9b5059-1b3e-4067-a63d-2952cbe863af\") " Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.239263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.239296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.239912 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.243713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (OuterVolumeSpecName: "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2") pod "9e9b5059-1b3e-4067-a63d-2952cbe863af" (UID: "9e9b5059-1b3e-4067-a63d-2952cbe863af"). InnerVolumeSpecName "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.265159 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access\") pod \"revision-pruner-6-crc\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.280039 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.281625 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.284965 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.340615 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568xg\" (UniqueName: \"kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.340664 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.341026 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.373723 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.444083 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.444257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-568xg\" (UniqueName: \"kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.444296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.445113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.445124 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.468339 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-568xg\" (UniqueName: \"kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg\") pod \"redhat-marketplace-6sztj\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.491773 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.530073 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:07:59 crc kubenswrapper[5030]: W0316 13:07:59.538449 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb16e26a_d8e5_49e1_8562_8e12bdbf3dbf.slice/crio-c5e545dcc7e489b42882aa42fcbc3a0ff2b418804923c2e1d44ec1c71ccb4021 WatchSource:0}: Error finding container c5e545dcc7e489b42882aa42fcbc3a0ff2b418804923c2e1d44ec1c71ccb4021: Status 404 returned error can't find the container with id c5e545dcc7e489b42882aa42fcbc3a0ff2b418804923c2e1d44ec1c71ccb4021 Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.603821 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-crc"] Mar 16 13:07:59 crc kubenswrapper[5030]: W0316 13:07:59.632666 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod390d765c_337a_4d5b_901d_0e2425dc85b0.slice/crio-6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f WatchSource:0}: Error finding container 6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f: Status 404 returned error can't find the container with id 6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.640680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" event={"ID":"d6a67ee1-697d-4340-9064-c24e0dbd080b","Type":"ContainerStarted","Data":"449e7e29f49bff46360b2eab6dfdb963df24cfb534c054357a88f7be75b478fa"} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.641943 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" event={"ID":"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf","Type":"ContainerStarted","Data":"c5e545dcc7e489b42882aa42fcbc3a0ff2b418804923c2e1d44ec1c71ccb4021"} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.644410 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerID="907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a" exitCode=0 Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.644508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerDied","Data":"907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a"} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.644568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerStarted","Data":"e340eac969a9103edea4f0c349d6cd21af622c48ba69ab07a9cb653fe3c487bc"} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.650466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"390d765c-337a-4d5b-901d-0e2425dc85b0","Type":"ContainerStarted","Data":"6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f"} Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.659506 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="hostpath-provisioner/csi-hostpathplugin-tq7cq" podStartSLOduration=11.659491399 podStartE2EDuration="11.659491399s" podCreationTimestamp="2026-03-16 13:07:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:07:59.656470105 +0000 UTC m=+124.055782652" watchObservedRunningTime="2026-03-16 13:07:59.659491399 +0000 UTC m=+124.058803947" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.719043 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:07:59 crc kubenswrapper[5030]: W0316 13:07:59.730699 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5302786_53d9_4461_a9cd_fbc978f14b86.slice/crio-7373a40bc0c6cd443824369e21661b7b5ac3f4f92ef9cfdc8e6867961d9c55de WatchSource:0}: Error finding container 7373a40bc0c6cd443824369e21661b7b5ac3f4f92ef9cfdc8e6867961d9c55de: Status 404 returned error can't find the container with id 7373a40bc0c6cd443824369e21661b7b5ac3f4f92ef9cfdc8e6867961d9c55de Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.801919 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.815859 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.817921 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.818278 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.951992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.952058 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jvz9\" (UniqueName: \"kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.952175 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:07:59 crc kubenswrapper[5030]: I0316 13:07:59.954140 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9b5059-1b3e-4067-a63d-2952cbe863af" path="/var/lib/kubelet/pods/9e9b5059-1b3e-4067-a63d-2952cbe863af/volumes" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.053954 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.054051 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jvz9\" (UniqueName: \"kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.054129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.054912 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.055670 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.074729 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jvz9\" (UniqueName: \"kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9\") pod \"redhat-operators-qd6sf\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.120031 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561108-mfzq4"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.127899 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561108-mfzq4"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.127962 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.130134 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.130423 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.136946 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.172228 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:08:00 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:08:00 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:08:00 crc kubenswrapper[5030]: healthz check failed Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.172806 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.203656 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.207681 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.207780 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.257175 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm6ml\" (UniqueName: \"kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml\") pod \"auto-csr-approver-29561108-mfzq4\" (UID: \"372722e3-ea5c-49ce-b1d1-574906ebd61d\") " pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.322753 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:08:00 crc kubenswrapper[5030]: W0316 13:08:00.327415 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a42fd25_73e1_47ce_ac45_2fe1834de6d1.slice/crio-ce294e1955367955bd2bff11a38f5e78b8aaf4503e5b0cd7e0b7233327dedcb3 WatchSource:0}: Error finding container ce294e1955367955bd2bff11a38f5e78b8aaf4503e5b0cd7e0b7233327dedcb3: Status 404 returned error can't find the container with id ce294e1955367955bd2bff11a38f5e78b8aaf4503e5b0cd7e0b7233327dedcb3 Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.358781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cm6ml\" (UniqueName: \"kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml\") pod \"auto-csr-approver-29561108-mfzq4\" (UID: \"372722e3-ea5c-49ce-b1d1-574906ebd61d\") " pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.359146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.359182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2sp\" (UniqueName: \"kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.359218 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.374252 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm6ml\" (UniqueName: \"kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml\") pod \"auto-csr-approver-29561108-mfzq4\" (UID: \"372722e3-ea5c-49ce-b1d1-574906ebd61d\") " pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.446668 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.461297 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.461397 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.461420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2sp\" (UniqueName: \"kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.461691 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.461912 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.474482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2sp\" (UniqueName: \"kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp\") pod \"redhat-operators-gbffh\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.521155 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.601708 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561108-mfzq4"] Mar 16 13:08:00 crc kubenswrapper[5030]: W0316 13:08:00.611854 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod372722e3_ea5c_49ce_b1d1_574906ebd61d.slice/crio-7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b WatchSource:0}: Error finding container 7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b: Status 404 returned error can't find the container with id 7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.617524 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-config-operator/openshift-config-operator-5777786469-f2vgj" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.668015 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerID="25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a" exitCode=0 Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.669138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerDied","Data":"25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.669166 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerStarted","Data":"ce294e1955367955bd2bff11a38f5e78b8aaf4503e5b0cd7e0b7233327dedcb3"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.688693 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" event={"ID":"372722e3-ea5c-49ce-b1d1-574906ebd61d","Type":"ContainerStarted","Data":"7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.692814 5030 generic.go:358] "Generic (PLEG): container finished" podID="390d765c-337a-4d5b-901d-0e2425dc85b0" containerID="0b6eee445bc4ed0819af2fac3e5d95b4a883817ed4e4db15c336b979f1fcec2c" exitCode=0 Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.692940 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"390d765c-337a-4d5b-901d-0e2425dc85b0","Type":"ContainerDied","Data":"0b6eee445bc4ed0819af2fac3e5d95b4a883817ed4e4db15c336b979f1fcec2c"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.716237 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" event={"ID":"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf","Type":"ContainerStarted","Data":"e862734b60b0140b96863d40f4e3208bf96befb3c51a8413820d022926b0d775"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.716298 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.741449 5030 generic.go:358] "Generic (PLEG): container finished" podID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerID="16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda" exitCode=0 Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.742921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerDied","Data":"16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.742950 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerStarted","Data":"7373a40bc0c6cd443824369e21661b7b5ac3f4f92ef9cfdc8e6867961d9c55de"} Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.763914 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" podStartSLOduration=104.763900794 podStartE2EDuration="1m44.763900794s" podCreationTimestamp="2026-03-16 13:06:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:00.736317561 +0000 UTC m=+125.135630109" watchObservedRunningTime="2026-03-16 13:08:00.763900794 +0000 UTC m=+125.163213341" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.774176 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.777669 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.780233 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.781383 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.783075 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.867182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.867224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.939512 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:00 crc kubenswrapper[5030]: W0316 13:08:00.949095 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772c8088_5466_47ca_a244_41d060e3aa05.slice/crio-36961e20b0146663c9f52f81b9469dfd61ac63f6d9f167d4af0c9fd8622a727f WatchSource:0}: Error finding container 36961e20b0146663c9f52f81b9469dfd61ac63f6d9f167d4af0c9fd8622a727f: Status 404 returned error can't find the container with id 36961e20b0146663c9f52f81b9469dfd61ac63f6d9f167d4af0c9fd8622a727f Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.969575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.969640 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.969964 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:00 crc kubenswrapper[5030]: I0316 13:08:00.987259 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access\") pod \"revision-pruner-11-crc\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.091179 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.182671 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:08:01 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:08:01 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:08:01 crc kubenswrapper[5030]: healthz check failed Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.182911 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.292575 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-11-crc"] Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.634026 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.638115 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-9ddfb9f55-f7gz7" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.760769 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"e35eb279-da09-4530-bd1f-f07b6627aaf8","Type":"ContainerStarted","Data":"4ec3c558ee4f8b4195f3fd66c2a4a0c12f1b8242a77f7650a873cab25cdb797b"} Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.760961 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"e35eb279-da09-4530-bd1f-f07b6627aaf8","Type":"ContainerStarted","Data":"128e04fcbb3806a2ec4a36f5eb847c15b697829f77674db50b5f30703bf57371"} Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.766097 5030 generic.go:358] "Generic (PLEG): container finished" podID="772c8088-5466-47ca-a244-41d060e3aa05" containerID="7ab47efe4e198a89e90ac7d809948083ffdacb431c753954cb2fe438cdd52120" exitCode=0 Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.766408 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerDied","Data":"7ab47efe4e198a89e90ac7d809948083ffdacb431c753954cb2fe438cdd52120"} Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.766481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerStarted","Data":"36961e20b0146663c9f52f81b9469dfd61ac63f6d9f167d4af0c9fd8622a727f"} Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.779687 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/revision-pruner-11-crc" podStartSLOduration=1.7796688440000001 podStartE2EDuration="1.779668844s" podCreationTimestamp="2026-03-16 13:08:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:01.777890903 +0000 UTC m=+126.177203450" watchObservedRunningTime="2026-03-16 13:08:01.779668844 +0000 UTC m=+126.178981391" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.803834 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.803904 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.807707 5030 patch_prober.go:28] interesting pod/console-64d44f6ddf-7mr2q container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.217.0.16:8443/health\": dial tcp 10.217.0.16:8443: connect: connection refused" start-of-body= Mar 16 13:08:01 crc kubenswrapper[5030]: I0316 13:08:01.807753 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64d44f6ddf-7mr2q" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerName="console" probeResult="failure" output="Get \"https://10.217.0.16:8443/health\": dial tcp 10.217.0.16:8443: connect: connection refused" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.001448 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.093940 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir\") pod \"390d765c-337a-4d5b-901d-0e2425dc85b0\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.094046 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "390d765c-337a-4d5b-901d-0e2425dc85b0" (UID: "390d765c-337a-4d5b-901d-0e2425dc85b0"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.094423 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access\") pod \"390d765c-337a-4d5b-901d-0e2425dc85b0\" (UID: \"390d765c-337a-4d5b-901d-0e2425dc85b0\") " Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.094818 5030 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/390d765c-337a-4d5b-901d-0e2425dc85b0-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.113071 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "390d765c-337a-4d5b-901d-0e2425dc85b0" (UID: "390d765c-337a-4d5b-901d-0e2425dc85b0"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.169581 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.172630 5030 patch_prober.go:28] interesting pod/router-default-68cf44c8b8-6hwhj container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-http failed: reason withheld Mar 16 13:08:02 crc kubenswrapper[5030]: [-]has-synced failed: reason withheld Mar 16 13:08:02 crc kubenswrapper[5030]: [+]process-running ok Mar 16 13:08:02 crc kubenswrapper[5030]: healthz check failed Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.172689 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" podUID="9e25b438-8403-4ede-bb95-4c48c10acd65" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.196745 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/390d765c-337a-4d5b-901d-0e2425dc85b0-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.779023 5030 generic.go:358] "Generic (PLEG): container finished" podID="e35eb279-da09-4530-bd1f-f07b6627aaf8" containerID="4ec3c558ee4f8b4195f3fd66c2a4a0c12f1b8242a77f7650a873cab25cdb797b" exitCode=0 Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.779121 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"e35eb279-da09-4530-bd1f-f07b6627aaf8","Type":"ContainerDied","Data":"4ec3c558ee4f8b4195f3fd66c2a4a0c12f1b8242a77f7650a873cab25cdb797b"} Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.783509 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-crc" Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.783535 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-crc" event={"ID":"390d765c-337a-4d5b-901d-0e2425dc85b0","Type":"ContainerDied","Data":"6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f"} Mar 16 13:08:02 crc kubenswrapper[5030]: I0316 13:08:02.783629 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6abffe2f6a9920a952f110382046a27f3de6dffdf5e44c8115517fff9a58376f" Mar 16 13:08:03 crc kubenswrapper[5030]: I0316 13:08:03.176793 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:08:03 crc kubenswrapper[5030]: I0316 13:08:03.179240 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68cf44c8b8-6hwhj" Mar 16 13:08:04 crc kubenswrapper[5030]: I0316 13:08:04.238360 5030 ???:1] "http: TLS handshake error from 192.168.126.11:35264: no serving certificate available for the kubelet" Mar 16 13:08:05 crc kubenswrapper[5030]: E0316 13:08:05.316427 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:05 crc kubenswrapper[5030]: E0316 13:08:05.318321 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:05 crc kubenswrapper[5030]: E0316 13:08:05.319485 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:05 crc kubenswrapper[5030]: E0316 13:08:05.319582 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.434468 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.553041 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir\") pod \"e35eb279-da09-4530-bd1f-f07b6627aaf8\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.553289 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access\") pod \"e35eb279-da09-4530-bd1f-f07b6627aaf8\" (UID: \"e35eb279-da09-4530-bd1f-f07b6627aaf8\") " Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.553860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "e35eb279-da09-4530-bd1f-f07b6627aaf8" (UID: "e35eb279-da09-4530-bd1f-f07b6627aaf8"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.561318 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "e35eb279-da09-4530-bd1f-f07b6627aaf8" (UID: "e35eb279-da09-4530-bd1f-f07b6627aaf8"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.654893 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/e35eb279-da09-4530-bd1f-f07b6627aaf8-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.654925 5030 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e35eb279-da09-4530-bd1f-f07b6627aaf8-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.809586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-11-crc" event={"ID":"e35eb279-da09-4530-bd1f-f07b6627aaf8","Type":"ContainerDied","Data":"128e04fcbb3806a2ec4a36f5eb847c15b697829f77674db50b5f30703bf57371"} Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.809626 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="128e04fcbb3806a2ec4a36f5eb847c15b697829f77674db50b5f30703bf57371" Mar 16 13:08:05 crc kubenswrapper[5030]: I0316 13:08:05.809701 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-11-crc" Mar 16 13:08:06 crc kubenswrapper[5030]: I0316 13:08:06.514941 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-747b44746d-plw2x" Mar 16 13:08:06 crc kubenswrapper[5030]: I0316 13:08:06.588177 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sxs7j" Mar 16 13:08:11 crc kubenswrapper[5030]: I0316 13:08:11.806701 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:08:11 crc kubenswrapper[5030]: I0316 13:08:11.812362 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:08:11 crc kubenswrapper[5030]: I0316 13:08:11.855355 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerStarted","Data":"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44"} Mar 16 13:08:11 crc kubenswrapper[5030]: I0316 13:08:11.859004 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerStarted","Data":"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.283792 5030 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cpgb" Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.288281 5030 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cpgb" Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.876392 5030 generic.go:358] "Generic (PLEG): container finished" podID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerID="a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.876504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerDied","Data":"a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.883059 5030 generic.go:358] "Generic (PLEG): container finished" podID="772c8088-5466-47ca-a244-41d060e3aa05" containerID="65281040bc8d45b47a0d4b6bfef28710a356d4c027a10118798c3d77c6c49e79" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.883397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerDied","Data":"65281040bc8d45b47a0d4b6bfef28710a356d4c027a10118798c3d77c6c49e79"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.888140 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerID="28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.888529 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerDied","Data":"28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.897885 5030 generic.go:358] "Generic (PLEG): container finished" podID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerID="3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.897982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerDied","Data":"3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.901135 5030 generic.go:358] "Generic (PLEG): container finished" podID="372722e3-ea5c-49ce-b1d1-574906ebd61d" containerID="a6a501243cebace4d9905640fb24c33745f3446408c61dd0443915312c3abb57" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.901256 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" event={"ID":"372722e3-ea5c-49ce-b1d1-574906ebd61d","Type":"ContainerDied","Data":"a6a501243cebace4d9905640fb24c33745f3446408c61dd0443915312c3abb57"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.903742 5030 generic.go:358] "Generic (PLEG): container finished" podID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerID="d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.903830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerDied","Data":"d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.909871 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerID="cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.911708 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerDied","Data":"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.913857 5030 generic.go:358] "Generic (PLEG): container finished" podID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerID="7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.913934 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerDied","Data":"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466"} Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.916880 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerID="ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295" exitCode=0 Mar 16 13:08:12 crc kubenswrapper[5030]: I0316 13:08:12.917524 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerDied","Data":"ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.288994 5030 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2026-04-15 13:03:12 +0000 UTC" deadline="2026-04-09 20:46:24.788842983 +0000 UTC" Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.289040 5030 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="583h38m11.499807511s" Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.926184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerStarted","Data":"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.927869 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerStarted","Data":"3c6fe83747d061787377df30b948709260c054fb6252bfcd494b0d2f4102b73c"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.929535 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerStarted","Data":"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.931274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerStarted","Data":"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.933895 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerStarted","Data":"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.935669 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerStarted","Data":"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.937431 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerStarted","Data":"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.939443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerStarted","Data":"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3"} Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.946929 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-6sztj" podStartSLOduration=4.12762709 podStartE2EDuration="14.946912251s" podCreationTimestamp="2026-03-16 13:07:59 +0000 UTC" firstStartedPulling="2026-03-16 13:08:00.74277852 +0000 UTC m=+125.142091067" lastFinishedPulling="2026-03-16 13:08:11.56206368 +0000 UTC m=+135.961376228" observedRunningTime="2026-03-16 13:08:13.944677707 +0000 UTC m=+138.343990254" watchObservedRunningTime="2026-03-16 13:08:13.946912251 +0000 UTC m=+138.346224797" Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.989418 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-6pjlx" podStartSLOduration=5.048011731 podStartE2EDuration="17.989400225s" podCreationTimestamp="2026-03-16 13:07:56 +0000 UTC" firstStartedPulling="2026-03-16 13:07:58.612390689 +0000 UTC m=+123.011703226" lastFinishedPulling="2026-03-16 13:08:11.553779173 +0000 UTC m=+135.953091720" observedRunningTime="2026-03-16 13:08:13.988417961 +0000 UTC m=+138.387730508" watchObservedRunningTime="2026-03-16 13:08:13.989400225 +0000 UTC m=+138.388712772" Mar 16 13:08:13 crc kubenswrapper[5030]: I0316 13:08:13.990791 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-qd6sf" podStartSLOduration=4.057986101 podStartE2EDuration="14.990781935s" podCreationTimestamp="2026-03-16 13:07:59 +0000 UTC" firstStartedPulling="2026-03-16 13:08:00.669020489 +0000 UTC m=+125.068333037" lastFinishedPulling="2026-03-16 13:08:11.601816324 +0000 UTC m=+136.001128871" observedRunningTime="2026-03-16 13:08:13.967886319 +0000 UTC m=+138.367198865" watchObservedRunningTime="2026-03-16 13:08:13.990781935 +0000 UTC m=+138.390094642" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.007430 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-k4gzs" podStartSLOduration=4.055906413 podStartE2EDuration="17.007412899s" podCreationTimestamp="2026-03-16 13:07:57 +0000 UTC" firstStartedPulling="2026-03-16 13:07:58.614712055 +0000 UTC m=+123.014024602" lastFinishedPulling="2026-03-16 13:08:11.56621854 +0000 UTC m=+135.965531088" observedRunningTime="2026-03-16 13:08:14.005432327 +0000 UTC m=+138.404744874" watchObservedRunningTime="2026-03-16 13:08:14.007412899 +0000 UTC m=+138.406725446" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.024433 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-tdlk4" podStartSLOduration=4.092209829 podStartE2EDuration="16.024420411s" podCreationTimestamp="2026-03-16 13:07:58 +0000 UTC" firstStartedPulling="2026-03-16 13:07:59.645271836 +0000 UTC m=+124.044584384" lastFinishedPulling="2026-03-16 13:08:11.577482419 +0000 UTC m=+135.976794966" observedRunningTime="2026-03-16 13:08:14.022493039 +0000 UTC m=+138.421805586" watchObservedRunningTime="2026-03-16 13:08:14.024420411 +0000 UTC m=+138.423732958" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.040427 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-dmpzv" podStartSLOduration=5.082690809 podStartE2EDuration="18.040408922s" podCreationTimestamp="2026-03-16 13:07:56 +0000 UTC" firstStartedPulling="2026-03-16 13:07:58.618033616 +0000 UTC m=+123.017346163" lastFinishedPulling="2026-03-16 13:08:11.575751729 +0000 UTC m=+135.975064276" observedRunningTime="2026-03-16 13:08:14.038159526 +0000 UTC m=+138.437472073" watchObservedRunningTime="2026-03-16 13:08:14.040408922 +0000 UTC m=+138.439721468" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.051979 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-gdkft" podStartSLOduration=5.125398442 podStartE2EDuration="18.05195947s" podCreationTimestamp="2026-03-16 13:07:56 +0000 UTC" firstStartedPulling="2026-03-16 13:07:58.62641803 +0000 UTC m=+123.025730578" lastFinishedPulling="2026-03-16 13:08:11.552979059 +0000 UTC m=+135.952291606" observedRunningTime="2026-03-16 13:08:14.049250123 +0000 UTC m=+138.448562670" watchObservedRunningTime="2026-03-16 13:08:14.05195947 +0000 UTC m=+138.451272017" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.289218 5030 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2026-04-15 13:03:12 +0000 UTC" deadline="2026-04-10 04:40:42.121852001 +0000 UTC" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.289260 5030 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="591h32m27.832594416s" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.289916 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.314834 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-gbffh" podStartSLOduration=4.47440897 podStartE2EDuration="14.314820451s" podCreationTimestamp="2026-03-16 13:08:00 +0000 UTC" firstStartedPulling="2026-03-16 13:08:01.766989053 +0000 UTC m=+126.166301600" lastFinishedPulling="2026-03-16 13:08:11.607400534 +0000 UTC m=+136.006713081" observedRunningTime="2026-03-16 13:08:14.077837394 +0000 UTC m=+138.477149962" watchObservedRunningTime="2026-03-16 13:08:14.314820451 +0000 UTC m=+138.714132998" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.372678 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm6ml\" (UniqueName: \"kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml\") pod \"372722e3-ea5c-49ce-b1d1-574906ebd61d\" (UID: \"372722e3-ea5c-49ce-b1d1-574906ebd61d\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.383452 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml" (OuterVolumeSpecName: "kube-api-access-cm6ml") pod "372722e3-ea5c-49ce-b1d1-574906ebd61d" (UID: "372722e3-ea5c-49ce-b1d1-574906ebd61d"). InnerVolumeSpecName "kube-api-access-cm6ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.396831 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.397124 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" podUID="00dfada3-100e-4894-bab4-77f210aa0f67" containerName="controller-manager" containerID="cri-o://5542a2ff45cfadaf858ab8df9f6c2c21a134cbbb25879dfd6c66f0cc930418c5" gracePeriod=30 Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.406158 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.406483 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerName="route-controller-manager" containerID="cri-o://65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e" gracePeriod=30 Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.474457 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm6ml\" (UniqueName: \"kubernetes.io/projected/372722e3-ea5c-49ce-b1d1-574906ebd61d-kube-api-access-cm6ml\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.845829 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876232 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876705 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerName="route-controller-manager" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876721 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerName="route-controller-manager" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876740 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372722e3-ea5c-49ce-b1d1-574906ebd61d" containerName="oc" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876746 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="372722e3-ea5c-49ce-b1d1-574906ebd61d" containerName="oc" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876763 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35eb279-da09-4530-bd1f-f07b6627aaf8" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876768 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35eb279-da09-4530-bd1f-f07b6627aaf8" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876775 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390d765c-337a-4d5b-901d-0e2425dc85b0" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876779 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="390d765c-337a-4d5b-901d-0e2425dc85b0" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876849 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerName="route-controller-manager" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876860 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35eb279-da09-4530-bd1f-f07b6627aaf8" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876867 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="390d765c-337a-4d5b-901d-0e2425dc85b0" containerName="pruner" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.876873 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="372722e3-ea5c-49ce-b1d1-574906ebd61d" containerName="oc" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879355 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d85jq\" (UniqueName: \"kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq\") pod \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879561 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp\") pod \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879605 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert\") pod \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879658 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config\") pod \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879775 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca\") pod \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\" (UID: \"f1c067b0-58fd-45c4-a2c1-28a7692be3be\") " Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.879889 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp" (OuterVolumeSpecName: "tmp") pod "f1c067b0-58fd-45c4-a2c1-28a7692be3be" (UID: "f1c067b0-58fd-45c4-a2c1-28a7692be3be"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.880230 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.880409 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c067b0-58fd-45c4-a2c1-28a7692be3be-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.880715 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config" (OuterVolumeSpecName: "config") pod "f1c067b0-58fd-45c4-a2c1-28a7692be3be" (UID: "f1c067b0-58fd-45c4-a2c1-28a7692be3be"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.880744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca" (OuterVolumeSpecName: "client-ca") pod "f1c067b0-58fd-45c4-a2c1-28a7692be3be" (UID: "f1c067b0-58fd-45c4-a2c1-28a7692be3be"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.887064 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "f1c067b0-58fd-45c4-a2c1-28a7692be3be" (UID: "f1c067b0-58fd-45c4-a2c1-28a7692be3be"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.898152 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq" (OuterVolumeSpecName: "kube-api-access-d85jq") pod "f1c067b0-58fd-45c4-a2c1-28a7692be3be" (UID: "f1c067b0-58fd-45c4-a2c1-28a7692be3be"). InnerVolumeSpecName "kube-api-access-d85jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.932093 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.949593 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.949659 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561108-mfzq4" event={"ID":"372722e3-ea5c-49ce-b1d1-574906ebd61d","Type":"ContainerDied","Data":"7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b"} Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.949700 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ecfb13b65b2e7f6952e3fe22305fcf5589089243794ac895461a1201985723b" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.951987 5030 generic.go:358] "Generic (PLEG): container finished" podID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" containerID="65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e" exitCode=0 Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.952017 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" event={"ID":"f1c067b0-58fd-45c4-a2c1-28a7692be3be","Type":"ContainerDied","Data":"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e"} Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.952059 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.952190 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz" event={"ID":"f1c067b0-58fd-45c4-a2c1-28a7692be3be","Type":"ContainerDied","Data":"8a35084e47062032b6b7ceedd41ee0e4f4c07e964e6e4cac97e4399598f57ce0"} Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.952216 5030 scope.go:117] "RemoveContainer" containerID="65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.957822 5030 generic.go:358] "Generic (PLEG): container finished" podID="00dfada3-100e-4894-bab4-77f210aa0f67" containerID="5542a2ff45cfadaf858ab8df9f6c2c21a134cbbb25879dfd6c66f0cc930418c5" exitCode=0 Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.958432 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" event={"ID":"00dfada3-100e-4894-bab4-77f210aa0f67","Type":"ContainerDied","Data":"5542a2ff45cfadaf858ab8df9f6c2c21a134cbbb25879dfd6c66f0cc930418c5"} Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.978705 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981079 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981104 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981122 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981216 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8ll\" (UniqueName: \"kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981297 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f1c067b0-58fd-45c4-a2c1-28a7692be3be-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981307 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981316 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c067b0-58fd-45c4-a2c1-28a7692be3be-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.981325 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d85jq\" (UniqueName: \"kubernetes.io/projected/f1c067b0-58fd-45c4-a2c1-28a7692be3be-kube-api-access-d85jq\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.984811 5030 scope.go:117] "RemoveContainer" containerID="65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e" Mar 16 13:08:14 crc kubenswrapper[5030]: E0316 13:08:14.985089 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e\": container with ID starting with 65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e not found: ID does not exist" containerID="65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e" Mar 16 13:08:14 crc kubenswrapper[5030]: I0316 13:08:14.985124 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e"} err="failed to get container status \"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e\": rpc error: code = NotFound desc = could not find container \"65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e\": container with ID starting with 65597c17b93cb4a0ff22d02a8e497ef15810aa8b9277c3f9698e602fdb34655e not found: ID does not exist" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.005222 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.005739 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00dfada3-100e-4894-bab4-77f210aa0f67" containerName="controller-manager" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.005757 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="00dfada3-100e-4894-bab4-77f210aa0f67" containerName="controller-manager" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.005860 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="00dfada3-100e-4894-bab4-77f210aa0f67" containerName="controller-manager" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.010917 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.013213 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.018681 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-776cdc94d6-9x8lz"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.020999 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.081729 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.081936 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.082339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.082290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp" (OuterVolumeSpecName: "tmp") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.082451 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083017 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083120 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s42qs\" (UniqueName: \"kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca\") pod \"00dfada3-100e-4894-bab4-77f210aa0f67\" (UID: \"00dfada3-100e-4894-bab4-77f210aa0f67\") " Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083389 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083479 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7ws8\" (UniqueName: \"kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083562 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083646 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083782 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8ll\" (UniqueName: \"kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083867 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.083975 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084107 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084241 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084424 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084476 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00dfada3-100e-4894-bab4-77f210aa0f67-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.084998 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config" (OuterVolumeSpecName: "config") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.085470 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.085760 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca" (OuterVolumeSpecName: "client-ca") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.086517 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.086636 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.086658 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.088255 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.090874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs" (OuterVolumeSpecName: "kube-api-access-s42qs") pod "00dfada3-100e-4894-bab4-77f210aa0f67" (UID: "00dfada3-100e-4894-bab4-77f210aa0f67"). InnerVolumeSpecName "kube-api-access-s42qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.102206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8ll\" (UniqueName: \"kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll\") pod \"route-controller-manager-55688b86b9-fwvgv\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.185857 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.185949 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7ws8\" (UniqueName: \"kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.185985 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186010 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186051 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186153 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186195 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s42qs\" (UniqueName: \"kubernetes.io/projected/00dfada3-100e-4894-bab4-77f210aa0f67-kube-api-access-s42qs\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186205 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186214 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/00dfada3-100e-4894-bab4-77f210aa0f67-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186222 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/00dfada3-100e-4894-bab4-77f210aa0f67-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186726 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.186984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.187381 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.187720 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.189135 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.205824 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7ws8\" (UniqueName: \"kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8\") pod \"controller-manager-7974bfd95d-6tfvg\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.206047 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: E0316 13:08:15.316932 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:15 crc kubenswrapper[5030]: E0316 13:08:15.323492 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.335184 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:15 crc kubenswrapper[5030]: E0316 13:08:15.343197 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:15 crc kubenswrapper[5030]: E0316 13:08:15.343230 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.436210 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.742526 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.955591 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c067b0-58fd-45c4-a2c1-28a7692be3be" path="/var/lib/kubelet/pods/f1c067b0-58fd-45c4-a2c1-28a7692be3be/volumes" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.977190 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.977261 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-65b6cccf98-9s6k9" event={"ID":"00dfada3-100e-4894-bab4-77f210aa0f67","Type":"ContainerDied","Data":"c736b7dfcdf187b5ca48e97a4fa7b98a02a877fd155a7bd30c195d32c91da6ce"} Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.977627 5030 scope.go:117] "RemoveContainer" containerID="5542a2ff45cfadaf858ab8df9f6c2c21a134cbbb25879dfd6c66f0cc930418c5" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.981962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" event={"ID":"0b6b3681-9caa-42c4-abef-bc4d44b454c0","Type":"ContainerStarted","Data":"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912"} Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.981994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" event={"ID":"0b6b3681-9caa-42c4-abef-bc4d44b454c0","Type":"ContainerStarted","Data":"18c6b8e2950cb4d0a34e113456df3621268b09adbc9a07aa27e5336802d05bb8"} Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.982904 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.989352 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" event={"ID":"3545fcdf-42a9-45cd-bbba-4be9245b85b6","Type":"ContainerStarted","Data":"1ad144ba7bed321d38686c92c36d1f1920647a2f1ac8edc230993956fa85ca5d"} Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.989378 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" event={"ID":"3545fcdf-42a9-45cd-bbba-4be9245b85b6","Type":"ContainerStarted","Data":"8a38e33810a57e82b6491ade385119c2bb6346c090adf7b467108e18be0c20cb"} Mar 16 13:08:15 crc kubenswrapper[5030]: I0316 13:08:15.989773 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.012782 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" podStartSLOduration=2.012767226 podStartE2EDuration="2.012767226s" podCreationTimestamp="2026-03-16 13:08:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:16.011260985 +0000 UTC m=+140.410573533" watchObservedRunningTime="2026-03-16 13:08:16.012767226 +0000 UTC m=+140.412079773" Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.023522 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" podStartSLOduration=2.0235082110000002 podStartE2EDuration="2.023508211s" podCreationTimestamp="2026-03-16 13:08:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:16.021754183 +0000 UTC m=+140.421066730" watchObservedRunningTime="2026-03-16 13:08:16.023508211 +0000 UTC m=+140.422820748" Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.033436 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.036270 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-65b6cccf98-9s6k9"] Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.116776 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.205034 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:16 crc kubenswrapper[5030]: I0316 13:08:16.325594 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.011874 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.012493 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.172716 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.172950 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.229079 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.230580 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.345826 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.345873 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.378104 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.536206 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.536326 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.577958 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:17 crc kubenswrapper[5030]: I0316 13:08:17.954432 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00dfada3-100e-4894-bab4-77f210aa0f67" path="/var/lib/kubelet/pods/00dfada3-100e-4894-bab4-77f210aa0f67/volumes" Mar 16 13:08:18 crc kubenswrapper[5030]: I0316 13:08:18.036229 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:18 crc kubenswrapper[5030]: I0316 13:08:18.036705 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:18 crc kubenswrapper[5030]: I0316 13:08:18.036737 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:08:18 crc kubenswrapper[5030]: I0316 13:08:18.039797 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:08:18 crc kubenswrapper[5030]: I0316 13:08:18.794812 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.118708 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.118783 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.149846 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.530834 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.531002 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:19 crc kubenswrapper[5030]: I0316 13:08:19.565757 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.011377 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-k4gzs" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="registry-server" containerID="cri-o://5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb" gracePeriod=2 Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.040800 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.041594 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.137642 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.137688 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.173337 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.309477 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.356525 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content\") pod \"e14fcd4f-8619-4f51-a74e-f168d486c636\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.356585 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities\") pod \"e14fcd4f-8619-4f51-a74e-f168d486c636\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.356760 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8fm5\" (UniqueName: \"kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5\") pod \"e14fcd4f-8619-4f51-a74e-f168d486c636\" (UID: \"e14fcd4f-8619-4f51-a74e-f168d486c636\") " Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.358600 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities" (OuterVolumeSpecName: "utilities") pod "e14fcd4f-8619-4f51-a74e-f168d486c636" (UID: "e14fcd4f-8619-4f51-a74e-f168d486c636"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.369236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5" (OuterVolumeSpecName: "kube-api-access-p8fm5") pod "e14fcd4f-8619-4f51-a74e-f168d486c636" (UID: "e14fcd4f-8619-4f51-a74e-f168d486c636"). InnerVolumeSpecName "kube-api-access-p8fm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.399038 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e14fcd4f-8619-4f51-a74e-f168d486c636" (UID: "e14fcd4f-8619-4f51-a74e-f168d486c636"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.459150 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8fm5\" (UniqueName: \"kubernetes.io/projected/e14fcd4f-8619-4f51-a74e-f168d486c636-kube-api-access-p8fm5\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.459192 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.459204 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e14fcd4f-8619-4f51-a74e-f168d486c636-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.521923 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.521982 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:20 crc kubenswrapper[5030]: I0316 13:08:20.559754 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.020592 5030 generic.go:358] "Generic (PLEG): container finished" podID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerID="5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb" exitCode=0 Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.020658 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerDied","Data":"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb"} Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.020722 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-k4gzs" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.020745 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-k4gzs" event={"ID":"e14fcd4f-8619-4f51-a74e-f168d486c636","Type":"ContainerDied","Data":"dd3112614fac0f71b7f0ed80c300d2e3fa65c3b48cd7b836cf95abe557960e1e"} Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.020777 5030 scope.go:117] "RemoveContainer" containerID="5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.046432 5030 scope.go:117] "RemoveContainer" containerID="d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.065475 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.068023 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-k4gzs"] Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.070799 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.079378 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.080101 5030 scope.go:117] "RemoveContainer" containerID="602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.095406 5030 scope.go:117] "RemoveContainer" containerID="5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb" Mar 16 13:08:21 crc kubenswrapper[5030]: E0316 13:08:21.096178 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb\": container with ID starting with 5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb not found: ID does not exist" containerID="5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.096229 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb"} err="failed to get container status \"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb\": rpc error: code = NotFound desc = could not find container \"5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb\": container with ID starting with 5352ea02bb69593144ef73e452ae890ae4017f61e16ab74d76747e288d4c07cb not found: ID does not exist" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.096249 5030 scope.go:117] "RemoveContainer" containerID="d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01" Mar 16 13:08:21 crc kubenswrapper[5030]: E0316 13:08:21.096534 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01\": container with ID starting with d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01 not found: ID does not exist" containerID="d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.096599 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01"} err="failed to get container status \"d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01\": rpc error: code = NotFound desc = could not find container \"d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01\": container with ID starting with d104af19dea4e2751c4e928a342355a2492ed5aeb08c7b087a1498282556cf01 not found: ID does not exist" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.096629 5030 scope.go:117] "RemoveContainer" containerID="602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f" Mar 16 13:08:21 crc kubenswrapper[5030]: E0316 13:08:21.096896 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f\": container with ID starting with 602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f not found: ID does not exist" containerID="602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.096923 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f"} err="failed to get container status \"602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f\": rpc error: code = NotFound desc = could not find container \"602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f\": container with ID starting with 602a7073e85336e8bff6f3607b2e10bbfc7d29d468a25739ac056c9eefcbab3f not found: ID does not exist" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.194140 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.194407 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-6pjlx" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="registry-server" containerID="cri-o://c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202" gracePeriod=2 Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.518027 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.573946 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities\") pod \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.573998 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content\") pod \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.574036 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5f2m\" (UniqueName: \"kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m\") pod \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\" (UID: \"bffe5fbf-4ec3-4355-9b3a-2d386293349b\") " Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.575074 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities" (OuterVolumeSpecName: "utilities") pod "bffe5fbf-4ec3-4355-9b3a-2d386293349b" (UID: "bffe5fbf-4ec3-4355-9b3a-2d386293349b"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.579189 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m" (OuterVolumeSpecName: "kube-api-access-p5f2m") pod "bffe5fbf-4ec3-4355-9b3a-2d386293349b" (UID: "bffe5fbf-4ec3-4355-9b3a-2d386293349b"). InnerVolumeSpecName "kube-api-access-p5f2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.601044 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "bffe5fbf-4ec3-4355-9b3a-2d386293349b" (UID: "bffe5fbf-4ec3-4355-9b3a-2d386293349b"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.676510 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.676590 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/bffe5fbf-4ec3-4355-9b3a-2d386293349b-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.676609 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5f2m\" (UniqueName: \"kubernetes.io/projected/bffe5fbf-4ec3-4355-9b3a-2d386293349b-kube-api-access-p5f2m\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.776072 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:08:21 crc kubenswrapper[5030]: I0316 13:08:21.954525 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" path="/var/lib/kubelet/pods/e14fcd4f-8619-4f51-a74e-f168d486c636/volumes" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.027979 5030 generic.go:358] "Generic (PLEG): container finished" podID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerID="c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202" exitCode=0 Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.028077 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerDied","Data":"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202"} Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.028105 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-6pjlx" event={"ID":"bffe5fbf-4ec3-4355-9b3a-2d386293349b","Type":"ContainerDied","Data":"9fd8df4b31078aa1ae5d84a398357d1328a3db0c96ab72493f90829586c05688"} Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.028123 5030 scope.go:117] "RemoveContainer" containerID="c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.028215 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-6pjlx" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.048967 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.050659 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-6pjlx"] Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.052902 5030 scope.go:117] "RemoveContainer" containerID="3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.078666 5030 scope.go:117] "RemoveContainer" containerID="91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.092712 5030 scope.go:117] "RemoveContainer" containerID="c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202" Mar 16 13:08:22 crc kubenswrapper[5030]: E0316 13:08:22.093080 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202\": container with ID starting with c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202 not found: ID does not exist" containerID="c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.093127 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202"} err="failed to get container status \"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202\": rpc error: code = NotFound desc = could not find container \"c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202\": container with ID starting with c268c6d0cb6f35d605c5cb23520c26d8b793844e85d254fad8330fcb3b377202 not found: ID does not exist" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.093152 5030 scope.go:117] "RemoveContainer" containerID="3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e" Mar 16 13:08:22 crc kubenswrapper[5030]: E0316 13:08:22.093397 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e\": container with ID starting with 3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e not found: ID does not exist" containerID="3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.093435 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e"} err="failed to get container status \"3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e\": rpc error: code = NotFound desc = could not find container \"3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e\": container with ID starting with 3cd3008f63cb18034295764ec0bf5661c399de3fb037a7865338dda28d63ed1e not found: ID does not exist" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.093457 5030 scope.go:117] "RemoveContainer" containerID="91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e" Mar 16 13:08:22 crc kubenswrapper[5030]: E0316 13:08:22.093720 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e\": container with ID starting with 91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e not found: ID does not exist" containerID="91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e" Mar 16 13:08:22 crc kubenswrapper[5030]: I0316 13:08:22.093746 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e"} err="failed to get container status \"91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e\": rpc error: code = NotFound desc = could not find container \"91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e\": container with ID starting with 91ccd1e1e6c08d175a4f2eff698ec9afd1a447f5624c9598349e2ec0a1b88d0e not found: ID does not exist" Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.597997 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.598339 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-6sztj" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="registry-server" containerID="cri-o://8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d" gracePeriod=2 Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.797027 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.797756 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-gbffh" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="registry-server" containerID="cri-o://3c6fe83747d061787377df30b948709260c054fb6252bfcd494b0d2f4102b73c" gracePeriod=2 Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.959613 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" path="/var/lib/kubelet/pods/bffe5fbf-4ec3-4355-9b3a-2d386293349b/volumes" Mar 16 13:08:23 crc kubenswrapper[5030]: I0316 13:08:23.962341 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.009544 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content\") pod \"e5302786-53d9-4461-a9cd-fbc978f14b86\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.010003 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-568xg\" (UniqueName: \"kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg\") pod \"e5302786-53d9-4461-a9cd-fbc978f14b86\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.010159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities\") pod \"e5302786-53d9-4461-a9cd-fbc978f14b86\" (UID: \"e5302786-53d9-4461-a9cd-fbc978f14b86\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.011034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities" (OuterVolumeSpecName: "utilities") pod "e5302786-53d9-4461-a9cd-fbc978f14b86" (UID: "e5302786-53d9-4461-a9cd-fbc978f14b86"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.022669 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg" (OuterVolumeSpecName: "kube-api-access-568xg") pod "e5302786-53d9-4461-a9cd-fbc978f14b86" (UID: "e5302786-53d9-4461-a9cd-fbc978f14b86"). InnerVolumeSpecName "kube-api-access-568xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.024926 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "e5302786-53d9-4461-a9cd-fbc978f14b86" (UID: "e5302786-53d9-4461-a9cd-fbc978f14b86"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.054365 5030 generic.go:358] "Generic (PLEG): container finished" podID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerID="8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d" exitCode=0 Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.054440 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerDied","Data":"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d"} Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.054468 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-6sztj" event={"ID":"e5302786-53d9-4461-a9cd-fbc978f14b86","Type":"ContainerDied","Data":"7373a40bc0c6cd443824369e21661b7b5ac3f4f92ef9cfdc8e6867961d9c55de"} Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.054486 5030 scope.go:117] "RemoveContainer" containerID="8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.054633 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-6sztj" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.070502 5030 generic.go:358] "Generic (PLEG): container finished" podID="772c8088-5466-47ca-a244-41d060e3aa05" containerID="3c6fe83747d061787377df30b948709260c054fb6252bfcd494b0d2f4102b73c" exitCode=0 Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.070832 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerDied","Data":"3c6fe83747d061787377df30b948709260c054fb6252bfcd494b0d2f4102b73c"} Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.091843 5030 scope.go:117] "RemoveContainer" containerID="a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.104310 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.114742 5030 scope.go:117] "RemoveContainer" containerID="16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.114782 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.114821 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/e5302786-53d9-4461-a9cd-fbc978f14b86-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.114832 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-568xg\" (UniqueName: \"kubernetes.io/projected/e5302786-53d9-4461-a9cd-fbc978f14b86-kube-api-access-568xg\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.117733 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-6sztj"] Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.153192 5030 scope.go:117] "RemoveContainer" containerID="8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d" Mar 16 13:08:24 crc kubenswrapper[5030]: E0316 13:08:24.156121 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d\": container with ID starting with 8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d not found: ID does not exist" containerID="8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.156165 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d"} err="failed to get container status \"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d\": rpc error: code = NotFound desc = could not find container \"8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d\": container with ID starting with 8c6cc92a70edab9950363fc4eb0a8d23b2e85e8801a5f033ca29ed3d18edb54d not found: ID does not exist" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.156190 5030 scope.go:117] "RemoveContainer" containerID="a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8" Mar 16 13:08:24 crc kubenswrapper[5030]: E0316 13:08:24.160650 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8\": container with ID starting with a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8 not found: ID does not exist" containerID="a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.160679 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8"} err="failed to get container status \"a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8\": rpc error: code = NotFound desc = could not find container \"a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8\": container with ID starting with a0119565929509fc7b34c4977216fa035e6ebfe75867a12773f6b0e3cf1967d8 not found: ID does not exist" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.160696 5030 scope.go:117] "RemoveContainer" containerID="16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda" Mar 16 13:08:24 crc kubenswrapper[5030]: E0316 13:08:24.160989 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda\": container with ID starting with 16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda not found: ID does not exist" containerID="16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.161023 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda"} err="failed to get container status \"16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda\": rpc error: code = NotFound desc = could not find container \"16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda\": container with ID starting with 16da3136a8130875ea9b6745c14326fed8ed7b5834b2d41bd6be63bdcc64fbda not found: ID does not exist" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.178875 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.216076 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb2sp\" (UniqueName: \"kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp\") pod \"772c8088-5466-47ca-a244-41d060e3aa05\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.216229 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities\") pod \"772c8088-5466-47ca-a244-41d060e3aa05\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.216312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content\") pod \"772c8088-5466-47ca-a244-41d060e3aa05\" (UID: \"772c8088-5466-47ca-a244-41d060e3aa05\") " Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.217999 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities" (OuterVolumeSpecName: "utilities") pod "772c8088-5466-47ca-a244-41d060e3aa05" (UID: "772c8088-5466-47ca-a244-41d060e3aa05"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.227408 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp" (OuterVolumeSpecName: "kube-api-access-tb2sp") pod "772c8088-5466-47ca-a244-41d060e3aa05" (UID: "772c8088-5466-47ca-a244-41d060e3aa05"). InnerVolumeSpecName "kube-api-access-tb2sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.318702 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb2sp\" (UniqueName: \"kubernetes.io/projected/772c8088-5466-47ca-a244-41d060e3aa05-kube-api-access-tb2sp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.318755 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.321478 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "772c8088-5466-47ca-a244-41d060e3aa05" (UID: "772c8088-5466-47ca-a244-41d060e3aa05"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:24 crc kubenswrapper[5030]: I0316 13:08:24.420189 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/772c8088-5466-47ca-a244-41d060e3aa05-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.080825 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-gbffh" event={"ID":"772c8088-5466-47ca-a244-41d060e3aa05","Type":"ContainerDied","Data":"36961e20b0146663c9f52f81b9469dfd61ac63f6d9f167d4af0c9fd8622a727f"} Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.080893 5030 scope.go:117] "RemoveContainer" containerID="3c6fe83747d061787377df30b948709260c054fb6252bfcd494b0d2f4102b73c" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.080891 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-gbffh" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.098456 5030 scope.go:117] "RemoveContainer" containerID="65281040bc8d45b47a0d4b6bfef28710a356d4c027a10118798c3d77c6c49e79" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.121844 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.121882 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-gbffh"] Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.123600 5030 scope.go:117] "RemoveContainer" containerID="7ab47efe4e198a89e90ac7d809948083ffdacb431c753954cb2fe438cdd52120" Mar 16 13:08:25 crc kubenswrapper[5030]: E0316 13:08:25.314829 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:25 crc kubenswrapper[5030]: E0316 13:08:25.316609 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:25 crc kubenswrapper[5030]: E0316 13:08:25.318008 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" cmd=["/bin/bash","-c","test -f /ready/ready"] Mar 16 13:08:25 crc kubenswrapper[5030]: E0316 13:08:25.318095 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" probeResult="unknown" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.951405 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="772c8088-5466-47ca-a244-41d060e3aa05" path="/var/lib/kubelet/pods/772c8088-5466-47ca-a244-41d060e3aa05/volumes" Mar 16 13:08:25 crc kubenswrapper[5030]: I0316 13:08:25.952037 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" path="/var/lib/kubelet/pods/e5302786-53d9-4461-a9cd-fbc978f14b86/volumes" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.179392 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.595659 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operator-lifecycle-manager/package-server-manager-77f986bd66-c67zb" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.731809 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-674tp_6eaab042-d448-4ec2-9baf-d50c84c73d7c/kube-multus-additional-cni-plugins/0.log" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.732052 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869033 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df652\" (UniqueName: \"kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652\") pod \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869139 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir\") pod \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869179 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist\") pod \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869202 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready\") pod \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\" (UID: \"6eaab042-d448-4ec2-9baf-d50c84c73d7c\") " Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869249 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir" (OuterVolumeSpecName: "tuning-conf-dir") pod "6eaab042-d448-4ec2-9baf-d50c84c73d7c" (UID: "6eaab042-d448-4ec2-9baf-d50c84c73d7c"). InnerVolumeSpecName "tuning-conf-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869673 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready" (OuterVolumeSpecName: "ready") pod "6eaab042-d448-4ec2-9baf-d50c84c73d7c" (UID: "6eaab042-d448-4ec2-9baf-d50c84c73d7c"). InnerVolumeSpecName "ready". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869828 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist" (OuterVolumeSpecName: "cni-sysctl-allowlist") pod "6eaab042-d448-4ec2-9baf-d50c84c73d7c" (UID: "6eaab042-d448-4ec2-9baf-d50c84c73d7c"). InnerVolumeSpecName "cni-sysctl-allowlist". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869910 5030 reconciler_common.go:299] "Volume detached for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6eaab042-d448-4ec2-9baf-d50c84c73d7c-tuning-conf-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869927 5030 reconciler_common.go:299] "Volume detached for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6eaab042-d448-4ec2-9baf-d50c84c73d7c-cni-sysctl-allowlist\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.869936 5030 reconciler_common.go:299] "Volume detached for volume \"ready\" (UniqueName: \"kubernetes.io/empty-dir/6eaab042-d448-4ec2-9baf-d50c84c73d7c-ready\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.874807 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652" (OuterVolumeSpecName: "kube-api-access-df652") pod "6eaab042-d448-4ec2-9baf-d50c84c73d7c" (UID: "6eaab042-d448-4ec2-9baf-d50c84c73d7c"). InnerVolumeSpecName "kube-api-access-df652". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:27 crc kubenswrapper[5030]: I0316 13:08:27.971645 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df652\" (UniqueName: \"kubernetes.io/projected/6eaab042-d448-4ec2-9baf-d50c84c73d7c-kube-api-access-df652\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097242 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_cni-sysctl-allowlist-ds-674tp_6eaab042-d448-4ec2-9baf-d50c84c73d7c/kube-multus-additional-cni-plugins/0.log" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097283 5030 generic.go:358] "Generic (PLEG): container finished" podID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" exitCode=137 Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" event={"ID":"6eaab042-d448-4ec2-9baf-d50c84c73d7c","Type":"ContainerDied","Data":"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64"} Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097362 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097385 5030 scope.go:117] "RemoveContainer" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.097373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/cni-sysctl-allowlist-ds-674tp" event={"ID":"6eaab042-d448-4ec2-9baf-d50c84c73d7c","Type":"ContainerDied","Data":"22d4a8a24778d947d3744e3affe61d478a7fc1b1f4969b26fb855034cd36bcba"} Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.110260 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-674tp"] Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.112225 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-multus/cni-sysctl-allowlist-ds-674tp"] Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.112353 5030 scope.go:117] "RemoveContainer" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" Mar 16 13:08:28 crc kubenswrapper[5030]: E0316 13:08:28.112658 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64\": container with ID starting with 8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64 not found: ID does not exist" containerID="8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.112684 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64"} err="failed to get container status \"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64\": rpc error: code = NotFound desc = could not find container \"8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64\": container with ID starting with 8a88aae61350ee45c8e016abbcad2b324549a8266b1b163afd0493d2b3733a64 not found: ID does not exist" Mar 16 13:08:28 crc kubenswrapper[5030]: I0316 13:08:28.646200 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fhkjl" Mar 16 13:08:29 crc kubenswrapper[5030]: I0316 13:08:29.951396 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" path="/var/lib/kubelet/pods/6eaab042-d448-4ec2-9baf-d50c84c73d7c/volumes" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.356689 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.357708 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" podUID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" containerName="controller-manager" containerID="cri-o://1ad144ba7bed321d38686c92c36d1f1920647a2f1ac8edc230993956fa85ca5d" gracePeriod=30 Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.368096 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.368399 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" podUID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" containerName="route-controller-manager" containerID="cri-o://af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912" gracePeriod=30 Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.826683 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.856698 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857384 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857403 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857414 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857420 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857428 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857433 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857440 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857445 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857458 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857462 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857468 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" containerName="route-controller-manager" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857473 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" containerName="route-controller-manager" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857481 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857487 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857495 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857501 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857507 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857512 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857519 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857525 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857533 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857537 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857559 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857564 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857571 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857575 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="extract-content" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857582 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857587 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="extract-utilities" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857668 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bffe5fbf-4ec3-4355-9b3a-2d386293349b" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857678 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6eaab042-d448-4ec2-9baf-d50c84c73d7c" containerName="kube-multus-additional-cni-plugins" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857683 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="772c8088-5466-47ca-a244-41d060e3aa05" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857689 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e14fcd4f-8619-4f51-a74e-f168d486c636" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857697 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" containerName="route-controller-manager" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.857703 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5302786-53d9-4461-a9cd-fbc978f14b86" containerName="registry-server" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.860056 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.870668 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.979539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert\") pod \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.979816 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp\") pod \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.979866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca\") pod \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.979944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z8ll\" (UniqueName: \"kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll\") pod \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.979982 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config\") pod \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\" (UID: \"0b6b3681-9caa-42c4-abef-bc4d44b454c0\") " Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980258 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp" (OuterVolumeSpecName: "tmp") pod "0b6b3681-9caa-42c4-abef-bc4d44b454c0" (UID: "0b6b3681-9caa-42c4-abef-bc4d44b454c0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980512 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9qg\" (UniqueName: \"kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980611 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca" (OuterVolumeSpecName: "client-ca") pod "0b6b3681-9caa-42c4-abef-bc4d44b454c0" (UID: "0b6b3681-9caa-42c4-abef-bc4d44b454c0"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980689 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config" (OuterVolumeSpecName: "config") pod "0b6b3681-9caa-42c4-abef-bc4d44b454c0" (UID: "0b6b3681-9caa-42c4-abef-bc4d44b454c0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980731 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980816 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.980896 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.981008 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b6b3681-9caa-42c4-abef-bc4d44b454c0-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.981042 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.981059 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0b6b3681-9caa-42c4-abef-bc4d44b454c0-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.986805 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll" (OuterVolumeSpecName: "kube-api-access-7z8ll") pod "0b6b3681-9caa-42c4-abef-bc4d44b454c0" (UID: "0b6b3681-9caa-42c4-abef-bc4d44b454c0"). InnerVolumeSpecName "kube-api-access-7z8ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:34 crc kubenswrapper[5030]: I0316 13:08:34.987057 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "0b6b3681-9caa-42c4-abef-bc4d44b454c0" (UID: "0b6b3681-9caa-42c4-abef-bc4d44b454c0"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082347 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082429 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9qg\" (UniqueName: \"kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082495 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082533 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082636 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0b6b3681-9caa-42c4-abef-bc4d44b454c0-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.082652 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z8ll\" (UniqueName: \"kubernetes.io/projected/0b6b3681-9caa-42c4-abef-bc4d44b454c0-kube-api-access-7z8ll\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.083124 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.083440 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.083493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.086027 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.095352 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9qg\" (UniqueName: \"kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg\") pod \"route-controller-manager-bdcb59844-75sd8\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.130532 5030 generic.go:358] "Generic (PLEG): container finished" podID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" containerID="af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912" exitCode=0 Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.130586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" event={"ID":"0b6b3681-9caa-42c4-abef-bc4d44b454c0","Type":"ContainerDied","Data":"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912"} Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.130635 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" event={"ID":"0b6b3681-9caa-42c4-abef-bc4d44b454c0","Type":"ContainerDied","Data":"18c6b8e2950cb4d0a34e113456df3621268b09adbc9a07aa27e5336802d05bb8"} Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.130658 5030 scope.go:117] "RemoveContainer" containerID="af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.130699 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.132758 5030 generic.go:358] "Generic (PLEG): container finished" podID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" containerID="1ad144ba7bed321d38686c92c36d1f1920647a2f1ac8edc230993956fa85ca5d" exitCode=0 Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.132833 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" event={"ID":"3545fcdf-42a9-45cd-bbba-4be9245b85b6","Type":"ContainerDied","Data":"1ad144ba7bed321d38686c92c36d1f1920647a2f1ac8edc230993956fa85ca5d"} Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.153117 5030 scope.go:117] "RemoveContainer" containerID="af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912" Mar 16 13:08:35 crc kubenswrapper[5030]: E0316 13:08:35.156106 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912\": container with ID starting with af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912 not found: ID does not exist" containerID="af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.156158 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912"} err="failed to get container status \"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912\": rpc error: code = NotFound desc = could not find container \"af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912\": container with ID starting with af7174f4dc6676d6a266bac5f2131204d24dae88b5919ef5f8b5fc0b9b5e4912 not found: ID does not exist" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.160310 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.163488 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-55688b86b9-fwvgv"] Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.168404 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.176777 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.190321 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.190962 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" containerName="controller-manager" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.190982 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" containerName="controller-manager" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.191075 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" containerName="controller-manager" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.195243 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.201801 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.284577 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.284661 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.284731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7ws8\" (UniqueName: \"kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.284794 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285169 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp" (OuterVolumeSpecName: "tmp") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285382 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config\") pod \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\" (UID: \"3545fcdf-42a9-45cd-bbba-4be9245b85b6\") " Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca" (OuterVolumeSpecName: "client-ca") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.285939 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3545fcdf-42a9-45cd-bbba-4be9245b85b6-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.286240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config" (OuterVolumeSpecName: "config") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.289354 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8" (OuterVolumeSpecName: "kube-api-access-c7ws8") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "kube-api-access-c7ws8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.291504 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "3545fcdf-42a9-45cd-bbba-4be9245b85b6" (UID: "3545fcdf-42a9-45cd-bbba-4be9245b85b6"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.343928 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:35 crc kubenswrapper[5030]: W0316 13:08:35.346521 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fa63e6_cfdd_40ec_a983_028c7074ee11.slice/crio-41c8415412bc154a9f7c04fdd898833f9123b9198a7146da5aa3c13b5dfa6f85 WatchSource:0}: Error finding container 41c8415412bc154a9f7c04fdd898833f9123b9198a7146da5aa3c13b5dfa6f85: Status 404 returned error can't find the container with id 41c8415412bc154a9f7c04fdd898833f9123b9198a7146da5aa3c13b5dfa6f85 Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfvk7\" (UniqueName: \"kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.387862 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.388036 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.388057 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.388066 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7ws8\" (UniqueName: \"kubernetes.io/projected/3545fcdf-42a9-45cd-bbba-4be9245b85b6-kube-api-access-c7ws8\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.388077 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3545fcdf-42a9-45cd-bbba-4be9245b85b6-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.388086 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3545fcdf-42a9-45cd-bbba-4be9245b85b6-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.490446 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.490896 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.490931 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.490980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.491022 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.491131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfvk7\" (UniqueName: \"kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.492081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.492116 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.492167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.492271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.495585 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.506392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfvk7\" (UniqueName: \"kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7\") pod \"controller-manager-cddf8dc47-k2vv2\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.519142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.724667 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:35 crc kubenswrapper[5030]: W0316 13:08:35.728907 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ad5c74_ab83_4f51_84d5_1c002f032737.slice/crio-4b4031ccd3c937d8e7694dfd9c3c9f351b970e0875520b15bf58569f95731f2e WatchSource:0}: Error finding container 4b4031ccd3c937d8e7694dfd9c3c9f351b970e0875520b15bf58569f95731f2e: Status 404 returned error can't find the container with id 4b4031ccd3c937d8e7694dfd9c3c9f351b970e0875520b15bf58569f95731f2e Mar 16 13:08:35 crc kubenswrapper[5030]: I0316 13:08:35.951278 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6b3681-9caa-42c4-abef-bc4d44b454c0" path="/var/lib/kubelet/pods/0b6b3681-9caa-42c4-abef-bc4d44b454c0/volumes" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.136989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" event={"ID":"d7fa63e6-cfdd-40ec-a983-028c7074ee11","Type":"ContainerStarted","Data":"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb"} Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.137046 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.137056 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" event={"ID":"d7fa63e6-cfdd-40ec-a983-028c7074ee11","Type":"ContainerStarted","Data":"41c8415412bc154a9f7c04fdd898833f9123b9198a7146da5aa3c13b5dfa6f85"} Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.138007 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" event={"ID":"66ad5c74-ab83-4f51-84d5-1c002f032737","Type":"ContainerStarted","Data":"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2"} Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.138047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" event={"ID":"66ad5c74-ab83-4f51-84d5-1c002f032737","Type":"ContainerStarted","Data":"4b4031ccd3c937d8e7694dfd9c3c9f351b970e0875520b15bf58569f95731f2e"} Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.138212 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.144830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" event={"ID":"3545fcdf-42a9-45cd-bbba-4be9245b85b6","Type":"ContainerDied","Data":"8a38e33810a57e82b6491ade385119c2bb6346c090adf7b467108e18be0c20cb"} Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.144896 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.144919 5030 scope.go:117] "RemoveContainer" containerID="1ad144ba7bed321d38686c92c36d1f1920647a2f1ac8edc230993956fa85ca5d" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.144984 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-7974bfd95d-6tfvg" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.150923 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" podStartSLOduration=2.150910152 podStartE2EDuration="2.150910152s" podCreationTimestamp="2026-03-16 13:08:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:36.149581754 +0000 UTC m=+160.548894302" watchObservedRunningTime="2026-03-16 13:08:36.150910152 +0000 UTC m=+160.550222699" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.191795 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" podStartSLOduration=2.191778277 podStartE2EDuration="2.191778277s" podCreationTimestamp="2026-03-16 13:08:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:36.179543324 +0000 UTC m=+160.578855871" watchObservedRunningTime="2026-03-16 13:08:36.191778277 +0000 UTC m=+160.591090814" Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.194673 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.196189 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-7974bfd95d-6tfvg"] Mar 16 13:08:36 crc kubenswrapper[5030]: I0316 13:08:36.236330 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.571051 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.578676 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.580808 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.581892 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.585918 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.619804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.619883 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.721349 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.721410 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.721497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.740226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access\") pod \"revision-pruner-12-crc\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.894159 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:37 crc kubenswrapper[5030]: I0316 13:08:37.951900 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3545fcdf-42a9-45cd-bbba-4be9245b85b6" path="/var/lib/kubelet/pods/3545fcdf-42a9-45cd-bbba-4be9245b85b6/volumes" Mar 16 13:08:38 crc kubenswrapper[5030]: I0316 13:08:38.256750 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-12-crc"] Mar 16 13:08:38 crc kubenswrapper[5030]: W0316 13:08:38.261256 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d2796b5_1f1c_4b1e_9331_f59370ecf758.slice/crio-adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d WatchSource:0}: Error finding container adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d: Status 404 returned error can't find the container with id adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d Mar 16 13:08:39 crc kubenswrapper[5030]: I0316 13:08:39.166105 5030 generic.go:358] "Generic (PLEG): container finished" podID="3d2796b5-1f1c-4b1e-9331-f59370ecf758" containerID="02055c036f4c401c5fd6a6dceb98d79c964fad6078181acaa8d1289dc6a13644" exitCode=0 Mar 16 13:08:39 crc kubenswrapper[5030]: I0316 13:08:39.166240 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"3d2796b5-1f1c-4b1e-9331-f59370ecf758","Type":"ContainerDied","Data":"02055c036f4c401c5fd6a6dceb98d79c964fad6078181acaa8d1289dc6a13644"} Mar 16 13:08:39 crc kubenswrapper[5030]: I0316 13:08:39.166579 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"3d2796b5-1f1c-4b1e-9331-f59370ecf758","Type":"ContainerStarted","Data":"adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d"} Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.361294 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.456087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir\") pod \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.456140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access\") pod \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\" (UID: \"3d2796b5-1f1c-4b1e-9331-f59370ecf758\") " Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.456206 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "3d2796b5-1f1c-4b1e-9331-f59370ecf758" (UID: "3d2796b5-1f1c-4b1e-9331-f59370ecf758"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.456493 5030 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.463531 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "3d2796b5-1f1c-4b1e-9331-f59370ecf758" (UID: "3d2796b5-1f1c-4b1e-9331-f59370ecf758"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:40 crc kubenswrapper[5030]: I0316 13:08:40.558141 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/3d2796b5-1f1c-4b1e-9331-f59370ecf758-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:41 crc kubenswrapper[5030]: I0316 13:08:41.178014 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-12-crc" event={"ID":"3d2796b5-1f1c-4b1e-9331-f59370ecf758","Type":"ContainerDied","Data":"adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d"} Mar 16 13:08:41 crc kubenswrapper[5030]: I0316 13:08:41.178151 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adca4939f3953abad1569c8f9c432e33613edf1e951c8df7a99ed6ca0d70bd2d" Mar 16 13:08:41 crc kubenswrapper[5030]: I0316 13:08:41.178178 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.169583 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.170378 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2796b5-1f1c-4b1e-9331-f59370ecf758" containerName="pruner" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.170397 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2796b5-1f1c-4b1e-9331-f59370ecf758" containerName="pruner" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.170478 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d2796b5-1f1c-4b1e-9331-f59370ecf758" containerName="pruner" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.174228 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.176656 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.176880 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver\"/\"installer-sa-dockercfg-bqqnb\"" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.181174 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.282081 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.282143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.282316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.383977 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.384084 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.384110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.384181 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.384191 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.400684 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access\") pod \"installer-12-crc\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.486251 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:08:42 crc kubenswrapper[5030]: I0316 13:08:42.853936 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-12-crc"] Mar 16 13:08:43 crc kubenswrapper[5030]: I0316 13:08:43.188824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"1061bd55-2388-4bb3-bc23-35431748b0da","Type":"ContainerStarted","Data":"6c349686c2de3c4979b870ab4d9d31d305aa8a6acbb07e8ff2be106ef513cc22"} Mar 16 13:08:43 crc kubenswrapper[5030]: I0316 13:08:43.189115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"1061bd55-2388-4bb3-bc23-35431748b0da","Type":"ContainerStarted","Data":"e8f95e7955a12fb25dea55ae58317ef48590ef36368560e5c7cfff7730bfd83e"} Mar 16 13:08:43 crc kubenswrapper[5030]: I0316 13:08:43.205711 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-12-crc" podStartSLOduration=1.2056953 podStartE2EDuration="1.2056953s" podCreationTimestamp="2026-03-16 13:08:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:43.202446582 +0000 UTC m=+167.601759129" watchObservedRunningTime="2026-03-16 13:08:43.2056953 +0000 UTC m=+167.605007847" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.211128 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" podUID="54b0f14b-7261-4621-abc8-e8e62848ea0d" containerName="oauth-openshift" containerID="cri-o://a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1" gracePeriod=15 Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.686268 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.722249 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-6567f5ffdb-nd92f"] Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.722900 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b0f14b-7261-4621-abc8-e8e62848ea0d" containerName="oauth-openshift" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.722919 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b0f14b-7261-4621-abc8-e8e62848ea0d" containerName="oauth-openshift" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.723041 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b0f14b-7261-4621-abc8-e8e62848ea0d" containerName="oauth-openshift" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.726225 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.734224 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-6567f5ffdb-nd92f"] Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.815785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.815986 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816055 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816086 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816122 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816186 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816266 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816345 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816382 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816412 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpf78\" (UniqueName: \"kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816535 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816605 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir\") pod \"54b0f14b-7261-4621-abc8-e8e62848ea0d\" (UID: \"54b0f14b-7261-4621-abc8-e8e62848ea0d\") " Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816879 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.816943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bl8\" (UniqueName: \"kubernetes.io/projected/a3044fa6-5805-431b-9dfc-a3e068092ade-kube-api-access-x9bl8\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.817718 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-dir\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818367 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-router-certs\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818484 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818610 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-error\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-policies\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818764 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle" (OuterVolumeSpecName: "v4-0-config-system-trusted-ca-bundle") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818766 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca" (OuterVolumeSpecName: "v4-0-config-system-service-ca") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.818798 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819265 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-service-ca\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819432 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig" (OuterVolumeSpecName: "v4-0-config-system-cliconfig") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-cliconfig". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-session\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819727 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-login\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819813 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819938 5030 reconciler_common.go:299] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-policies\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819957 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819971 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.819989 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-cliconfig\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.820002 5030 reconciler_common.go:299] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/54b0f14b-7261-4621-abc8-e8e62848ea0d-audit-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.824806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login" (OuterVolumeSpecName: "v4-0-config-user-template-login") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-user-template-login". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.825717 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session" (OuterVolumeSpecName: "v4-0-config-system-session") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-session". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.826217 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template" (OuterVolumeSpecName: "v4-0-config-system-ocp-branding-template") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-ocp-branding-template". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.826479 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data" (OuterVolumeSpecName: "v4-0-config-user-idp-0-file-data") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-user-idp-0-file-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.826685 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78" (OuterVolumeSpecName: "kube-api-access-tpf78") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "kube-api-access-tpf78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.826749 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert" (OuterVolumeSpecName: "v4-0-config-system-serving-cert") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.826882 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error" (OuterVolumeSpecName: "v4-0-config-user-template-error") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-user-template-error". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.827237 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs" (OuterVolumeSpecName: "v4-0-config-system-router-certs") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-system-router-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.828024 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection" (OuterVolumeSpecName: "v4-0-config-user-template-provider-selection") pod "54b0f14b-7261-4621-abc8-e8e62848ea0d" (UID: "54b0f14b-7261-4621-abc8-e8e62848ea0d"). InnerVolumeSpecName "v4-0-config-user-template-provider-selection". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.920968 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921016 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921045 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bl8\" (UniqueName: \"kubernetes.io/projected/a3044fa6-5805-431b-9dfc-a3e068092ade-kube-api-access-x9bl8\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921067 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-dir\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-router-certs\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921114 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-error\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921439 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-policies\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921456 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921502 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-service-ca\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-session\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-login\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921694 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-login\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921706 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-idp-0-file-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921718 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-provider-selection\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921728 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921736 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-ocp-branding-template\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921746 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-user-template-error\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921756 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-router-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921765 5030 reconciler_common.go:299] "Volume detached for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/54b0f14b-7261-4621-abc8-e8e62848ea0d-v4-0-config-system-session\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921774 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpf78\" (UniqueName: \"kubernetes.io/projected/54b0f14b-7261-4621-abc8-e8e62848ea0d-kube-api-access-tpf78\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.921977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-dir\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.922473 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.922543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-cliconfig\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.923440 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-service-ca\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.923814 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a3044fa6-5805-431b-9dfc-a3e068092ade-audit-policies\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.924847 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-login\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.925333 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.925331 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-serving-cert\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.925886 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-session\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.925927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-idp-0-file-data\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-idp-0-file-data\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.926146 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-system-router-certs\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.927308 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.927326 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/a3044fa6-5805-431b-9dfc-a3e068092ade-v4-0-config-user-template-error\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:52 crc kubenswrapper[5030]: I0316 13:08:52.934927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bl8\" (UniqueName: \"kubernetes.io/projected/a3044fa6-5805-431b-9dfc-a3e068092ade-kube-api-access-x9bl8\") pod \"oauth-openshift-6567f5ffdb-nd92f\" (UID: \"a3044fa6-5805-431b-9dfc-a3e068092ade\") " pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.038751 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.273735 5030 generic.go:358] "Generic (PLEG): container finished" podID="54b0f14b-7261-4621-abc8-e8e62848ea0d" containerID="a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1" exitCode=0 Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.274156 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" event={"ID":"54b0f14b-7261-4621-abc8-e8e62848ea0d","Type":"ContainerDied","Data":"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1"} Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.274201 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" event={"ID":"54b0f14b-7261-4621-abc8-e8e62848ea0d","Type":"ContainerDied","Data":"58d4db4e86f4b9b12ac35359d6ea6f7e59f84a25a912db33ccefbc7e022cb080"} Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.274227 5030 scope.go:117] "RemoveContainer" containerID="a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.274300 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-66458b6674-xnmxt" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.297098 5030 scope.go:117] "RemoveContainer" containerID="a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1" Mar 16 13:08:53 crc kubenswrapper[5030]: E0316 13:08:53.297501 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1\": container with ID starting with a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1 not found: ID does not exist" containerID="a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.297583 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1"} err="failed to get container status \"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1\": rpc error: code = NotFound desc = could not find container \"a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1\": container with ID starting with a8ba0679fc291e01622640485f536c84816919511aa976b4addb3e84a10eebc1 not found: ID does not exist" Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.304964 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.306832 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-authentication/oauth-openshift-66458b6674-xnmxt"] Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.431004 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-6567f5ffdb-nd92f"] Mar 16 13:08:53 crc kubenswrapper[5030]: W0316 13:08:53.437759 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3044fa6_5805_431b_9dfc_a3e068092ade.slice/crio-c6d203c4535e52799b61edd549fe981ab603f1f1085b8866170f2f36a0048bc8 WatchSource:0}: Error finding container c6d203c4535e52799b61edd549fe981ab603f1f1085b8866170f2f36a0048bc8: Status 404 returned error can't find the container with id c6d203c4535e52799b61edd549fe981ab603f1f1085b8866170f2f36a0048bc8 Mar 16 13:08:53 crc kubenswrapper[5030]: I0316 13:08:53.952482 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b0f14b-7261-4621-abc8-e8e62848ea0d" path="/var/lib/kubelet/pods/54b0f14b-7261-4621-abc8-e8e62848ea0d/volumes" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.281392 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" event={"ID":"a3044fa6-5805-431b-9dfc-a3e068092ade","Type":"ContainerStarted","Data":"ecc3379810cd08cda9b6c77b1ba09e44f160c533f954f36e8705212d9b219276"} Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.281441 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" event={"ID":"a3044fa6-5805-431b-9dfc-a3e068092ade","Type":"ContainerStarted","Data":"c6d203c4535e52799b61edd549fe981ab603f1f1085b8866170f2f36a0048bc8"} Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.281698 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.287766 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.296705 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-6567f5ffdb-nd92f" podStartSLOduration=27.296691049 podStartE2EDuration="27.296691049s" podCreationTimestamp="2026-03-16 13:08:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:54.294661253 +0000 UTC m=+178.693973800" watchObservedRunningTime="2026-03-16 13:08:54.296691049 +0000 UTC m=+178.696003597" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.352683 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.352949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" podUID="66ad5c74-ab83-4f51-84d5-1c002f032737" containerName="controller-manager" containerID="cri-o://9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2" gracePeriod=30 Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.371598 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.371821 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" podUID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" containerName="route-controller-manager" containerID="cri-o://6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb" gracePeriod=30 Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.826650 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.853760 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8"] Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.854210 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" containerName="route-controller-manager" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.854229 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" containerName="route-controller-manager" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.854325 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" containerName="route-controller-manager" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.857260 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.863767 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8"] Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950467 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b9qg\" (UniqueName: \"kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg\") pod \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950524 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert\") pod \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950565 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp\") pod \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950628 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config\") pod \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950740 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca\") pod \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\" (UID: \"d7fa63e6-cfdd-40ec-a983-028c7074ee11\") " Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950897 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84af087f-2c90-4932-ad68-8105c53ea334-serving-cert\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.950962 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgsn7\" (UniqueName: \"kubernetes.io/projected/84af087f-2c90-4932-ad68-8105c53ea334-kube-api-access-sgsn7\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951126 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp" (OuterVolumeSpecName: "tmp") pod "d7fa63e6-cfdd-40ec-a983-028c7074ee11" (UID: "d7fa63e6-cfdd-40ec-a983-028c7074ee11"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951368 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-config\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-client-ca\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951572 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca" (OuterVolumeSpecName: "client-ca") pod "d7fa63e6-cfdd-40ec-a983-028c7074ee11" (UID: "d7fa63e6-cfdd-40ec-a983-028c7074ee11"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951596 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config" (OuterVolumeSpecName: "config") pod "d7fa63e6-cfdd-40ec-a983-028c7074ee11" (UID: "d7fa63e6-cfdd-40ec-a983-028c7074ee11"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951663 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84af087f-2c90-4932-ad68-8105c53ea334-tmp\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951782 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951801 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7fa63e6-cfdd-40ec-a983-028c7074ee11-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.951809 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7fa63e6-cfdd-40ec-a983-028c7074ee11-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.957176 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "d7fa63e6-cfdd-40ec-a983-028c7074ee11" (UID: "d7fa63e6-cfdd-40ec-a983-028c7074ee11"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:54 crc kubenswrapper[5030]: I0316 13:08:54.957568 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg" (OuterVolumeSpecName: "kube-api-access-7b9qg") pod "d7fa63e6-cfdd-40ec-a983-028c7074ee11" (UID: "d7fa63e6-cfdd-40ec-a983-028c7074ee11"). InnerVolumeSpecName "kube-api-access-7b9qg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.053323 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-config\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.053406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-client-ca\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054194 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84af087f-2c90-4932-ad68-8105c53ea334-tmp\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054250 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84af087f-2c90-4932-ad68-8105c53ea334-serving-cert\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsn7\" (UniqueName: \"kubernetes.io/projected/84af087f-2c90-4932-ad68-8105c53ea334-kube-api-access-sgsn7\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054323 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-client-ca\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054406 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b9qg\" (UniqueName: \"kubernetes.io/projected/d7fa63e6-cfdd-40ec-a983-028c7074ee11-kube-api-access-7b9qg\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054419 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7fa63e6-cfdd-40ec-a983-028c7074ee11-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054500 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/84af087f-2c90-4932-ad68-8105c53ea334-config\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.054604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84af087f-2c90-4932-ad68-8105c53ea334-tmp\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.058185 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84af087f-2c90-4932-ad68-8105c53ea334-serving-cert\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.070067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsn7\" (UniqueName: \"kubernetes.io/projected/84af087f-2c90-4932-ad68-8105c53ea334-kube-api-access-sgsn7\") pod \"route-controller-manager-5d649d5479-fgbz8\" (UID: \"84af087f-2c90-4932-ad68-8105c53ea334\") " pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.076527 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.096149 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-845c69c967-6vwkk"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.096639 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ad5c74-ab83-4f51-84d5-1c002f032737" containerName="controller-manager" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.096658 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ad5c74-ab83-4f51-84d5-1c002f032737" containerName="controller-manager" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.096746 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="66ad5c74-ab83-4f51-84d5-1c002f032737" containerName="controller-manager" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.099960 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.105265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-845c69c967-6vwkk"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.168664 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256655 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfvk7\" (UniqueName: \"kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.256943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca\") pod \"66ad5c74-ab83-4f51-84d5-1c002f032737\" (UID: \"66ad5c74-ab83-4f51-84d5-1c002f032737\") " Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257047 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-serving-cert\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257084 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-tmp\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-proxy-ca-bundles\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257185 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-config\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257193 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp" (OuterVolumeSpecName: "tmp") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257343 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-client-ca\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9nk\" (UniqueName: \"kubernetes.io/projected/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-kube-api-access-nt9nk\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257409 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles" (OuterVolumeSpecName: "proxy-ca-bundles") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "proxy-ca-bundles". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257417 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66ad5c74-ab83-4f51-84d5-1c002f032737-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257575 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca" (OuterVolumeSpecName: "client-ca") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.257761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config" (OuterVolumeSpecName: "config") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.260543 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.260569 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7" (OuterVolumeSpecName: "kube-api-access-vfvk7") pod "66ad5c74-ab83-4f51-84d5-1c002f032737" (UID: "66ad5c74-ab83-4f51-84d5-1c002f032737"). InnerVolumeSpecName "kube-api-access-vfvk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.291953 5030 generic.go:358] "Generic (PLEG): container finished" podID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" containerID="6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb" exitCode=0 Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.292054 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.292141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" event={"ID":"d7fa63e6-cfdd-40ec-a983-028c7074ee11","Type":"ContainerDied","Data":"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb"} Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.292169 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8" event={"ID":"d7fa63e6-cfdd-40ec-a983-028c7074ee11","Type":"ContainerDied","Data":"41c8415412bc154a9f7c04fdd898833f9123b9198a7146da5aa3c13b5dfa6f85"} Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.292188 5030 scope.go:117] "RemoveContainer" containerID="6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.294592 5030 generic.go:358] "Generic (PLEG): container finished" podID="66ad5c74-ab83-4f51-84d5-1c002f032737" containerID="9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2" exitCode=0 Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.294680 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.294707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" event={"ID":"66ad5c74-ab83-4f51-84d5-1c002f032737","Type":"ContainerDied","Data":"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2"} Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.294760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-cddf8dc47-k2vv2" event={"ID":"66ad5c74-ab83-4f51-84d5-1c002f032737","Type":"ContainerDied","Data":"4b4031ccd3c937d8e7694dfd9c3c9f351b970e0875520b15bf58569f95731f2e"} Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.307785 5030 scope.go:117] "RemoveContainer" containerID="6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb" Mar 16 13:08:55 crc kubenswrapper[5030]: E0316 13:08:55.313789 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb\": container with ID starting with 6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb not found: ID does not exist" containerID="6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.313830 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb"} err="failed to get container status \"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb\": rpc error: code = NotFound desc = could not find container \"6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb\": container with ID starting with 6fceaf9902b6cdb6158e127fd1600111155013495f72cf0209092d74494f4aeb not found: ID does not exist" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.313868 5030 scope.go:117] "RemoveContainer" containerID="9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.322348 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.325535 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-bdcb59844-75sd8"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.327638 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.329783 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-controller-manager/controller-manager-cddf8dc47-k2vv2"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.334216 5030 scope.go:117] "RemoveContainer" containerID="9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2" Mar 16 13:08:55 crc kubenswrapper[5030]: E0316 13:08:55.334723 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2\": container with ID starting with 9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2 not found: ID does not exist" containerID="9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.334756 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2"} err="failed to get container status \"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2\": rpc error: code = NotFound desc = could not find container \"9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2\": container with ID starting with 9793df70fc2149f8471438b32b2d3d3912917a93f437221e1682948cc5f20ff2 not found: ID does not exist" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-serving-cert\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-tmp\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358631 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-proxy-ca-bundles\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-config\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358713 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-client-ca\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358740 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9nk\" (UniqueName: \"kubernetes.io/projected/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-kube-api-access-nt9nk\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358785 5030 reconciler_common.go:299] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66ad5c74-ab83-4f51-84d5-1c002f032737-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358797 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfvk7\" (UniqueName: \"kubernetes.io/projected/66ad5c74-ab83-4f51-84d5-1c002f032737-kube-api-access-vfvk7\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358806 5030 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-client-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358815 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.358823 5030 reconciler_common.go:299] "Volume detached for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/66ad5c74-ab83-4f51-84d5-1c002f032737-proxy-ca-bundles\") on node \"crc\" DevicePath \"\"" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.359398 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-tmp\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.360696 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-client-ca\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.361014 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-config\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.361703 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-proxy-ca-bundles\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.362087 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-serving-cert\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.372279 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9nk\" (UniqueName: \"kubernetes.io/projected/c42e33cf-5ef3-4941-85bb-c78a4d0b443b-kube-api-access-nt9nk\") pod \"controller-manager-845c69c967-6vwkk\" (UID: \"c42e33cf-5ef3-4941-85bb-c78a4d0b443b\") " pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.417494 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.524733 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8"] Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.776804 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-845c69c967-6vwkk"] Mar 16 13:08:55 crc kubenswrapper[5030]: W0316 13:08:55.779734 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42e33cf_5ef3_4941_85bb_c78a4d0b443b.slice/crio-56e0a46dac42754bbe6b6107bccd8169cf964c9f1506bead9b449b9e87b5a1d8 WatchSource:0}: Error finding container 56e0a46dac42754bbe6b6107bccd8169cf964c9f1506bead9b449b9e87b5a1d8: Status 404 returned error can't find the container with id 56e0a46dac42754bbe6b6107bccd8169cf964c9f1506bead9b449b9e87b5a1d8 Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.953598 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66ad5c74-ab83-4f51-84d5-1c002f032737" path="/var/lib/kubelet/pods/66ad5c74-ab83-4f51-84d5-1c002f032737/volumes" Mar 16 13:08:55 crc kubenswrapper[5030]: I0316 13:08:55.954758 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7fa63e6-cfdd-40ec-a983-028c7074ee11" path="/var/lib/kubelet/pods/d7fa63e6-cfdd-40ec-a983-028c7074ee11/volumes" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.300259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" event={"ID":"84af087f-2c90-4932-ad68-8105c53ea334","Type":"ContainerStarted","Data":"fc607d9d65343b168823de450be6a3b6a11998752660f320755eb15330803964"} Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.300303 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" event={"ID":"84af087f-2c90-4932-ad68-8105c53ea334","Type":"ContainerStarted","Data":"5ddbe547ec146fce0cfd7438da78388ebcb83d8088ff40b60bf4a419eb5cb27b"} Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.302465 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.303932 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" event={"ID":"c42e33cf-5ef3-4941-85bb-c78a4d0b443b","Type":"ContainerStarted","Data":"1199f432dd2605c15aa35f96c35cf2bd0510f187f3bb5eaed7247e6924f1086f"} Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.303978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" event={"ID":"c42e33cf-5ef3-4941-85bb-c78a4d0b443b","Type":"ContainerStarted","Data":"56e0a46dac42754bbe6b6107bccd8169cf964c9f1506bead9b449b9e87b5a1d8"} Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.304112 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.306035 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.317290 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-5d649d5479-fgbz8" podStartSLOduration=2.317280299 podStartE2EDuration="2.317280299s" podCreationTimestamp="2026-03-16 13:08:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:56.314916985 +0000 UTC m=+180.714229533" watchObservedRunningTime="2026-03-16 13:08:56.317280299 +0000 UTC m=+180.716592846" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.339377 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" podStartSLOduration=2.339365601 podStartE2EDuration="2.339365601s" podCreationTimestamp="2026-03-16 13:08:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:08:56.33836495 +0000 UTC m=+180.737677497" watchObservedRunningTime="2026-03-16 13:08:56.339365601 +0000 UTC m=+180.738678148" Mar 16 13:08:56 crc kubenswrapper[5030]: I0316 13:08:56.467542 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-845c69c967-6vwkk" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.844108 5030 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.849778 5030 kubelet.go:2547] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.849812 5030 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850039 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850105 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850126 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850137 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850143 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850149 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850155 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850162 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850167 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850177 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850182 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850205 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850214 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850220 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850227 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="setup" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850232 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="setup" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850441 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" containerID="cri-o://c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431" gracePeriod=15 Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850581 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850611 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850623 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850614 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793" gracePeriod=15 Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850620 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" containerID="cri-o://d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc" gracePeriod=15 Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850683 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" containerID="cri-o://f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91" gracePeriod=15 Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850635 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-syncer" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850749 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850775 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850792 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851007 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851028 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851144 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851161 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.850588 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624" gracePeriod=15 Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851265 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.851280 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a14caf222afb62aaabdc47808b6f944" containerName="kube-apiserver-check-endpoints" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.853384 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-crc" oldPodUID="3a14caf222afb62aaabdc47808b6f944" podUID="57755cc5f99000cc11e193051474d4e2" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.877789 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945357 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945452 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945492 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945508 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945536 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945576 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945713 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:20 crc kubenswrapper[5030]: I0316 13:09:20.945740 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.048770 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.048943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049449 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049624 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-cert-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049665 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049714 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049809 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049864 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049889 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.049996 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-resource-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050114 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050154 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"kube-apiserver-startup-monitor-crc\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050201 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050253 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050432 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050527 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/57755cc5f99000cc11e193051474d4e2-audit-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050855 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-ca-bundle-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.050931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57755cc5f99000cc11e193051474d4e2-tmp-dir\") pod \"kube-apiserver-crc\" (UID: \"57755cc5f99000cc11e193051474d4e2\") " pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.435728 5030 generic.go:358] "Generic (PLEG): container finished" podID="1061bd55-2388-4bb3-bc23-35431748b0da" containerID="6c349686c2de3c4979b870ab4d9d31d305aa8a6acbb07e8ff2be106ef513cc22" exitCode=0 Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.435818 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"1061bd55-2388-4bb3-bc23-35431748b0da","Type":"ContainerDied","Data":"6c349686c2de3c4979b870ab4d9d31d305aa8a6acbb07e8ff2be106ef513cc22"} Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.436887 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.438103 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-check-endpoints/3.log" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.439277 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.439940 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc" exitCode=0 Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.439994 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793" exitCode=0 Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.440005 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624" exitCode=0 Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.440015 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91" exitCode=2 Mar 16 13:09:21 crc kubenswrapper[5030]: I0316 13:09:21.440068 5030 scope.go:117] "RemoveContainer" containerID="7ac70798871fd2643b108f75b808fc37bc92f8eaf8e4eb5d29fde03bcaa33438" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.449111 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.749090 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.749875 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.875850 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access\") pod \"1061bd55-2388-4bb3-bc23-35431748b0da\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.875903 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock\") pod \"1061bd55-2388-4bb3-bc23-35431748b0da\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.876006 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir\") pod \"1061bd55-2388-4bb3-bc23-35431748b0da\" (UID: \"1061bd55-2388-4bb3-bc23-35431748b0da\") " Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.876066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock" (OuterVolumeSpecName: "var-lock") pod "1061bd55-2388-4bb3-bc23-35431748b0da" (UID: "1061bd55-2388-4bb3-bc23-35431748b0da"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.876177 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "1061bd55-2388-4bb3-bc23-35431748b0da" (UID: "1061bd55-2388-4bb3-bc23-35431748b0da"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.876240 5030 reconciler_common.go:299] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-var-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.881206 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "1061bd55-2388-4bb3-bc23-35431748b0da" (UID: "1061bd55-2388-4bb3-bc23-35431748b0da"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.978104 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1061bd55-2388-4bb3-bc23-35431748b0da-kube-api-access\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:22 crc kubenswrapper[5030]: I0316 13:09:22.978139 5030 reconciler_common.go:299] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1061bd55-2388-4bb3-bc23-35431748b0da-kubelet-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.140563 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.141468 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.142079 5030 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.142443 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.155822 5030 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.156172 5030 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.156481 5030 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.156746 5030 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.157017 5030 controller.go:195] "Failed to update lease" err="Put \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.157051 5030 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.157288 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="200ms" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280921 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280939 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") pod \"3a14caf222afb62aaabdc47808b6f944\" (UID: \"3a14caf222afb62aaabdc47808b6f944\") " Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.280999 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281028 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281042 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281438 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir" (OuterVolumeSpecName: "ca-bundle-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "ca-bundle-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281610 5030 reconciler_common.go:299] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281636 5030 reconciler_common.go:299] "Volume detached for volume \"ca-bundle-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-ca-bundle-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281649 5030 reconciler_common.go:299] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-audit-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.281660 5030 reconciler_common.go:299] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/3a14caf222afb62aaabdc47808b6f944-cert-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.282353 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a14caf222afb62aaabdc47808b6f944" (UID: "3a14caf222afb62aaabdc47808b6f944"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.357979 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="400ms" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.383325 5030 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a14caf222afb62aaabdc47808b6f944-tmp-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.457796 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-crc_3a14caf222afb62aaabdc47808b6f944/kube-apiserver-cert-syncer/0.log" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.458498 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a14caf222afb62aaabdc47808b6f944" containerID="c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431" exitCode=0 Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.458624 5030 scope.go:117] "RemoveContainer" containerID="d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.458636 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.460768 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-12-crc" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.460771 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-12-crc" event={"ID":"1061bd55-2388-4bb3-bc23-35431748b0da","Type":"ContainerDied","Data":"e8f95e7955a12fb25dea55ae58317ef48590ef36368560e5c7cfff7730bfd83e"} Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.460821 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f95e7955a12fb25dea55ae58317ef48590ef36368560e5c7cfff7730bfd83e" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.473472 5030 scope.go:117] "RemoveContainer" containerID="0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.475967 5030 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.476347 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.476706 5030 status_manager.go:895] "Failed to get status for pod" podUID="3a14caf222afb62aaabdc47808b6f944" pod="openshift-kube-apiserver/kube-apiserver-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.476945 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.484762 5030 scope.go:117] "RemoveContainer" containerID="a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.495076 5030 scope.go:117] "RemoveContainer" containerID="f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.506935 5030 scope.go:117] "RemoveContainer" containerID="c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.518736 5030 scope.go:117] "RemoveContainer" containerID="bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.559883 5030 scope.go:117] "RemoveContainer" containerID="d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.560277 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\": container with ID starting with d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc not found: ID does not exist" containerID="d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.560328 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc"} err="failed to get container status \"d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\": rpc error: code = NotFound desc = could not find container \"d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc\": container with ID starting with d87f4fffc06a407a9a830a265474ac62776583f5880c8cc5408a38dfd9d7e4dc not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.560357 5030 scope.go:117] "RemoveContainer" containerID="0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.560933 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\": container with ID starting with 0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793 not found: ID does not exist" containerID="0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.560970 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793"} err="failed to get container status \"0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\": rpc error: code = NotFound desc = could not find container \"0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793\": container with ID starting with 0913b9f98f0ba1b52bb2be69fa8597518b3dbe08c1da2afbaaada2c97e932793 not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.561007 5030 scope.go:117] "RemoveContainer" containerID="a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.561339 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\": container with ID starting with a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624 not found: ID does not exist" containerID="a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.561366 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624"} err="failed to get container status \"a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\": rpc error: code = NotFound desc = could not find container \"a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624\": container with ID starting with a33625827d1e3cff4e09120449ff8e35d8572367ddfb9e1c278cbfedd20fa624 not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.561381 5030 scope.go:117] "RemoveContainer" containerID="f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.561731 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\": container with ID starting with f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91 not found: ID does not exist" containerID="f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.561774 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91"} err="failed to get container status \"f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\": rpc error: code = NotFound desc = could not find container \"f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91\": container with ID starting with f7269ddca4c805314ed938270e9f3ca29536faa164b565a43a7ee0ff78c64a91 not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.561795 5030 scope.go:117] "RemoveContainer" containerID="c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.562108 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\": container with ID starting with c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431 not found: ID does not exist" containerID="c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.562135 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431"} err="failed to get container status \"c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\": rpc error: code = NotFound desc = could not find container \"c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431\": container with ID starting with c1c18e8e6ea3c71145ca6234ecb81818a261b8dacf7b54ee8de51cc4a4251431 not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.562150 5030 scope.go:117] "RemoveContainer" containerID="bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.562408 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\": container with ID starting with bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81 not found: ID does not exist" containerID="bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.562434 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81"} err="failed to get container status \"bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\": rpc error: code = NotFound desc = could not find container \"bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81\": container with ID starting with bd64a706c001aebc8acb91234ae267b0245e3237093dff1fdc192414b129fe81 not found: ID does not exist" Mar 16 13:09:23 crc kubenswrapper[5030]: E0316 13:09:23.758503 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="800ms" Mar 16 13:09:23 crc kubenswrapper[5030]: I0316 13:09:23.952681 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a14caf222afb62aaabdc47808b6f944" path="/var/lib/kubelet/pods/3a14caf222afb62aaabdc47808b6f944/volumes" Mar 16 13:09:24 crc kubenswrapper[5030]: E0316 13:09:24.559657 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="1.6s" Mar 16 13:09:25 crc kubenswrapper[5030]: E0316 13:09:25.882461 5030 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.25.179:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:25 crc kubenswrapper[5030]: I0316 13:09:25.883008 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:25 crc kubenswrapper[5030]: E0316 13:09:25.907712 5030 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.25.179:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-crc.189d54582ad9a349 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-crc,UID:f7dbc7e1ee9c187a863ef9b473fad27b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:09:25.906604873 +0000 UTC m=+210.305917420,LastTimestamp:2026-03-16 13:09:25.906604873 +0000 UTC m=+210.305917420,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:09:25 crc kubenswrapper[5030]: I0316 13:09:25.951119 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:26 crc kubenswrapper[5030]: E0316 13:09:26.018364 5030 desired_state_of_world_populator.go:305] "Error processing volume" err="error processing PVC openshift-image-registry/crc-image-registry-storage: failed to fetch PVC from API server: Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-image-registry/persistentvolumeclaims/crc-image-registry-storage\": dial tcp 192.168.25.179:6443: connect: connection refused" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" volumeName="registry-storage" Mar 16 13:09:26 crc kubenswrapper[5030]: E0316 13:09:26.160598 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="3.2s" Mar 16 13:09:26 crc kubenswrapper[5030]: I0316 13:09:26.485393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" event={"ID":"f7dbc7e1ee9c187a863ef9b473fad27b","Type":"ContainerStarted","Data":"c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35"} Mar 16 13:09:26 crc kubenswrapper[5030]: I0316 13:09:26.485462 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" event={"ID":"f7dbc7e1ee9c187a863ef9b473fad27b","Type":"ContainerStarted","Data":"89ba45494d2f7802ada6bd0a523a013e2084dc8f62ee8a028a989f46a09c6f7f"} Mar 16 13:09:26 crc kubenswrapper[5030]: I0316 13:09:26.485814 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:26 crc kubenswrapper[5030]: E0316 13:09:26.486207 5030 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods\": dial tcp 192.168.25.179:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:09:26 crc kubenswrapper[5030]: I0316 13:09:26.486204 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:29 crc kubenswrapper[5030]: E0316 13:09:29.361890 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="6.4s" Mar 16 13:09:33 crc kubenswrapper[5030]: E0316 13:09:33.609369 5030 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/events\": dial tcp 192.168.25.179:6443: connect: connection refused" event="&Event{ObjectMeta:{kube-apiserver-startup-monitor-crc.189d54582ad9a349 openshift-kube-apiserver 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-kube-apiserver,Name:kube-apiserver-startup-monitor-crc,UID:f7dbc7e1ee9c187a863ef9b473fad27b,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{startup-monitor},},Reason:Pulled,Message:Container image \"quay.io/crcont/openshift-crc-cluster-kube-apiserver-operator@sha256:68c07ee2fb6450c7b3b35bfdfc158dc475aaa0bcf9fba28b5e310d7e03355c04\" already present on machine,Source:EventSource{Component:kubelet,Host:crc,},FirstTimestamp:2026-03-16 13:09:25.906604873 +0000 UTC m=+210.305917420,LastTimestamp:2026-03-16 13:09:25.906604873 +0000 UTC m=+210.305917420,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:crc,}" Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.548590 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.548636 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f0bc7fcb0822a2c13eb2d22cd8c0641" containerID="fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772" exitCode=1 Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.548683 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerDied","Data":"fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772"} Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.549282 5030 scope.go:117] "RemoveContainer" containerID="fb6e9408d2ac19cbbda26b04b9c28f8305b1b004a73ffe449a31adf183e06772" Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.549588 5030 status_manager.go:895] "Failed to get status for pod" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:34 crc kubenswrapper[5030]: I0316 13:09:34.550051 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.557469 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.557847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-crc" event={"ID":"9f0bc7fcb0822a2c13eb2d22cd8c0641","Type":"ContainerStarted","Data":"1fe979057a48bc4af0bad65f0ad28bc745fde26f2213fb3baee8b1fa7de22f0e"} Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.559073 5030 status_manager.go:895] "Failed to get status for pod" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.559509 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: E0316 13:09:35.763407 5030 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://api-int.crc.testing:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/crc?timeout=10s\": dial tcp 192.168.25.179:6443: connect: connection refused" interval="7s" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.949700 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.949802 5030 status_manager.go:895] "Failed to get status for pod" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.950028 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.950287 5030 status_manager.go:895] "Failed to get status for pod" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.950528 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.963364 5030 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.963392 5030 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:35 crc kubenswrapper[5030]: E0316 13:09:35.963716 5030 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:35 crc kubenswrapper[5030]: I0316 13:09:35.963878 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.564868 5030 generic.go:358] "Generic (PLEG): container finished" podID="57755cc5f99000cc11e193051474d4e2" containerID="27d763df98a32e43fe455f9c97fcc2ea4cf6fb4aa60d7f1056b6522d6df06fd4" exitCode=0 Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.564977 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerDied","Data":"27d763df98a32e43fe455f9c97fcc2ea4cf6fb4aa60d7f1056b6522d6df06fd4"} Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.565276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"160b56909b0c791a39bce0ce2d06e64b34aa50338dba8fdd06a054eed3670290"} Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.565600 5030 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.565614 5030 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:36 crc kubenswrapper[5030]: E0316 13:09:36.565870 5030 mirror_client.go:138] "Failed deleting a mirror pod" err="Delete \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/kube-apiserver-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.566045 5030 status_manager.go:895] "Failed to get status for pod" podUID="9f0bc7fcb0822a2c13eb2d22cd8c0641" pod="openshift-kube-controller-manager/kube-controller-manager-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-controller-manager/pods/kube-controller-manager-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:36 crc kubenswrapper[5030]: I0316 13:09:36.566206 5030 status_manager.go:895] "Failed to get status for pod" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" pod="openshift-kube-apiserver/installer-12-crc" err="Get \"https://api-int.crc.testing:6443/api/v1/namespaces/openshift-kube-apiserver/pods/installer-12-crc\": dial tcp 192.168.25.179:6443: connect: connection refused" Mar 16 13:09:37 crc kubenswrapper[5030]: I0316 13:09:37.581968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"b67f5785f27ca8a5104999eaa4759e78e2ec0c443638b91901ad4d77cec265a3"} Mar 16 13:09:37 crc kubenswrapper[5030]: I0316 13:09:37.582188 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"7a04ca4c43d455d9ecb86b0e4956776ad64831238da052ab8a5ff5ec17b0eddd"} Mar 16 13:09:37 crc kubenswrapper[5030]: I0316 13:09:37.582199 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"a8a544507e13654e96a2aa009ea24b4b7f2cdd1bf66e8f8a1e4a1bebe289f23b"} Mar 16 13:09:37 crc kubenswrapper[5030]: I0316 13:09:37.582207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"4c6f7d0d3fa5198110ee0390dc520ce82a879213e60bbf1e91937acab35ef210"} Mar 16 13:09:38 crc kubenswrapper[5030]: I0316 13:09:38.590029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-crc" event={"ID":"57755cc5f99000cc11e193051474d4e2","Type":"ContainerStarted","Data":"017df494ab99f4eb4f22223794db5d6f0118f4ece5802c7247b74a34da7021b0"} Mar 16 13:09:38 crc kubenswrapper[5030]: I0316 13:09:38.590638 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:38 crc kubenswrapper[5030]: I0316 13:09:38.590240 5030 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:38 crc kubenswrapper[5030]: I0316 13:09:38.590797 5030 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:40 crc kubenswrapper[5030]: I0316 13:09:40.964833 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:40 crc kubenswrapper[5030]: I0316 13:09:40.965200 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:40 crc kubenswrapper[5030]: I0316 13:09:40.970477 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:43 crc kubenswrapper[5030]: I0316 13:09:43.413840 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:09:43 crc kubenswrapper[5030]: I0316 13:09:43.417855 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:09:43 crc kubenswrapper[5030]: I0316 13:09:43.603024 5030 kubelet.go:3329] "Deleted mirror pod as it didn't match the static Pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:43 crc kubenswrapper[5030]: I0316 13:09:43.603187 5030 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:43 crc kubenswrapper[5030]: I0316 13:09:43.621166 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:09:44 crc kubenswrapper[5030]: I0316 13:09:44.627382 5030 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:44 crc kubenswrapper[5030]: I0316 13:09:44.627431 5030 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:44 crc kubenswrapper[5030]: I0316 13:09:44.630982 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:44 crc kubenswrapper[5030]: I0316 13:09:44.631383 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-crc" Mar 16 13:09:45 crc kubenswrapper[5030]: I0316 13:09:45.632214 5030 kubelet.go:3323] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:45 crc kubenswrapper[5030]: I0316 13:09:45.632473 5030 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-crc" podUID="35794383-12ee-45b9-b4b5-e9653ba4f6f2" Mar 16 13:09:45 crc kubenswrapper[5030]: I0316 13:09:45.959140 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-crc" oldPodUID="57755cc5f99000cc11e193051474d4e2" podUID="7b6cc454-db3d-4d26-b9b7-cc9cc3d2502a" Mar 16 13:09:52 crc kubenswrapper[5030]: I0316 13:09:52.953123 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-client\"" Mar 16 13:09:53 crc kubenswrapper[5030]: I0316 13:09:53.264417 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.052019 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-session\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.072568 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"kube-root-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.287612 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.287856 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.308835 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"serving-cert\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.350094 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.398990 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ac-dockercfg-gj7jx\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.672664 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.699332 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"kube-root-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.716133 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.875771 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-dockercfg-tnfx9\"" Mar 16 13:09:54 crc kubenswrapper[5030]: I0316 13:09:54.887493 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.003839 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.032765 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.092474 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8dkm8\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.485893 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"marketplace-trusted-ca\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.517208 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"dns-operator-dockercfg-wbbsn\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.541763 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"metrics-tls\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.658237 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-config\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.821999 5030 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.825910 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.825964 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-crc"] Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.829480 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"trusted-ca\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.829833 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-crc" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.837626 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-provider-selection\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.839168 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-crc" podStartSLOduration=12.8391566 podStartE2EDuration="12.8391566s" podCreationTimestamp="2026-03-16 13:09:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:09:55.839153855 +0000 UTC m=+240.238466402" watchObservedRunningTime="2026-03-16 13:09:55.8391566 +0000 UTC m=+240.238469147" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.863655 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-dockercfg-4vdnc\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.869748 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"openshift-service-ca.crt\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.882983 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-serving-ca\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.898653 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"kube-root-ca.crt\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.947286 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.969151 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-images\"" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.971096 5030 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:09:55 crc kubenswrapper[5030]: I0316 13:09:55.997985 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tk7bt\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.049176 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"serving-cert\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.052934 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"config\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.095671 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tjs74\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.117940 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kpvmz\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.142849 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-service-ca\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.159698 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.169730 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-config\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.210322 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kw8fx\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.325634 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.387810 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.730779 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-metrics\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.744334 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.770530 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.800245 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-serving-cert\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.849569 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.860372 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.915118 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Mar 16 13:09:56 crc kubenswrapper[5030]: I0316 13:09:56.929447 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.056934 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-dockercfg-6c46w\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.077315 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.168091 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"audit-1\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.243111 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"openshift-service-ca.crt\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.246197 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"pprof-cert\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.274604 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.291956 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.393051 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"openshift-controller-manager-sa-dockercfg-djmfg\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.461194 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"serving-cert\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.538701 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"kube-root-ca.crt\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.558705 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"trusted-ca-bundle\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.588175 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-idp-0-file-data\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.624464 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"etcd-client\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.739727 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kl6m8\"" Mar 16 13:09:57 crc kubenswrapper[5030]: I0316 13:09:57.896189 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kknhg\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.064519 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.143656 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.159128 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager\"/\"serving-cert\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.164348 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bjqfd\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.232774 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-sa-dockercfg-wzhvk\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.393135 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"config\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.475766 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bgxvm\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.533071 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.538308 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-serving-cert\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.566030 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mcc-proxy-tls\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.597517 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.650832 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"etcd-client\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.669893 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.686531 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.789274 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"metrics-tls\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.843003 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"audit\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.850002 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.902520 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.946088 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-controller-dockercfg-xnj77\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.982357 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Mar 16 13:09:58 crc kubenswrapper[5030]: I0316 13:09:58.995677 5030 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.028173 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.082718 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-rbac-proxy\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.140055 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"oauth-apiserver-sa-dockercfg-qqw4z\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.246336 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"env-overrides\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.253728 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.291919 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"hostpath-provisioner\"/\"csi-hostpath-provisioner-sa-dockercfg-7dcws\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.300860 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.343761 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-dockercfg-jcmfj\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.370743 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.380119 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.418595 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.440529 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.444682 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.517857 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.556968 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serviceaccount-dockercfg-4gqzj\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.557012 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-global-ca\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.567672 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.634451 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.657379 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.680403 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.737690 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns-operator\"/\"kube-root-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.757982 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.803401 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.818376 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"openshift-config-operator-dockercfg-sjn6s\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.871840 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Mar 16 13:09:59 crc kubenswrapper[5030]: I0316 13:09:59.922269 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"service-ca-bundle\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.347688 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"proxy-tls\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.353900 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.647090 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"cluster-version-operator-serving-cert\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.653783 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"cluster-image-registry-operator-dockercfg-ntnd7\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.747984 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"kube-root-ca.crt\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.780080 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-operator\"/\"ingress-operator-dockercfg-74nwh\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.835401 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-operator-tls\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.846386 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"mco-proxy-tls\"" Mar 16 13:10:00 crc kubenswrapper[5030]: I0316 13:10:00.863295 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"openshift-apiserver-sa-dockercfg-4zqgh\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.058222 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"openshift-service-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.101992 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.158568 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.186109 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"marketplace-operator-dockercfg-2cfkp\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.202226 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-version\"/\"default-dockercfg-hqpm5\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.261147 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-etcd-operator\"/\"etcd-operator-serving-cert\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.275275 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pgs7\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.324383 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.361779 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"client-ca\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.393668 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-dockercfg-sw6nc\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.430909 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns-operator\"/\"metrics-tls\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.442159 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.443090 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.484825 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"openshift-kube-scheduler-operator-dockercfg-2wbn2\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.594274 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-config-operator\"/\"config-operator-serving-cert\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.721399 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.725506 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-version\"/\"openshift-service-ca.crt\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.725763 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2h6bs\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.888425 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.905935 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-trusted-ca-bundle\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.913958 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.935104 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-ocp-branding-template\"" Mar 16 13:10:01 crc kubenswrapper[5030]: I0316 13:10:01.993508 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.004789 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.011733 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"packageserver-service-cert\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.144764 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-admission-controller-secret\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.268953 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.293635 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-dockercfg-bf7fj\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.310928 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"trusted-ca-bundle\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.318294 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-serving-cert\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.356808 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwglk\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.379842 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"image-import-ca\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.398823 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.439049 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-node-identity\"/\"network-node-identity-cert\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.449295 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.452452 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-oauth-apiserver\"/\"encryption-config-1\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.487329 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.712952 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-scheduler-operator\"/\"kube-scheduler-operator-serving-cert\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.728525 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t8n29\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.783218 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"client-ca\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.890961 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"openshift-service-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.919787 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.977997 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-config\"" Mar 16 13:10:02 crc kubenswrapper[5030]: I0316 13:10:02.992651 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-service-ca-bundle\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.042245 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"serving-cert\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.123604 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.283579 5030 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.457815 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-cliconfig\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.465304 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.468455 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"kube-root-ca.crt\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.488544 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"catalog-operator-serving-cert\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.567204 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-tls\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.570483 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-operator-images\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.633228 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-rbac-proxy\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.637710 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-apiserver-operator-config\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.685666 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.691363 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.752762 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:03 crc kubenswrapper[5030]: I0316 13:10:03.878482 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.035031 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-route-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.035257 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"etcd-ca-bundle\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.092660 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.108270 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.131894 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-login\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.143023 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver\"/\"encryption-config-1\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.171220 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"openshift-service-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.248974 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l2v2m\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.382209 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"node-bootstrapper-token\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.395113 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-config\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.465959 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.480568 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-dockercfg-6n5ln\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.525020 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.559495 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.664265 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-control-plane-dockercfg-nl8tp\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.685226 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-tls\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.822655 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.837860 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-server-dockercfg-dzw6b\"" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.838998 5030 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Mar 16 13:10:04 crc kubenswrapper[5030]: I0316 13:10:04.976748 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"package-server-manager-serving-cert\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.130510 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"olm-operator-serving-cert\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.143938 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.154503 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.178419 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-machine-approver\"/\"machine-approver-tls\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.199021 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.263228 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6w67b\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.285044 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.294869 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-apiserver-operator\"/\"openshift-apiserver-operator-serving-cert\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.377964 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561110-wlz2f"] Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.378742 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" containerName="installer" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.378774 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" containerName="installer" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.378935 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1061bd55-2388-4bb3-bc23-35431748b0da" containerName="installer" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.383053 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.384640 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.385051 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.385068 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.386598 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561110-wlz2f"] Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.407127 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.444444 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"hostpath-provisioner\"/\"openshift-service-ca.crt\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.487706 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbkdn\" (UniqueName: \"kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn\") pod \"auto-csr-approver-29561110-wlz2f\" (UID: \"8436014c-172c-48c6-80c1-29872ac193a2\") " pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.581222 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-machine-approver\"/\"kube-root-ca.crt\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.587059 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.588865 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbkdn\" (UniqueName: \"kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn\") pod \"auto-csr-approver-29561110-wlz2f\" (UID: \"8436014c-172c-48c6-80c1-29872ac193a2\") " pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.594013 5030 kubelet.go:2547] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-startup-monitor-crc"] Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.594297 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" containerID="cri-o://c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35" gracePeriod=5 Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.604736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbkdn\" (UniqueName: \"kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn\") pod \"auto-csr-approver-29561110-wlz2f\" (UID: \"8436014c-172c-48c6-80c1-29872ac193a2\") " pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.698598 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.749139 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-config-operator\"/\"machine-config-daemon-dockercfg-w9nzh\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.768959 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.820060 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"etcd-serving-ca\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.838141 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-controller-manager-operator\"/\"kube-controller-manager-operator-config\"" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.949878 5030 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="pods \"kube-apiserver-startup-monitor-crc\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-apiserver\": no relationship found between node 'crc' and this object" Mar 16 13:10:05 crc kubenswrapper[5030]: I0316 13:10:05.963404 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-user-template-error\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.001654 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-root-ca.crt\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.014449 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-node-identity\"/\"ovnkube-identity-cm\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.021885 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"control-plane-machine-set-operator-dockercfg-gnx66\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.063149 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561110-wlz2f"] Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.137599 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"kube-root-ca.crt\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.208224 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-apiserver-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.210124 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.357412 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-api\"/\"kube-rbac-proxy\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.732568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" event={"ID":"8436014c-172c-48c6-80c1-29872ac193a2","Type":"ContainerStarted","Data":"b32e6a32a379d3332ec45bc163f2b937a4200d90b1f6ff80977187f992827bdd"} Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.837437 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Mar 16 13:10:06 crc kubenswrapper[5030]: I0316 13:10:06.863662 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.006678 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-route-controller-manager\"/\"route-controller-manager-sa-dockercfg-mmcpt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.035453 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-control-plane-metrics-cert\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.070799 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g6kgg\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.073278 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.132962 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.158202 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.164453 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-controller-manager-operator\"/\"openshift-controller-manager-operator-serving-cert\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.202384 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-certs-default\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.353267 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.358782 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.559153 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-oauth-apiserver\"/\"trusted-ca-bundle\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.610693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.741841 5030 generic.go:358] "Generic (PLEG): container finished" podID="8436014c-172c-48c6-80c1-29872ac193a2" containerID="acc68fd911747ba8c16214669f8d531f92d4be37032aa8611f1b9b904fd11043" exitCode=0 Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.742176 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" event={"ID":"8436014c-172c-48c6-80c1-29872ac193a2","Type":"ContainerDied","Data":"acc68fd911747ba8c16214669f8d531f92d4be37032aa8611f1b9b904fd11043"} Mar 16 13:10:07 crc kubenswrapper[5030]: I0316 13:10:07.950930 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"v4-0-config-system-router-certs\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.166405 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.438564 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.648945 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.649096 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-etcd-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.771721 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jmhxf\"" Mar 16 13:10:08 crc kubenswrapper[5030]: I0316 13:10:08.984059 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.141026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbkdn\" (UniqueName: \"kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn\") pod \"8436014c-172c-48c6-80c1-29872ac193a2\" (UID: \"8436014c-172c-48c6-80c1-29872ac193a2\") " Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.151750 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn" (OuterVolumeSpecName: "kube-api-access-fbkdn") pod "8436014c-172c-48c6-80c1-29872ac193a2" (UID: "8436014c-172c-48c6-80c1-29872ac193a2"). InnerVolumeSpecName "kube-api-access-fbkdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.241814 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbkdn\" (UniqueName: \"kubernetes.io/projected/8436014c-172c-48c6-80c1-29872ac193a2-kube-api-access-fbkdn\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.332853 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.374781 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-machine-config-operator\"/\"kube-root-ca.crt\"" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.755868 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" event={"ID":"8436014c-172c-48c6-80c1-29872ac193a2","Type":"ContainerDied","Data":"b32e6a32a379d3332ec45bc163f2b937a4200d90b1f6ff80977187f992827bdd"} Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.755919 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b32e6a32a379d3332ec45bc163f2b937a4200d90b1f6ff80977187f992827bdd" Mar 16 13:10:09 crc kubenswrapper[5030]: I0316 13:10:09.756205 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561110-wlz2f" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.194830 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-controller-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.716108 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-crc_f7dbc7e1ee9c187a863ef9b473fad27b/startup-monitor/0.log" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.716200 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.717780 5030 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="pods \"kube-apiserver-startup-monitor-crc\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-apiserver\": no relationship found between node 'crc' and this object" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.761323 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-startup-monitor-crc_f7dbc7e1ee9c187a863ef9b473fad27b/startup-monitor/0.log" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.761376 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7dbc7e1ee9c187a863ef9b473fad27b" containerID="c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35" exitCode=137 Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.761513 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.761537 5030 scope.go:117] "RemoveContainer" containerID="c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.772307 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication-operator\"/\"authentication-operator-dockercfg-6tbpn\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.776025 5030 scope.go:117] "RemoveContainer" containerID="c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35" Mar 16 13:10:10 crc kubenswrapper[5030]: E0316 13:10:10.776362 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35\": container with ID starting with c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35 not found: ID does not exist" containerID="c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.776397 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35"} err="failed to get container status \"c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35\": rpc error: code = NotFound desc = could not find container \"c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35\": container with ID starting with c1cfb520192ca29342418919c29509243e152c61a9f5648950e39e08ada3dd35 not found: ID does not exist" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.861992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862068 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock" (OuterVolumeSpecName: "var-lock") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862154 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862215 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862256 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") pod \"f7dbc7e1ee9c187a863ef9b473fad27b\" (UID: \"f7dbc7e1ee9c187a863ef9b473fad27b\") " Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862263 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests" (OuterVolumeSpecName: "manifests") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "manifests". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862297 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log" (OuterVolumeSpecName: "var-log") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862388 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862439 5030 reconciler_common.go:299] "Volume detached for volume \"manifests\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-manifests\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862451 5030 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.862459 5030 reconciler_common.go:299] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-var-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.870075 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir" (OuterVolumeSpecName: "pod-resource-dir") pod "f7dbc7e1ee9c187a863ef9b473fad27b" (UID: "f7dbc7e1ee9c187a863ef9b473fad27b"). InnerVolumeSpecName "pod-resource-dir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.963540 5030 reconciler_common.go:299] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.963581 5030 reconciler_common.go:299] "Volume detached for volume \"pod-resource-dir\" (UniqueName: \"kubernetes.io/host-path/f7dbc7e1ee9c187a863ef9b473fad27b-pod-resource-dir\") on node \"crc\" DevicePath \"\"" Mar 16 13:10:10 crc kubenswrapper[5030]: I0316 13:10:10.969695 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Mar 16 13:10:11 crc kubenswrapper[5030]: I0316 13:10:11.075850 5030 status_manager.go:895] "Failed to get status for pod" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" pod="openshift-kube-apiserver/kube-apiserver-startup-monitor-crc" err="pods \"kube-apiserver-startup-monitor-crc\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-kube-apiserver\": no relationship found between node 'crc' and this object" Mar 16 13:10:11 crc kubenswrapper[5030]: I0316 13:10:11.951331 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" path="/var/lib/kubelet/pods/f7dbc7e1ee9c187a863ef9b473fad27b/volumes" Mar 16 13:10:24 crc kubenswrapper[5030]: I0316 13:10:24.287152 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:10:24 crc kubenswrapper[5030]: I0316 13:10:24.287712 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:10:25 crc kubenswrapper[5030]: I0316 13:10:25.242911 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-authentication\"/\"oauth-openshift-dockercfg-d2bf2\"" Mar 16 13:10:26 crc kubenswrapper[5030]: I0316 13:10:26.506458 5030 patch_prober.go:28] interesting pod/marketplace-operator-547dbd544d-pmsrq container/marketplace-operator namespace/openshift-marketplace: Readiness probe status=failure output="Get \"http://10.217.0.40:8080/healthz\": dial tcp 10.217.0.40:8080: connect: connection refused" start-of-body= Mar 16 13:10:26 crc kubenswrapper[5030]: I0316 13:10:26.506578 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" probeResult="failure" output="Get \"http://10.217.0.40:8080/healthz\": dial tcp 10.217.0.40:8080: connect: connection refused" Mar 16 13:10:26 crc kubenswrapper[5030]: I0316 13:10:26.863363 5030 generic.go:358] "Generic (PLEG): container finished" podID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerID="6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" exitCode=0 Mar 16 13:10:26 crc kubenswrapper[5030]: I0316 13:10:26.863570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerDied","Data":"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1"} Mar 16 13:10:26 crc kubenswrapper[5030]: I0316 13:10:26.864086 5030 scope.go:117] "RemoveContainer" containerID="6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" Mar 16 13:10:27 crc kubenswrapper[5030]: I0316 13:10:27.873448 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerStarted","Data":"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277"} Mar 16 13:10:27 crc kubenswrapper[5030]: I0316 13:10:27.874747 5030 status_manager.go:355] "Container readiness changed for unknown container" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" containerID="cri-o://6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" Mar 16 13:10:27 crc kubenswrapper[5030]: I0316 13:10:27.874783 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:10:28 crc kubenswrapper[5030]: I0316 13:10:28.879047 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:10:28 crc kubenswrapper[5030]: I0316 13:10:28.880329 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:10:31 crc kubenswrapper[5030]: I0316 13:10:31.106624 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Mar 16 13:10:37 crc kubenswrapper[5030]: I0316 13:10:37.966104 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mdwwj\"" Mar 16 13:10:44 crc kubenswrapper[5030]: I0316 13:10:44.309956 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-machine-api\"/\"machine-api-operator-tls\"" Mar 16 13:10:47 crc kubenswrapper[5030]: I0316 13:10:47.758849 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Mar 16 13:10:49 crc kubenswrapper[5030]: I0316 13:10:49.556847 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-apiserver\"/\"audit-1\"" Mar 16 13:10:54 crc kubenswrapper[5030]: I0316 13:10:54.287127 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:10:54 crc kubenswrapper[5030]: I0316 13:10:54.288606 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:10:54 crc kubenswrapper[5030]: I0316 13:10:54.288687 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:10:54 crc kubenswrapper[5030]: I0316 13:10:54.289371 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:10:54 crc kubenswrapper[5030]: I0316 13:10:54.289449 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35" gracePeriod=600 Mar 16 13:10:55 crc kubenswrapper[5030]: I0316 13:10:55.022610 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35" exitCode=0 Mar 16 13:10:55 crc kubenswrapper[5030]: I0316 13:10:55.022692 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35"} Mar 16 13:10:55 crc kubenswrapper[5030]: I0316 13:10:55.023369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150"} Mar 16 13:10:56 crc kubenswrapper[5030]: I0316 13:10:56.074211 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:10:56 crc kubenswrapper[5030]: I0316 13:10:56.074978 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:11:28 crc kubenswrapper[5030]: I0316 13:11:28.353469 5030 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.672770 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.673543 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-gdkft" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="registry-server" containerID="cri-o://3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c" gracePeriod=30 Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.677564 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.677854 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-dmpzv" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="registry-server" containerID="cri-o://e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d" gracePeriod=30 Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.684753 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.684987 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" containerID="cri-o://a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277" gracePeriod=30 Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.701462 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pzc7k"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.701945 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8436014c-172c-48c6-80c1-29872ac193a2" containerName="oc" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.701963 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8436014c-172c-48c6-80c1-29872ac193a2" containerName="oc" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.701977 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.701983 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.702094 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8436014c-172c-48c6-80c1-29872ac193a2" containerName="oc" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.702105 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7dbc7e1ee9c187a863ef9b473fad27b" containerName="startup-monitor" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.704156 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.712923 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.713514 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-tdlk4" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="registry-server" containerID="cri-o://02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3" gracePeriod=30 Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.716747 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pzc7k"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.727958 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.728304 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-qd6sf" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="registry-server" containerID="cri-o://bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8" gracePeriod=30 Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.835712 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-tmp\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.835843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.835936 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.836055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthcw\" (UniqueName: \"kubernetes.io/projected/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-kube-api-access-mthcw\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.939516 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mthcw\" (UniqueName: \"kubernetes.io/projected/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-kube-api-access-mthcw\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.939636 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-tmp\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.939708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.940366 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.940809 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-tmp\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.942003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-trusted-ca\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.950236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-marketplace-operator-metrics\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:54 crc kubenswrapper[5030]: I0316 13:11:54.963713 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthcw\" (UniqueName: \"kubernetes.io/projected/2fe4fcbb-95ce-47f4-9483-59d73b9f7b23-kube-api-access-mthcw\") pod \"marketplace-operator-547dbd544d-pzc7k\" (UID: \"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23\") " pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.080141 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.085246 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.090197 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.106503 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.110500 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.125176 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246473 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities\") pod \"2dd1741f-617e-4120-a3f5-3c972b198c2c\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246566 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgf8h\" (UniqueName: \"kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h\") pod \"2dd1741f-617e-4120-a3f5-3c972b198c2c\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246635 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbkgd\" (UniqueName: \"kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd\") pod \"5141b8bf-7a03-4e30-af39-f8690d31097b\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246659 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99\") pod \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jvz9\" (UniqueName: \"kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9\") pod \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246811 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics\") pod \"5141b8bf-7a03-4e30-af39-f8690d31097b\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246857 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content\") pod \"2dd1741f-617e-4120-a3f5-3c972b198c2c\" (UID: \"2dd1741f-617e-4120-a3f5-3c972b198c2c\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246878 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content\") pod \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246925 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities\") pod \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities\") pod \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\" (UID: \"2a42fd25-73e1-47ce-ac45-2fe1834de6d1\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.246983 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities\") pod \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.247026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content\") pod \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\" (UID: \"2c9a8760-f2d9-4c2a-94fc-8106898e7659\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.247068 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp\") pod \"5141b8bf-7a03-4e30-af39-f8690d31097b\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.247095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content\") pod \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.247117 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca\") pod \"5141b8bf-7a03-4e30-af39-f8690d31097b\" (UID: \"5141b8bf-7a03-4e30-af39-f8690d31097b\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.247152 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsqtb\" (UniqueName: \"kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb\") pod \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\" (UID: \"4ff3f114-4c94-422f-b432-e99d57e2ba6a\") " Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.248430 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp" (OuterVolumeSpecName: "tmp") pod "5141b8bf-7a03-4e30-af39-f8690d31097b" (UID: "5141b8bf-7a03-4e30-af39-f8690d31097b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.248962 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca" (OuterVolumeSpecName: "marketplace-trusted-ca") pod "5141b8bf-7a03-4e30-af39-f8690d31097b" (UID: "5141b8bf-7a03-4e30-af39-f8690d31097b"). InnerVolumeSpecName "marketplace-trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.249271 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities" (OuterVolumeSpecName: "utilities") pod "2a42fd25-73e1-47ce-ac45-2fe1834de6d1" (UID: "2a42fd25-73e1-47ce-ac45-2fe1834de6d1"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.250543 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities" (OuterVolumeSpecName: "utilities") pod "2dd1741f-617e-4120-a3f5-3c972b198c2c" (UID: "2dd1741f-617e-4120-a3f5-3c972b198c2c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.251654 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities" (OuterVolumeSpecName: "utilities") pod "2c9a8760-f2d9-4c2a-94fc-8106898e7659" (UID: "2c9a8760-f2d9-4c2a-94fc-8106898e7659"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.253140 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities" (OuterVolumeSpecName: "utilities") pod "4ff3f114-4c94-422f-b432-e99d57e2ba6a" (UID: "4ff3f114-4c94-422f-b432-e99d57e2ba6a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.254732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd" (OuterVolumeSpecName: "kube-api-access-xbkgd") pod "5141b8bf-7a03-4e30-af39-f8690d31097b" (UID: "5141b8bf-7a03-4e30-af39-f8690d31097b"). InnerVolumeSpecName "kube-api-access-xbkgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.254941 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99" (OuterVolumeSpecName: "kube-api-access-dlg99") pod "2c9a8760-f2d9-4c2a-94fc-8106898e7659" (UID: "2c9a8760-f2d9-4c2a-94fc-8106898e7659"). InnerVolumeSpecName "kube-api-access-dlg99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.255013 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9" (OuterVolumeSpecName: "kube-api-access-6jvz9") pod "2a42fd25-73e1-47ce-ac45-2fe1834de6d1" (UID: "2a42fd25-73e1-47ce-ac45-2fe1834de6d1"). InnerVolumeSpecName "kube-api-access-6jvz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.255161 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb" (OuterVolumeSpecName: "kube-api-access-jsqtb") pod "4ff3f114-4c94-422f-b432-e99d57e2ba6a" (UID: "4ff3f114-4c94-422f-b432-e99d57e2ba6a"). InnerVolumeSpecName "kube-api-access-jsqtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256098 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256127 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbkgd\" (UniqueName: \"kubernetes.io/projected/5141b8bf-7a03-4e30-af39-f8690d31097b-kube-api-access-xbkgd\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256140 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlg99\" (UniqueName: \"kubernetes.io/projected/2c9a8760-f2d9-4c2a-94fc-8106898e7659-kube-api-access-dlg99\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256152 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jvz9\" (UniqueName: \"kubernetes.io/projected/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-kube-api-access-6jvz9\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256161 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256173 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256159 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h" (OuterVolumeSpecName: "kube-api-access-bgf8h") pod "2dd1741f-617e-4120-a3f5-3c972b198c2c" (UID: "2dd1741f-617e-4120-a3f5-3c972b198c2c"). InnerVolumeSpecName "kube-api-access-bgf8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256184 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256259 5030 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5141b8bf-7a03-4e30-af39-f8690d31097b-tmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256282 5030 reconciler_common.go:299] "Volume detached for volume \"marketplace-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.256295 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsqtb\" (UniqueName: \"kubernetes.io/projected/4ff3f114-4c94-422f-b432-e99d57e2ba6a-kube-api-access-jsqtb\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.262917 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics" (OuterVolumeSpecName: "marketplace-operator-metrics") pod "5141b8bf-7a03-4e30-af39-f8690d31097b" (UID: "5141b8bf-7a03-4e30-af39-f8690d31097b"). InnerVolumeSpecName "marketplace-operator-metrics". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.279386 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.280834 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pzc7k"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.288209 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "4ff3f114-4c94-422f-b432-e99d57e2ba6a" (UID: "4ff3f114-4c94-422f-b432-e99d57e2ba6a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.310152 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2dd1741f-617e-4120-a3f5-3c972b198c2c" (UID: "2dd1741f-617e-4120-a3f5-3c972b198c2c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.325602 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2c9a8760-f2d9-4c2a-94fc-8106898e7659" (UID: "2c9a8760-f2d9-4c2a-94fc-8106898e7659"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.360970 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2c9a8760-f2d9-4c2a-94fc-8106898e7659-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.360997 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/4ff3f114-4c94-422f-b432-e99d57e2ba6a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.361012 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgf8h\" (UniqueName: \"kubernetes.io/projected/2dd1741f-617e-4120-a3f5-3c972b198c2c-kube-api-access-bgf8h\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.361027 5030 reconciler_common.go:299] "Volume detached for volume \"marketplace-operator-metrics\" (UniqueName: \"kubernetes.io/secret/5141b8bf-7a03-4e30-af39-f8690d31097b-marketplace-operator-metrics\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.361039 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2dd1741f-617e-4120-a3f5-3c972b198c2c-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.361506 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2a42fd25-73e1-47ce-ac45-2fe1834de6d1" (UID: "2a42fd25-73e1-47ce-ac45-2fe1834de6d1"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.366501 5030 generic.go:358] "Generic (PLEG): container finished" podID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerID="a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277" exitCode=0 Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.366601 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.366595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerDied","Data":"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.366888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pmsrq" event={"ID":"5141b8bf-7a03-4e30-af39-f8690d31097b","Type":"ContainerDied","Data":"f9eaddef222446e53ba5c03f5c384aa9169fefdda0a42859c8bb1e740b6a42e5"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.366937 5030 scope.go:117] "RemoveContainer" containerID="a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.369963 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerID="bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8" exitCode=0 Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.370111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerDied","Data":"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.370151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-qd6sf" event={"ID":"2a42fd25-73e1-47ce-ac45-2fe1834de6d1","Type":"ContainerDied","Data":"ce294e1955367955bd2bff11a38f5e78b8aaf4503e5b0cd7e0b7233327dedcb3"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.370250 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-qd6sf" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.376863 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerID="e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d" exitCode=0 Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.376952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerDied","Data":"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.376988 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-dmpzv" event={"ID":"2c9a8760-f2d9-4c2a-94fc-8106898e7659","Type":"ContainerDied","Data":"aed20761daeacae3921e2b49a37f06f1ad7517fae2bc8c7888badd8a0af1a564"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.377143 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-dmpzv" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.379084 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" event={"ID":"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23","Type":"ContainerStarted","Data":"f36ac2cd0ebc7f13d92c5b076acfa4cacd7e6d88ca0a12ed2793b11d90998efd"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.380803 5030 generic.go:358] "Generic (PLEG): container finished" podID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerID="3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c" exitCode=0 Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.380857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerDied","Data":"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.380877 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-gdkft" event={"ID":"2dd1741f-617e-4120-a3f5-3c972b198c2c","Type":"ContainerDied","Data":"bd255c42f19e5866377bf2fead05beddee1804cb834f91bf73ef90df5cdf2c7e"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.380967 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-gdkft" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.387961 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerID="02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3" exitCode=0 Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.388000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerDied","Data":"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.388026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tdlk4" event={"ID":"4ff3f114-4c94-422f-b432-e99d57e2ba6a","Type":"ContainerDied","Data":"e340eac969a9103edea4f0c349d6cd21af622c48ba69ab07a9cb653fe3c487bc"} Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.388127 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tdlk4" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.390584 5030 scope.go:117] "RemoveContainer" containerID="6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.404580 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.410438 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/marketplace-operator-547dbd544d-pmsrq"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.414849 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.417097 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-qd6sf"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.428475 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.428667 5030 scope.go:117] "RemoveContainer" containerID="a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.429004 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277\": container with ID starting with a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277 not found: ID does not exist" containerID="a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.429033 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277"} err="failed to get container status \"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277\": rpc error: code = NotFound desc = could not find container \"a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277\": container with ID starting with a383f17a843f2e5c3c2377723a9cd7457137194ca80d80972c00b0f77feaf277 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.429051 5030 scope.go:117] "RemoveContainer" containerID="6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.429294 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1\": container with ID starting with 6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1 not found: ID does not exist" containerID="6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.429320 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1"} err="failed to get container status \"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1\": rpc error: code = NotFound desc = could not find container \"6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1\": container with ID starting with 6d8b3d5a7cd9f12700f66d9349632fc7364b85c68be5fdbbea12917f32387aa1 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.429336 5030 scope.go:117] "RemoveContainer" containerID="bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.433384 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-tdlk4"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.436615 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.450959 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-dmpzv"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.451032 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.451068 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-gdkft"] Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.453396 5030 scope.go:117] "RemoveContainer" containerID="28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.463576 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2a42fd25-73e1-47ce-ac45-2fe1834de6d1-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.470559 5030 scope.go:117] "RemoveContainer" containerID="25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.483562 5030 scope.go:117] "RemoveContainer" containerID="bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.483904 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8\": container with ID starting with bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8 not found: ID does not exist" containerID="bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.483936 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8"} err="failed to get container status \"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8\": rpc error: code = NotFound desc = could not find container \"bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8\": container with ID starting with bc2f6c881b4a643ab19a31db4cdeea673d09204a3165450caeabbda9b3b841a8 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.483960 5030 scope.go:117] "RemoveContainer" containerID="28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.484129 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996\": container with ID starting with 28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996 not found: ID does not exist" containerID="28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.484152 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996"} err="failed to get container status \"28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996\": rpc error: code = NotFound desc = could not find container \"28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996\": container with ID starting with 28d9ece927a0d6ebe6e29c13e28ce22dc42d21cf4397a7f3fcacaf63af973996 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.484166 5030 scope.go:117] "RemoveContainer" containerID="25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.484335 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a\": container with ID starting with 25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a not found: ID does not exist" containerID="25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.484355 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a"} err="failed to get container status \"25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a\": rpc error: code = NotFound desc = could not find container \"25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a\": container with ID starting with 25148f8782aa64c279339fae7ba5784252fec349bcc62cd175ffc119ee99805a not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.484368 5030 scope.go:117] "RemoveContainer" containerID="e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.495403 5030 scope.go:117] "RemoveContainer" containerID="cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.507683 5030 scope.go:117] "RemoveContainer" containerID="7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.518496 5030 scope.go:117] "RemoveContainer" containerID="e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.518803 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d\": container with ID starting with e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d not found: ID does not exist" containerID="e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.518833 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d"} err="failed to get container status \"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d\": rpc error: code = NotFound desc = could not find container \"e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d\": container with ID starting with e4cfbeff583e1cc35a92bf500363342509d81433968ad9a66e310f0dfd3bfa5d not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.518857 5030 scope.go:117] "RemoveContainer" containerID="cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.519093 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44\": container with ID starting with cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44 not found: ID does not exist" containerID="cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.519123 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44"} err="failed to get container status \"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44\": rpc error: code = NotFound desc = could not find container \"cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44\": container with ID starting with cc76f4b7f73de0a75eb6bbe1d90b1c85047ef3ce0673085ad21c67a921e9fc44 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.519144 5030 scope.go:117] "RemoveContainer" containerID="7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.519476 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634\": container with ID starting with 7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634 not found: ID does not exist" containerID="7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.519511 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634"} err="failed to get container status \"7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634\": rpc error: code = NotFound desc = could not find container \"7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634\": container with ID starting with 7aa9e0b14d202369acd954fffda7d7b9bde0b1f4d5fb13850d8ea1265834b634 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.519528 5030 scope.go:117] "RemoveContainer" containerID="3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.530964 5030 scope.go:117] "RemoveContainer" containerID="7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.542205 5030 scope.go:117] "RemoveContainer" containerID="da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.553301 5030 scope.go:117] "RemoveContainer" containerID="3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.553683 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c\": container with ID starting with 3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c not found: ID does not exist" containerID="3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.553711 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c"} err="failed to get container status \"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c\": rpc error: code = NotFound desc = could not find container \"3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c\": container with ID starting with 3be187b88ab89c5e71f0dfd4ea2c85653f3edf3c566b76442e8db6f0a454b53c not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.553727 5030 scope.go:117] "RemoveContainer" containerID="7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.554033 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466\": container with ID starting with 7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466 not found: ID does not exist" containerID="7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.554063 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466"} err="failed to get container status \"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466\": rpc error: code = NotFound desc = could not find container \"7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466\": container with ID starting with 7f677dc5e8b8501f1fe255adf399fb1151f8a9e264595849d32159ae229b2466 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.554081 5030 scope.go:117] "RemoveContainer" containerID="da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.554330 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101\": container with ID starting with da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101 not found: ID does not exist" containerID="da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.554352 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101"} err="failed to get container status \"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101\": rpc error: code = NotFound desc = could not find container \"da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101\": container with ID starting with da566cb150ce2ee89a5ec30e409538ae8f38a86dbd4f35fecab5d613817fb101 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.554366 5030 scope.go:117] "RemoveContainer" containerID="02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.567886 5030 scope.go:117] "RemoveContainer" containerID="ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.584692 5030 scope.go:117] "RemoveContainer" containerID="907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.608339 5030 scope.go:117] "RemoveContainer" containerID="02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.608764 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3\": container with ID starting with 02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3 not found: ID does not exist" containerID="02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.608806 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3"} err="failed to get container status \"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3\": rpc error: code = NotFound desc = could not find container \"02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3\": container with ID starting with 02aa6b67e55fc397cc9ce7d03a77a50046d07717ac3210655e4d46cf46e83df3 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.608830 5030 scope.go:117] "RemoveContainer" containerID="ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.609403 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295\": container with ID starting with ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295 not found: ID does not exist" containerID="ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.609430 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295"} err="failed to get container status \"ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295\": rpc error: code = NotFound desc = could not find container \"ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295\": container with ID starting with ba52458577f930931d9973b05d585019742b78be0c69ccc09bc00c78d0d5b295 not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.609448 5030 scope.go:117] "RemoveContainer" containerID="907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a" Mar 16 13:11:55 crc kubenswrapper[5030]: E0316 13:11:55.609766 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a\": container with ID starting with 907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a not found: ID does not exist" containerID="907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.609791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a"} err="failed to get container status \"907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a\": rpc error: code = NotFound desc = could not find container \"907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a\": container with ID starting with 907a66d5b12d228917e08a2fbb4477a29fe886e21997bdfa859d8a56593b355a not found: ID does not exist" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.951684 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" path="/var/lib/kubelet/pods/2a42fd25-73e1-47ce-ac45-2fe1834de6d1/volumes" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.952336 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" path="/var/lib/kubelet/pods/2c9a8760-f2d9-4c2a-94fc-8106898e7659/volumes" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.952925 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" path="/var/lib/kubelet/pods/2dd1741f-617e-4120-a3f5-3c972b198c2c/volumes" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.953992 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" path="/var/lib/kubelet/pods/4ff3f114-4c94-422f-b432-e99d57e2ba6a/volumes" Mar 16 13:11:55 crc kubenswrapper[5030]: I0316 13:11:55.954624 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" path="/var/lib/kubelet/pods/5141b8bf-7a03-4e30-af39-f8690d31097b/volumes" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.395326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" event={"ID":"2fe4fcbb-95ce-47f4-9483-59d73b9f7b23","Type":"ContainerStarted","Data":"6ddcf4b653f713a0b96713fb98dfccccfc0ea19d0a0d51c1c212ffd11889870f"} Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.395670 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.400762 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.412229 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/marketplace-operator-547dbd544d-pzc7k" podStartSLOduration=2.412214326 podStartE2EDuration="2.412214326s" podCreationTimestamp="2026-03-16 13:11:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:11:56.408824955 +0000 UTC m=+360.808137492" watchObservedRunningTime="2026-03-16 13:11:56.412214326 +0000 UTC m=+360.811526874" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485039 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-2qsrs"] Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485802 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485827 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485852 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485860 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485868 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485875 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485885 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485890 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485899 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485905 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485933 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485940 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485947 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485955 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485964 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485971 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485981 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.485987 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486002 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486007 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486015 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486022 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="extract-utilities" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486028 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486035 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486041 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486047 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486055 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486061 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="extract-content" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486167 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a42fd25-73e1-47ce-ac45-2fe1834de6d1" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486176 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486185 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5141b8bf-7a03-4e30-af39-f8690d31097b" containerName="marketplace-operator" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486192 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c9a8760-f2d9-4c2a-94fc-8106898e7659" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486200 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2dd1741f-617e-4120-a3f5-3c972b198c2c" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.486207 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ff3f114-4c94-422f-b432-e99d57e2ba6a" containerName="registry-server" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.493880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.496571 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"certified-operators-dockercfg-7cl8d\"" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.498167 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2qsrs"] Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.580437 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv58l\" (UniqueName: \"kubernetes.io/projected/318ad99c-6c0f-46b0-b626-3e123a81b3d2-kube-api-access-vv58l\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.580500 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-catalog-content\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.580543 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-utilities\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.681982 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv58l\" (UniqueName: \"kubernetes.io/projected/318ad99c-6c0f-46b0-b626-3e123a81b3d2-kube-api-access-vv58l\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.682288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-catalog-content\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.682406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-utilities\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.682849 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-catalog-content\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.682947 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/318ad99c-6c0f-46b0-b626-3e123a81b3d2-utilities\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.700525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv58l\" (UniqueName: \"kubernetes.io/projected/318ad99c-6c0f-46b0-b626-3e123a81b3d2-kube-api-access-vv58l\") pod \"certified-operators-2qsrs\" (UID: \"318ad99c-6c0f-46b0-b626-3e123a81b3d2\") " pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:56 crc kubenswrapper[5030]: I0316 13:11:56.812703 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.001875 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-2qsrs"] Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.403387 5030 generic.go:358] "Generic (PLEG): container finished" podID="318ad99c-6c0f-46b0-b626-3e123a81b3d2" containerID="cefa5bcc52b358ab956b4f56eacc21c44c9aff25ca1259dfa11cfec00ab49b48" exitCode=0 Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.403508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2qsrs" event={"ID":"318ad99c-6c0f-46b0-b626-3e123a81b3d2","Type":"ContainerDied","Data":"cefa5bcc52b358ab956b4f56eacc21c44c9aff25ca1259dfa11cfec00ab49b48"} Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.403580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2qsrs" event={"ID":"318ad99c-6c0f-46b0-b626-3e123a81b3d2","Type":"ContainerStarted","Data":"7323626059cca3c656ae119a35e01b3ed42b5b715f863916491f794e45f31cfc"} Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.479514 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-jzsdp"] Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.483288 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.485308 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-marketplace-dockercfg-gg4w7\"" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.486917 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-jzsdp"] Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.492291 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-utilities\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.492579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkxmk\" (UniqueName: \"kubernetes.io/projected/5ab61305-abfd-4a6f-897b-7e82819260f6-kube-api-access-dkxmk\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.492620 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-catalog-content\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.593864 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-utilities\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.593915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkxmk\" (UniqueName: \"kubernetes.io/projected/5ab61305-abfd-4a6f-897b-7e82819260f6-kube-api-access-dkxmk\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.593952 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-catalog-content\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.594517 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-utilities\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.594906 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/5ab61305-abfd-4a6f-897b-7e82819260f6-catalog-content\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.616183 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkxmk\" (UniqueName: \"kubernetes.io/projected/5ab61305-abfd-4a6f-897b-7e82819260f6-kube-api-access-dkxmk\") pod \"redhat-marketplace-jzsdp\" (UID: \"5ab61305-abfd-4a6f-897b-7e82819260f6\") " pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.798904 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:11:57 crc kubenswrapper[5030]: I0316 13:11:57.957732 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-jzsdp"] Mar 16 13:11:57 crc kubenswrapper[5030]: W0316 13:11:57.961462 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab61305_abfd_4a6f_897b_7e82819260f6.slice/crio-5e0450cae7ed21ea151ce3ada525ae614c179959dae2b11cdd297bf71fd01554 WatchSource:0}: Error finding container 5e0450cae7ed21ea151ce3ada525ae614c179959dae2b11cdd297bf71fd01554: Status 404 returned error can't find the container with id 5e0450cae7ed21ea151ce3ada525ae614c179959dae2b11cdd297bf71fd01554 Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.412153 5030 generic.go:358] "Generic (PLEG): container finished" podID="318ad99c-6c0f-46b0-b626-3e123a81b3d2" containerID="538e61cb36a3ab899d852b4125396b3fd289f98096ad120ca23a66d67718b284" exitCode=0 Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.412393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2qsrs" event={"ID":"318ad99c-6c0f-46b0-b626-3e123a81b3d2","Type":"ContainerDied","Data":"538e61cb36a3ab899d852b4125396b3fd289f98096ad120ca23a66d67718b284"} Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.416296 5030 generic.go:358] "Generic (PLEG): container finished" podID="5ab61305-abfd-4a6f-897b-7e82819260f6" containerID="e765f339f17abacddea00a11f1f2efe10f74c81c8af23ad16557a8b007c1c1a2" exitCode=0 Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.416399 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-jzsdp" event={"ID":"5ab61305-abfd-4a6f-897b-7e82819260f6","Type":"ContainerDied","Data":"e765f339f17abacddea00a11f1f2efe10f74c81c8af23ad16557a8b007c1c1a2"} Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.416509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-jzsdp" event={"ID":"5ab61305-abfd-4a6f-897b-7e82819260f6","Type":"ContainerStarted","Data":"5e0450cae7ed21ea151ce3ada525ae614c179959dae2b11cdd297bf71fd01554"} Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.888622 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-4cbxz"] Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.892938 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.895632 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"redhat-operators-dockercfg-9gxlh\"" Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.897257 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4cbxz"] Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.909820 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-catalog-content\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.909894 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf9tf\" (UniqueName: \"kubernetes.io/projected/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-kube-api-access-zf9tf\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:58 crc kubenswrapper[5030]: I0316 13:11:58.909914 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-utilities\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.010989 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zf9tf\" (UniqueName: \"kubernetes.io/projected/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-kube-api-access-zf9tf\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.011054 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-utilities\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.011512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-catalog-content\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.011752 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-utilities\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.012149 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-catalog-content\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.030667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf9tf\" (UniqueName: \"kubernetes.io/projected/cae8ed9c-e60f-4e14-b71c-f57857fb3ce7-kube-api-access-zf9tf\") pod \"redhat-operators-4cbxz\" (UID: \"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7\") " pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.208470 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.388394 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4cbxz"] Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.436484 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-2qsrs" event={"ID":"318ad99c-6c0f-46b0-b626-3e123a81b3d2","Type":"ContainerStarted","Data":"e73f4e2bd781f6369360056ca5f477a4873aee26f6558a887235079153f45069"} Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.439933 5030 generic.go:358] "Generic (PLEG): container finished" podID="5ab61305-abfd-4a6f-897b-7e82819260f6" containerID="84b7dfef6463e62a1bf2fa1e9e90f3c7ee02b9ef76dc78c4d28df534492e9efc" exitCode=0 Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.440138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-jzsdp" event={"ID":"5ab61305-abfd-4a6f-897b-7e82819260f6","Type":"ContainerDied","Data":"84b7dfef6463e62a1bf2fa1e9e90f3c7ee02b9ef76dc78c4d28df534492e9efc"} Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.442676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4cbxz" event={"ID":"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7","Type":"ContainerStarted","Data":"44a97e7e868eb3401a54d7ac2075636fcb6720bd3acbbb50987255ddce7c919b"} Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.461398 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-2qsrs" podStartSLOduration=2.751461525 podStartE2EDuration="3.461379017s" podCreationTimestamp="2026-03-16 13:11:56 +0000 UTC" firstStartedPulling="2026-03-16 13:11:57.40426543 +0000 UTC m=+361.803577977" lastFinishedPulling="2026-03-16 13:11:58.114182922 +0000 UTC m=+362.513495469" observedRunningTime="2026-03-16 13:11:59.455937738 +0000 UTC m=+363.855250275" watchObservedRunningTime="2026-03-16 13:11:59.461379017 +0000 UTC m=+363.860691564" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.888251 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-2vplc"] Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.892710 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.895621 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"community-operators-dockercfg-vrd5f\"" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.898223 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2vplc"] Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.929780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64pgm\" (UniqueName: \"kubernetes.io/projected/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-kube-api-access-64pgm\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.929848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-catalog-content\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:11:59 crc kubenswrapper[5030]: I0316 13:11:59.929984 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-utilities\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.032193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-utilities\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.032325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64pgm\" (UniqueName: \"kubernetes.io/projected/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-kube-api-access-64pgm\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.032430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-catalog-content\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.032934 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-catalog-content\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.033178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-utilities\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.050860 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64pgm\" (UniqueName: \"kubernetes.io/projected/cf8ecd63-98d9-47a8-839f-927a5ca04ec6-kube-api-access-64pgm\") pod \"community-operators-2vplc\" (UID: \"cf8ecd63-98d9-47a8-839f-927a5ca04ec6\") " pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.135093 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561112-hj95h"] Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.139179 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.141023 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.141112 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.141785 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.143316 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561112-hj95h"] Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.206808 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.236179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx7zr\" (UniqueName: \"kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr\") pod \"auto-csr-approver-29561112-hj95h\" (UID: \"297460b2-fd22-4f53-ad05-cf34d79be5ed\") " pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.342805 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx7zr\" (UniqueName: \"kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr\") pod \"auto-csr-approver-29561112-hj95h\" (UID: \"297460b2-fd22-4f53-ad05-cf34d79be5ed\") " pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.360696 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx7zr\" (UniqueName: \"kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr\") pod \"auto-csr-approver-29561112-hj95h\" (UID: \"297460b2-fd22-4f53-ad05-cf34d79be5ed\") " pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.400405 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2vplc"] Mar 16 13:12:00 crc kubenswrapper[5030]: W0316 13:12:00.408194 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8ecd63_98d9_47a8_839f_927a5ca04ec6.slice/crio-2c8b24319871e2c19034fc4a49d0a7364eefd9e8fb628e2b077a264fff0a260e WatchSource:0}: Error finding container 2c8b24319871e2c19034fc4a49d0a7364eefd9e8fb628e2b077a264fff0a260e: Status 404 returned error can't find the container with id 2c8b24319871e2c19034fc4a49d0a7364eefd9e8fb628e2b077a264fff0a260e Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.452611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2vplc" event={"ID":"cf8ecd63-98d9-47a8-839f-927a5ca04ec6","Type":"ContainerStarted","Data":"2c8b24319871e2c19034fc4a49d0a7364eefd9e8fb628e2b077a264fff0a260e"} Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.453193 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.458989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-jzsdp" event={"ID":"5ab61305-abfd-4a6f-897b-7e82819260f6","Type":"ContainerStarted","Data":"b1e7fd052f9ea38d49ea70cb6fa2cb234c2423beee9b2c70106c9de26e25162c"} Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.463314 5030 generic.go:358] "Generic (PLEG): container finished" podID="cae8ed9c-e60f-4e14-b71c-f57857fb3ce7" containerID="143de153b8a8332157b713904ba37f1ada18c3f4498bd6646ace4c0feca8a2b5" exitCode=0 Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.464981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4cbxz" event={"ID":"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7","Type":"ContainerDied","Data":"143de153b8a8332157b713904ba37f1ada18c3f4498bd6646ace4c0feca8a2b5"} Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.481934 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-jzsdp" podStartSLOduration=2.741644987 podStartE2EDuration="3.481913909s" podCreationTimestamp="2026-03-16 13:11:57 +0000 UTC" firstStartedPulling="2026-03-16 13:11:58.417191869 +0000 UTC m=+362.816504416" lastFinishedPulling="2026-03-16 13:11:59.157460791 +0000 UTC m=+363.556773338" observedRunningTime="2026-03-16 13:12:00.481665933 +0000 UTC m=+364.880978480" watchObservedRunningTime="2026-03-16 13:12:00.481913909 +0000 UTC m=+364.881226457" Mar 16 13:12:00 crc kubenswrapper[5030]: I0316 13:12:00.642600 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561112-hj95h"] Mar 16 13:12:00 crc kubenswrapper[5030]: W0316 13:12:00.647747 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod297460b2_fd22_4f53_ad05_cf34d79be5ed.slice/crio-69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb WatchSource:0}: Error finding container 69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb: Status 404 returned error can't find the container with id 69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb Mar 16 13:12:01 crc kubenswrapper[5030]: I0316 13:12:01.470195 5030 generic.go:358] "Generic (PLEG): container finished" podID="cf8ecd63-98d9-47a8-839f-927a5ca04ec6" containerID="2beb2a482e60b337a9bb743d31ea80ec2802a2a6c01e2984cd558bd5c682913a" exitCode=0 Mar 16 13:12:01 crc kubenswrapper[5030]: I0316 13:12:01.470247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2vplc" event={"ID":"cf8ecd63-98d9-47a8-839f-927a5ca04ec6","Type":"ContainerDied","Data":"2beb2a482e60b337a9bb743d31ea80ec2802a2a6c01e2984cd558bd5c682913a"} Mar 16 13:12:01 crc kubenswrapper[5030]: I0316 13:12:01.473572 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4cbxz" event={"ID":"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7","Type":"ContainerStarted","Data":"187d59276c3c0fe500083aa8411bd137eee6b5b246dbc09386ca1ea5f5575955"} Mar 16 13:12:01 crc kubenswrapper[5030]: I0316 13:12:01.474598 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561112-hj95h" event={"ID":"297460b2-fd22-4f53-ad05-cf34d79be5ed","Type":"ContainerStarted","Data":"69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb"} Mar 16 13:12:02 crc kubenswrapper[5030]: I0316 13:12:02.484542 5030 generic.go:358] "Generic (PLEG): container finished" podID="297460b2-fd22-4f53-ad05-cf34d79be5ed" containerID="9aaeb5bbe1782be07879c210176f6dcc3fb349e437a9532e16134253f42c29bb" exitCode=0 Mar 16 13:12:02 crc kubenswrapper[5030]: I0316 13:12:02.484688 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561112-hj95h" event={"ID":"297460b2-fd22-4f53-ad05-cf34d79be5ed","Type":"ContainerDied","Data":"9aaeb5bbe1782be07879c210176f6dcc3fb349e437a9532e16134253f42c29bb"} Mar 16 13:12:02 crc kubenswrapper[5030]: I0316 13:12:02.488781 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2vplc" event={"ID":"cf8ecd63-98d9-47a8-839f-927a5ca04ec6","Type":"ContainerStarted","Data":"6866366034ad03361c091ad20bfe7210088da88371ed7ace6892bfeebfc54b86"} Mar 16 13:12:02 crc kubenswrapper[5030]: I0316 13:12:02.490857 5030 generic.go:358] "Generic (PLEG): container finished" podID="cae8ed9c-e60f-4e14-b71c-f57857fb3ce7" containerID="187d59276c3c0fe500083aa8411bd137eee6b5b246dbc09386ca1ea5f5575955" exitCode=0 Mar 16 13:12:02 crc kubenswrapper[5030]: I0316 13:12:02.490978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4cbxz" event={"ID":"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7","Type":"ContainerDied","Data":"187d59276c3c0fe500083aa8411bd137eee6b5b246dbc09386ca1ea5f5575955"} Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.499361 5030 generic.go:358] "Generic (PLEG): container finished" podID="cf8ecd63-98d9-47a8-839f-927a5ca04ec6" containerID="6866366034ad03361c091ad20bfe7210088da88371ed7ace6892bfeebfc54b86" exitCode=0 Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.499472 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2vplc" event={"ID":"cf8ecd63-98d9-47a8-839f-927a5ca04ec6","Type":"ContainerDied","Data":"6866366034ad03361c091ad20bfe7210088da88371ed7ace6892bfeebfc54b86"} Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.502858 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4cbxz" event={"ID":"cae8ed9c-e60f-4e14-b71c-f57857fb3ce7","Type":"ContainerStarted","Data":"0b7ea3757eecaabd7d21d2ca809aad9805a36c861e225fa42398a09baf6b1b72"} Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.537616 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-4cbxz" podStartSLOduration=4.737316432 podStartE2EDuration="5.537595391s" podCreationTimestamp="2026-03-16 13:11:58 +0000 UTC" firstStartedPulling="2026-03-16 13:12:00.46558897 +0000 UTC m=+364.864901516" lastFinishedPulling="2026-03-16 13:12:01.265867928 +0000 UTC m=+365.665180475" observedRunningTime="2026-03-16 13:12:03.535292081 +0000 UTC m=+367.934604629" watchObservedRunningTime="2026-03-16 13:12:03.537595391 +0000 UTC m=+367.936907938" Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.719312 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.784930 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx7zr\" (UniqueName: \"kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr\") pod \"297460b2-fd22-4f53-ad05-cf34d79be5ed\" (UID: \"297460b2-fd22-4f53-ad05-cf34d79be5ed\") " Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.791922 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr" (OuterVolumeSpecName: "kube-api-access-tx7zr") pod "297460b2-fd22-4f53-ad05-cf34d79be5ed" (UID: "297460b2-fd22-4f53-ad05-cf34d79be5ed"). InnerVolumeSpecName "kube-api-access-tx7zr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:12:03 crc kubenswrapper[5030]: I0316 13:12:03.886362 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx7zr\" (UniqueName: \"kubernetes.io/projected/297460b2-fd22-4f53-ad05-cf34d79be5ed-kube-api-access-tx7zr\") on node \"crc\" DevicePath \"\"" Mar 16 13:12:04 crc kubenswrapper[5030]: I0316 13:12:04.510263 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561112-hj95h" event={"ID":"297460b2-fd22-4f53-ad05-cf34d79be5ed","Type":"ContainerDied","Data":"69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb"} Mar 16 13:12:04 crc kubenswrapper[5030]: I0316 13:12:04.510327 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69ca62fc7ea0e587c913aba621d7b727cf03227d3f726ef13bdef731b6f2eacb" Mar 16 13:12:04 crc kubenswrapper[5030]: I0316 13:12:04.510471 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561112-hj95h" Mar 16 13:12:04 crc kubenswrapper[5030]: I0316 13:12:04.514111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2vplc" event={"ID":"cf8ecd63-98d9-47a8-839f-927a5ca04ec6","Type":"ContainerStarted","Data":"8207bbc6fb6a8bee6dff3ce49ce8da3d6e216653fc02a56d7625e909cf93a2a3"} Mar 16 13:12:04 crc kubenswrapper[5030]: I0316 13:12:04.534692 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-2vplc" podStartSLOduration=4.805998962 podStartE2EDuration="5.534677734s" podCreationTimestamp="2026-03-16 13:11:59 +0000 UTC" firstStartedPulling="2026-03-16 13:12:01.471095509 +0000 UTC m=+365.870408057" lastFinishedPulling="2026-03-16 13:12:02.199774281 +0000 UTC m=+366.599086829" observedRunningTime="2026-03-16 13:12:04.529786609 +0000 UTC m=+368.929099146" watchObservedRunningTime="2026-03-16 13:12:04.534677734 +0000 UTC m=+368.933990271" Mar 16 13:12:06 crc kubenswrapper[5030]: I0316 13:12:06.813805 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:12:06 crc kubenswrapper[5030]: I0316 13:12:06.814202 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:12:06 crc kubenswrapper[5030]: I0316 13:12:06.850867 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:12:07 crc kubenswrapper[5030]: I0316 13:12:07.561731 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-2qsrs" Mar 16 13:12:07 crc kubenswrapper[5030]: I0316 13:12:07.799761 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:12:07 crc kubenswrapper[5030]: I0316 13:12:07.799840 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:12:07 crc kubenswrapper[5030]: I0316 13:12:07.833588 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:12:08 crc kubenswrapper[5030]: I0316 13:12:08.564830 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-jzsdp" Mar 16 13:12:09 crc kubenswrapper[5030]: I0316 13:12:09.209018 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:12:09 crc kubenswrapper[5030]: I0316 13:12:09.209088 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:12:09 crc kubenswrapper[5030]: I0316 13:12:09.245607 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:12:09 crc kubenswrapper[5030]: I0316 13:12:09.572540 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-4cbxz" Mar 16 13:12:10 crc kubenswrapper[5030]: I0316 13:12:10.207344 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:10 crc kubenswrapper[5030]: I0316 13:12:10.207633 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:10 crc kubenswrapper[5030]: I0316 13:12:10.241159 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:10 crc kubenswrapper[5030]: I0316 13:12:10.576720 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-2vplc" Mar 16 13:12:54 crc kubenswrapper[5030]: I0316 13:12:54.286645 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:12:54 crc kubenswrapper[5030]: I0316 13:12:54.287033 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:13:24 crc kubenswrapper[5030]: I0316 13:13:24.286466 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:13:24 crc kubenswrapper[5030]: I0316 13:13:24.287076 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:13:54 crc kubenswrapper[5030]: I0316 13:13:54.286722 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:13:54 crc kubenswrapper[5030]: I0316 13:13:54.287165 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:13:54 crc kubenswrapper[5030]: I0316 13:13:54.287210 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:13:54 crc kubenswrapper[5030]: I0316 13:13:54.287723 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:13:54 crc kubenswrapper[5030]: I0316 13:13:54.287780 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150" gracePeriod=600 Mar 16 13:13:55 crc kubenswrapper[5030]: I0316 13:13:55.100601 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150" exitCode=0 Mar 16 13:13:55 crc kubenswrapper[5030]: I0316 13:13:55.100685 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150"} Mar 16 13:13:55 crc kubenswrapper[5030]: I0316 13:13:55.101254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144"} Mar 16 13:13:55 crc kubenswrapper[5030]: I0316 13:13:55.101278 5030 scope.go:117] "RemoveContainer" containerID="40907c453e9d2f04e88f019b44a044522c87f3ee7dc9c22ee2e7446d184a3f35" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.130086 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561114-sflgz"] Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.131349 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297460b2-fd22-4f53-ad05-cf34d79be5ed" containerName="oc" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.131365 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="297460b2-fd22-4f53-ad05-cf34d79be5ed" containerName="oc" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.131472 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="297460b2-fd22-4f53-ad05-cf34d79be5ed" containerName="oc" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.139382 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.141062 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.141261 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.141330 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.141644 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561114-sflgz"] Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.283693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656bp\" (UniqueName: \"kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp\") pod \"auto-csr-approver-29561114-sflgz\" (UID: \"05e1edb2-555e-4c5f-96c2-22f8eefe31c5\") " pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.385147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-656bp\" (UniqueName: \"kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp\") pod \"auto-csr-approver-29561114-sflgz\" (UID: \"05e1edb2-555e-4c5f-96c2-22f8eefe31c5\") " pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.401971 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-656bp\" (UniqueName: \"kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp\") pod \"auto-csr-approver-29561114-sflgz\" (UID: \"05e1edb2-555e-4c5f-96c2-22f8eefe31c5\") " pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.454655 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:00 crc kubenswrapper[5030]: I0316 13:14:00.624487 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561114-sflgz"] Mar 16 13:14:01 crc kubenswrapper[5030]: I0316 13:14:01.147013 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561114-sflgz" event={"ID":"05e1edb2-555e-4c5f-96c2-22f8eefe31c5","Type":"ContainerStarted","Data":"09a8ee9b0e14ba29fa87d7cf426e6a9bd091848353297d22559649d9583b7820"} Mar 16 13:14:02 crc kubenswrapper[5030]: I0316 13:14:02.152854 5030 generic.go:358] "Generic (PLEG): container finished" podID="05e1edb2-555e-4c5f-96c2-22f8eefe31c5" containerID="e726e6ef6e5170fdc74a37098adc29f681cff4916c4bb608d6e86da019f61343" exitCode=0 Mar 16 13:14:02 crc kubenswrapper[5030]: I0316 13:14:02.152901 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561114-sflgz" event={"ID":"05e1edb2-555e-4c5f-96c2-22f8eefe31c5","Type":"ContainerDied","Data":"e726e6ef6e5170fdc74a37098adc29f681cff4916c4bb608d6e86da019f61343"} Mar 16 13:14:03 crc kubenswrapper[5030]: I0316 13:14:03.317824 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:03 crc kubenswrapper[5030]: I0316 13:14:03.422885 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-656bp\" (UniqueName: \"kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp\") pod \"05e1edb2-555e-4c5f-96c2-22f8eefe31c5\" (UID: \"05e1edb2-555e-4c5f-96c2-22f8eefe31c5\") " Mar 16 13:14:03 crc kubenswrapper[5030]: I0316 13:14:03.430185 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp" (OuterVolumeSpecName: "kube-api-access-656bp") pod "05e1edb2-555e-4c5f-96c2-22f8eefe31c5" (UID: "05e1edb2-555e-4c5f-96c2-22f8eefe31c5"). InnerVolumeSpecName "kube-api-access-656bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:14:03 crc kubenswrapper[5030]: I0316 13:14:03.524792 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-656bp\" (UniqueName: \"kubernetes.io/projected/05e1edb2-555e-4c5f-96c2-22f8eefe31c5-kube-api-access-656bp\") on node \"crc\" DevicePath \"\"" Mar 16 13:14:04 crc kubenswrapper[5030]: I0316 13:14:04.165856 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561114-sflgz" Mar 16 13:14:04 crc kubenswrapper[5030]: I0316 13:14:04.165909 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561114-sflgz" event={"ID":"05e1edb2-555e-4c5f-96c2-22f8eefe31c5","Type":"ContainerDied","Data":"09a8ee9b0e14ba29fa87d7cf426e6a9bd091848353297d22559649d9583b7820"} Mar 16 13:14:04 crc kubenswrapper[5030]: I0316 13:14:04.166245 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09a8ee9b0e14ba29fa87d7cf426e6a9bd091848353297d22559649d9583b7820" Mar 16 13:14:04 crc kubenswrapper[5030]: I0316 13:14:04.367531 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561108-mfzq4"] Mar 16 13:14:04 crc kubenswrapper[5030]: I0316 13:14:04.370281 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561108-mfzq4"] Mar 16 13:14:05 crc kubenswrapper[5030]: I0316 13:14:05.952176 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="372722e3-ea5c-49ce-b1d1-574906ebd61d" path="/var/lib/kubelet/pods/372722e3-ea5c-49ce-b1d1-574906ebd61d/volumes" Mar 16 13:14:56 crc kubenswrapper[5030]: I0316 13:14:56.164756 5030 scope.go:117] "RemoveContainer" containerID="a6a501243cebace4d9905640fb24c33745f3446408c61dd0443915312c3abb57" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.127238 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt"] Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.128899 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e1edb2-555e-4c5f-96c2-22f8eefe31c5" containerName="oc" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.128977 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e1edb2-555e-4c5f-96c2-22f8eefe31c5" containerName="oc" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.129116 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="05e1edb2-555e-4c5f-96c2-22f8eefe31c5" containerName="oc" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.134004 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt"] Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.134140 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.137160 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.139135 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.196669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.196736 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6qwc\" (UniqueName: \"kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.196768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.298209 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.298259 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6qwc\" (UniqueName: \"kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.298284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.299091 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.304144 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.313716 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6qwc\" (UniqueName: \"kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc\") pod \"collect-profiles-29561115-gcrwt\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.449750 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:00 crc kubenswrapper[5030]: I0316 13:15:00.621767 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt"] Mar 16 13:15:01 crc kubenswrapper[5030]: I0316 13:15:01.497821 5030 generic.go:358] "Generic (PLEG): container finished" podID="81444552-4fc5-4fcb-adc8-8fd275e08e54" containerID="022b122eb3013edbe2466911c6e5a1f59ead48dad55e8dd4db53ac1e212ee7d1" exitCode=0 Mar 16 13:15:01 crc kubenswrapper[5030]: I0316 13:15:01.497861 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" event={"ID":"81444552-4fc5-4fcb-adc8-8fd275e08e54","Type":"ContainerDied","Data":"022b122eb3013edbe2466911c6e5a1f59ead48dad55e8dd4db53ac1e212ee7d1"} Mar 16 13:15:01 crc kubenswrapper[5030]: I0316 13:15:01.498170 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" event={"ID":"81444552-4fc5-4fcb-adc8-8fd275e08e54","Type":"ContainerStarted","Data":"591786f7c39d13aacea8354adf944b86acc60726f4c55d6966e0bcf2e28685f2"} Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.653749 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.728894 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6qwc\" (UniqueName: \"kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc\") pod \"81444552-4fc5-4fcb-adc8-8fd275e08e54\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.729055 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume\") pod \"81444552-4fc5-4fcb-adc8-8fd275e08e54\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.729125 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume\") pod \"81444552-4fc5-4fcb-adc8-8fd275e08e54\" (UID: \"81444552-4fc5-4fcb-adc8-8fd275e08e54\") " Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.729804 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume" (OuterVolumeSpecName: "config-volume") pod "81444552-4fc5-4fcb-adc8-8fd275e08e54" (UID: "81444552-4fc5-4fcb-adc8-8fd275e08e54"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.734406 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc" (OuterVolumeSpecName: "kube-api-access-b6qwc") pod "81444552-4fc5-4fcb-adc8-8fd275e08e54" (UID: "81444552-4fc5-4fcb-adc8-8fd275e08e54"). InnerVolumeSpecName "kube-api-access-b6qwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.734431 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "81444552-4fc5-4fcb-adc8-8fd275e08e54" (UID: "81444552-4fc5-4fcb-adc8-8fd275e08e54"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.830944 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6qwc\" (UniqueName: \"kubernetes.io/projected/81444552-4fc5-4fcb-adc8-8fd275e08e54-kube-api-access-b6qwc\") on node \"crc\" DevicePath \"\"" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.830986 5030 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/81444552-4fc5-4fcb-adc8-8fd275e08e54-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:15:02 crc kubenswrapper[5030]: I0316 13:15:02.830996 5030 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/81444552-4fc5-4fcb-adc8-8fd275e08e54-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:15:03 crc kubenswrapper[5030]: I0316 13:15:03.512404 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" event={"ID":"81444552-4fc5-4fcb-adc8-8fd275e08e54","Type":"ContainerDied","Data":"591786f7c39d13aacea8354adf944b86acc60726f4c55d6966e0bcf2e28685f2"} Mar 16 13:15:03 crc kubenswrapper[5030]: I0316 13:15:03.512453 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="591786f7c39d13aacea8354adf944b86acc60726f4c55d6966e0bcf2e28685f2" Mar 16 13:15:03 crc kubenswrapper[5030]: I0316 13:15:03.512473 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561115-gcrwt" Mar 16 13:15:54 crc kubenswrapper[5030]: I0316 13:15:54.286767 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:15:54 crc kubenswrapper[5030]: I0316 13:15:54.287184 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:15:56 crc kubenswrapper[5030]: I0316 13:15:56.124219 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:15:56 crc kubenswrapper[5030]: I0316 13:15:56.126294 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.127691 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561116-pfq4p"] Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.129269 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81444552-4fc5-4fcb-adc8-8fd275e08e54" containerName="collect-profiles" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.129301 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="81444552-4fc5-4fcb-adc8-8fd275e08e54" containerName="collect-profiles" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.129451 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="81444552-4fc5-4fcb-adc8-8fd275e08e54" containerName="collect-profiles" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.133350 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.135325 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.135657 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561116-pfq4p"] Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.135979 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.136813 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.184609 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7j7\" (UniqueName: \"kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7\") pod \"auto-csr-approver-29561116-pfq4p\" (UID: \"fba932c8-123f-453e-9399-7ca6e740f23d\") " pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.285972 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7j7\" (UniqueName: \"kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7\") pod \"auto-csr-approver-29561116-pfq4p\" (UID: \"fba932c8-123f-453e-9399-7ca6e740f23d\") " pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.302695 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7j7\" (UniqueName: \"kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7\") pod \"auto-csr-approver-29561116-pfq4p\" (UID: \"fba932c8-123f-453e-9399-7ca6e740f23d\") " pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.450142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.599336 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561116-pfq4p"] Mar 16 13:16:00 crc kubenswrapper[5030]: I0316 13:16:00.791385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" event={"ID":"fba932c8-123f-453e-9399-7ca6e740f23d","Type":"ContainerStarted","Data":"1ea826409cded8c3877983cf7b02df837e845d85f32802f350146709be70d27c"} Mar 16 13:16:01 crc kubenswrapper[5030]: I0316 13:16:01.798859 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" event={"ID":"fba932c8-123f-453e-9399-7ca6e740f23d","Type":"ContainerStarted","Data":"07aa65a8b27ec41810fe6a9076e8717485296d490d538fcb5de56a182ee3b774"} Mar 16 13:16:01 crc kubenswrapper[5030]: I0316 13:16:01.818757 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" podStartSLOduration=0.886922456 podStartE2EDuration="1.818743367s" podCreationTimestamp="2026-03-16 13:16:00 +0000 UTC" firstStartedPulling="2026-03-16 13:16:00.602770101 +0000 UTC m=+605.002082648" lastFinishedPulling="2026-03-16 13:16:01.534591012 +0000 UTC m=+605.933903559" observedRunningTime="2026-03-16 13:16:01.817084609 +0000 UTC m=+606.216397156" watchObservedRunningTime="2026-03-16 13:16:01.818743367 +0000 UTC m=+606.218055914" Mar 16 13:16:02 crc kubenswrapper[5030]: I0316 13:16:02.804767 5030 generic.go:358] "Generic (PLEG): container finished" podID="fba932c8-123f-453e-9399-7ca6e740f23d" containerID="07aa65a8b27ec41810fe6a9076e8717485296d490d538fcb5de56a182ee3b774" exitCode=0 Mar 16 13:16:02 crc kubenswrapper[5030]: I0316 13:16:02.804876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" event={"ID":"fba932c8-123f-453e-9399-7ca6e740f23d","Type":"ContainerDied","Data":"07aa65a8b27ec41810fe6a9076e8717485296d490d538fcb5de56a182ee3b774"} Mar 16 13:16:03 crc kubenswrapper[5030]: I0316 13:16:03.970131 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.027537 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x7j7\" (UniqueName: \"kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7\") pod \"fba932c8-123f-453e-9399-7ca6e740f23d\" (UID: \"fba932c8-123f-453e-9399-7ca6e740f23d\") " Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.032985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7" (OuterVolumeSpecName: "kube-api-access-9x7j7") pod "fba932c8-123f-453e-9399-7ca6e740f23d" (UID: "fba932c8-123f-453e-9399-7ca6e740f23d"). InnerVolumeSpecName "kube-api-access-9x7j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.129256 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x7j7\" (UniqueName: \"kubernetes.io/projected/fba932c8-123f-453e-9399-7ca6e740f23d-kube-api-access-9x7j7\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.817727 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.817721 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561116-pfq4p" event={"ID":"fba932c8-123f-453e-9399-7ca6e740f23d","Type":"ContainerDied","Data":"1ea826409cded8c3877983cf7b02df837e845d85f32802f350146709be70d27c"} Mar 16 13:16:04 crc kubenswrapper[5030]: I0316 13:16:04.818330 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ea826409cded8c3877983cf7b02df837e845d85f32802f350146709be70d27c" Mar 16 13:16:05 crc kubenswrapper[5030]: I0316 13:16:05.017220 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561110-wlz2f"] Mar 16 13:16:05 crc kubenswrapper[5030]: I0316 13:16:05.020965 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561110-wlz2f"] Mar 16 13:16:05 crc kubenswrapper[5030]: I0316 13:16:05.951402 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8436014c-172c-48c6-80c1-29872ac193a2" path="/var/lib/kubelet/pods/8436014c-172c-48c6-80c1-29872ac193a2/volumes" Mar 16 13:16:24 crc kubenswrapper[5030]: I0316 13:16:24.286611 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:16:24 crc kubenswrapper[5030]: I0316 13:16:24.287343 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.234267 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c"] Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.235067 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="kube-rbac-proxy" containerID="cri-o://56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.235080 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="ovnkube-cluster-manager" containerID="cri-o://9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.404718 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.432497 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9"] Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.432986 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="kube-rbac-proxy" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433004 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="kube-rbac-proxy" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433019 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba932c8-123f-453e-9399-7ca6e740f23d" containerName="oc" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433024 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba932c8-123f-453e-9399-7ca6e740f23d" containerName="oc" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433036 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="ovnkube-cluster-manager" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433040 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="ovnkube-cluster-manager" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433121 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="kube-rbac-proxy" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433130 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fba932c8-123f-453e-9399-7ca6e740f23d" containerName="oc" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.433141 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerName="ovnkube-cluster-manager" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.435627 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.453280 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-s9mkc"] Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454543 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="nbdb" containerID="cri-o://3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454631 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-node" containerID="cri-o://7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454654 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-ovn-metrics" containerID="cri-o://e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454701 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="sbdb" containerID="cri-o://754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454778 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="northd" containerID="cri-o://a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454673 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-acl-logging" containerID="cri-o://652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.454836 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-controller" containerID="cri-o://99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.474818 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovnkube-controller" containerID="cri-o://4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" gracePeriod=30 Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.505859 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides\") pod \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.505920 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config\") pod \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506126 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klzfx\" (UniqueName: \"kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx\") pod \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506161 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert\") pod \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\" (UID: \"de3e8bdc-a01d-4a4e-8f3a-0e82826daace\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506442 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-552zj\" (UniqueName: \"kubernetes.io/projected/1ae0afcc-e6c1-4d93-acac-018eb69522d1-kube-api-access-552zj\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506485 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "de3e8bdc-a01d-4a4e-8f3a-0e82826daace" (UID: "de3e8bdc-a01d-4a4e-8f3a-0e82826daace"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506566 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "de3e8bdc-a01d-4a4e-8f3a-0e82826daace" (UID: "de3e8bdc-a01d-4a4e-8f3a-0e82826daace"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506599 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506645 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506695 5030 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.506711 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.515592 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx" (OuterVolumeSpecName: "kube-api-access-klzfx") pod "de3e8bdc-a01d-4a4e-8f3a-0e82826daace" (UID: "de3e8bdc-a01d-4a4e-8f3a-0e82826daace"). InnerVolumeSpecName "kube-api-access-klzfx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.515662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert" (OuterVolumeSpecName: "ovn-control-plane-metrics-cert") pod "de3e8bdc-a01d-4a4e-8f3a-0e82826daace" (UID: "de3e8bdc-a01d-4a4e-8f3a-0e82826daace"). InnerVolumeSpecName "ovn-control-plane-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608650 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-552zj\" (UniqueName: \"kubernetes.io/projected/1ae0afcc-e6c1-4d93-acac-018eb69522d1-kube-api-access-552zj\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608705 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klzfx\" (UniqueName: \"kubernetes.io/projected/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-kube-api-access-klzfx\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.608716 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3e8bdc-a01d-4a4e-8f3a-0e82826daace-ovn-control-plane-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.609084 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovnkube-config\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.609611 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ae0afcc-e6c1-4d93-acac-018eb69522d1-env-overrides\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.613872 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-control-plane-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ae0afcc-e6c1-4d93-acac-018eb69522d1-ovn-control-plane-metrics-cert\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.623000 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-552zj\" (UniqueName: \"kubernetes.io/projected/1ae0afcc-e6c1-4d93-acac-018eb69522d1-kube-api-access-552zj\") pod \"ovnkube-control-plane-97c9b6c48-dbhz9\" (UID: \"1ae0afcc-e6c1-4d93-acac-018eb69522d1\") " pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.699123 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mkc_92122bee-3681-4341-b3d4-f23c56fb9a6d/ovn-acl-logging/0.log" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.699841 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mkc_92122bee-3681-4341-b3d4-f23c56fb9a6d/ovn-controller/0.log" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.700216 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710243 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710325 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch" (OuterVolumeSpecName: "run-openvswitch") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "run-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710452 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log" (OuterVolumeSpecName: "node-log") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "node-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710525 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd" (OuterVolumeSpecName: "host-cni-netd") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-cni-netd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710592 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet" (OuterVolumeSpecName: "host-kubelet") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-kubelet". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710626 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710681 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs95x\" (UniqueName: \"kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710719 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710763 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash" (OuterVolumeSpecName: "host-slash") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-slash". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710810 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710920 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes" (OuterVolumeSpecName: "host-run-ovn-kubernetes") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-run-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710928 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes" (OuterVolumeSpecName: "host-var-lib-cni-networks-ovn-kubernetes") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-var-lib-cni-networks-ovn-kubernetes". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.710991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711065 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711135 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711172 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711187 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns" (OuterVolumeSpecName: "host-run-netns") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-run-netns". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711199 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711230 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket" (OuterVolumeSpecName: "log-socket") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "log-socket". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711154 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch" (OuterVolumeSpecName: "var-lib-openvswitch") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "var-lib-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711300 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units" (OuterVolumeSpecName: "systemd-units") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "systemd-units". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711332 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin" (OuterVolumeSpecName: "host-cni-bin") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "host-cni-bin". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch\") pod \"92122bee-3681-4341-b3d4-f23c56fb9a6d\" (UID: \"92122bee-3681-4341-b3d4-f23c56fb9a6d\") " Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn" (OuterVolumeSpecName: "run-ovn") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711406 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch" (OuterVolumeSpecName: "etc-openvswitch") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "etc-openvswitch". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711445 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides" (OuterVolumeSpecName: "env-overrides") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "env-overrides". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711750 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib" (OuterVolumeSpecName: "ovnkube-script-lib") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "ovnkube-script-lib". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.711923 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config" (OuterVolumeSpecName: "ovnkube-config") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "ovnkube-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712131 5030 reconciler_common.go:299] "Volume detached for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712148 5030 reconciler_common.go:299] "Volume detached for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-node-log\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712157 5030 reconciler_common.go:299] "Volume detached for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-kubelet\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712166 5030 reconciler_common.go:299] "Volume detached for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-netd\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712175 5030 reconciler_common.go:299] "Volume detached for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-slash\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712186 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-script-lib\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712229 5030 reconciler_common.go:299] "Volume detached for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712247 5030 reconciler_common.go:299] "Volume detached for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-var-lib-cni-networks-ovn-kubernetes\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712257 5030 reconciler_common.go:299] "Volume detached for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-env-overrides\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712267 5030 reconciler_common.go:299] "Volume detached for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-var-lib-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712275 5030 reconciler_common.go:299] "Volume detached for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-run-netns\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712283 5030 reconciler_common.go:299] "Volume detached for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-log-socket\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712291 5030 reconciler_common.go:299] "Volume detached for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovnkube-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712299 5030 reconciler_common.go:299] "Volume detached for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-host-cni-bin\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712307 5030 reconciler_common.go:299] "Volume detached for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-systemd-units\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712316 5030 reconciler_common.go:299] "Volume detached for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.712324 5030 reconciler_common.go:299] "Volume detached for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-etc-openvswitch\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.714335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert" (OuterVolumeSpecName: "ovn-node-metrics-cert") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "ovn-node-metrics-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.715558 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x" (OuterVolumeSpecName: "kube-api-access-xs95x") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "kube-api-access-xs95x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.722512 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd" (OuterVolumeSpecName: "run-systemd") pod "92122bee-3681-4341-b3d4-f23c56fb9a6d" (UID: "92122bee-3681-4341-b3d4-f23c56fb9a6d"). InnerVolumeSpecName "run-systemd". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.746588 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-6vmkd"] Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747163 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-node" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747185 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-node" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747205 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747212 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="northd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="northd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747235 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kubecfg-setup" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747242 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kubecfg-setup" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747254 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-acl-logging" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747261 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-acl-logging" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747268 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="sbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747274 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="sbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747294 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747300 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747307 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="nbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747313 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="nbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747324 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovnkube-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747330 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovnkube-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747442 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovnkube-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747451 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-ovn-metrics" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747460 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="kube-rbac-proxy-node" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747471 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="nbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747478 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="sbdb" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747485 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-controller" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747493 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="northd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.747501 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerName="ovn-acl-logging" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.751115 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.751454 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-systemd-units\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814101 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-env-overrides\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814128 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-netd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814153 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-node-log\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814206 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64f58b37-ffa8-4355-a882-8c3f157e094c-ovn-node-metrics-cert\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814345 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-config\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814391 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-netns\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814439 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-script-lib\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814506 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p924d\" (UniqueName: \"kubernetes.io/projected/64f58b37-ffa8-4355-a882-8c3f157e094c-kube-api-access-p924d\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814755 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-systemd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-slash\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814831 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-var-lib-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814857 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-etc-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.814973 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-bin\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.815808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-kubelet\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.815859 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-log-socket\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.815909 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-ovn\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.815933 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.816061 5030 reconciler_common.go:299] "Volume detached for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92122bee-3681-4341-b3d4-f23c56fb9a6d-run-systemd\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.816077 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92122bee-3681-4341-b3d4-f23c56fb9a6d-ovn-node-metrics-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.816088 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs95x\" (UniqueName: \"kubernetes.io/projected/92122bee-3681-4341-b3d4-f23c56fb9a6d-kube-api-access-xs95x\") on node \"crc\" DevicePath \"\"" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917197 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-kubelet\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-log-socket\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917282 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-ovn\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-systemd-units\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917349 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-env-overrides\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-netd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917390 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917410 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-node-log\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917427 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64f58b37-ffa8-4355-a882-8c3f157e094c-ovn-node-metrics-cert\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-config\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917470 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-netns\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917495 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917513 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-script-lib\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917537 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p924d\" (UniqueName: \"kubernetes.io/projected/64f58b37-ffa8-4355-a882-8c3f157e094c-kube-api-access-p924d\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917582 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-systemd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-slash\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-var-lib-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917649 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-etc-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-bin\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917774 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-bin\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917826 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-kubelet\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-log-socket\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917877 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-ovn\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917899 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917925 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-slash\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917964 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-run-netns\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.917977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-systemd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-var-lib-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-systemd-units\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918134 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-node-log\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-host-cni-netd\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918198 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-run-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918632 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/64f58b37-ffa8-4355-a882-8c3f157e094c-etc-openvswitch\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918690 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-script-lib\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.918840 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-ovnkube-config\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.919324 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/64f58b37-ffa8-4355-a882-8c3f157e094c-env-overrides\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.922237 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/64f58b37-ffa8-4355-a882-8c3f157e094c-ovn-node-metrics-cert\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:52 crc kubenswrapper[5030]: I0316 13:16:52.932403 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p924d\" (UniqueName: \"kubernetes.io/projected/64f58b37-ffa8-4355-a882-8c3f157e094c-kube-api-access-p924d\") pod \"ovnkube-node-6vmkd\" (UID: \"64f58b37-ffa8-4355-a882-8c3f157e094c\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.064561 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:53 crc kubenswrapper[5030]: W0316 13:16:53.084640 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f58b37_ffa8_4355_a882_8c3f157e094c.slice/crio-9bc1029c2a04408a9062b56fa0e5f04b74a8fee715677653e9f37ab82fa2f360 WatchSource:0}: Error finding container 9bc1029c2a04408a9062b56fa0e5f04b74a8fee715677653e9f37ab82fa2f360: Status 404 returned error can't find the container with id 9bc1029c2a04408a9062b56fa0e5f04b74a8fee715677653e9f37ab82fa2f360 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.092707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"9bc1029c2a04408a9062b56fa0e5f04b74a8fee715677653e9f37ab82fa2f360"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.094475 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" event={"ID":"1ae0afcc-e6c1-4d93-acac-018eb69522d1","Type":"ContainerStarted","Data":"53fc657fdcc1fe0745dbd7bd737bfdd04266545ec92258ecda8d368b17a9bd69"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.094514 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" event={"ID":"1ae0afcc-e6c1-4d93-acac-018eb69522d1","Type":"ContainerStarted","Data":"be3ef47dce752368e902e031a5a7488296e39444fc94e171aa7fc418f4c519ed"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.094525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" event={"ID":"1ae0afcc-e6c1-4d93-acac-018eb69522d1","Type":"ContainerStarted","Data":"995a9a46e941c4f75173a9104fd62a147ea9e778ac9c670340632068cf84915f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.096888 5030 generic.go:358] "Generic (PLEG): container finished" podID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerID="9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.096910 5030 generic.go:358] "Generic (PLEG): container finished" podID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" containerID="56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.097037 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerDied","Data":"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.097060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerDied","Data":"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.097071 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" event={"ID":"de3e8bdc-a01d-4a4e-8f3a-0e82826daace","Type":"ContainerDied","Data":"d21aca5e4ad97f7b7d01349ee1470ae0fd67ffddca410ec1549d5ae6fbcf03be"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.097087 5030 scope.go:117] "RemoveContainer" containerID="9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.097270 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.106444 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mkc_92122bee-3681-4341-b3d4-f23c56fb9a6d/ovn-acl-logging/0.log" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.106811 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s9mkc_92122bee-3681-4341-b3d4-f23c56fb9a6d/ovn-controller/0.log" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107036 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107047 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107052 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107060 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107065 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107069 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" exitCode=0 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107075 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" exitCode=143 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107080 5030 generic.go:358] "Generic (PLEG): container finished" podID="92122bee-3681-4341-b3d4-f23c56fb9a6d" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" exitCode=143 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107164 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107181 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107198 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107216 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107238 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107248 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107256 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107261 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107266 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107271 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107275 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107280 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107285 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107289 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107296 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107302 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107309 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107314 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107317 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107322 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107327 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107331 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107335 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107340 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107346 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107498 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107507 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107535 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107540 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107557 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107563 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107567 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107570 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107577 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107581 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s9mkc" event={"ID":"92122bee-3681-4341-b3d4-f23c56fb9a6d","Type":"ContainerDied","Data":"c4b1837df76c6a42c84bf8b8f86cb1d7b4a7f8ac0256d844c0ce1c060b131f0e"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107599 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107606 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107610 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107614 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107619 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107623 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107627 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107751 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.107758 5030 pod_container_deletor.go:114] "Failed to issue the request to remove container" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.108797 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.108836 5030 generic.go:358] "Generic (PLEG): container finished" podID="9c20ed32-4ad5-4984-9876-39b7b1ee1877" containerID="7fd0ae08df8136e826c22242fcc455535fef29ba9eeab95e5c9aad2fdae70382" exitCode=2 Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.108863 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfwbx" event={"ID":"9c20ed32-4ad5-4984-9876-39b7b1ee1877","Type":"ContainerDied","Data":"7fd0ae08df8136e826c22242fcc455535fef29ba9eeab95e5c9aad2fdae70382"} Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.109374 5030 scope.go:117] "RemoveContainer" containerID="7fd0ae08df8136e826c22242fcc455535fef29ba9eeab95e5c9aad2fdae70382" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.115439 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-control-plane-97c9b6c48-dbhz9" podStartSLOduration=1.115421022 podStartE2EDuration="1.115421022s" podCreationTimestamp="2026-03-16 13:16:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:16:53.114382053 +0000 UTC m=+657.513694589" watchObservedRunningTime="2026-03-16 13:16:53.115421022 +0000 UTC m=+657.514733570" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.123443 5030 scope.go:117] "RemoveContainer" containerID="56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.150926 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c"] Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.152457 5030 scope.go:117] "RemoveContainer" containerID="9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.153529 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1\": container with ID starting with 9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1 not found: ID does not exist" containerID="9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.153577 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-control-plane-57b78d8988-8ch6c"] Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.153593 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1"} err="failed to get container status \"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1\": rpc error: code = NotFound desc = could not find container \"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1\": container with ID starting with 9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.153621 5030 scope.go:117] "RemoveContainer" containerID="56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.156193 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48\": container with ID starting with 56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48 not found: ID does not exist" containerID="56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.156254 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48"} err="failed to get container status \"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48\": rpc error: code = NotFound desc = could not find container \"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48\": container with ID starting with 56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.156286 5030 scope.go:117] "RemoveContainer" containerID="9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.156742 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1"} err="failed to get container status \"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1\": rpc error: code = NotFound desc = could not find container \"9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1\": container with ID starting with 9e6b6ebaf466377a0826d8a924b142f29dfc6f7d7cd2e1b336a7aae2db54a4d1 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.156764 5030 scope.go:117] "RemoveContainer" containerID="56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.160599 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48"} err="failed to get container status \"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48\": rpc error: code = NotFound desc = could not find container \"56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48\": container with ID starting with 56cd5d0bd5e2d47d732e924966c29259a6a116fd1842a17e3fcfaf7f292bbe48 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.160719 5030 scope.go:117] "RemoveContainer" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.165497 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-s9mkc"] Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.172390 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-s9mkc"] Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.193049 5030 scope.go:117] "RemoveContainer" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.259809 5030 scope.go:117] "RemoveContainer" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.274729 5030 scope.go:117] "RemoveContainer" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.285473 5030 scope.go:117] "RemoveContainer" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.295226 5030 scope.go:117] "RemoveContainer" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.305255 5030 scope.go:117] "RemoveContainer" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.315456 5030 scope.go:117] "RemoveContainer" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.325343 5030 scope.go:117] "RemoveContainer" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.337475 5030 scope.go:117] "RemoveContainer" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.337759 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": container with ID starting with 4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650 not found: ID does not exist" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.337796 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} err="failed to get container status \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": rpc error: code = NotFound desc = could not find container \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": container with ID starting with 4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.337820 5030 scope.go:117] "RemoveContainer" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.338094 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": container with ID starting with 754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696 not found: ID does not exist" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338113 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} err="failed to get container status \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": rpc error: code = NotFound desc = could not find container \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": container with ID starting with 754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338125 5030 scope.go:117] "RemoveContainer" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.338353 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": container with ID starting with 3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f not found: ID does not exist" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338378 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} err="failed to get container status \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": rpc error: code = NotFound desc = could not find container \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": container with ID starting with 3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338392 5030 scope.go:117] "RemoveContainer" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.338675 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": container with ID starting with a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441 not found: ID does not exist" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338703 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} err="failed to get container status \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": rpc error: code = NotFound desc = could not find container \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": container with ID starting with a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338721 5030 scope.go:117] "RemoveContainer" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.338938 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": container with ID starting with e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a not found: ID does not exist" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338961 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} err="failed to get container status \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": rpc error: code = NotFound desc = could not find container \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": container with ID starting with e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.338975 5030 scope.go:117] "RemoveContainer" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.339161 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": container with ID starting with 7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c not found: ID does not exist" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.339185 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} err="failed to get container status \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": rpc error: code = NotFound desc = could not find container \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": container with ID starting with 7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.339201 5030 scope.go:117] "RemoveContainer" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.339691 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": container with ID starting with 652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418 not found: ID does not exist" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.339714 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} err="failed to get container status \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": rpc error: code = NotFound desc = could not find container \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": container with ID starting with 652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.339728 5030 scope.go:117] "RemoveContainer" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.339984 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": container with ID starting with 99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd not found: ID does not exist" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340004 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} err="failed to get container status \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": rpc error: code = NotFound desc = could not find container \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": container with ID starting with 99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340017 5030 scope.go:117] "RemoveContainer" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: E0316 13:16:53.340249 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": container with ID starting with 941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8 not found: ID does not exist" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340273 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} err="failed to get container status \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": rpc error: code = NotFound desc = could not find container \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": container with ID starting with 941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340286 5030 scope.go:117] "RemoveContainer" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340506 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} err="failed to get container status \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": rpc error: code = NotFound desc = could not find container \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": container with ID starting with 4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340526 5030 scope.go:117] "RemoveContainer" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340805 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} err="failed to get container status \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": rpc error: code = NotFound desc = could not find container \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": container with ID starting with 754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.340822 5030 scope.go:117] "RemoveContainer" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341027 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} err="failed to get container status \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": rpc error: code = NotFound desc = could not find container \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": container with ID starting with 3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341047 5030 scope.go:117] "RemoveContainer" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341286 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} err="failed to get container status \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": rpc error: code = NotFound desc = could not find container \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": container with ID starting with a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341303 5030 scope.go:117] "RemoveContainer" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341516 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} err="failed to get container status \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": rpc error: code = NotFound desc = could not find container \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": container with ID starting with e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341533 5030 scope.go:117] "RemoveContainer" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341724 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} err="failed to get container status \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": rpc error: code = NotFound desc = could not find container \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": container with ID starting with 7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341741 5030 scope.go:117] "RemoveContainer" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341950 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} err="failed to get container status \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": rpc error: code = NotFound desc = could not find container \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": container with ID starting with 652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.341985 5030 scope.go:117] "RemoveContainer" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342157 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} err="failed to get container status \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": rpc error: code = NotFound desc = could not find container \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": container with ID starting with 99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342174 5030 scope.go:117] "RemoveContainer" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342434 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} err="failed to get container status \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": rpc error: code = NotFound desc = could not find container \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": container with ID starting with 941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342452 5030 scope.go:117] "RemoveContainer" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342635 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} err="failed to get container status \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": rpc error: code = NotFound desc = could not find container \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": container with ID starting with 4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342654 5030 scope.go:117] "RemoveContainer" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342841 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} err="failed to get container status \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": rpc error: code = NotFound desc = could not find container \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": container with ID starting with 754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.342858 5030 scope.go:117] "RemoveContainer" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343014 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} err="failed to get container status \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": rpc error: code = NotFound desc = could not find container \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": container with ID starting with 3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343031 5030 scope.go:117] "RemoveContainer" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343179 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} err="failed to get container status \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": rpc error: code = NotFound desc = could not find container \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": container with ID starting with a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343195 5030 scope.go:117] "RemoveContainer" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343380 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} err="failed to get container status \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": rpc error: code = NotFound desc = could not find container \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": container with ID starting with e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343396 5030 scope.go:117] "RemoveContainer" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343592 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} err="failed to get container status \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": rpc error: code = NotFound desc = could not find container \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": container with ID starting with 7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343608 5030 scope.go:117] "RemoveContainer" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343767 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} err="failed to get container status \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": rpc error: code = NotFound desc = could not find container \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": container with ID starting with 652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343782 5030 scope.go:117] "RemoveContainer" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343929 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} err="failed to get container status \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": rpc error: code = NotFound desc = could not find container \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": container with ID starting with 99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.343947 5030 scope.go:117] "RemoveContainer" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344094 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} err="failed to get container status \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": rpc error: code = NotFound desc = could not find container \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": container with ID starting with 941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344109 5030 scope.go:117] "RemoveContainer" containerID="4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344270 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650"} err="failed to get container status \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": rpc error: code = NotFound desc = could not find container \"4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650\": container with ID starting with 4e0fd48217baa07f94fe5e7905737339eb702d616e811d13842db19d21f1e650 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344286 5030 scope.go:117] "RemoveContainer" containerID="754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344428 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696"} err="failed to get container status \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": rpc error: code = NotFound desc = could not find container \"754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696\": container with ID starting with 754da30f467488f99addfc630df8705b72de208f975aac2d863ccfe7a3282696 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344445 5030 scope.go:117] "RemoveContainer" containerID="3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344696 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f"} err="failed to get container status \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": rpc error: code = NotFound desc = could not find container \"3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f\": container with ID starting with 3483bce95aab2ca03b2dc352505fadecbadc925e53bf7cc912760e768011ae8f not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344714 5030 scope.go:117] "RemoveContainer" containerID="a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344898 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441"} err="failed to get container status \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": rpc error: code = NotFound desc = could not find container \"a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441\": container with ID starting with a974c2c7087b467dc08014cc215f352ed3cccbe1141762c45553785a0f540441 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.344916 5030 scope.go:117] "RemoveContainer" containerID="e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345177 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a"} err="failed to get container status \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": rpc error: code = NotFound desc = could not find container \"e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a\": container with ID starting with e1d88efc96e792cc4c95998a548e77a0e461ed4eab06598d3bf998cb94bd830a not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345193 5030 scope.go:117] "RemoveContainer" containerID="7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345491 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c"} err="failed to get container status \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": rpc error: code = NotFound desc = could not find container \"7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c\": container with ID starting with 7d3bfe3728b008ed74fcdb29a0ad82b7bbdb88d56055d1df853d4c9fd1a07b3c not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345508 5030 scope.go:117] "RemoveContainer" containerID="652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345706 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418"} err="failed to get container status \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": rpc error: code = NotFound desc = could not find container \"652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418\": container with ID starting with 652c45527d2b186955a1ddb28e6a78c8293ab830a7f123644b69825465bbd418 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345722 5030 scope.go:117] "RemoveContainer" containerID="99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345901 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd"} err="failed to get container status \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": rpc error: code = NotFound desc = could not find container \"99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd\": container with ID starting with 99fb3697958307d5aac8a6119454376ef32b8b551e35582b4d591673aeeb41dd not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.345918 5030 scope.go:117] "RemoveContainer" containerID="941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.346103 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8"} err="failed to get container status \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": rpc error: code = NotFound desc = could not find container \"941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8\": container with ID starting with 941e9cab8aa415e59e730e0c4b487f105bbfeee7f8065c2fb592a452650b32d8 not found: ID does not exist" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.955212 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92122bee-3681-4341-b3d4-f23c56fb9a6d" path="/var/lib/kubelet/pods/92122bee-3681-4341-b3d4-f23c56fb9a6d/volumes" Mar 16 13:16:53 crc kubenswrapper[5030]: I0316 13:16:53.956599 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3e8bdc-a01d-4a4e-8f3a-0e82826daace" path="/var/lib/kubelet/pods/de3e8bdc-a01d-4a4e-8f3a-0e82826daace/volumes" Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.116813 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.116970 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfwbx" event={"ID":"9c20ed32-4ad5-4984-9876-39b7b1ee1877","Type":"ContainerStarted","Data":"1775fb3fbbc43ef267d7f525a317d942cf6edc4b82c6156a6c00019e2168d6a8"} Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.119054 5030 generic.go:358] "Generic (PLEG): container finished" podID="64f58b37-ffa8-4355-a882-8c3f157e094c" containerID="0c0c70185bf065ddc9ae68a4b034aaeba98bf7c51761a33fef227b5f90c7aebc" exitCode=0 Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.119234 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerDied","Data":"0c0c70185bf065ddc9ae68a4b034aaeba98bf7c51761a33fef227b5f90c7aebc"} Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.287415 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.287697 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.287753 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.288338 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:16:54 crc kubenswrapper[5030]: I0316 13:16:54.288404 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144" gracePeriod=600 Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.131670 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"5c7823e5d99997db3b9525aae1be2ebb2279d9b17bb69ad2120a36c4ef2c3320"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.132093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"843d4188bf0cc11a18abadd255397a01befbf8d22f5399d42b2fda500d1b4c5b"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.132108 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"37963a7df324ca70456c9c83887ae14e015cfad77791a6a0d14720836d97ec0e"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.132117 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"a39655fe3207f655b8deed4be763de05215e00ea801fdac14a58382396a5045e"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.132129 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"58e368f09473b207c5fd05f1eac6d5e57bd3a6db637feeacf7d92feabba49e26"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.132140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"1d43279106dd2fb7ec4861c765e15287b0656bc63f49f1682c47edea0d8954cf"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.134357 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144" exitCode=0 Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.134433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.134477 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d"} Mar 16 13:16:55 crc kubenswrapper[5030]: I0316 13:16:55.134498 5030 scope.go:117] "RemoveContainer" containerID="e5035d7de87767dcacf86207f61e77a757c441b7d5d3a4a0ab0611436bc17150" Mar 16 13:16:56 crc kubenswrapper[5030]: I0316 13:16:56.271195 5030 scope.go:117] "RemoveContainer" containerID="acc68fd911747ba8c16214669f8d531f92d4be37032aa8611f1b9b904fd11043" Mar 16 13:16:56 crc kubenswrapper[5030]: I0316 13:16:56.838927 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:16:57 crc kubenswrapper[5030]: I0316 13:16:57.152824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"57d38248e54708ba3bcfcf0eefd8ade02bef39a4510f07bb25193ceb9bdce07e"} Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.170369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" event={"ID":"64f58b37-ffa8-4355-a882-8c3f157e094c","Type":"ContainerStarted","Data":"fadab7817935d94df4d53c69aa7f0e8826f3a22e749eea6d07e8ff58525ad332"} Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.170844 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.170887 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.170936 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.193449 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" podStartSLOduration=7.193431545 podStartE2EDuration="7.193431545s" podCreationTimestamp="2026-03-16 13:16:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:16:59.192351898 +0000 UTC m=+663.591664445" watchObservedRunningTime="2026-03-16 13:16:59.193431545 +0000 UTC m=+663.592744093" Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.197843 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:16:59 crc kubenswrapper[5030]: I0316 13:16:59.198740 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:17:20 crc kubenswrapper[5030]: I0316 13:17:20.866826 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-5w7c9"] Mar 16 13:17:20 crc kubenswrapper[5030]: I0316 13:17:20.870590 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:20 crc kubenswrapper[5030]: I0316 13:17:20.880021 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-5w7c9"] Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047447 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-registry-tls\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047518 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-trusted-ca\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047567 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047593 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7581752e-b356-42ed-b535-118a73ede87c-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7581752e-b356-42ed-b535-118a73ede87c-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047679 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjzw\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-kube-api-access-7vjzw\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047697 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-registry-certificates\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.047712 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-bound-sa-token\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.069506 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7581752e-b356-42ed-b535-118a73ede87c-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149446 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjzw\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-kube-api-access-7vjzw\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-registry-certificates\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149651 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-bound-sa-token\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-registry-tls\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149867 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-trusted-ca\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.149909 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7581752e-b356-42ed-b535-118a73ede87c-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.150733 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-registry-certificates\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.150951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7581752e-b356-42ed-b535-118a73ede87c-ca-trust-extracted\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.151049 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7581752e-b356-42ed-b535-118a73ede87c-trusted-ca\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.156699 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-registry-tls\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.162589 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7581752e-b356-42ed-b535-118a73ede87c-installation-pull-secrets\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.165207 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjzw\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-kube-api-access-7vjzw\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.166393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7581752e-b356-42ed-b535-118a73ede87c-bound-sa-token\") pod \"image-registry-5d9d95bf5b-5w7c9\" (UID: \"7581752e-b356-42ed-b535-118a73ede87c\") " pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.185480 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:21 crc kubenswrapper[5030]: I0316 13:17:21.369687 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9d95bf5b-5w7c9"] Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.057737 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k"] Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.063500 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.065891 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.074130 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k"] Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.160675 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.160952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6p5r\" (UniqueName: \"kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.161020 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.263000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.263058 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.263104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6p5r\" (UniqueName: \"kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.263845 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.263965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.281711 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6p5r\" (UniqueName: \"kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r\") pod \"d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.310374 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" event={"ID":"7581752e-b356-42ed-b535-118a73ede87c","Type":"ContainerStarted","Data":"add18c3406d6690e78a2b80f0dee1d88482fc5a56e70fe7a215fcdbcd138ac2c"} Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.310419 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" event={"ID":"7581752e-b356-42ed-b535-118a73ede87c","Type":"ContainerStarted","Data":"d2b0ca2fa559bd598fab2cbd1ad3b0bea7d3145919bfde36d75e54aac95e8470"} Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.310528 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.327779 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" podStartSLOduration=2.327763336 podStartE2EDuration="2.327763336s" podCreationTimestamp="2026-03-16 13:17:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:17:22.326022868 +0000 UTC m=+686.725335415" watchObservedRunningTime="2026-03-16 13:17:22.327763336 +0000 UTC m=+686.727075883" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.386798 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:22 crc kubenswrapper[5030]: I0316 13:17:22.742091 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k"] Mar 16 13:17:23 crc kubenswrapper[5030]: I0316 13:17:23.318569 5030 generic.go:358] "Generic (PLEG): container finished" podID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerID="2e0df977dccb2992c212b797c145b2b013320582131928bd7868ebd6bcc2a099" exitCode=0 Mar 16 13:17:23 crc kubenswrapper[5030]: I0316 13:17:23.318697 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" event={"ID":"e389f96d-d6e4-4211-86ff-1e439988c87d","Type":"ContainerDied","Data":"2e0df977dccb2992c212b797c145b2b013320582131928bd7868ebd6bcc2a099"} Mar 16 13:17:23 crc kubenswrapper[5030]: I0316 13:17:23.318782 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" event={"ID":"e389f96d-d6e4-4211-86ff-1e439988c87d","Type":"ContainerStarted","Data":"fe22216476bc6f3696dd8f68a0d87d1c05fe9d9ff76e3902a5a38a28b55c617e"} Mar 16 13:17:26 crc kubenswrapper[5030]: I0316 13:17:26.341162 5030 generic.go:358] "Generic (PLEG): container finished" podID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerID="017cb625cbb504ed78ea3a57527885871cd479243a634de097d8a73ff22727e1" exitCode=0 Mar 16 13:17:26 crc kubenswrapper[5030]: I0316 13:17:26.341469 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" event={"ID":"e389f96d-d6e4-4211-86ff-1e439988c87d","Type":"ContainerDied","Data":"017cb625cbb504ed78ea3a57527885871cd479243a634de097d8a73ff22727e1"} Mar 16 13:17:27 crc kubenswrapper[5030]: I0316 13:17:27.349282 5030 generic.go:358] "Generic (PLEG): container finished" podID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerID="a145a2d114660ef47c45764663469ffcae87dcf3565b62bd425201ca46b60a25" exitCode=0 Mar 16 13:17:27 crc kubenswrapper[5030]: I0316 13:17:27.349367 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" event={"ID":"e389f96d-d6e4-4211-86ff-1e439988c87d","Type":"ContainerDied","Data":"a145a2d114660ef47c45764663469ffcae87dcf3565b62bd425201ca46b60a25"} Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.563273 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.673712 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle\") pod \"e389f96d-d6e4-4211-86ff-1e439988c87d\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.673790 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6p5r\" (UniqueName: \"kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r\") pod \"e389f96d-d6e4-4211-86ff-1e439988c87d\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.673812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util\") pod \"e389f96d-d6e4-4211-86ff-1e439988c87d\" (UID: \"e389f96d-d6e4-4211-86ff-1e439988c87d\") " Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.674815 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle" (OuterVolumeSpecName: "bundle") pod "e389f96d-d6e4-4211-86ff-1e439988c87d" (UID: "e389f96d-d6e4-4211-86ff-1e439988c87d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.680079 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r" (OuterVolumeSpecName: "kube-api-access-g6p5r") pod "e389f96d-d6e4-4211-86ff-1e439988c87d" (UID: "e389f96d-d6e4-4211-86ff-1e439988c87d"). InnerVolumeSpecName "kube-api-access-g6p5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.681230 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util" (OuterVolumeSpecName: "util") pod "e389f96d-d6e4-4211-86ff-1e439988c87d" (UID: "e389f96d-d6e4-4211-86ff-1e439988c87d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.775808 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.775832 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6p5r\" (UniqueName: \"kubernetes.io/projected/e389f96d-d6e4-4211-86ff-1e439988c87d-kube-api-access-g6p5r\") on node \"crc\" DevicePath \"\"" Mar 16 13:17:28 crc kubenswrapper[5030]: I0316 13:17:28.775847 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e389f96d-d6e4-4211-86ff-1e439988c87d-util\") on node \"crc\" DevicePath \"\"" Mar 16 13:17:29 crc kubenswrapper[5030]: I0316 13:17:29.366239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" event={"ID":"e389f96d-d6e4-4211-86ff-1e439988c87d","Type":"ContainerDied","Data":"fe22216476bc6f3696dd8f68a0d87d1c05fe9d9ff76e3902a5a38a28b55c617e"} Mar 16 13:17:29 crc kubenswrapper[5030]: I0316 13:17:29.366286 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe22216476bc6f3696dd8f68a0d87d1c05fe9d9ff76e3902a5a38a28b55c617e" Mar 16 13:17:29 crc kubenswrapper[5030]: I0316 13:17:29.366373 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k" Mar 16 13:17:31 crc kubenswrapper[5030]: I0316 13:17:31.204770 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vmkd" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363194 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc"] Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363737 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="extract" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363749 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="extract" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363765 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="util" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363770 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="util" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363791 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="pull" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363796 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="pull" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.363872 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e389f96d-d6e4-4211-86ff-1e439988c87d" containerName="extract" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.367312 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.369046 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"nmstate-operator-dockercfg-86pnh\"" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.369171 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"openshift-service-ca.crt\"" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.369188 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"kube-root-ca.crt\"" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.373670 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc"] Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.440532 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjkm\" (UniqueName: \"kubernetes.io/projected/60db2621-32fa-4111-9b59-ba60756ca410-kube-api-access-zpjkm\") pod \"nmstate-operator-54b58fcbc5-57jgc\" (UID: \"60db2621-32fa-4111-9b59-ba60756ca410\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.542601 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjkm\" (UniqueName: \"kubernetes.io/projected/60db2621-32fa-4111-9b59-ba60756ca410-kube-api-access-zpjkm\") pod \"nmstate-operator-54b58fcbc5-57jgc\" (UID: \"60db2621-32fa-4111-9b59-ba60756ca410\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.559695 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjkm\" (UniqueName: \"kubernetes.io/projected/60db2621-32fa-4111-9b59-ba60756ca410-kube-api-access-zpjkm\") pod \"nmstate-operator-54b58fcbc5-57jgc\" (UID: \"60db2621-32fa-4111-9b59-ba60756ca410\") " pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.679474 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:33 crc kubenswrapper[5030]: I0316 13:17:33.858628 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc"] Mar 16 13:17:34 crc kubenswrapper[5030]: I0316 13:17:34.393627 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" event={"ID":"60db2621-32fa-4111-9b59-ba60756ca410","Type":"ContainerStarted","Data":"4cfa4a2f5f181af84ab6956b42cd1636e2aa23436caf004a906270db7e87cdc6"} Mar 16 13:17:40 crc kubenswrapper[5030]: I0316 13:17:40.432009 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" event={"ID":"60db2621-32fa-4111-9b59-ba60756ca410","Type":"ContainerStarted","Data":"708bcdd48e97e34c6ead6f22d0f5dc75f0ee4d070d0b968d52dc164953070afa"} Mar 16 13:17:40 crc kubenswrapper[5030]: I0316 13:17:40.432456 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:40 crc kubenswrapper[5030]: I0316 13:17:40.451901 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" podStartSLOduration=1.560542264 podStartE2EDuration="7.451879985s" podCreationTimestamp="2026-03-16 13:17:33 +0000 UTC" firstStartedPulling="2026-03-16 13:17:33.865039021 +0000 UTC m=+698.264351568" lastFinishedPulling="2026-03-16 13:17:39.756376742 +0000 UTC m=+704.155689289" observedRunningTime="2026-03-16 13:17:40.447047642 +0000 UTC m=+704.846360189" watchObservedRunningTime="2026-03-16 13:17:40.451879985 +0000 UTC m=+704.851192533" Mar 16 13:17:43 crc kubenswrapper[5030]: I0316 13:17:43.323298 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d9d95bf5b-5w7c9" Mar 16 13:17:43 crc kubenswrapper[5030]: I0316 13:17:43.361923 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:17:51 crc kubenswrapper[5030]: I0316 13:17:51.440189 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-operator-54b58fcbc5-57jgc" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.176886 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-2gt2d"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.181402 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.186123 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"nmstate-handler-dockercfg-c6vs9\"" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.189119 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.193141 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-2gt2d"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.193282 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.195304 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"openshift-nmstate-webhook\"" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.206118 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-6f7qf"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.209238 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.216201 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334490 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdjn\" (UniqueName: \"kubernetes.io/projected/44977e20-5353-45ed-b2ef-069946a7fedc-kube-api-access-8tdjn\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334571 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-dbus-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334608 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdspg\" (UniqueName: \"kubernetes.io/projected/795a6c5a-054d-497e-963e-faff3ca80086-kube-api-access-zdspg\") pod \"nmstate-metrics-7f888697b-2gt2d\" (UID: \"795a6c5a-054d-497e-963e-faff3ca80086\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334626 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-ovs-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-nmstate-lock\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.334709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlcs6\" (UniqueName: \"kubernetes.io/projected/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-kube-api-access-mlcs6\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.365209 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.368465 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.372318 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-nmstate\"/\"nginx-conf\"" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.372632 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.372756 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"plugin-serving-cert\"" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.374427 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-nmstate\"/\"default-dockercfg-x7hcw\"" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.435730 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.435866 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-dbus-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.435994 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdspg\" (UniqueName: \"kubernetes.io/projected/795a6c5a-054d-497e-963e-faff3ca80086-kube-api-access-zdspg\") pod \"nmstate-metrics-7f888697b-2gt2d\" (UID: \"795a6c5a-054d-497e-963e-faff3ca80086\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436036 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-ovs-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436060 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-nmstate-lock\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlcs6\" (UniqueName: \"kubernetes.io/projected/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-kube-api-access-mlcs6\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-ovs-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436242 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-dbus-socket\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/44977e20-5353-45ed-b2ef-069946a7fedc-nmstate-lock\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436381 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e99427c-ec9d-48f0-a078-aebc933dba2b-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbsst\" (UniqueName: \"kubernetes.io/projected/7e99427c-ec9d-48f0-a078-aebc933dba2b-kube-api-access-nbsst\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: E0316 13:17:52.436718 5030 secret.go:189] Couldn't get secret openshift-nmstate/openshift-nmstate-webhook: secret "openshift-nmstate-webhook" not found Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.436748 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdjn\" (UniqueName: \"kubernetes.io/projected/44977e20-5353-45ed-b2ef-069946a7fedc-kube-api-access-8tdjn\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: E0316 13:17:52.436802 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair podName:ab0f671f-c99b-4a1e-a09f-c248dd1c40c3 nodeName:}" failed. No retries permitted until 2026-03-16 13:17:52.936781221 +0000 UTC m=+717.336093768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-key-pair" (UniqueName: "kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair") pod "nmstate-webhook-78fdd78d8b-ljkg4" (UID: "ab0f671f-c99b-4a1e-a09f-c248dd1c40c3") : secret "openshift-nmstate-webhook" not found Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.454602 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdjn\" (UniqueName: \"kubernetes.io/projected/44977e20-5353-45ed-b2ef-069946a7fedc-kube-api-access-8tdjn\") pod \"nmstate-handler-6f7qf\" (UID: \"44977e20-5353-45ed-b2ef-069946a7fedc\") " pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.454797 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlcs6\" (UniqueName: \"kubernetes.io/projected/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-kube-api-access-mlcs6\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.456309 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdspg\" (UniqueName: \"kubernetes.io/projected/795a6c5a-054d-497e-963e-faff3ca80086-kube-api-access-zdspg\") pod \"nmstate-metrics-7f888697b-2gt2d\" (UID: \"795a6c5a-054d-497e-963e-faff3ca80086\") " pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.499938 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.527729 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.538901 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e99427c-ec9d-48f0-a078-aebc933dba2b-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.539351 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbsst\" (UniqueName: \"kubernetes.io/projected/7e99427c-ec9d-48f0-a078-aebc933dba2b-kube-api-access-nbsst\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.539457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: E0316 13:17:52.539630 5030 secret.go:189] Couldn't get secret openshift-nmstate/plugin-serving-cert: secret "plugin-serving-cert" not found Mar 16 13:17:52 crc kubenswrapper[5030]: E0316 13:17:52.539751 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert podName:7e99427c-ec9d-48f0-a078-aebc933dba2b nodeName:}" failed. No retries permitted until 2026-03-16 13:17:53.039733362 +0000 UTC m=+717.439045899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert") pod "nmstate-console-plugin-74686bb6b4-qh988" (UID: "7e99427c-ec9d-48f0-a078-aebc933dba2b") : secret "plugin-serving-cert" not found Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.540292 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e99427c-ec9d-48f0-a078-aebc933dba2b-nginx-conf\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.558849 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbsst\" (UniqueName: \"kubernetes.io/projected/7e99427c-ec9d-48f0-a078-aebc933dba2b-kube-api-access-nbsst\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:52 crc kubenswrapper[5030]: W0316 13:17:52.559031 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44977e20_5353_45ed_b2ef_069946a7fedc.slice/crio-7faca3d5a667a7e914fb053ed98a0e45fe2a04bfa8787e0832304427406964c2 WatchSource:0}: Error finding container 7faca3d5a667a7e914fb053ed98a0e45fe2a04bfa8787e0832304427406964c2: Status 404 returned error can't find the container with id 7faca3d5a667a7e914fb053ed98a0e45fe2a04bfa8787e0832304427406964c2 Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.576658 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-769cbf8bcb-dq64n"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.584764 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.593367 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769cbf8bcb-dq64n"] Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-oauth-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-service-ca\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-oauth-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641521 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-trusted-ca-bundle\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641539 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsrmf\" (UniqueName: \"kubernetes.io/projected/e79770f0-39d3-4208-9a75-65fa5c36b6e7-kube-api-access-lsrmf\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.641602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.723134 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-7f888697b-2gt2d"] Mar 16 13:17:52 crc kubenswrapper[5030]: W0316 13:17:52.727853 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795a6c5a_054d_497e_963e_faff3ca80086.slice/crio-7376e287b350c26bdca69420072f419d6d6cd4e2f5ae6e4136a83a70e6c27049 WatchSource:0}: Error finding container 7376e287b350c26bdca69420072f419d6d6cd4e2f5ae6e4136a83a70e6c27049: Status 404 returned error can't find the container with id 7376e287b350c26bdca69420072f419d6d6cd4e2f5ae6e4136a83a70e6c27049 Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.743246 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-oauth-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.743318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-service-ca\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.743393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-oauth-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.743424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-trusted-ca-bundle\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.744090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsrmf\" (UniqueName: \"kubernetes.io/projected/e79770f0-39d3-4208-9a75-65fa5c36b6e7-kube-api-access-lsrmf\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.744122 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.744156 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.744505 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-trusted-ca-bundle\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.744511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-service-ca\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.745290 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.746376 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e79770f0-39d3-4208-9a75-65fa5c36b6e7-oauth-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.748891 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-oauth-config\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.749204 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e79770f0-39d3-4208-9a75-65fa5c36b6e7-console-serving-cert\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.758537 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsrmf\" (UniqueName: \"kubernetes.io/projected/e79770f0-39d3-4208-9a75-65fa5c36b6e7-kube-api-access-lsrmf\") pod \"console-769cbf8bcb-dq64n\" (UID: \"e79770f0-39d3-4208-9a75-65fa5c36b6e7\") " pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.899739 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.946878 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:52 crc kubenswrapper[5030]: I0316 13:17:52.952193 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/ab0f671f-c99b-4a1e-a09f-c248dd1c40c3-tls-key-pair\") pod \"nmstate-webhook-78fdd78d8b-ljkg4\" (UID: \"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3\") " pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.048398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.053059 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e99427c-ec9d-48f0-a078-aebc933dba2b-plugin-serving-cert\") pod \"nmstate-console-plugin-74686bb6b4-qh988\" (UID: \"7e99427c-ec9d-48f0-a078-aebc933dba2b\") " pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.084694 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-769cbf8bcb-dq64n"] Mar 16 13:17:53 crc kubenswrapper[5030]: W0316 13:17:53.091295 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79770f0_39d3_4208_9a75_65fa5c36b6e7.slice/crio-2af41bb8cbf87590f7c7f7553557469fab73e0ebf98e7875ae73593b9f67c2a3 WatchSource:0}: Error finding container 2af41bb8cbf87590f7c7f7553557469fab73e0ebf98e7875ae73593b9f67c2a3: Status 404 returned error can't find the container with id 2af41bb8cbf87590f7c7f7553557469fab73e0ebf98e7875ae73593b9f67c2a3 Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.110048 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.284617 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4"] Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.295998 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.504563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbf8bcb-dq64n" event={"ID":"e79770f0-39d3-4208-9a75-65fa5c36b6e7","Type":"ContainerStarted","Data":"765016fcc0491d31aac37087ca4663fe819c5e8bf341c5f4112db32abcd47aa6"} Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.504639 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-769cbf8bcb-dq64n" event={"ID":"e79770f0-39d3-4208-9a75-65fa5c36b6e7","Type":"ContainerStarted","Data":"2af41bb8cbf87590f7c7f7553557469fab73e0ebf98e7875ae73593b9f67c2a3"} Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.505829 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" event={"ID":"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3","Type":"ContainerStarted","Data":"3390129cf7b56c8ec4e80af91e204349de9da813e1fad7be24fee503539cf96a"} Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.507589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" event={"ID":"795a6c5a-054d-497e-963e-faff3ca80086","Type":"ContainerStarted","Data":"7376e287b350c26bdca69420072f419d6d6cd4e2f5ae6e4136a83a70e6c27049"} Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.508996 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-6f7qf" event={"ID":"44977e20-5353-45ed-b2ef-069946a7fedc","Type":"ContainerStarted","Data":"7faca3d5a667a7e914fb053ed98a0e45fe2a04bfa8787e0832304427406964c2"} Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.524385 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-769cbf8bcb-dq64n" podStartSLOduration=1.524364219 podStartE2EDuration="1.524364219s" podCreationTimestamp="2026-03-16 13:17:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:17:53.518459546 +0000 UTC m=+717.917772093" watchObservedRunningTime="2026-03-16 13:17:53.524364219 +0000 UTC m=+717.923676766" Mar 16 13:17:53 crc kubenswrapper[5030]: I0316 13:17:53.654497 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988"] Mar 16 13:17:53 crc kubenswrapper[5030]: W0316 13:17:53.659924 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e99427c_ec9d_48f0_a078_aebc933dba2b.slice/crio-343ebb1dd7d4fc1267d81c0bd9a3ccd88984d8289f2fc3015c81654d0ec6b660 WatchSource:0}: Error finding container 343ebb1dd7d4fc1267d81c0bd9a3ccd88984d8289f2fc3015c81654d0ec6b660: Status 404 returned error can't find the container with id 343ebb1dd7d4fc1267d81c0bd9a3ccd88984d8289f2fc3015c81654d0ec6b660 Mar 16 13:17:54 crc kubenswrapper[5030]: I0316 13:17:54.520309 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" event={"ID":"7e99427c-ec9d-48f0-a078-aebc933dba2b","Type":"ContainerStarted","Data":"343ebb1dd7d4fc1267d81c0bd9a3ccd88984d8289f2fc3015c81654d0ec6b660"} Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.546864 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" event={"ID":"7e99427c-ec9d-48f0-a078-aebc933dba2b","Type":"ContainerStarted","Data":"4e92d6a49ade44781b16d238dd35ed99162796d3fa61101c608bd56b890d28a0"} Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.547699 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.549159 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-6f7qf" event={"ID":"44977e20-5353-45ed-b2ef-069946a7fedc","Type":"ContainerStarted","Data":"2838ce1d014ccc5cfb020f4e9a106a68681b1b8a791e142830e49a73e52a31da"} Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.549237 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.551972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" event={"ID":"ab0f671f-c99b-4a1e-a09f-c248dd1c40c3","Type":"ContainerStarted","Data":"19d5db9f10a35b11261fdc40c796f1244a6b88143c5248f8a5284ffccb0da4ec"} Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.552109 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.553439 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" event={"ID":"795a6c5a-054d-497e-963e-faff3ca80086","Type":"ContainerStarted","Data":"608d19022dff46a1c66cecc349ddfc8b7417f7064e3b82fb8ccad699951ead3d"} Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.564110 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" podStartSLOduration=2.4487909930000002 podStartE2EDuration="5.564087072s" podCreationTimestamp="2026-03-16 13:17:52 +0000 UTC" firstStartedPulling="2026-03-16 13:17:53.66476161 +0000 UTC m=+718.064074158" lastFinishedPulling="2026-03-16 13:17:56.780057689 +0000 UTC m=+721.179370237" observedRunningTime="2026-03-16 13:17:57.559947279 +0000 UTC m=+721.959259826" watchObservedRunningTime="2026-03-16 13:17:57.564087072 +0000 UTC m=+721.963399619" Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.579687 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" podStartSLOduration=2.091344457 podStartE2EDuration="5.579666048s" podCreationTimestamp="2026-03-16 13:17:52 +0000 UTC" firstStartedPulling="2026-03-16 13:17:53.291859689 +0000 UTC m=+717.691172236" lastFinishedPulling="2026-03-16 13:17:56.78018128 +0000 UTC m=+721.179493827" observedRunningTime="2026-03-16 13:17:57.573081984 +0000 UTC m=+721.972394532" watchObservedRunningTime="2026-03-16 13:17:57.579666048 +0000 UTC m=+721.978978595" Mar 16 13:17:57 crc kubenswrapper[5030]: I0316 13:17:57.587007 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-6f7qf" podStartSLOduration=1.362507315 podStartE2EDuration="5.586990236s" podCreationTimestamp="2026-03-16 13:17:52 +0000 UTC" firstStartedPulling="2026-03-16 13:17:52.564596181 +0000 UTC m=+716.963908717" lastFinishedPulling="2026-03-16 13:17:56.789079091 +0000 UTC m=+721.188391638" observedRunningTime="2026-03-16 13:17:57.584985917 +0000 UTC m=+721.984298463" watchObservedRunningTime="2026-03-16 13:17:57.586990236 +0000 UTC m=+721.986302783" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.130835 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561118-7rlrb"] Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.135783 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561118-7rlrb"] Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.135906 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.138753 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.139255 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.140824 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.260850 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mlh\" (UniqueName: \"kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh\") pod \"auto-csr-approver-29561118-7rlrb\" (UID: \"f39b588c-93ce-463a-aef8-95fced91a4f3\") " pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.362146 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mlh\" (UniqueName: \"kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh\") pod \"auto-csr-approver-29561118-7rlrb\" (UID: \"f39b588c-93ce-463a-aef8-95fced91a4f3\") " pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.384410 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mlh\" (UniqueName: \"kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh\") pod \"auto-csr-approver-29561118-7rlrb\" (UID: \"f39b588c-93ce-463a-aef8-95fced91a4f3\") " pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.456323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.579479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" event={"ID":"795a6c5a-054d-497e-963e-faff3ca80086","Type":"ContainerStarted","Data":"ff9189bdea99b4b131e6aa6041b288e3d1f3de65569a63b3e2932f9aeb3fbac5"} Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.580187 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.602935 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" podStartSLOduration=0.953946293 podStartE2EDuration="8.602919017s" podCreationTimestamp="2026-03-16 13:17:52 +0000 UTC" firstStartedPulling="2026-03-16 13:17:52.730523678 +0000 UTC m=+717.129836225" lastFinishedPulling="2026-03-16 13:18:00.379496402 +0000 UTC m=+724.778808949" observedRunningTime="2026-03-16 13:18:00.597174033 +0000 UTC m=+724.996486600" watchObservedRunningTime="2026-03-16 13:18:00.602919017 +0000 UTC m=+725.002231554" Mar 16 13:18:00 crc kubenswrapper[5030]: I0316 13:18:00.627785 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561118-7rlrb"] Mar 16 13:18:00 crc kubenswrapper[5030]: W0316 13:18:00.630651 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39b588c_93ce_463a_aef8_95fced91a4f3.slice/crio-ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac WatchSource:0}: Error finding container ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac: Status 404 returned error can't find the container with id ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac Mar 16 13:18:01 crc kubenswrapper[5030]: I0316 13:18:01.588123 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" event={"ID":"f39b588c-93ce-463a-aef8-95fced91a4f3","Type":"ContainerStarted","Data":"ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac"} Mar 16 13:18:02 crc kubenswrapper[5030]: I0316 13:18:02.900563 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:18:02 crc kubenswrapper[5030]: I0316 13:18:02.901287 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:18:02 crc kubenswrapper[5030]: I0316 13:18:02.906679 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:18:03 crc kubenswrapper[5030]: I0316 13:18:03.585861 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-6f7qf" Mar 16 13:18:03 crc kubenswrapper[5030]: I0316 13:18:03.604232 5030 generic.go:358] "Generic (PLEG): container finished" podID="f39b588c-93ce-463a-aef8-95fced91a4f3" containerID="f13588f69f2615b045aaa48ca4b680d5e08b9e015c6abd1fa3f28fa0351f8080" exitCode=0 Mar 16 13:18:03 crc kubenswrapper[5030]: I0316 13:18:03.604276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" event={"ID":"f39b588c-93ce-463a-aef8-95fced91a4f3","Type":"ContainerDied","Data":"f13588f69f2615b045aaa48ca4b680d5e08b9e015c6abd1fa3f28fa0351f8080"} Mar 16 13:18:03 crc kubenswrapper[5030]: I0316 13:18:03.608283 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-769cbf8bcb-dq64n" Mar 16 13:18:03 crc kubenswrapper[5030]: I0316 13:18:03.651497 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:18:04 crc kubenswrapper[5030]: I0316 13:18:04.795764 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:04 crc kubenswrapper[5030]: I0316 13:18:04.834587 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7mlh\" (UniqueName: \"kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh\") pod \"f39b588c-93ce-463a-aef8-95fced91a4f3\" (UID: \"f39b588c-93ce-463a-aef8-95fced91a4f3\") " Mar 16 13:18:04 crc kubenswrapper[5030]: I0316 13:18:04.840225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh" (OuterVolumeSpecName: "kube-api-access-b7mlh") pod "f39b588c-93ce-463a-aef8-95fced91a4f3" (UID: "f39b588c-93ce-463a-aef8-95fced91a4f3"). InnerVolumeSpecName "kube-api-access-b7mlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:04 crc kubenswrapper[5030]: I0316 13:18:04.936482 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7mlh\" (UniqueName: \"kubernetes.io/projected/f39b588c-93ce-463a-aef8-95fced91a4f3-kube-api-access-b7mlh\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.617798 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" event={"ID":"f39b588c-93ce-463a-aef8-95fced91a4f3","Type":"ContainerDied","Data":"ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac"} Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.617853 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba17bbf9939cd694c9f971fb90158a733bb391a725fb93b7f6e59335677fd2ac" Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.617970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561118-7rlrb" Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.858015 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561112-hj95h"] Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.860868 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561112-hj95h"] Mar 16 13:18:05 crc kubenswrapper[5030]: I0316 13:18:05.952926 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297460b2-fd22-4f53-ad05-cf34d79be5ed" path="/var/lib/kubelet/pods/297460b2-fd22-4f53-ad05-cf34d79be5ed/volumes" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.391160 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" podUID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" containerName="registry" containerID="cri-o://e862734b60b0140b96863d40f4e3208bf96befb3c51a8413820d022926b0d775" gracePeriod=30 Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.567285 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-console-plugin-74686bb6b4-qh988" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.568988 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-78fdd78d8b-ljkg4" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.637355 5030 generic.go:358] "Generic (PLEG): container finished" podID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" containerID="e862734b60b0140b96863d40f4e3208bf96befb3c51a8413820d022926b0d775" exitCode=0 Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.637466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" event={"ID":"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf","Type":"ContainerDied","Data":"e862734b60b0140b96863d40f4e3208bf96befb3c51a8413820d022926b0d775"} Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.722045 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793517 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793601 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793627 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793680 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793709 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793738 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9h52\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.793923 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-storage\" (UniqueName: \"kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2\") pod \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\" (UID: \"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf\") " Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.794747 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.794873 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.801260 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.801743 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.801768 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.802424 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52" (OuterVolumeSpecName: "kube-api-access-t9h52") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "kube-api-access-t9h52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.803700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/kubevirt.io.hostpath-provisioner^pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2" (OuterVolumeSpecName: "registry-storage") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "pvc-b21f41aa-58d4-44b1-aeaa-280a8e32ddf2". PluginName "kubernetes.io/csi", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.811708 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" (UID: "db16e26a-d8e5-49e1-8562-8e12bdbf3dbf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895135 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9h52\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-kube-api-access-t9h52\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895174 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-trusted-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895185 5030 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-ca-trust-extracted\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895194 5030 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895204 5030 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-bound-sa-token\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895211 5030 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-registry-certificates\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:08 crc kubenswrapper[5030]: I0316 13:18:08.895221 5030 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf-installation-pull-secrets\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.643593 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" event={"ID":"db16e26a-d8e5-49e1-8562-8e12bdbf3dbf","Type":"ContainerDied","Data":"c5e545dcc7e489b42882aa42fcbc3a0ff2b418804923c2e1d44ec1c71ccb4021"} Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.643981 5030 scope.go:117] "RemoveContainer" containerID="e862734b60b0140b96863d40f4e3208bf96befb3c51a8413820d022926b0d775" Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.643636 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66587d64c8-9j2ww" Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.668830 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.675232 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66587d64c8-9j2ww"] Mar 16 13:18:09 crc kubenswrapper[5030]: I0316 13:18:09.962515 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" path="/var/lib/kubelet/pods/db16e26a-d8e5-49e1-8562-8e12bdbf3dbf/volumes" Mar 16 13:18:11 crc kubenswrapper[5030]: I0316 13:18:11.593749 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-metrics-7f888697b-2gt2d" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.927931 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz"] Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.928993 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" containerName="registry" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.929008 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" containerName="registry" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.929020 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39b588c-93ce-463a-aef8-95fced91a4f3" containerName="oc" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.929025 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39b588c-93ce-463a-aef8-95fced91a4f3" containerName="oc" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.929113 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f39b588c-93ce-463a-aef8-95fced91a4f3" containerName="oc" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.929121 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db16e26a-d8e5-49e1-8562-8e12bdbf3dbf" containerName="registry" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.953602 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz"] Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.953698 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:18 crc kubenswrapper[5030]: I0316 13:18:18.955675 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.027545 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.027646 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.027684 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r975\" (UniqueName: \"kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.129330 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.129385 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.129426 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r975\" (UniqueName: \"kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.129936 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.130005 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.149690 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r975\" (UniqueName: \"kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975\") pod \"5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.270963 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.654652 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz"] Mar 16 13:18:19 crc kubenswrapper[5030]: W0316 13:18:19.656759 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62f6170_9809_4a7a_a2df_d5c1f11da5e0.slice/crio-43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3 WatchSource:0}: Error finding container 43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3: Status 404 returned error can't find the container with id 43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3 Mar 16 13:18:19 crc kubenswrapper[5030]: I0316 13:18:19.698770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" event={"ID":"c62f6170-9809-4a7a-a2df-d5c1f11da5e0","Type":"ContainerStarted","Data":"43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3"} Mar 16 13:18:20 crc kubenswrapper[5030]: I0316 13:18:20.707320 5030 generic.go:358] "Generic (PLEG): container finished" podID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerID="3081d310cd2decf72b4a557b6486d72d735f7e4dbc2ff063aaa49047ac39d93d" exitCode=0 Mar 16 13:18:20 crc kubenswrapper[5030]: I0316 13:18:20.707388 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" event={"ID":"c62f6170-9809-4a7a-a2df-d5c1f11da5e0","Type":"ContainerDied","Data":"3081d310cd2decf72b4a557b6486d72d735f7e4dbc2ff063aaa49047ac39d93d"} Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.259410 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.263223 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.269002 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.361531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.361598 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.361876 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxmg\" (UniqueName: \"kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.462978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxmg\" (UniqueName: \"kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.463035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.463068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.463595 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.463666 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.480766 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxmg\" (UniqueName: \"kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg\") pod \"redhat-operators-txc5l\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.576261 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:21 crc kubenswrapper[5030]: I0316 13:18:21.936005 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:21 crc kubenswrapper[5030]: W0316 13:18:21.943190 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdd7a6b_c914_43da_a6c6_e857624c091f.slice/crio-961a3e7e433d73c87a07703e3e551dbba0bd2888e0d72c479bd36bcd13136816 WatchSource:0}: Error finding container 961a3e7e433d73c87a07703e3e551dbba0bd2888e0d72c479bd36bcd13136816: Status 404 returned error can't find the container with id 961a3e7e433d73c87a07703e3e551dbba0bd2888e0d72c479bd36bcd13136816 Mar 16 13:18:22 crc kubenswrapper[5030]: I0316 13:18:22.720871 5030 generic.go:358] "Generic (PLEG): container finished" podID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerID="1bdb579b107fd5b8f01a1d76f872a3dd9295854c5e1613b5cfb4fe134e0bd05c" exitCode=0 Mar 16 13:18:22 crc kubenswrapper[5030]: I0316 13:18:22.720921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" event={"ID":"c62f6170-9809-4a7a-a2df-d5c1f11da5e0","Type":"ContainerDied","Data":"1bdb579b107fd5b8f01a1d76f872a3dd9295854c5e1613b5cfb4fe134e0bd05c"} Mar 16 13:18:22 crc kubenswrapper[5030]: I0316 13:18:22.724067 5030 generic.go:358] "Generic (PLEG): container finished" podID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerID="5beb61d303107e3bfa59182644cf41d759860172f8e8949c63feb5273406097c" exitCode=0 Mar 16 13:18:22 crc kubenswrapper[5030]: I0316 13:18:22.724143 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerDied","Data":"5beb61d303107e3bfa59182644cf41d759860172f8e8949c63feb5273406097c"} Mar 16 13:18:22 crc kubenswrapper[5030]: I0316 13:18:22.724184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerStarted","Data":"961a3e7e433d73c87a07703e3e551dbba0bd2888e0d72c479bd36bcd13136816"} Mar 16 13:18:23 crc kubenswrapper[5030]: I0316 13:18:23.733130 5030 generic.go:358] "Generic (PLEG): container finished" podID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerID="9a8b8771faf6ca2e5f3a0135e6a4f0b007dc83597980b71a7a80de329c21edba" exitCode=0 Mar 16 13:18:23 crc kubenswrapper[5030]: I0316 13:18:23.733202 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" event={"ID":"c62f6170-9809-4a7a-a2df-d5c1f11da5e0","Type":"ContainerDied","Data":"9a8b8771faf6ca2e5f3a0135e6a4f0b007dc83597980b71a7a80de329c21edba"} Mar 16 13:18:24 crc kubenswrapper[5030]: I0316 13:18:24.739630 5030 generic.go:358] "Generic (PLEG): container finished" podID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerID="e87cf5bd02e95fc31e4f393fa8fbb48fb688577a38c9a122f675747f9e671819" exitCode=0 Mar 16 13:18:24 crc kubenswrapper[5030]: I0316 13:18:24.739709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerDied","Data":"e87cf5bd02e95fc31e4f393fa8fbb48fb688577a38c9a122f675747f9e671819"} Mar 16 13:18:24 crc kubenswrapper[5030]: I0316 13:18:24.949139 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.109810 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util\") pod \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.110076 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r975\" (UniqueName: \"kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975\") pod \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.110196 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle\") pod \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\" (UID: \"c62f6170-9809-4a7a-a2df-d5c1f11da5e0\") " Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.111016 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle" (OuterVolumeSpecName: "bundle") pod "c62f6170-9809-4a7a-a2df-d5c1f11da5e0" (UID: "c62f6170-9809-4a7a-a2df-d5c1f11da5e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.111449 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.117630 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975" (OuterVolumeSpecName: "kube-api-access-2r975") pod "c62f6170-9809-4a7a-a2df-d5c1f11da5e0" (UID: "c62f6170-9809-4a7a-a2df-d5c1f11da5e0"). InnerVolumeSpecName "kube-api-access-2r975". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.121066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util" (OuterVolumeSpecName: "util") pod "c62f6170-9809-4a7a-a2df-d5c1f11da5e0" (UID: "c62f6170-9809-4a7a-a2df-d5c1f11da5e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.213185 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-util\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.213221 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r975\" (UniqueName: \"kubernetes.io/projected/c62f6170-9809-4a7a-a2df-d5c1f11da5e0-kube-api-access-2r975\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.750637 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" event={"ID":"c62f6170-9809-4a7a-a2df-d5c1f11da5e0","Type":"ContainerDied","Data":"43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3"} Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.750694 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43cb6c3dd9bfeef2f4e58c9137ac33ad9e6d9a7d6fff3e4d2666de44bd752db3" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.751036 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz" Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.753570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerStarted","Data":"481006cb3d5c99baf79eb16f5b56c671b9bea7129f65fd1483d6b110d2b52afe"} Mar 16 13:18:25 crc kubenswrapper[5030]: I0316 13:18:25.771980 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-txc5l" podStartSLOduration=3.563126665 podStartE2EDuration="4.771965607s" podCreationTimestamp="2026-03-16 13:18:21 +0000 UTC" firstStartedPulling="2026-03-16 13:18:22.724616041 +0000 UTC m=+747.123928589" lastFinishedPulling="2026-03-16 13:18:23.933454983 +0000 UTC m=+748.332767531" observedRunningTime="2026-03-16 13:18:25.769822139 +0000 UTC m=+750.169134686" watchObservedRunningTime="2026-03-16 13:18:25.771965607 +0000 UTC m=+750.171278154" Mar 16 13:18:28 crc kubenswrapper[5030]: I0316 13:18:28.683457 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-console/console-64d44f6ddf-7mr2q" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerName="console" containerID="cri-o://e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0" gracePeriod=15 Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.010448 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d44f6ddf-7mr2q_6c8ad577-d0d0-440d-bcd7-b85ed839114b/console/0.log" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.010765 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061718 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061794 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnlp8\" (UniqueName: \"kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061834 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061891 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.061940 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.062022 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca\") pod \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\" (UID: \"6c8ad577-d0d0-440d-bcd7-b85ed839114b\") " Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.062891 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.062972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.063214 5030 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-trusted-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.063233 5030 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-service-ca\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.063345 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config" (OuterVolumeSpecName: "console-config") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.063617 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.086687 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8" (OuterVolumeSpecName: "kube-api-access-wnlp8") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "kube-api-access-wnlp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.093413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.101666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c8ad577-d0d0-440d-bcd7-b85ed839114b" (UID: "6c8ad577-d0d0-440d-bcd7-b85ed839114b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.164256 5030 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.164289 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnlp8\" (UniqueName: \"kubernetes.io/projected/6c8ad577-d0d0-440d-bcd7-b85ed839114b-kube-api-access-wnlp8\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.164300 5030 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c8ad577-d0d0-440d-bcd7-b85ed839114b-oauth-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.164309 5030 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-oauth-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.164317 5030 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c8ad577-d0d0-440d-bcd7-b85ed839114b-console-serving-cert\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775257 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d44f6ddf-7mr2q_6c8ad577-d0d0-440d-bcd7-b85ed839114b/console/0.log" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775321 5030 generic.go:358] "Generic (PLEG): container finished" podID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerID="e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0" exitCode=2 Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775478 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-7mr2q" event={"ID":"6c8ad577-d0d0-440d-bcd7-b85ed839114b","Type":"ContainerDied","Data":"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0"} Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775510 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d44f6ddf-7mr2q" event={"ID":"6c8ad577-d0d0-440d-bcd7-b85ed839114b","Type":"ContainerDied","Data":"5719d082ee8e38a2cce2d089c3c826cf44351da3cc905c0df3143b4165be1d8a"} Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775529 5030 scope.go:117] "RemoveContainer" containerID="e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.775700 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d44f6ddf-7mr2q" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.801837 5030 scope.go:117] "RemoveContainer" containerID="e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0" Mar 16 13:18:29 crc kubenswrapper[5030]: E0316 13:18:29.802231 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0\": container with ID starting with e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0 not found: ID does not exist" containerID="e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.802262 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0"} err="failed to get container status \"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0\": rpc error: code = NotFound desc = could not find container \"e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0\": container with ID starting with e13e650177fc7a7966622c79176ff5051986c90af6c1f61d8bbc0271fc533eb0 not found: ID does not exist" Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.810412 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.819561 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d44f6ddf-7mr2q"] Mar 16 13:18:29 crc kubenswrapper[5030]: I0316 13:18:29.952161 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" path="/var/lib/kubelet/pods/6c8ad577-d0d0-440d-bcd7-b85ed839114b/volumes" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.461732 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462585 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="extract" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462599 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="extract" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462620 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerName="console" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462625 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerName="console" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462641 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="util" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462646 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="util" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462655 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="pull" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462661 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="pull" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462776 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c62f6170-9809-4a7a-a2df-d5c1f11da5e0" containerName="extract" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.462784 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c8ad577-d0d0-440d-bcd7-b85ed839114b" containerName="console" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.467698 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.475481 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.492499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.492540 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.492587 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2t7x\" (UniqueName: \"kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.576684 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.576756 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.593306 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.593354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.593376 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2t7x\" (UniqueName: \"kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.593814 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.593937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.603734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.608851 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2t7x\" (UniqueName: \"kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x\") pod \"redhat-marketplace-qwr4c\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.786102 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:31 crc kubenswrapper[5030]: I0316 13:18:31.825721 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:32 crc kubenswrapper[5030]: I0316 13:18:32.152727 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:32 crc kubenswrapper[5030]: I0316 13:18:32.800002 5030 generic.go:358] "Generic (PLEG): container finished" podID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerID="480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb" exitCode=0 Mar 16 13:18:32 crc kubenswrapper[5030]: I0316 13:18:32.800096 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerDied","Data":"480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb"} Mar 16 13:18:32 crc kubenswrapper[5030]: I0316 13:18:32.800397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerStarted","Data":"4f263635c8d19790882fd2a1b1b784ef095fbfba7c6ddb556f5632861f48e9c1"} Mar 16 13:18:33 crc kubenswrapper[5030]: I0316 13:18:33.807900 5030 generic.go:358] "Generic (PLEG): container finished" podID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerID="47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be" exitCode=0 Mar 16 13:18:33 crc kubenswrapper[5030]: I0316 13:18:33.808315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerDied","Data":"47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be"} Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.560098 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65"] Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.563437 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.565457 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-controller-manager-service-cert\"" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.565517 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"openshift-service-ca.crt\"" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.565536 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"kube-root-ca.crt\"" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.565704 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"manager-account-dockercfg-868gg\"" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.565710 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-webhook-server-cert\"" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.573568 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65"] Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.631072 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-apiservice-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.631125 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbxlb\" (UniqueName: \"kubernetes.io/projected/5229b811-944b-4010-8df6-f2f54bbaeefe-kube-api-access-xbxlb\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.631152 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-webhook-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.668665 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.668959 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-txc5l" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="registry-server" containerID="cri-o://481006cb3d5c99baf79eb16f5b56c671b9bea7129f65fd1483d6b110d2b52afe" gracePeriod=2 Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.732160 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-apiservice-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.732221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbxlb\" (UniqueName: \"kubernetes.io/projected/5229b811-944b-4010-8df6-f2f54bbaeefe-kube-api-access-xbxlb\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.732252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-webhook-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.738284 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-apiservice-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.741163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5229b811-944b-4010-8df6-f2f54bbaeefe-webhook-cert\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.764156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbxlb\" (UniqueName: \"kubernetes.io/projected/5229b811-944b-4010-8df6-f2f54bbaeefe-kube-api-access-xbxlb\") pod \"metallb-operator-controller-manager-6cdcb85899-x7t65\" (UID: \"5229b811-944b-4010-8df6-f2f54bbaeefe\") " pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.831386 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerStarted","Data":"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121"} Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.845978 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-qwr4c" podStartSLOduration=3.2576317169999998 podStartE2EDuration="3.845963816s" podCreationTimestamp="2026-03-16 13:18:31 +0000 UTC" firstStartedPulling="2026-03-16 13:18:32.801059575 +0000 UTC m=+757.200372122" lastFinishedPulling="2026-03-16 13:18:33.389391674 +0000 UTC m=+757.788704221" observedRunningTime="2026-03-16 13:18:34.843473138 +0000 UTC m=+759.242785685" watchObservedRunningTime="2026-03-16 13:18:34.845963816 +0000 UTC m=+759.245276363" Mar 16 13:18:34 crc kubenswrapper[5030]: I0316 13:18:34.876558 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.003804 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6"] Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.007869 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.009699 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"controller-dockercfg-gpc8v\"" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.010878 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-webhook-cert\"" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.011970 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-operator-webhook-server-service-cert\"" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.015946 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6"] Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.136322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkgs\" (UniqueName: \"kubernetes.io/projected/fce107bc-5860-4b8c-b330-ded7dd35c6aa-kube-api-access-qbkgs\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.136388 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-webhook-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.136425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-apiservice-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.237526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-webhook-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.237614 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-apiservice-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.237760 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkgs\" (UniqueName: \"kubernetes.io/projected/fce107bc-5860-4b8c-b330-ded7dd35c6aa-kube-api-access-qbkgs\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.244498 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-webhook-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.246906 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fce107bc-5860-4b8c-b330-ded7dd35c6aa-apiservice-cert\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.254079 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkgs\" (UniqueName: \"kubernetes.io/projected/fce107bc-5860-4b8c-b330-ded7dd35c6aa-kube-api-access-qbkgs\") pod \"metallb-operator-webhook-server-754d499d9c-wvks6\" (UID: \"fce107bc-5860-4b8c-b330-ded7dd35c6aa\") " pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.324597 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65"] Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.326538 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:35 crc kubenswrapper[5030]: W0316 13:18:35.342894 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5229b811_944b_4010_8df6_f2f54bbaeefe.slice/crio-dbc79bf2a4e5be3519b0db0a9d56c4b59483704a65af60732a4b6052619d606b WatchSource:0}: Error finding container dbc79bf2a4e5be3519b0db0a9d56c4b59483704a65af60732a4b6052619d606b: Status 404 returned error can't find the container with id dbc79bf2a4e5be3519b0db0a9d56c4b59483704a65af60732a4b6052619d606b Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.557817 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6"] Mar 16 13:18:35 crc kubenswrapper[5030]: W0316 13:18:35.565153 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfce107bc_5860_4b8c_b330_ded7dd35c6aa.slice/crio-5afd83d8981c79b1e1107890fa6a8b0b12903ac42eb953afece4a2ec9c340cac WatchSource:0}: Error finding container 5afd83d8981c79b1e1107890fa6a8b0b12903ac42eb953afece4a2ec9c340cac: Status 404 returned error can't find the container with id 5afd83d8981c79b1e1107890fa6a8b0b12903ac42eb953afece4a2ec9c340cac Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.838503 5030 generic.go:358] "Generic (PLEG): container finished" podID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerID="481006cb3d5c99baf79eb16f5b56c671b9bea7129f65fd1483d6b110d2b52afe" exitCode=0 Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.838583 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerDied","Data":"481006cb3d5c99baf79eb16f5b56c671b9bea7129f65fd1483d6b110d2b52afe"} Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.840191 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" event={"ID":"fce107bc-5860-4b8c-b330-ded7dd35c6aa","Type":"ContainerStarted","Data":"5afd83d8981c79b1e1107890fa6a8b0b12903ac42eb953afece4a2ec9c340cac"} Mar 16 13:18:35 crc kubenswrapper[5030]: I0316 13:18:35.841443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" event={"ID":"5229b811-944b-4010-8df6-f2f54bbaeefe","Type":"ContainerStarted","Data":"dbc79bf2a4e5be3519b0db0a9d56c4b59483704a65af60732a4b6052619d606b"} Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.090659 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.151075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content\") pod \"0fdd7a6b-c914-43da-a6c6-e857624c091f\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.151194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nxmg\" (UniqueName: \"kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg\") pod \"0fdd7a6b-c914-43da-a6c6-e857624c091f\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.151264 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities\") pod \"0fdd7a6b-c914-43da-a6c6-e857624c091f\" (UID: \"0fdd7a6b-c914-43da-a6c6-e857624c091f\") " Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.152297 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities" (OuterVolumeSpecName: "utilities") pod "0fdd7a6b-c914-43da-a6c6-e857624c091f" (UID: "0fdd7a6b-c914-43da-a6c6-e857624c091f"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.155725 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg" (OuterVolumeSpecName: "kube-api-access-2nxmg") pod "0fdd7a6b-c914-43da-a6c6-e857624c091f" (UID: "0fdd7a6b-c914-43da-a6c6-e857624c091f"). InnerVolumeSpecName "kube-api-access-2nxmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.233951 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0fdd7a6b-c914-43da-a6c6-e857624c091f" (UID: "0fdd7a6b-c914-43da-a6c6-e857624c091f"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.253019 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.253054 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nxmg\" (UniqueName: \"kubernetes.io/projected/0fdd7a6b-c914-43da-a6c6-e857624c091f-kube-api-access-2nxmg\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.253069 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0fdd7a6b-c914-43da-a6c6-e857624c091f-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.849940 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-txc5l" event={"ID":"0fdd7a6b-c914-43da-a6c6-e857624c091f","Type":"ContainerDied","Data":"961a3e7e433d73c87a07703e3e551dbba0bd2888e0d72c479bd36bcd13136816"} Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.850015 5030 scope.go:117] "RemoveContainer" containerID="481006cb3d5c99baf79eb16f5b56c671b9bea7129f65fd1483d6b110d2b52afe" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.850074 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-txc5l" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.866128 5030 scope.go:117] "RemoveContainer" containerID="e87cf5bd02e95fc31e4f393fa8fbb48fb688577a38c9a122f675747f9e671819" Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.879135 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.881753 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-txc5l"] Mar 16 13:18:36 crc kubenswrapper[5030]: I0316 13:18:36.903139 5030 scope.go:117] "RemoveContainer" containerID="5beb61d303107e3bfa59182644cf41d759860172f8e8949c63feb5273406097c" Mar 16 13:18:37 crc kubenswrapper[5030]: I0316 13:18:37.956251 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" path="/var/lib/kubelet/pods/0fdd7a6b-c914-43da-a6c6-e857624c091f/volumes" Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.894846 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" event={"ID":"fce107bc-5860-4b8c-b330-ded7dd35c6aa","Type":"ContainerStarted","Data":"f354fc49f4c4dba60b739b2f268e8286caa96f49059d4a54870f8a655685581c"} Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.895180 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.896644 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" event={"ID":"5229b811-944b-4010-8df6-f2f54bbaeefe","Type":"ContainerStarted","Data":"6674b558b45ba3dbfc595e5ae33563eb1ea45d3dbde30ccee8fd4417c8ad3ea8"} Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.896814 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.908922 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" podStartSLOduration=1.9931852399999999 podStartE2EDuration="6.908909812s" podCreationTimestamp="2026-03-16 13:18:34 +0000 UTC" firstStartedPulling="2026-03-16 13:18:35.566687033 +0000 UTC m=+759.965999580" lastFinishedPulling="2026-03-16 13:18:40.482411605 +0000 UTC m=+764.881724152" observedRunningTime="2026-03-16 13:18:40.90817025 +0000 UTC m=+765.307482796" watchObservedRunningTime="2026-03-16 13:18:40.908909812 +0000 UTC m=+765.308222359" Mar 16 13:18:40 crc kubenswrapper[5030]: I0316 13:18:40.929047 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" podStartSLOduration=1.8405713609999999 podStartE2EDuration="6.92902988s" podCreationTimestamp="2026-03-16 13:18:34 +0000 UTC" firstStartedPulling="2026-03-16 13:18:35.347520919 +0000 UTC m=+759.746833465" lastFinishedPulling="2026-03-16 13:18:40.435979438 +0000 UTC m=+764.835291984" observedRunningTime="2026-03-16 13:18:40.923383541 +0000 UTC m=+765.322696088" watchObservedRunningTime="2026-03-16 13:18:40.92902988 +0000 UTC m=+765.328342428" Mar 16 13:18:41 crc kubenswrapper[5030]: I0316 13:18:41.786434 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:41 crc kubenswrapper[5030]: I0316 13:18:41.786959 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:41 crc kubenswrapper[5030]: I0316 13:18:41.823365 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:41 crc kubenswrapper[5030]: I0316 13:18:41.936759 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.665486 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666137 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="extract-utilities" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666160 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="extract-utilities" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666174 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="registry-server" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666180 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="registry-server" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666208 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="extract-content" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666213 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="extract-content" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.666316 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdd7a6b-c914-43da-a6c6-e857624c091f" containerName="registry-server" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.669121 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.682736 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.751095 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.751169 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xbp\" (UniqueName: \"kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.751224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.853140 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.853210 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xbp\" (UniqueName: \"kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.853372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.853787 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.853867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.878692 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xbp\" (UniqueName: \"kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp\") pod \"community-operators-wkqdm\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:42 crc kubenswrapper[5030]: I0316 13:18:42.983856 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:43 crc kubenswrapper[5030]: I0316 13:18:43.195339 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:43 crc kubenswrapper[5030]: W0316 13:18:43.217886 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c61f59b_dc9a_4ea2_9c6a_901f139eba90.slice/crio-fbbeb1bb8fabb82e59f1562f8027ee8c2cb5ba0d01858e31229143fcdd41fbb5 WatchSource:0}: Error finding container fbbeb1bb8fabb82e59f1562f8027ee8c2cb5ba0d01858e31229143fcdd41fbb5: Status 404 returned error can't find the container with id fbbeb1bb8fabb82e59f1562f8027ee8c2cb5ba0d01858e31229143fcdd41fbb5 Mar 16 13:18:43 crc kubenswrapper[5030]: I0316 13:18:43.915863 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerID="276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348" exitCode=0 Mar 16 13:18:43 crc kubenswrapper[5030]: I0316 13:18:43.916006 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerDied","Data":"276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348"} Mar 16 13:18:43 crc kubenswrapper[5030]: I0316 13:18:43.916053 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerStarted","Data":"fbbeb1bb8fabb82e59f1562f8027ee8c2cb5ba0d01858e31229143fcdd41fbb5"} Mar 16 13:18:44 crc kubenswrapper[5030]: I0316 13:18:44.854131 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:44 crc kubenswrapper[5030]: I0316 13:18:44.854825 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-qwr4c" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="registry-server" containerID="cri-o://3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121" gracePeriod=2 Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.158428 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.292235 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2t7x\" (UniqueName: \"kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x\") pod \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.292389 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities\") pod \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.292413 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content\") pod \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\" (UID: \"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a\") " Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.293361 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities" (OuterVolumeSpecName: "utilities") pod "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" (UID: "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.298671 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x" (OuterVolumeSpecName: "kube-api-access-x2t7x") pod "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" (UID: "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a"). InnerVolumeSpecName "kube-api-access-x2t7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.304843 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" (UID: "b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.394070 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.394386 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.394455 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2t7x\" (UniqueName: \"kubernetes.io/projected/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a-kube-api-access-x2t7x\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.943128 5030 generic.go:358] "Generic (PLEG): container finished" podID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerID="3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121" exitCode=0 Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.943310 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerDied","Data":"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121"} Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.943357 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-qwr4c" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.943401 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-qwr4c" event={"ID":"b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a","Type":"ContainerDied","Data":"4f263635c8d19790882fd2a1b1b784ef095fbfba7c6ddb556f5632861f48e9c1"} Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.943437 5030 scope.go:117] "RemoveContainer" containerID="3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.954515 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerID="f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e" exitCode=0 Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.966818 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerDied","Data":"f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e"} Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.974085 5030 scope.go:117] "RemoveContainer" containerID="47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be" Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.990639 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:45 crc kubenswrapper[5030]: I0316 13:18:45.994689 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-qwr4c"] Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.015771 5030 scope.go:117] "RemoveContainer" containerID="480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.027375 5030 scope.go:117] "RemoveContainer" containerID="3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121" Mar 16 13:18:46 crc kubenswrapper[5030]: E0316 13:18:46.027730 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121\": container with ID starting with 3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121 not found: ID does not exist" containerID="3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.027758 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121"} err="failed to get container status \"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121\": rpc error: code = NotFound desc = could not find container \"3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121\": container with ID starting with 3333f541d9162ef74798a9a248e144fe11ac776cbd1659082a40beff41f63121 not found: ID does not exist" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.027778 5030 scope.go:117] "RemoveContainer" containerID="47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be" Mar 16 13:18:46 crc kubenswrapper[5030]: E0316 13:18:46.028025 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be\": container with ID starting with 47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be not found: ID does not exist" containerID="47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.028053 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be"} err="failed to get container status \"47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be\": rpc error: code = NotFound desc = could not find container \"47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be\": container with ID starting with 47c574548fb4c5006589f4c0d90e6ba64b17c87a4a5859c9236583d6774a13be not found: ID does not exist" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.028067 5030 scope.go:117] "RemoveContainer" containerID="480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb" Mar 16 13:18:46 crc kubenswrapper[5030]: E0316 13:18:46.028367 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb\": container with ID starting with 480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb not found: ID does not exist" containerID="480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.028408 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb"} err="failed to get container status \"480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb\": rpc error: code = NotFound desc = could not find container \"480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb\": container with ID starting with 480a0c7be54a0d0969fe6cc66c193da4bfc5bbef1e156f08e0a5fe226cf4fbeb not found: ID does not exist" Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.966097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerStarted","Data":"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720"} Mar 16 13:18:46 crc kubenswrapper[5030]: I0316 13:18:46.983682 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-wkqdm" podStartSLOduration=3.960239242 podStartE2EDuration="4.983663611s" podCreationTimestamp="2026-03-16 13:18:42 +0000 UTC" firstStartedPulling="2026-03-16 13:18:43.917147711 +0000 UTC m=+768.316460258" lastFinishedPulling="2026-03-16 13:18:44.940572079 +0000 UTC m=+769.339884627" observedRunningTime="2026-03-16 13:18:46.980980533 +0000 UTC m=+771.380293080" watchObservedRunningTime="2026-03-16 13:18:46.983663611 +0000 UTC m=+771.382976158" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.260983 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261492 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="extract-content" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261509 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="extract-content" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261525 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="extract-utilities" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261539 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="extract-utilities" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261581 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="registry-server" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261587 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="registry-server" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.261676 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" containerName="registry-server" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.264711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.271408 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.419613 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.419691 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zs6n\" (UniqueName: \"kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.420172 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.521541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.521637 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zs6n\" (UniqueName: \"kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.521708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.521997 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.522032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.538858 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zs6n\" (UniqueName: \"kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n\") pod \"certified-operators-8mp92\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.576543 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.786917 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:18:47 crc kubenswrapper[5030]: W0316 13:18:47.790832 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efc37c7_17b7_4c2a_a15e_c4d1e7cd2e50.slice/crio-7857881db595a15c40e933f58692291f9d61562e48e77ceeee80c0bfe183efaa WatchSource:0}: Error finding container 7857881db595a15c40e933f58692291f9d61562e48e77ceeee80c0bfe183efaa: Status 404 returned error can't find the container with id 7857881db595a15c40e933f58692291f9d61562e48e77ceeee80c0bfe183efaa Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.958169 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a" path="/var/lib/kubelet/pods/b0ba51a4-0c3a-4bb2-a4a9-ea7c9c2e392a/volumes" Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.974498 5030 generic.go:358] "Generic (PLEG): container finished" podID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerID="71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069" exitCode=0 Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.975047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerDied","Data":"71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069"} Mar 16 13:18:47 crc kubenswrapper[5030]: I0316 13:18:47.975159 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerStarted","Data":"7857881db595a15c40e933f58692291f9d61562e48e77ceeee80c0bfe183efaa"} Mar 16 13:18:48 crc kubenswrapper[5030]: I0316 13:18:48.982923 5030 generic.go:358] "Generic (PLEG): container finished" podID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerID="21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507" exitCode=0 Mar 16 13:18:48 crc kubenswrapper[5030]: I0316 13:18:48.983005 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerDied","Data":"21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507"} Mar 16 13:18:49 crc kubenswrapper[5030]: I0316 13:18:49.989685 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerStarted","Data":"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2"} Mar 16 13:18:50 crc kubenswrapper[5030]: I0316 13:18:50.008541 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-8mp92" podStartSLOduration=2.406615111 podStartE2EDuration="3.008524963s" podCreationTimestamp="2026-03-16 13:18:47 +0000 UTC" firstStartedPulling="2026-03-16 13:18:47.975293298 +0000 UTC m=+772.374605845" lastFinishedPulling="2026-03-16 13:18:48.577203149 +0000 UTC m=+772.976515697" observedRunningTime="2026-03-16 13:18:50.004981883 +0000 UTC m=+774.404294429" watchObservedRunningTime="2026-03-16 13:18:50.008524963 +0000 UTC m=+774.407837510" Mar 16 13:18:51 crc kubenswrapper[5030]: I0316 13:18:51.909629 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-754d499d9c-wvks6" Mar 16 13:18:52 crc kubenswrapper[5030]: I0316 13:18:52.984180 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:52 crc kubenswrapper[5030]: I0316 13:18:52.984236 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:53 crc kubenswrapper[5030]: I0316 13:18:53.024186 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:53 crc kubenswrapper[5030]: I0316 13:18:53.063096 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:54 crc kubenswrapper[5030]: I0316 13:18:54.287062 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:18:54 crc kubenswrapper[5030]: I0316 13:18:54.287853 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:18:56 crc kubenswrapper[5030]: I0316 13:18:56.371418 5030 scope.go:117] "RemoveContainer" containerID="9aaeb5bbe1782be07879c210176f6dcc3fb349e437a9532e16134253f42c29bb" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.062134 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.062781 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-wkqdm" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="registry-server" containerID="cri-o://276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720" gracePeriod=2 Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.425860 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.572891 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities\") pod \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.573096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content\") pod \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.573192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9xbp\" (UniqueName: \"kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp\") pod \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\" (UID: \"0c61f59b-dc9a-4ea2-9c6a-901f139eba90\") " Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.573892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities" (OuterVolumeSpecName: "utilities") pod "0c61f59b-dc9a-4ea2-9c6a-901f139eba90" (UID: "0c61f59b-dc9a-4ea2-9c6a-901f139eba90"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.577740 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.578617 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.578613 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp" (OuterVolumeSpecName: "kube-api-access-q9xbp") pod "0c61f59b-dc9a-4ea2-9c6a-901f139eba90" (UID: "0c61f59b-dc9a-4ea2-9c6a-901f139eba90"). InnerVolumeSpecName "kube-api-access-q9xbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.617474 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.622564 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0c61f59b-dc9a-4ea2-9c6a-901f139eba90" (UID: "0c61f59b-dc9a-4ea2-9c6a-901f139eba90"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.674892 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.674926 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9xbp\" (UniqueName: \"kubernetes.io/projected/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-kube-api-access-q9xbp\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:57 crc kubenswrapper[5030]: I0316 13:18:57.674941 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0c61f59b-dc9a-4ea2-9c6a-901f139eba90-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.045815 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerID="276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720" exitCode=0 Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.046793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-wkqdm" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.046874 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerDied","Data":"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720"} Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.046953 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-wkqdm" event={"ID":"0c61f59b-dc9a-4ea2-9c6a-901f139eba90","Type":"ContainerDied","Data":"fbbeb1bb8fabb82e59f1562f8027ee8c2cb5ba0d01858e31229143fcdd41fbb5"} Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.046979 5030 scope.go:117] "RemoveContainer" containerID="276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.066876 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.068370 5030 scope.go:117] "RemoveContainer" containerID="f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.071827 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-wkqdm"] Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.091650 5030 scope.go:117] "RemoveContainer" containerID="276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.094009 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.110600 5030 scope.go:117] "RemoveContainer" containerID="276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720" Mar 16 13:18:58 crc kubenswrapper[5030]: E0316 13:18:58.111215 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720\": container with ID starting with 276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720 not found: ID does not exist" containerID="276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.111261 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720"} err="failed to get container status \"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720\": rpc error: code = NotFound desc = could not find container \"276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720\": container with ID starting with 276e90be20cbbc32092c2244e08a18816c7d8f0ba838673af52d4cf6a4d1e720 not found: ID does not exist" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.111294 5030 scope.go:117] "RemoveContainer" containerID="f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e" Mar 16 13:18:58 crc kubenswrapper[5030]: E0316 13:18:58.111730 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e\": container with ID starting with f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e not found: ID does not exist" containerID="f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.111758 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e"} err="failed to get container status \"f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e\": rpc error: code = NotFound desc = could not find container \"f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e\": container with ID starting with f2612c68b985727db1a686e6ea44424e4de74da3a08462c25e11bdc2c7d1924e not found: ID does not exist" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.111801 5030 scope.go:117] "RemoveContainer" containerID="276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348" Mar 16 13:18:58 crc kubenswrapper[5030]: E0316 13:18:58.112126 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348\": container with ID starting with 276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348 not found: ID does not exist" containerID="276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348" Mar 16 13:18:58 crc kubenswrapper[5030]: I0316 13:18:58.112154 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348"} err="failed to get container status \"276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348\": rpc error: code = NotFound desc = could not find container \"276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348\": container with ID starting with 276704580f2ca3523106940b8aa571c9e72ae2a613f971bd8ba37d74e45fc348 not found: ID does not exist" Mar 16 13:18:59 crc kubenswrapper[5030]: I0316 13:18:59.952233 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" path="/var/lib/kubelet/pods/0c61f59b-dc9a-4ea2-9c6a-901f139eba90/volumes" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.052601 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.063049 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-8mp92" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="registry-server" containerID="cri-o://610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2" gracePeriod=2 Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.433074 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.527141 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zs6n\" (UniqueName: \"kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n\") pod \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.527257 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content\") pod \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.527313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities\") pod \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\" (UID: \"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50\") " Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.528225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities" (OuterVolumeSpecName: "utilities") pod "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" (UID: "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.533048 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n" (OuterVolumeSpecName: "kube-api-access-7zs6n") pod "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" (UID: "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50"). InnerVolumeSpecName "kube-api-access-7zs6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.556494 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" (UID: "6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.628892 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.628922 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:01 crc kubenswrapper[5030]: I0316 13:19:01.628933 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zs6n\" (UniqueName: \"kubernetes.io/projected/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50-kube-api-access-7zs6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.071286 5030 generic.go:358] "Generic (PLEG): container finished" podID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerID="610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2" exitCode=0 Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.071343 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerDied","Data":"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2"} Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.071418 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-8mp92" event={"ID":"6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50","Type":"ContainerDied","Data":"7857881db595a15c40e933f58692291f9d61562e48e77ceeee80c0bfe183efaa"} Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.071442 5030 scope.go:117] "RemoveContainer" containerID="610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.071492 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-8mp92" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.095063 5030 scope.go:117] "RemoveContainer" containerID="21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.108032 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.109182 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-8mp92"] Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.119700 5030 scope.go:117] "RemoveContainer" containerID="71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.133461 5030 scope.go:117] "RemoveContainer" containerID="610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2" Mar 16 13:19:02 crc kubenswrapper[5030]: E0316 13:19:02.134067 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2\": container with ID starting with 610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2 not found: ID does not exist" containerID="610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.134112 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2"} err="failed to get container status \"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2\": rpc error: code = NotFound desc = could not find container \"610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2\": container with ID starting with 610cb72d78c84513de21d653d172ca26a42dd532cde9f0ab2a2506911a1bd8d2 not found: ID does not exist" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.134137 5030 scope.go:117] "RemoveContainer" containerID="21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507" Mar 16 13:19:02 crc kubenswrapper[5030]: E0316 13:19:02.134408 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507\": container with ID starting with 21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507 not found: ID does not exist" containerID="21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.134434 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507"} err="failed to get container status \"21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507\": rpc error: code = NotFound desc = could not find container \"21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507\": container with ID starting with 21fbd40b86ca55a85c72c5c03d0074c5959b9cedf85ae87389050994b7682507 not found: ID does not exist" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.134452 5030 scope.go:117] "RemoveContainer" containerID="71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069" Mar 16 13:19:02 crc kubenswrapper[5030]: E0316 13:19:02.134693 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069\": container with ID starting with 71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069 not found: ID does not exist" containerID="71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069" Mar 16 13:19:02 crc kubenswrapper[5030]: I0316 13:19:02.134722 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069"} err="failed to get container status \"71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069\": rpc error: code = NotFound desc = could not find container \"71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069\": container with ID starting with 71028ee6d6454c84cd825c3c04b9de3e8e2f04494aea1ad1f30d621ea3859069 not found: ID does not exist" Mar 16 13:19:03 crc kubenswrapper[5030]: I0316 13:19:03.954356 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" path="/var/lib/kubelet/pods/6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50/volumes" Mar 16 13:19:11 crc kubenswrapper[5030]: I0316 13:19:11.906027 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-6cdcb85899-x7t65" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.618198 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-ccvkx"] Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619100 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="extract-utilities" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619122 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="extract-utilities" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619135 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="extract-content" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619143 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="extract-content" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619158 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619163 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619175 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="extract-content" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619179 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="extract-content" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619195 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="extract-utilities" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619199 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="extract-utilities" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619206 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619210 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619326 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6efc37c7-17b7-4c2a-a15e-c4d1e7cd2e50" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.619339 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c61f59b-dc9a-4ea2-9c6a-901f139eba90" containerName="registry-server" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.622124 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.623849 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"metallb-system\"/\"metallb-excludel2\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.623995 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-memberlist\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.624244 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"speaker-dockercfg-twtx4\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.624303 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"speaker-certs-secret\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.639873 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["metallb-system/controller-774d88f846-glmqk"] Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.642680 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.652686 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"controller-certs-secret\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.657188 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-774d88f846-glmqk"] Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676495 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwvh\" (UniqueName: \"kubernetes.io/projected/a787c80d-7a29-4fa9-b5e2-335785499ec3-kube-api-access-2nwvh\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676730 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dltc\" (UniqueName: \"kubernetes.io/projected/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-kube-api-access-5dltc\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676762 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676887 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metallb-excludel2\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.676994 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-cert\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.677086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778490 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778569 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwvh\" (UniqueName: \"kubernetes.io/projected/a787c80d-7a29-4fa9-b5e2-335785499ec3-kube-api-access-2nwvh\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778698 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dltc\" (UniqueName: \"kubernetes.io/projected/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-kube-api-access-5dltc\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778711 5030 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778787 5030 secret.go:189] Couldn't get secret metallb-system/speaker-certs-secret: secret "speaker-certs-secret" not found Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778829 5030 secret.go:189] Couldn't get secret metallb-system/controller-certs-secret: secret "controller-certs-secret" not found Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778801 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist podName:4e4e2dff-7723-44e9-ac2b-21fcbfc64f43 nodeName:}" failed. No retries permitted until 2026-03-16 13:19:13.278781889 +0000 UTC m=+797.678094436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist") pod "speaker-ccvkx" (UID: "4e4e2dff-7723-44e9-ac2b-21fcbfc64f43") : secret "metallb-memberlist" not found Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778896 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs podName:4e4e2dff-7723-44e9-ac2b-21fcbfc64f43 nodeName:}" failed. No retries permitted until 2026-03-16 13:19:13.278875274 +0000 UTC m=+797.678187821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs") pod "speaker-ccvkx" (UID: "4e4e2dff-7723-44e9-ac2b-21fcbfc64f43") : secret "speaker-certs-secret" not found Mar 16 13:19:12 crc kubenswrapper[5030]: E0316 13:19:12.778923 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs podName:a787c80d-7a29-4fa9-b5e2-335785499ec3 nodeName:}" failed. No retries permitted until 2026-03-16 13:19:13.278914889 +0000 UTC m=+797.678227486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs") pod "controller-774d88f846-glmqk" (UID: "a787c80d-7a29-4fa9-b5e2-335785499ec3") : secret "controller-certs-secret" not found Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.778991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metallb-excludel2\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.779069 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-cert\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.779681 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metallb-excludel2\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.780277 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"metallb-system\"/\"metallb-webhook-cert\"" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.794808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-cert\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.798765 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dltc\" (UniqueName: \"kubernetes.io/projected/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-kube-api-access-5dltc\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:12 crc kubenswrapper[5030]: I0316 13:19:12.799092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwvh\" (UniqueName: \"kubernetes.io/projected/a787c80d-7a29-4fa9-b5e2-335785499ec3-kube-api-access-2nwvh\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.284531 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.284881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:13 crc kubenswrapper[5030]: E0316 13:19:13.284693 5030 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Mar 16 13:19:13 crc kubenswrapper[5030]: E0316 13:19:13.284983 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist podName:4e4e2dff-7723-44e9-ac2b-21fcbfc64f43 nodeName:}" failed. No retries permitted until 2026-03-16 13:19:14.284960499 +0000 UTC m=+798.684273037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist") pod "speaker-ccvkx" (UID: "4e4e2dff-7723-44e9-ac2b-21fcbfc64f43") : secret "metallb-memberlist" not found Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.284915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.289167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a787c80d-7a29-4fa9-b5e2-335785499ec3-metrics-certs\") pod \"controller-774d88f846-glmqk\" (UID: \"a787c80d-7a29-4fa9-b5e2-335785499ec3\") " pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.290039 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-metrics-certs\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.552260 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:13 crc kubenswrapper[5030]: I0316 13:19:13.937967 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-774d88f846-glmqk"] Mar 16 13:19:14 crc kubenswrapper[5030]: I0316 13:19:14.148031 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-glmqk" event={"ID":"a787c80d-7a29-4fa9-b5e2-335785499ec3","Type":"ContainerStarted","Data":"e03c0e5ee3cf56063cbd23d4fe9bf02fa514c154a3011b4fd3214e08225da0cd"} Mar 16 13:19:14 crc kubenswrapper[5030]: I0316 13:19:14.148268 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-glmqk" event={"ID":"a787c80d-7a29-4fa9-b5e2-335785499ec3","Type":"ContainerStarted","Data":"475be95b68627adc16277208322f4b91a348d553d0ad1ae7359ecdfa0847357d"} Mar 16 13:19:14 crc kubenswrapper[5030]: I0316 13:19:14.297971 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:14 crc kubenswrapper[5030]: I0316 13:19:14.304815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/4e4e2dff-7723-44e9-ac2b-21fcbfc64f43-memberlist\") pod \"speaker-ccvkx\" (UID: \"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43\") " pod="metallb-system/speaker-ccvkx" Mar 16 13:19:14 crc kubenswrapper[5030]: I0316 13:19:14.437081 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-ccvkx" Mar 16 13:19:14 crc kubenswrapper[5030]: W0316 13:19:14.458046 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4e2dff_7723_44e9_ac2b_21fcbfc64f43.slice/crio-a6f9d84a5f74461d5643973f7ad1b2dcf13bba5bcb4d3cdfb1d50e45bb7e3535 WatchSource:0}: Error finding container a6f9d84a5f74461d5643973f7ad1b2dcf13bba5bcb4d3cdfb1d50e45bb7e3535: Status 404 returned error can't find the container with id a6f9d84a5f74461d5643973f7ad1b2dcf13bba5bcb4d3cdfb1d50e45bb7e3535 Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.157604 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-774d88f846-glmqk" event={"ID":"a787c80d-7a29-4fa9-b5e2-335785499ec3","Type":"ContainerStarted","Data":"192dd50e0c0be91b861a5ca11e9ba9d1c500e41f564f65ee4cba4692ec42be64"} Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.157710 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.160958 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-ccvkx" event={"ID":"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43","Type":"ContainerStarted","Data":"fef35ba2fc657e9977da25f926b51cd6836aa760f9ad7f8ada1a864910977b5e"} Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.161027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-ccvkx" event={"ID":"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43","Type":"ContainerStarted","Data":"5faf024415cd0294d3109ea78eef77d22f086a9ba4dd8c4e8a542d014ada42c1"} Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.161041 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-ccvkx" event={"ID":"4e4e2dff-7723-44e9-ac2b-21fcbfc64f43","Type":"ContainerStarted","Data":"a6f9d84a5f74461d5643973f7ad1b2dcf13bba5bcb4d3cdfb1d50e45bb7e3535"} Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.161289 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="metallb-system/speaker-ccvkx" Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.176418 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-774d88f846-glmqk" podStartSLOduration=3.176397439 podStartE2EDuration="3.176397439s" podCreationTimestamp="2026-03-16 13:19:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:19:15.172574421 +0000 UTC m=+799.571886968" watchObservedRunningTime="2026-03-16 13:19:15.176397439 +0000 UTC m=+799.575709986" Mar 16 13:19:15 crc kubenswrapper[5030]: I0316 13:19:15.185506 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-ccvkx" podStartSLOduration=3.185494803 podStartE2EDuration="3.185494803s" podCreationTimestamp="2026-03-16 13:19:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:19:15.183811358 +0000 UTC m=+799.583123904" watchObservedRunningTime="2026-03-16 13:19:15.185494803 +0000 UTC m=+799.584807349" Mar 16 13:19:24 crc kubenswrapper[5030]: I0316 13:19:24.287029 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:19:24 crc kubenswrapper[5030]: I0316 13:19:24.287977 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:19:26 crc kubenswrapper[5030]: I0316 13:19:26.170837 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-ccvkx" Mar 16 13:19:26 crc kubenswrapper[5030]: I0316 13:19:26.172541 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-774d88f846-glmqk" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.493543 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq"] Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.498255 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.500121 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.500870 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq"] Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.671043 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h57f6\" (UniqueName: \"kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.671088 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.671122 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.772035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h57f6\" (UniqueName: \"kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.772083 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.772117 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.772532 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.772682 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.790346 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h57f6\" (UniqueName: \"kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6\") pod \"925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:27 crc kubenswrapper[5030]: I0316 13:19:27.814707 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:28 crc kubenswrapper[5030]: I0316 13:19:28.184711 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq"] Mar 16 13:19:28 crc kubenswrapper[5030]: I0316 13:19:28.242523 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" event={"ID":"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8","Type":"ContainerStarted","Data":"97eedd77448cfb567cd28200dd5cfafc97ca9ea652deabe05f1a440ba522f287"} Mar 16 13:19:29 crc kubenswrapper[5030]: I0316 13:19:29.252701 5030 generic.go:358] "Generic (PLEG): container finished" podID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerID="f52ac3b12fdf3fb9b7530fd3c964b0c53259ba01ae53d3cf0d737f415bc22441" exitCode=0 Mar 16 13:19:29 crc kubenswrapper[5030]: I0316 13:19:29.252814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" event={"ID":"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8","Type":"ContainerDied","Data":"f52ac3b12fdf3fb9b7530fd3c964b0c53259ba01ae53d3cf0d737f415bc22441"} Mar 16 13:19:32 crc kubenswrapper[5030]: I0316 13:19:32.272031 5030 generic.go:358] "Generic (PLEG): container finished" podID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerID="5acf053f5abaf528db170d18eeeb28af31eb6503bf162b6d8a5a55feec9966bd" exitCode=0 Mar 16 13:19:32 crc kubenswrapper[5030]: I0316 13:19:32.272132 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" event={"ID":"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8","Type":"ContainerDied","Data":"5acf053f5abaf528db170d18eeeb28af31eb6503bf162b6d8a5a55feec9966bd"} Mar 16 13:19:33 crc kubenswrapper[5030]: I0316 13:19:33.283606 5030 generic.go:358] "Generic (PLEG): container finished" podID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerID="a016877274b3ba9ca3e6abb4bcb440eb4945d48de032859e93ccf8eeb66d184f" exitCode=0 Mar 16 13:19:33 crc kubenswrapper[5030]: I0316 13:19:33.283789 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" event={"ID":"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8","Type":"ContainerDied","Data":"a016877274b3ba9ca3e6abb4bcb440eb4945d48de032859e93ccf8eeb66d184f"} Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.487057 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.555180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h57f6\" (UniqueName: \"kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6\") pod \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.555590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle\") pod \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.555633 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util\") pod \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\" (UID: \"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8\") " Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.556469 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle" (OuterVolumeSpecName: "bundle") pod "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" (UID: "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.561503 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6" (OuterVolumeSpecName: "kube-api-access-h57f6") pod "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" (UID: "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8"). InnerVolumeSpecName "kube-api-access-h57f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.564312 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util" (OuterVolumeSpecName: "util") pod "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" (UID: "73106cf1-a54e-4ec3-9cfe-51a9ea1219f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.657059 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.657086 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-util\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:34 crc kubenswrapper[5030]: I0316 13:19:34.657097 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h57f6\" (UniqueName: \"kubernetes.io/projected/73106cf1-a54e-4ec3-9cfe-51a9ea1219f8-kube-api-access-h57f6\") on node \"crc\" DevicePath \"\"" Mar 16 13:19:35 crc kubenswrapper[5030]: I0316 13:19:35.297611 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" Mar 16 13:19:35 crc kubenswrapper[5030]: I0316 13:19:35.297606 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq" event={"ID":"73106cf1-a54e-4ec3-9cfe-51a9ea1219f8","Type":"ContainerDied","Data":"97eedd77448cfb567cd28200dd5cfafc97ca9ea652deabe05f1a440ba522f287"} Mar 16 13:19:35 crc kubenswrapper[5030]: I0316 13:19:35.297769 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97eedd77448cfb567cd28200dd5cfafc97ca9ea652deabe05f1a440ba522f287" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.277312 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-frr-k8s/frr-k8s-kk5pm"] Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278191 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="util" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278206 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="util" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278222 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="extract" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="extract" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278243 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="pull" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278248 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="pull" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.278348 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="73106cf1-a54e-4ec3-9cfe-51a9ea1219f8" containerName="extract" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.368055 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.369885 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-certs-secret\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.370184 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"kube-root-ca.crt\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.370308 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"openshift-service-ca.crt\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.370476 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"env-overrides\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.370635 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-frr-k8s\"/\"frr-startup\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.370854 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-daemon-dockercfg-bhs8l\"" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.402725 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.402880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-reloader\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.402936 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-status\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.402973 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-startup\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.403000 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-sockets\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.403245 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfc8\" (UniqueName: \"kubernetes.io/projected/aaf1089c-a411-4767-b952-ceabb40cd9be-kube-api-access-8mfc8\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.403366 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.403420 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-conf\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504593 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-reloader\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504659 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-status\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-startup\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-sockets\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfc8\" (UniqueName: \"kubernetes.io/projected/aaf1089c-a411-4767-b952-ceabb40cd9be-kube-api-access-8mfc8\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504788 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.504807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-conf\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.505069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.505169 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-reloader\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: E0316 13:19:38.505205 5030 secret.go:189] Couldn't get secret openshift-frr-k8s/frr-k8s-certs-secret: secret "frr-k8s-certs-secret" not found Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.505275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-conf\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: E0316 13:19:38.505325 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs podName:aaf1089c-a411-4767-b952-ceabb40cd9be nodeName:}" failed. No retries permitted until 2026-03-16 13:19:39.005301125 +0000 UTC m=+823.404613673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs") pod "frr-k8s-kk5pm" (UID: "aaf1089c-a411-4767-b952-ceabb40cd9be") : secret "frr-k8s-certs-secret" not found Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.506166 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-startup\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.506586 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-sockets\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.506618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"frr-status\" (UniqueName: \"kubernetes.io/empty-dir/aaf1089c-a411-4767-b952-ceabb40cd9be-frr-status\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:38 crc kubenswrapper[5030]: I0316 13:19:38.523693 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfc8\" (UniqueName: \"kubernetes.io/projected/aaf1089c-a411-4767-b952-ceabb40cd9be-kube-api-access-8mfc8\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.012166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.016965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aaf1089c-a411-4767-b952-ceabb40cd9be-metrics-certs\") pod \"frr-k8s-kk5pm\" (UID: \"aaf1089c-a411-4767-b952-ceabb40cd9be\") " pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.290837 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.680165 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b"] Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.683004 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.684642 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-frr-k8s\"/\"frr-k8s-webhook-server-cert\"" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.722094 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp92h\" (UniqueName: \"kubernetes.io/projected/0f2269c9-107c-4367-998d-8de306c70772-kube-api-access-sp92h\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.722143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f2269c9-107c-4367-998d-8de306c70772-cert\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.824183 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sp92h\" (UniqueName: \"kubernetes.io/projected/0f2269c9-107c-4367-998d-8de306c70772-kube-api-access-sp92h\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.824250 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f2269c9-107c-4367-998d-8de306c70772-cert\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.832984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f2269c9-107c-4367-998d-8de306c70772-cert\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.839875 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp92h\" (UniqueName: \"kubernetes.io/projected/0f2269c9-107c-4367-998d-8de306c70772-kube-api-access-sp92h\") pod \"frr-k8s-webhook-server-bc5694f79-xlc4b\" (UID: \"0f2269c9-107c-4367-998d-8de306c70772\") " pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.936251 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj"] Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.939414 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.942599 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fsztg\"" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.942849 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.943369 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.961870 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj"] Mar 16 13:19:39 crc kubenswrapper[5030]: I0316 13:19:39.996724 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.027356 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/487562fd-9ae9-4051-a527-24a738dd4876-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.027393 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksv4v\" (UniqueName: \"kubernetes.io/projected/487562fd-9ae9-4051-a527-24a738dd4876-kube-api-access-ksv4v\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.129450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/487562fd-9ae9-4051-a527-24a738dd4876-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.129507 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ksv4v\" (UniqueName: \"kubernetes.io/projected/487562fd-9ae9-4051-a527-24a738dd4876-kube-api-access-ksv4v\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.130067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/487562fd-9ae9-4051-a527-24a738dd4876-tmp\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.147194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksv4v\" (UniqueName: \"kubernetes.io/projected/487562fd-9ae9-4051-a527-24a738dd4876-kube-api-access-ksv4v\") pod \"cert-manager-operator-controller-manager-7f6f97fb86-nm6kj\" (UID: \"487562fd-9ae9-4051-a527-24a738dd4876\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.257149 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.331682 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" event={"ID":"0f2269c9-107c-4367-998d-8de306c70772","Type":"ContainerStarted","Data":"9577d23787a1c78a7b50c30bbaed015bdd22513af63ec5c7edc2c24f232fa525"} Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.340226 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"659484bdd6e6500bdd73006972998b8ee03527c43dc0d94ba4cfe6352a190acb"} Mar 16 13:19:40 crc kubenswrapper[5030]: I0316 13:19:40.627800 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj"] Mar 16 13:19:40 crc kubenswrapper[5030]: W0316 13:19:40.631902 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487562fd_9ae9_4051_a527_24a738dd4876.slice/crio-44471c96927de5b5e3194bfa4680cca495120403947955666e74787fd4f13ee1 WatchSource:0}: Error finding container 44471c96927de5b5e3194bfa4680cca495120403947955666e74787fd4f13ee1: Status 404 returned error can't find the container with id 44471c96927de5b5e3194bfa4680cca495120403947955666e74787fd4f13ee1 Mar 16 13:19:41 crc kubenswrapper[5030]: I0316 13:19:41.346301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" event={"ID":"487562fd-9ae9-4051-a527-24a738dd4876","Type":"ContainerStarted","Data":"44471c96927de5b5e3194bfa4680cca495120403947955666e74787fd4f13ee1"} Mar 16 13:19:44 crc kubenswrapper[5030]: I0316 13:19:44.373696 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" event={"ID":"487562fd-9ae9-4051-a527-24a738dd4876","Type":"ContainerStarted","Data":"ebf53734aa36a82e4fa6a70cb88d0c6e6e8de0bfe346fa418d8677bec9ac017e"} Mar 16 13:19:44 crc kubenswrapper[5030]: I0316 13:19:44.399478 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7f6f97fb86-nm6kj" podStartSLOduration=2.548458605 podStartE2EDuration="5.399465881s" podCreationTimestamp="2026-03-16 13:19:39 +0000 UTC" firstStartedPulling="2026-03-16 13:19:40.636201792 +0000 UTC m=+825.035514339" lastFinishedPulling="2026-03-16 13:19:43.487209068 +0000 UTC m=+827.886521615" observedRunningTime="2026-03-16 13:19:44.398597328 +0000 UTC m=+828.797909876" watchObservedRunningTime="2026-03-16 13:19:44.399465881 +0000 UTC m=+828.798778428" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.081796 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-5xkqn"] Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.086356 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.088205 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b8j6x\"" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.088892 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.089102 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.090330 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-5xkqn"] Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.262924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvwb8\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-kube-api-access-bvwb8\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.263035 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.365314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.365405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvwb8\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-kube-api-access-bvwb8\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.396167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.396266 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvwb8\" (UniqueName: \"kubernetes.io/projected/4ce95a79-bd46-4f73-a233-0d7b869046ba-kube-api-access-bvwb8\") pod \"cert-manager-webhook-597b96b99b-5xkqn\" (UID: \"4ce95a79-bd46-4f73-a233-0d7b869046ba\") " pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.411094 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:47 crc kubenswrapper[5030]: I0316 13:19:47.622992 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-5xkqn"] Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.149667 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-9lvw8"] Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.153974 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.156497 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-854pg\"" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.159530 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-9lvw8"] Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.284540 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.284753 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqxtc\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-kube-api-access-dqxtc\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.386205 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.386273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqxtc\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-kube-api-access-dqxtc\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.398805 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" event={"ID":"4ce95a79-bd46-4f73-a233-0d7b869046ba","Type":"ContainerStarted","Data":"f50e00b04efc586a4a9f6f8a5d460a4f8b34e981ed5165e8af86de21b59a98da"} Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.403571 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqxtc\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-kube-api-access-dqxtc\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.404258 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3c5b559-3a82-4ffa-802b-7e9ad8e49c52-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-9lvw8\" (UID: \"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.474142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" Mar 16 13:19:48 crc kubenswrapper[5030]: I0316 13:19:48.889266 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-9lvw8"] Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.421772 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" event={"ID":"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52","Type":"ContainerStarted","Data":"e532efd830270466a95c4097c3a77edf3e981b455be9df4534db155f9363749d"} Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.423427 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" event={"ID":"0f2269c9-107c-4367-998d-8de306c70772","Type":"ContainerStarted","Data":"d0bf7c24602e0980542b7deff33d9693b00cc46637da95d06b51accb61fbae9c"} Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.423586 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.426506 5030 generic.go:358] "Generic (PLEG): container finished" podID="aaf1089c-a411-4767-b952-ceabb40cd9be" containerID="c167a42c8cd76638ebe26dfa86da2eb96a778887ce32549bdae7c13a649c9f53" exitCode=0 Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.426580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerDied","Data":"c167a42c8cd76638ebe26dfa86da2eb96a778887ce32549bdae7c13a649c9f53"} Mar 16 13:19:51 crc kubenswrapper[5030]: I0316 13:19:51.440581 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" podStartSLOduration=1.573360433 podStartE2EDuration="12.440539381s" podCreationTimestamp="2026-03-16 13:19:39 +0000 UTC" firstStartedPulling="2026-03-16 13:19:40.023757089 +0000 UTC m=+824.423069636" lastFinishedPulling="2026-03-16 13:19:50.890936036 +0000 UTC m=+835.290248584" observedRunningTime="2026-03-16 13:19:51.435954981 +0000 UTC m=+835.835267528" watchObservedRunningTime="2026-03-16 13:19:51.440539381 +0000 UTC m=+835.839851927" Mar 16 13:19:52 crc kubenswrapper[5030]: I0316 13:19:52.436873 5030 generic.go:358] "Generic (PLEG): container finished" podID="aaf1089c-a411-4767-b952-ceabb40cd9be" containerID="76bcee0fb4ae73ae1608f78bd69994f1c7978e0ff6ef9e0abac5e6d2f633f6c4" exitCode=0 Mar 16 13:19:52 crc kubenswrapper[5030]: I0316 13:19:52.436952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerDied","Data":"76bcee0fb4ae73ae1608f78bd69994f1c7978e0ff6ef9e0abac5e6d2f633f6c4"} Mar 16 13:19:53 crc kubenswrapper[5030]: E0316 13:19:53.313762 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=755430 actualBytes=10240 Mar 16 13:19:53 crc kubenswrapper[5030]: I0316 13:19:53.445180 5030 generic.go:358] "Generic (PLEG): container finished" podID="aaf1089c-a411-4767-b952-ceabb40cd9be" containerID="347a466ed3296aeccade565e8ecc4137c390215923b79bb3d8db8401f14b53f1" exitCode=0 Mar 16 13:19:53 crc kubenswrapper[5030]: I0316 13:19:53.445369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerDied","Data":"347a466ed3296aeccade565e8ecc4137c390215923b79bb3d8db8401f14b53f1"} Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.286595 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.286934 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.286996 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.287739 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.287809 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d" gracePeriod=600 Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.452911 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d" exitCode=0 Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.452994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d"} Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.453336 5030 scope.go:117] "RemoveContainer" containerID="5cdfa1e6db4554797afe4da1977202fc227ac1a0c626a9eaaa3b5fdb41119144" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.455253 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" event={"ID":"4ce95a79-bd46-4f73-a233-0d7b869046ba","Type":"ContainerStarted","Data":"1c20f23c18d9a1161222b85d2634a3b0ee507ac40681a7484114049cef098f61"} Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.455378 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.458000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" event={"ID":"b3c5b559-3a82-4ffa-802b-7e9ad8e49c52","Type":"ContainerStarted","Data":"4f35946b0315098641bcc1ef4620d182d2eb73637ba1f5ce7d18ba4bac7285df"} Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.460455 5030 generic.go:358] "Generic (PLEG): container finished" podID="aaf1089c-a411-4767-b952-ceabb40cd9be" containerID="334212cff7a50e4ccb708a55eb53cdb5fe31db9bf5f798f54f547d27ebc574ea" exitCode=0 Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.460538 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerDied","Data":"334212cff7a50e4ccb708a55eb53cdb5fe31db9bf5f798f54f547d27ebc574ea"} Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.475506 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" podStartSLOduration=1.4139723929999999 podStartE2EDuration="7.475478058s" podCreationTimestamp="2026-03-16 13:19:47 +0000 UTC" firstStartedPulling="2026-03-16 13:19:47.643188185 +0000 UTC m=+832.042500732" lastFinishedPulling="2026-03-16 13:19:53.704693849 +0000 UTC m=+838.104006397" observedRunningTime="2026-03-16 13:19:54.468640784 +0000 UTC m=+838.867953330" watchObservedRunningTime="2026-03-16 13:19:54.475478058 +0000 UTC m=+838.874790605" Mar 16 13:19:54 crc kubenswrapper[5030]: I0316 13:19:54.515772 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-8966b78d4-9lvw8" podStartSLOduration=3.663221708 podStartE2EDuration="6.515748311s" podCreationTimestamp="2026-03-16 13:19:48 +0000 UTC" firstStartedPulling="2026-03-16 13:19:50.855796911 +0000 UTC m=+835.255109458" lastFinishedPulling="2026-03-16 13:19:53.708323513 +0000 UTC m=+838.107636061" observedRunningTime="2026-03-16 13:19:54.507483963 +0000 UTC m=+838.906796510" watchObservedRunningTime="2026-03-16 13:19:54.515748311 +0000 UTC m=+838.915060857" Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.476098 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484792 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"267b8306fde74871e67616c1e23c87f1c7edeec9e7e0f03af2af81f6d8213c0c"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"86e2fa1c39e67937757f7cda6f62411ff941d5293ddf9bd94a6f95a058185add"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484859 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"a00db6bfbc52d0799cc4cf771112e683773e41e520108be5a720a92c318e23d2"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484871 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"dcadaaf4bdecad3accd33b38ff0e185ee0058e745acf67c099c4bf56cfd24275"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484883 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"e66110b59ab17924aa4d961ba78337906ec693d1e877a13107842635b06d2ad3"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"aeb21f70a3f8d1bcd2e4800b6aa6036cd3f2c6f9443e0cfea012bb0116add99d"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.484905 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-frr-k8s/frr-k8s-kk5pm" event={"ID":"aaf1089c-a411-4767-b952-ceabb40cd9be","Type":"ContainerStarted","Data":"51586f3a7bc443b5fae48df55a59e08e689dd044b3b313ed91763fa0c1b6adea"} Mar 16 13:19:55 crc kubenswrapper[5030]: I0316 13:19:55.517812 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-frr-k8s/frr-k8s-kk5pm" podStartSLOduration=6.029474187 podStartE2EDuration="17.517788476s" podCreationTimestamp="2026-03-16 13:19:38 +0000 UTC" firstStartedPulling="2026-03-16 13:19:39.396930707 +0000 UTC m=+823.796243254" lastFinishedPulling="2026-03-16 13:19:50.885244996 +0000 UTC m=+835.284557543" observedRunningTime="2026-03-16 13:19:55.509418649 +0000 UTC m=+839.908731196" watchObservedRunningTime="2026-03-16 13:19:55.517788476 +0000 UTC m=+839.917101023" Mar 16 13:19:56 crc kubenswrapper[5030]: I0316 13:19:56.491055 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:59 crc kubenswrapper[5030]: I0316 13:19:59.291764 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:19:59 crc kubenswrapper[5030]: I0316 13:19:59.322786 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.123990 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561120-kg66j"] Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.181271 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561120-kg66j"] Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.181481 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.183805 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.183862 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.184377 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.286295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5g68\" (UniqueName: \"kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68\") pod \"auto-csr-approver-29561120-kg66j\" (UID: \"e42ea2a0-f6a3-4095-a842-1a7df5f742b1\") " pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.387287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5g68\" (UniqueName: \"kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68\") pod \"auto-csr-approver-29561120-kg66j\" (UID: \"e42ea2a0-f6a3-4095-a842-1a7df5f742b1\") " pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.405241 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5g68\" (UniqueName: \"kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68\") pod \"auto-csr-approver-29561120-kg66j\" (UID: \"e42ea2a0-f6a3-4095-a842-1a7df5f742b1\") " pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.488937 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-597b96b99b-5xkqn" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.498635 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:00 crc kubenswrapper[5030]: I0316 13:20:00.940638 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561120-kg66j"] Mar 16 13:20:01 crc kubenswrapper[5030]: I0316 13:20:01.525825 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561120-kg66j" event={"ID":"e42ea2a0-f6a3-4095-a842-1a7df5f742b1","Type":"ContainerStarted","Data":"5c52a84e653318a843cc73d38802265d3fa4a9594d536fb4bdc2ca4ecb852d79"} Mar 16 13:20:02 crc kubenswrapper[5030]: I0316 13:20:02.442707 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-frr-k8s/frr-k8s-webhook-server-bc5694f79-xlc4b" Mar 16 13:20:02 crc kubenswrapper[5030]: I0316 13:20:02.541774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561120-kg66j" event={"ID":"e42ea2a0-f6a3-4095-a842-1a7df5f742b1","Type":"ContainerStarted","Data":"dee53f2f2a54132c92fba268f9a6b133d41436ae47ef187180ddbac514faad68"} Mar 16 13:20:02 crc kubenswrapper[5030]: I0316 13:20:02.557251 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561120-kg66j" podStartSLOduration=1.342741899 podStartE2EDuration="2.557236965s" podCreationTimestamp="2026-03-16 13:20:00 +0000 UTC" firstStartedPulling="2026-03-16 13:20:00.947108984 +0000 UTC m=+845.346421531" lastFinishedPulling="2026-03-16 13:20:02.16160406 +0000 UTC m=+846.560916597" observedRunningTime="2026-03-16 13:20:02.554312187 +0000 UTC m=+846.953624734" watchObservedRunningTime="2026-03-16 13:20:02.557236965 +0000 UTC m=+846.956549512" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.059169 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-759f64656b-g2hjp"] Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.061908 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.063786 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xd2zq\"" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.070653 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-759f64656b-g2hjp"] Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.230872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvc8d\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-kube-api-access-rvc8d\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.231028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-bound-sa-token\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.331743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvc8d\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-kube-api-access-rvc8d\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.331817 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-bound-sa-token\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.348621 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-bound-sa-token\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.348852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvc8d\" (UniqueName: \"kubernetes.io/projected/5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7-kube-api-access-rvc8d\") pod \"cert-manager-759f64656b-g2hjp\" (UID: \"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7\") " pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.373374 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-759f64656b-g2hjp" Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.549293 5030 generic.go:358] "Generic (PLEG): container finished" podID="e42ea2a0-f6a3-4095-a842-1a7df5f742b1" containerID="dee53f2f2a54132c92fba268f9a6b133d41436ae47ef187180ddbac514faad68" exitCode=0 Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.549616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561120-kg66j" event={"ID":"e42ea2a0-f6a3-4095-a842-1a7df5f742b1","Type":"ContainerDied","Data":"dee53f2f2a54132c92fba268f9a6b133d41436ae47ef187180ddbac514faad68"} Mar 16 13:20:03 crc kubenswrapper[5030]: I0316 13:20:03.716357 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-759f64656b-g2hjp"] Mar 16 13:20:03 crc kubenswrapper[5030]: W0316 13:20:03.717749 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f0e674d_c17f_4daa_a37e_8e2b1a4f6dd7.slice/crio-bf10caf3e076a4be27d007f3dbcab69e33eb683739d3837fb900c07c8cace3f1 WatchSource:0}: Error finding container bf10caf3e076a4be27d007f3dbcab69e33eb683739d3837fb900c07c8cace3f1: Status 404 returned error can't find the container with id bf10caf3e076a4be27d007f3dbcab69e33eb683739d3837fb900c07c8cace3f1 Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.559743 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-759f64656b-g2hjp" event={"ID":"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7","Type":"ContainerStarted","Data":"9e4909da3a619e6fc1de6bcb025d76cfb8d6774aa72fff4e27231a190252cf88"} Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.559831 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-759f64656b-g2hjp" event={"ID":"5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7","Type":"ContainerStarted","Data":"bf10caf3e076a4be27d007f3dbcab69e33eb683739d3837fb900c07c8cace3f1"} Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.582563 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-759f64656b-g2hjp" podStartSLOduration=1.582538014 podStartE2EDuration="1.582538014s" podCreationTimestamp="2026-03-16 13:20:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:20:04.577882711 +0000 UTC m=+848.977195279" watchObservedRunningTime="2026-03-16 13:20:04.582538014 +0000 UTC m=+848.981850561" Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.779253 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.856878 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5g68\" (UniqueName: \"kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68\") pod \"e42ea2a0-f6a3-4095-a842-1a7df5f742b1\" (UID: \"e42ea2a0-f6a3-4095-a842-1a7df5f742b1\") " Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.863858 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68" (OuterVolumeSpecName: "kube-api-access-k5g68") pod "e42ea2a0-f6a3-4095-a842-1a7df5f742b1" (UID: "e42ea2a0-f6a3-4095-a842-1a7df5f742b1"). InnerVolumeSpecName "kube-api-access-k5g68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:20:04 crc kubenswrapper[5030]: I0316 13:20:04.959046 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5g68\" (UniqueName: \"kubernetes.io/projected/e42ea2a0-f6a3-4095-a842-1a7df5f742b1-kube-api-access-k5g68\") on node \"crc\" DevicePath \"\"" Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.568240 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561120-kg66j" Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.568296 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561120-kg66j" event={"ID":"e42ea2a0-f6a3-4095-a842-1a7df5f742b1","Type":"ContainerDied","Data":"5c52a84e653318a843cc73d38802265d3fa4a9594d536fb4bdc2ca4ecb852d79"} Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.568343 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c52a84e653318a843cc73d38802265d3fa4a9594d536fb4bdc2ca4ecb852d79" Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.607079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561114-sflgz"] Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.610694 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561114-sflgz"] Mar 16 13:20:05 crc kubenswrapper[5030]: I0316 13:20:05.954166 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e1edb2-555e-4c5f-96c2-22f8eefe31c5" path="/var/lib/kubelet/pods/05e1edb2-555e-4c5f-96c2-22f8eefe31c5/volumes" Mar 16 13:20:09 crc kubenswrapper[5030]: I0316 13:20:09.515602 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-frr-k8s/frr-k8s-kk5pm" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.668178 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.669097 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42ea2a0-f6a3-4095-a842-1a7df5f742b1" containerName="oc" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.669116 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42ea2a0-f6a3-4095-a842-1a7df5f742b1" containerName="oc" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.669242 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e42ea2a0-f6a3-4095-a842-1a7df5f742b1" containerName="oc" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.672864 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.674033 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.674185 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-index-dockercfg-grd9j\"" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.674392 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"openshift-service-ca.crt\"" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.675259 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-operators\"/\"kube-root-ca.crt\"" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.755339 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hf47\" (UniqueName: \"kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47\") pod \"openstack-operator-index-lwtf9\" (UID: \"093af23f-2389-4187-8e34-b3812cb80c6f\") " pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.856106 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hf47\" (UniqueName: \"kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47\") pod \"openstack-operator-index-lwtf9\" (UID: \"093af23f-2389-4187-8e34-b3812cb80c6f\") " pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.871538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hf47\" (UniqueName: \"kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47\") pod \"openstack-operator-index-lwtf9\" (UID: \"093af23f-2389-4187-8e34-b3812cb80c6f\") " pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:12 crc kubenswrapper[5030]: I0316 13:20:12.986104 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:13 crc kubenswrapper[5030]: I0316 13:20:13.344421 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:13 crc kubenswrapper[5030]: W0316 13:20:13.345820 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093af23f_2389_4187_8e34_b3812cb80c6f.slice/crio-ea187bd3ad2da542be00b029b6af7da484da45d317eeeaeb418d8087b887c59b WatchSource:0}: Error finding container ea187bd3ad2da542be00b029b6af7da484da45d317eeeaeb418d8087b887c59b: Status 404 returned error can't find the container with id ea187bd3ad2da542be00b029b6af7da484da45d317eeeaeb418d8087b887c59b Mar 16 13:20:13 crc kubenswrapper[5030]: I0316 13:20:13.625580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-lwtf9" event={"ID":"093af23f-2389-4187-8e34-b3812cb80c6f","Type":"ContainerStarted","Data":"ea187bd3ad2da542be00b029b6af7da484da45d317eeeaeb418d8087b887c59b"} Mar 16 13:20:16 crc kubenswrapper[5030]: I0316 13:20:16.841301 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.445448 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-vj6jm"] Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.450179 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.453896 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-vj6jm"] Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.519122 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkbk6\" (UniqueName: \"kubernetes.io/projected/56e99ffe-e8e4-4e04-a9c0-254ae926dfdc-kube-api-access-pkbk6\") pod \"openstack-operator-index-vj6jm\" (UID: \"56e99ffe-e8e4-4e04-a9c0-254ae926dfdc\") " pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.620512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkbk6\" (UniqueName: \"kubernetes.io/projected/56e99ffe-e8e4-4e04-a9c0-254ae926dfdc-kube-api-access-pkbk6\") pod \"openstack-operator-index-vj6jm\" (UID: \"56e99ffe-e8e4-4e04-a9c0-254ae926dfdc\") " pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.638273 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkbk6\" (UniqueName: \"kubernetes.io/projected/56e99ffe-e8e4-4e04-a9c0-254ae926dfdc-kube-api-access-pkbk6\") pod \"openstack-operator-index-vj6jm\" (UID: \"56e99ffe-e8e4-4e04-a9c0-254ae926dfdc\") " pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:17 crc kubenswrapper[5030]: I0316 13:20:17.768982 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:19 crc kubenswrapper[5030]: W0316 13:20:19.948958 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e99ffe_e8e4_4e04_a9c0_254ae926dfdc.slice/crio-624ac31b0d7a3d8cd7124436c934d1b2d22744bf3dbd9faab49c7f9a4b122d6d WatchSource:0}: Error finding container 624ac31b0d7a3d8cd7124436c934d1b2d22744bf3dbd9faab49c7f9a4b122d6d: Status 404 returned error can't find the container with id 624ac31b0d7a3d8cd7124436c934d1b2d22744bf3dbd9faab49c7f9a4b122d6d Mar 16 13:20:19 crc kubenswrapper[5030]: I0316 13:20:19.953286 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-vj6jm"] Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.671733 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-lwtf9" event={"ID":"093af23f-2389-4187-8e34-b3812cb80c6f","Type":"ContainerStarted","Data":"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a"} Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.671817 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-lwtf9" podUID="093af23f-2389-4187-8e34-b3812cb80c6f" containerName="registry-server" containerID="cri-o://1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a" gracePeriod=2 Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.673864 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-vj6jm" event={"ID":"56e99ffe-e8e4-4e04-a9c0-254ae926dfdc","Type":"ContainerStarted","Data":"39939546d391b0dcc3646a945a87198d98dbfdfe88e7d58ca8a83398e07d7fa3"} Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.673902 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-vj6jm" event={"ID":"56e99ffe-e8e4-4e04-a9c0-254ae926dfdc","Type":"ContainerStarted","Data":"624ac31b0d7a3d8cd7124436c934d1b2d22744bf3dbd9faab49c7f9a4b122d6d"} Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.689285 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-lwtf9" podStartSLOduration=2.379501306 podStartE2EDuration="8.689266713s" podCreationTimestamp="2026-03-16 13:20:12 +0000 UTC" firstStartedPulling="2026-03-16 13:20:13.347263877 +0000 UTC m=+857.746576424" lastFinishedPulling="2026-03-16 13:20:19.657029284 +0000 UTC m=+864.056341831" observedRunningTime="2026-03-16 13:20:20.685496764 +0000 UTC m=+865.084809312" watchObservedRunningTime="2026-03-16 13:20:20.689266713 +0000 UTC m=+865.088579260" Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.700606 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-vj6jm" podStartSLOduration=3.157633601 podStartE2EDuration="3.700595882s" podCreationTimestamp="2026-03-16 13:20:17 +0000 UTC" firstStartedPulling="2026-03-16 13:20:19.951122362 +0000 UTC m=+864.350434909" lastFinishedPulling="2026-03-16 13:20:20.494084642 +0000 UTC m=+864.893397190" observedRunningTime="2026-03-16 13:20:20.696852465 +0000 UTC m=+865.096165012" watchObservedRunningTime="2026-03-16 13:20:20.700595882 +0000 UTC m=+865.099908429" Mar 16 13:20:20 crc kubenswrapper[5030]: I0316 13:20:20.982793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.163360 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hf47\" (UniqueName: \"kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47\") pod \"093af23f-2389-4187-8e34-b3812cb80c6f\" (UID: \"093af23f-2389-4187-8e34-b3812cb80c6f\") " Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.168628 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47" (OuterVolumeSpecName: "kube-api-access-8hf47") pod "093af23f-2389-4187-8e34-b3812cb80c6f" (UID: "093af23f-2389-4187-8e34-b3812cb80c6f"). InnerVolumeSpecName "kube-api-access-8hf47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.264127 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hf47\" (UniqueName: \"kubernetes.io/projected/093af23f-2389-4187-8e34-b3812cb80c6f-kube-api-access-8hf47\") on node \"crc\" DevicePath \"\"" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.680332 5030 generic.go:358] "Generic (PLEG): container finished" podID="093af23f-2389-4187-8e34-b3812cb80c6f" containerID="1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a" exitCode=0 Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.680389 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-lwtf9" event={"ID":"093af23f-2389-4187-8e34-b3812cb80c6f","Type":"ContainerDied","Data":"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a"} Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.680428 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-lwtf9" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.680745 5030 scope.go:117] "RemoveContainer" containerID="1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.680706 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-lwtf9" event={"ID":"093af23f-2389-4187-8e34-b3812cb80c6f","Type":"ContainerDied","Data":"ea187bd3ad2da542be00b029b6af7da484da45d317eeeaeb418d8087b887c59b"} Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.698974 5030 scope.go:117] "RemoveContainer" containerID="1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a" Mar 16 13:20:21 crc kubenswrapper[5030]: E0316 13:20:21.699364 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a\": container with ID starting with 1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a not found: ID does not exist" containerID="1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.699414 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a"} err="failed to get container status \"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a\": rpc error: code = NotFound desc = could not find container \"1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a\": container with ID starting with 1d6ad85bd8611b16301c0f0dc33e1ae578f04513783ba380b044c2855108926a not found: ID does not exist" Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.705913 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.708966 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-lwtf9"] Mar 16 13:20:21 crc kubenswrapper[5030]: I0316 13:20:21.952725 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093af23f-2389-4187-8e34-b3812cb80c6f" path="/var/lib/kubelet/pods/093af23f-2389-4187-8e34-b3812cb80c6f/volumes" Mar 16 13:20:27 crc kubenswrapper[5030]: I0316 13:20:27.769769 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:27 crc kubenswrapper[5030]: I0316 13:20:27.770309 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:27 crc kubenswrapper[5030]: I0316 13:20:27.794356 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:28 crc kubenswrapper[5030]: I0316 13:20:28.743882 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-vj6jm" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.183335 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4"] Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.184101 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093af23f-2389-4187-8e34-b3812cb80c6f" containerName="registry-server" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.184118 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="093af23f-2389-4187-8e34-b3812cb80c6f" containerName="registry-server" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.184239 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="093af23f-2389-4187-8e34-b3812cb80c6f" containerName="registry-server" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.188119 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.190012 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"default-dockercfg-j95zs\"" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.190817 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4"] Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.222195 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.222251 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ssg5\" (UniqueName: \"kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.222384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.324230 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.324309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ssg5\" (UniqueName: \"kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.324368 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.325852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.326109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.342283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ssg5\" (UniqueName: \"kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5\") pod \"607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.500915 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:35 crc kubenswrapper[5030]: I0316 13:20:35.855726 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4"] Mar 16 13:20:36 crc kubenswrapper[5030]: I0316 13:20:36.768600 5030 generic.go:358] "Generic (PLEG): container finished" podID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerID="a21549a18623b12d931ff4f4c7d636b62baeeeab7002e12300986886736eb1cd" exitCode=0 Mar 16 13:20:36 crc kubenswrapper[5030]: I0316 13:20:36.768652 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" event={"ID":"c55cc7f7-7b8e-41b5-b85a-048aea828942","Type":"ContainerDied","Data":"a21549a18623b12d931ff4f4c7d636b62baeeeab7002e12300986886736eb1cd"} Mar 16 13:20:36 crc kubenswrapper[5030]: I0316 13:20:36.769017 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" event={"ID":"c55cc7f7-7b8e-41b5-b85a-048aea828942","Type":"ContainerStarted","Data":"07a156a2f2ff8cb0bad189b3d09227d7950e1d3ad755230e392300366c3f300a"} Mar 16 13:20:37 crc kubenswrapper[5030]: I0316 13:20:37.776600 5030 generic.go:358] "Generic (PLEG): container finished" podID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerID="4432424b1a8f69def114351582748d84f9a9db0fea150430cc21784fdc8a9e04" exitCode=0 Mar 16 13:20:37 crc kubenswrapper[5030]: I0316 13:20:37.776773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" event={"ID":"c55cc7f7-7b8e-41b5-b85a-048aea828942","Type":"ContainerDied","Data":"4432424b1a8f69def114351582748d84f9a9db0fea150430cc21784fdc8a9e04"} Mar 16 13:20:38 crc kubenswrapper[5030]: I0316 13:20:38.784230 5030 generic.go:358] "Generic (PLEG): container finished" podID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerID="e0856830a378f5c775d4d72f60298a5684002302ecbe2ff591a245edbd5a394f" exitCode=0 Mar 16 13:20:38 crc kubenswrapper[5030]: I0316 13:20:38.784322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" event={"ID":"c55cc7f7-7b8e-41b5-b85a-048aea828942","Type":"ContainerDied","Data":"e0856830a378f5c775d4d72f60298a5684002302ecbe2ff591a245edbd5a394f"} Mar 16 13:20:39 crc kubenswrapper[5030]: I0316 13:20:39.991588 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.088777 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle\") pod \"c55cc7f7-7b8e-41b5-b85a-048aea828942\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.089398 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle" (OuterVolumeSpecName: "bundle") pod "c55cc7f7-7b8e-41b5-b85a-048aea828942" (UID: "c55cc7f7-7b8e-41b5-b85a-048aea828942"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.089497 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util\") pod \"c55cc7f7-7b8e-41b5-b85a-048aea828942\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.090351 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ssg5\" (UniqueName: \"kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5\") pod \"c55cc7f7-7b8e-41b5-b85a-048aea828942\" (UID: \"c55cc7f7-7b8e-41b5-b85a-048aea828942\") " Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.090947 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.095590 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5" (OuterVolumeSpecName: "kube-api-access-7ssg5") pod "c55cc7f7-7b8e-41b5-b85a-048aea828942" (UID: "c55cc7f7-7b8e-41b5-b85a-048aea828942"). InnerVolumeSpecName "kube-api-access-7ssg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.099099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util" (OuterVolumeSpecName: "util") pod "c55cc7f7-7b8e-41b5-b85a-048aea828942" (UID: "c55cc7f7-7b8e-41b5-b85a-048aea828942"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.192331 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ssg5\" (UniqueName: \"kubernetes.io/projected/c55cc7f7-7b8e-41b5-b85a-048aea828942-kube-api-access-7ssg5\") on node \"crc\" DevicePath \"\"" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.192361 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c55cc7f7-7b8e-41b5-b85a-048aea828942-util\") on node \"crc\" DevicePath \"\"" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.798822 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" event={"ID":"c55cc7f7-7b8e-41b5-b85a-048aea828942","Type":"ContainerDied","Data":"07a156a2f2ff8cb0bad189b3d09227d7950e1d3ad755230e392300366c3f300a"} Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.798870 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07a156a2f2ff8cb0bad189b3d09227d7950e1d3ad755230e392300366c3f300a" Mar 16 13:20:40 crc kubenswrapper[5030]: I0316 13:20:40.798872 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.248413 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp"] Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.249951 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="extract" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250052 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="extract" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250113 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="util" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250161 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="util" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250220 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="pull" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250266 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="pull" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.250458 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c55cc7f7-7b8e-41b5-b85a-048aea828942" containerName="extract" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.252805 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.254716 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-controller-init-dockercfg-dcl85\"" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.265253 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp"] Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.378194 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfpn\" (UniqueName: \"kubernetes.io/projected/48a14535-29df-430f-be17-4042252cba4a-kube-api-access-pvfpn\") pod \"openstack-operator-controller-init-7b76cc8c59-b48fp\" (UID: \"48a14535-29df-430f-be17-4042252cba4a\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.479921 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfpn\" (UniqueName: \"kubernetes.io/projected/48a14535-29df-430f-be17-4042252cba4a-kube-api-access-pvfpn\") pod \"openstack-operator-controller-init-7b76cc8c59-b48fp\" (UID: \"48a14535-29df-430f-be17-4042252cba4a\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.497605 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfpn\" (UniqueName: \"kubernetes.io/projected/48a14535-29df-430f-be17-4042252cba4a-kube-api-access-pvfpn\") pod \"openstack-operator-controller-init-7b76cc8c59-b48fp\" (UID: \"48a14535-29df-430f-be17-4042252cba4a\") " pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:47 crc kubenswrapper[5030]: I0316 13:20:47.566217 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:48 crc kubenswrapper[5030]: I0316 13:20:48.045482 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp"] Mar 16 13:20:48 crc kubenswrapper[5030]: I0316 13:20:48.847180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" event={"ID":"48a14535-29df-430f-be17-4042252cba4a","Type":"ContainerStarted","Data":"f35a36548a01ae050faec9c9770c09d1f0d4ffae8807be3e0c4c25cbc31afaf0"} Mar 16 13:20:52 crc kubenswrapper[5030]: I0316 13:20:52.877668 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" event={"ID":"48a14535-29df-430f-be17-4042252cba4a","Type":"ContainerStarted","Data":"7a0a9b15bee740936cde534db9b196e1f1e321eef33cb01e7652ef7a6470171e"} Mar 16 13:20:52 crc kubenswrapper[5030]: I0316 13:20:52.878054 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:20:52 crc kubenswrapper[5030]: I0316 13:20:52.902114 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" podStartSLOduration=1.9608274049999999 podStartE2EDuration="5.902099928s" podCreationTimestamp="2026-03-16 13:20:47 +0000 UTC" firstStartedPulling="2026-03-16 13:20:48.055999963 +0000 UTC m=+892.455312509" lastFinishedPulling="2026-03-16 13:20:51.997272485 +0000 UTC m=+896.396585032" observedRunningTime="2026-03-16 13:20:52.89843637 +0000 UTC m=+897.297748918" watchObservedRunningTime="2026-03-16 13:20:52.902099928 +0000 UTC m=+897.301412475" Mar 16 13:20:53 crc kubenswrapper[5030]: E0316 13:20:53.324400 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=781067 actualBytes=10240 Mar 16 13:20:56 crc kubenswrapper[5030]: I0316 13:20:56.228594 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:20:56 crc kubenswrapper[5030]: I0316 13:20:56.231032 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:20:56 crc kubenswrapper[5030]: I0316 13:20:56.236763 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:20:56 crc kubenswrapper[5030]: I0316 13:20:56.238186 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:20:56 crc kubenswrapper[5030]: I0316 13:20:56.560770 5030 scope.go:117] "RemoveContainer" containerID="e726e6ef6e5170fdc74a37098adc29f681cff4916c4bb608d6e86da019f61343" Mar 16 13:21:04 crc kubenswrapper[5030]: I0316 13:21:04.892811 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-init-7b76cc8c59-b48fp" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.892113 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.902752 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.903838 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.905436 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.906260 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"barbican-operator-controller-manager-dockercfg-xjsqt\"" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.906912 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"cinder-operator-controller-manager-dockercfg-m4k5m\"" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.907536 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.932109 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.969655 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.978852 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.980727 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.985683 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"designate-operator-controller-manager-dockercfg-hcbzs\"" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.986903 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm"] Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.987018 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:21 crc kubenswrapper[5030]: I0316 13:21:21.990115 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"glance-operator-controller-manager-dockercfg-9nhwd\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.004830 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r788n\" (UniqueName: \"kubernetes.io/projected/c9dea77a-4d1e-4b1a-922d-562ecff4eb24-kube-api-access-r788n\") pod \"cinder-operator-controller-manager-55bc8cdcc4-xp7rw\" (UID: \"c9dea77a-4d1e-4b1a-922d-562ecff4eb24\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.004875 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8xzd\" (UniqueName: \"kubernetes.io/projected/15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe-kube-api-access-g8xzd\") pod \"barbican-operator-controller-manager-848cfb5779-rvhc2\" (UID: \"15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.006754 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.015652 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.019441 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.021691 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"heat-operator-controller-manager-dockercfg-g7tlf\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.021694 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.025254 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.026721 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"horizon-operator-controller-manager-dockercfg-7fjn4\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.039137 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.045702 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.064662 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.068655 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.073999 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-webhook-server-cert\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.074273 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"infra-operator-controller-manager-dockercfg-4snd2\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.101146 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.107014 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.113011 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"keystone-operator-controller-manager-dockercfg-dlssq\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.117961 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.117998 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120245 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx69w\" (UniqueName: \"kubernetes.io/projected/abb96aea-ef66-4411-8824-3317f9e44a8d-kube-api-access-rx69w\") pod \"designate-operator-controller-manager-7cf89c67bb-dqm94\" (UID: \"abb96aea-ef66-4411-8824-3317f9e44a8d\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120291 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hnp\" (UniqueName: \"kubernetes.io/projected/70f26644-127c-4815-8b72-7d4e18e4a809-kube-api-access-f9hnp\") pod \"glance-operator-controller-manager-58d9bbd8cc-24vjm\" (UID: \"70f26644-127c-4815-8b72-7d4e18e4a809\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz5jh\" (UniqueName: \"kubernetes.io/projected/e3f81986-b429-4bae-bdf6-ab4cff5534f9-kube-api-access-xz5jh\") pod \"heat-operator-controller-manager-79975d4c95-7vrpq\" (UID: \"e3f81986-b429-4bae-bdf6-ab4cff5534f9\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120353 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r788n\" (UniqueName: \"kubernetes.io/projected/c9dea77a-4d1e-4b1a-922d-562ecff4eb24-kube-api-access-r788n\") pod \"cinder-operator-controller-manager-55bc8cdcc4-xp7rw\" (UID: \"c9dea77a-4d1e-4b1a-922d-562ecff4eb24\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8xzd\" (UniqueName: \"kubernetes.io/projected/15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe-kube-api-access-g8xzd\") pod \"barbican-operator-controller-manager-848cfb5779-rvhc2\" (UID: \"15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.120456 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj7bt\" (UniqueName: \"kubernetes.io/projected/c2559c1e-8b4e-40f5-b4fc-d0fd6950b084-kube-api-access-tj7bt\") pod \"horizon-operator-controller-manager-5bf9fb4564-pdshw\" (UID: \"c2559c1e-8b4e-40f5-b4fc-d0fd6950b084\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.125094 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.125200 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.126278 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.133902 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"ironic-operator-controller-manager-dockercfg-9rnvb\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.135712 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.136189 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.143451 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.144321 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"manila-operator-controller-manager-dockercfg-s5wsx\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.153073 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r788n\" (UniqueName: \"kubernetes.io/projected/c9dea77a-4d1e-4b1a-922d-562ecff4eb24-kube-api-access-r788n\") pod \"cinder-operator-controller-manager-55bc8cdcc4-xp7rw\" (UID: \"c9dea77a-4d1e-4b1a-922d-562ecff4eb24\") " pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.169100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8xzd\" (UniqueName: \"kubernetes.io/projected/15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe-kube-api-access-g8xzd\") pod \"barbican-operator-controller-manager-848cfb5779-rvhc2\" (UID: \"15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe\") " pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.177225 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.177270 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.177284 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.177497 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.180432 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.180464 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.187120 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.188222 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.189329 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"mariadb-operator-controller-manager-dockercfg-jfgpn\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.192522 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.192576 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.192592 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.192649 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.192743 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.209077 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.209137 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.211721 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.223703 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.227572 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnlvt\" (UniqueName: \"kubernetes.io/projected/c30b09f1-af80-45c5-a218-2726d37fcc84-kube-api-access-hnlvt\") pod \"ironic-operator-controller-manager-997698bf9-kvdhl\" (UID: \"c30b09f1-af80-45c5-a218-2726d37fcc84\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.227624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj7bt\" (UniqueName: \"kubernetes.io/projected/c2559c1e-8b4e-40f5-b4fc-d0fd6950b084-kube-api-access-tj7bt\") pod \"horizon-operator-controller-manager-5bf9fb4564-pdshw\" (UID: \"c2559c1e-8b4e-40f5-b4fc-d0fd6950b084\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.227673 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45ms\" (UniqueName: \"kubernetes.io/projected/efb378d9-327b-4064-b4cb-60d7ea01c7e5-kube-api-access-h45ms\") pod \"manila-operator-controller-manager-7d6d87b867-w2kh9\" (UID: \"efb378d9-327b-4064-b4cb-60d7ea01c7e5\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.227732 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.228374 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"octavia-operator-controller-manager-dockercfg-2vmbs\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.228724 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"neutron-operator-controller-manager-dockercfg-vbng2\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.228893 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"nova-operator-controller-manager-dockercfg-4mvw9\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.229333 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwpm\" (UniqueName: \"kubernetes.io/projected/7cc12ea5-48ad-4e56-8980-2da1ff87da0b-kube-api-access-7xwpm\") pod \"keystone-operator-controller-manager-6f5b9fd59-485fs\" (UID: \"7cc12ea5-48ad-4e56-8980-2da1ff87da0b\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.229432 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rx69w\" (UniqueName: \"kubernetes.io/projected/abb96aea-ef66-4411-8824-3317f9e44a8d-kube-api-access-rx69w\") pod \"designate-operator-controller-manager-7cf89c67bb-dqm94\" (UID: \"abb96aea-ef66-4411-8824-3317f9e44a8d\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.229494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hnp\" (UniqueName: \"kubernetes.io/projected/70f26644-127c-4815-8b72-7d4e18e4a809-kube-api-access-f9hnp\") pod \"glance-operator-controller-manager-58d9bbd8cc-24vjm\" (UID: \"70f26644-127c-4815-8b72-7d4e18e4a809\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.229523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xz5jh\" (UniqueName: \"kubernetes.io/projected/e3f81986-b429-4bae-bdf6-ab4cff5534f9-kube-api-access-xz5jh\") pod \"heat-operator-controller-manager-79975d4c95-7vrpq\" (UID: \"e3f81986-b429-4bae-bdf6-ab4cff5534f9\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.229606 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gv9n\" (UniqueName: \"kubernetes.io/projected/7253144c-27eb-4979-a38d-419a993ae47f-kube-api-access-5gv9n\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.230753 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"ovn-operator-controller-manager-dockercfg-hvs4t\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.230979 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-baremetal-operator-controller-manager-dockercfg-z6g2j\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.231132 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-baremetal-operator-webhook-server-cert\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.257329 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.260128 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.262285 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hnp\" (UniqueName: \"kubernetes.io/projected/70f26644-127c-4815-8b72-7d4e18e4a809-kube-api-access-f9hnp\") pod \"glance-operator-controller-manager-58d9bbd8cc-24vjm\" (UID: \"70f26644-127c-4815-8b72-7d4e18e4a809\") " pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.265429 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx69w\" (UniqueName: \"kubernetes.io/projected/abb96aea-ef66-4411-8824-3317f9e44a8d-kube-api-access-rx69w\") pod \"designate-operator-controller-manager-7cf89c67bb-dqm94\" (UID: \"abb96aea-ef66-4411-8824-3317f9e44a8d\") " pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.271825 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj7bt\" (UniqueName: \"kubernetes.io/projected/c2559c1e-8b4e-40f5-b4fc-d0fd6950b084-kube-api-access-tj7bt\") pod \"horizon-operator-controller-manager-5bf9fb4564-pdshw\" (UID: \"c2559c1e-8b4e-40f5-b4fc-d0fd6950b084\") " pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.272069 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.285731 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.285887 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.286067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz5jh\" (UniqueName: \"kubernetes.io/projected/e3f81986-b429-4bae-bdf6-ab4cff5534f9-kube-api-access-xz5jh\") pod \"heat-operator-controller-manager-79975d4c95-7vrpq\" (UID: \"e3f81986-b429-4bae-bdf6-ab4cff5534f9\") " pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.288821 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"placement-operator-controller-manager-dockercfg-slqkk\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.295109 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.307746 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.317801 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.327142 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.334316 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gv9n\" (UniqueName: \"kubernetes.io/projected/7253144c-27eb-4979-a38d-419a993ae47f-kube-api-access-5gv9n\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svdjp\" (UniqueName: \"kubernetes.io/projected/d72d8146-effa-4874-bddf-6c525d6b1cda-kube-api-access-svdjp\") pod \"ovn-operator-controller-manager-6fb6cd45c4-hqxj8\" (UID: \"d72d8146-effa-4874-bddf-6c525d6b1cda\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335365 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnlvt\" (UniqueName: \"kubernetes.io/projected/c30b09f1-af80-45c5-a218-2726d37fcc84-kube-api-access-hnlvt\") pod \"ironic-operator-controller-manager-997698bf9-kvdhl\" (UID: \"c30b09f1-af80-45c5-a218-2726d37fcc84\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335385 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hbc\" (UniqueName: \"kubernetes.io/projected/cf6ecc43-5300-45aa-9a53-74967162632e-kube-api-access-c5hbc\") pod \"octavia-operator-controller-manager-7b89675745-w6gzv\" (UID: \"cf6ecc43-5300-45aa-9a53-74967162632e\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5kx\" (UniqueName: \"kubernetes.io/projected/8dd73d63-1019-48db-88da-47a95894a2ae-kube-api-access-vc5kx\") pod \"nova-operator-controller-manager-785d77464d-hzfh6\" (UID: \"8dd73d63-1019-48db-88da-47a95894a2ae\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h45ms\" (UniqueName: \"kubernetes.io/projected/efb378d9-327b-4064-b4cb-60d7ea01c7e5-kube-api-access-h45ms\") pod \"manila-operator-controller-manager-7d6d87b867-w2kh9\" (UID: \"efb378d9-327b-4064-b4cb-60d7ea01c7e5\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335477 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9mw\" (UniqueName: \"kubernetes.io/projected/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-kube-api-access-qx9mw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335559 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335605 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwpm\" (UniqueName: \"kubernetes.io/projected/7cc12ea5-48ad-4e56-8980-2da1ff87da0b-kube-api-access-7xwpm\") pod \"keystone-operator-controller-manager-6f5b9fd59-485fs\" (UID: \"7cc12ea5-48ad-4e56-8980-2da1ff87da0b\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zhc\" (UniqueName: \"kubernetes.io/projected/16bd7d26-97ce-4773-9866-35d85ed1f978-kube-api-access-79zhc\") pod \"neutron-operator-controller-manager-75c6f4bc76-66pvn\" (UID: \"16bd7d26-97ce-4773-9866-35d85ed1f978\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.335676 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmjb6\" (UniqueName: \"kubernetes.io/projected/d2c78a21-5083-4ded-a44e-6bd51017e613-kube-api-access-vmjb6\") pod \"mariadb-operator-controller-manager-5748db694b-2fhf2\" (UID: \"d2c78a21-5083-4ded-a44e-6bd51017e613\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.336564 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.336971 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:22.836608985 +0000 UTC m=+927.235921532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.340032 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"swift-operator-controller-manager-dockercfg-jtzgm\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.348338 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.361808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gv9n\" (UniqueName: \"kubernetes.io/projected/7253144c-27eb-4979-a38d-419a993ae47f-kube-api-access-5gv9n\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.362358 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45ms\" (UniqueName: \"kubernetes.io/projected/efb378d9-327b-4064-b4cb-60d7ea01c7e5-kube-api-access-h45ms\") pod \"manila-operator-controller-manager-7d6d87b867-w2kh9\" (UID: \"efb378d9-327b-4064-b4cb-60d7ea01c7e5\") " pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.362488 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.366654 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnlvt\" (UniqueName: \"kubernetes.io/projected/c30b09f1-af80-45c5-a218-2726d37fcc84-kube-api-access-hnlvt\") pod \"ironic-operator-controller-manager-997698bf9-kvdhl\" (UID: \"c30b09f1-af80-45c5-a218-2726d37fcc84\") " pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.367125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwpm\" (UniqueName: \"kubernetes.io/projected/7cc12ea5-48ad-4e56-8980-2da1ff87da0b-kube-api-access-7xwpm\") pod \"keystone-operator-controller-manager-6f5b9fd59-485fs\" (UID: \"7cc12ea5-48ad-4e56-8980-2da1ff87da0b\") " pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.371034 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.376220 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.390013 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.391419 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"telemetry-operator-controller-manager-dockercfg-gf7bx\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.412808 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.435338 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svdjp\" (UniqueName: \"kubernetes.io/projected/d72d8146-effa-4874-bddf-6c525d6b1cda-kube-api-access-svdjp\") pod \"ovn-operator-controller-manager-6fb6cd45c4-hqxj8\" (UID: \"d72d8146-effa-4874-bddf-6c525d6b1cda\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436678 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hbc\" (UniqueName: \"kubernetes.io/projected/cf6ecc43-5300-45aa-9a53-74967162632e-kube-api-access-c5hbc\") pod \"octavia-operator-controller-manager-7b89675745-w6gzv\" (UID: \"cf6ecc43-5300-45aa-9a53-74967162632e\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdmp\" (UniqueName: \"kubernetes.io/projected/0e928026-eaab-4408-a189-5fceb745b232-kube-api-access-kqdmp\") pod \"placement-operator-controller-manager-57fdd4b4cf-2z7l6\" (UID: \"0e928026-eaab-4408-a189-5fceb745b232\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5kx\" (UniqueName: \"kubernetes.io/projected/8dd73d63-1019-48db-88da-47a95894a2ae-kube-api-access-vc5kx\") pod \"nova-operator-controller-manager-785d77464d-hzfh6\" (UID: \"8dd73d63-1019-48db-88da-47a95894a2ae\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436811 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9mw\" (UniqueName: \"kubernetes.io/projected/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-kube-api-access-qx9mw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9k64\" (UniqueName: \"kubernetes.io/projected/40eebc4f-195d-495e-a989-4fd7684c3624-kube-api-access-g9k64\") pod \"swift-operator-controller-manager-5d89b4d5d5-96l7l\" (UID: \"40eebc4f-195d-495e-a989-4fd7684c3624\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436880 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436928 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79zhc\" (UniqueName: \"kubernetes.io/projected/16bd7d26-97ce-4773-9866-35d85ed1f978-kube-api-access-79zhc\") pod \"neutron-operator-controller-manager-75c6f4bc76-66pvn\" (UID: \"16bd7d26-97ce-4773-9866-35d85ed1f978\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.436943 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmjb6\" (UniqueName: \"kubernetes.io/projected/d2c78a21-5083-4ded-a44e-6bd51017e613-kube-api-access-vmjb6\") pod \"mariadb-operator-controller-manager-5748db694b-2fhf2\" (UID: \"d2c78a21-5083-4ded-a44e-6bd51017e613\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.437688 5030 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.437748 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert podName:65a755bb-3a4c-4aaa-a9fd-d69514e1b854 nodeName:}" failed. No retries permitted until 2026-03-16 13:21:22.937729364 +0000 UTC m=+927.337041911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" (UID: "65a755bb-3a4c-4aaa-a9fd-d69514e1b854") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.448168 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-9gf58"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.454189 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.454624 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-9gf58"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.455600 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"test-operator-controller-manager-dockercfg-qfqbw\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.458380 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zhc\" (UniqueName: \"kubernetes.io/projected/16bd7d26-97ce-4773-9866-35d85ed1f978-kube-api-access-79zhc\") pod \"neutron-operator-controller-manager-75c6f4bc76-66pvn\" (UID: \"16bd7d26-97ce-4773-9866-35d85ed1f978\") " pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.460281 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5kx\" (UniqueName: \"kubernetes.io/projected/8dd73d63-1019-48db-88da-47a95894a2ae-kube-api-access-vc5kx\") pod \"nova-operator-controller-manager-785d77464d-hzfh6\" (UID: \"8dd73d63-1019-48db-88da-47a95894a2ae\") " pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.463134 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hbc\" (UniqueName: \"kubernetes.io/projected/cf6ecc43-5300-45aa-9a53-74967162632e-kube-api-access-c5hbc\") pod \"octavia-operator-controller-manager-7b89675745-w6gzv\" (UID: \"cf6ecc43-5300-45aa-9a53-74967162632e\") " pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.464679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9mw\" (UniqueName: \"kubernetes.io/projected/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-kube-api-access-qx9mw\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.464700 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmjb6\" (UniqueName: \"kubernetes.io/projected/d2c78a21-5083-4ded-a44e-6bd51017e613-kube-api-access-vmjb6\") pod \"mariadb-operator-controller-manager-5748db694b-2fhf2\" (UID: \"d2c78a21-5083-4ded-a44e-6bd51017e613\") " pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.470615 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svdjp\" (UniqueName: \"kubernetes.io/projected/d72d8146-effa-4874-bddf-6c525d6b1cda-kube-api-access-svdjp\") pod \"ovn-operator-controller-manager-6fb6cd45c4-hqxj8\" (UID: \"d72d8146-effa-4874-bddf-6c525d6b1cda\") " pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.502023 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.511953 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.512085 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.513693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"watcher-operator-controller-manager-dockercfg-d4gn7\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.515177 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.527612 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.534395 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.542341 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwvmf\" (UniqueName: \"kubernetes.io/projected/767e9b64-7c11-4116-ac41-6b1399f52f93-kube-api-access-wwvmf\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-h87bk\" (UID: \"767e9b64-7c11-4116-ac41-6b1399f52f93\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.542400 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9k64\" (UniqueName: \"kubernetes.io/projected/40eebc4f-195d-495e-a989-4fd7684c3624-kube-api-access-g9k64\") pod \"swift-operator-controller-manager-5d89b4d5d5-96l7l\" (UID: \"40eebc4f-195d-495e-a989-4fd7684c3624\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.542599 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdmp\" (UniqueName: \"kubernetes.io/projected/0e928026-eaab-4408-a189-5fceb745b232-kube-api-access-kqdmp\") pod \"placement-operator-controller-manager-57fdd4b4cf-2z7l6\" (UID: \"0e928026-eaab-4408-a189-5fceb745b232\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.544329 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.560341 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.569243 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9k64\" (UniqueName: \"kubernetes.io/projected/40eebc4f-195d-495e-a989-4fd7684c3624-kube-api-access-g9k64\") pod \"swift-operator-controller-manager-5d89b4d5d5-96l7l\" (UID: \"40eebc4f-195d-495e-a989-4fd7684c3624\") " pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.573291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdmp\" (UniqueName: \"kubernetes.io/projected/0e928026-eaab-4408-a189-5fceb745b232-kube-api-access-kqdmp\") pod \"placement-operator-controller-manager-57fdd4b4cf-2z7l6\" (UID: \"0e928026-eaab-4408-a189-5fceb745b232\") " pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.624624 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.635769 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.635913 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.639738 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"webhook-server-cert\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.639802 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"openstack-operator-controller-manager-dockercfg-jxnx2\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.639886 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"metrics-server-cert\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.643961 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hctb\" (UniqueName: \"kubernetes.io/projected/1612f31d-fe0f-4756-b5df-2a95dddfcfa9-kube-api-access-5hctb\") pod \"watcher-operator-controller-manager-65d578856c-wknpb\" (UID: \"1612f31d-fe0f-4756-b5df-2a95dddfcfa9\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.644009 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwvmf\" (UniqueName: \"kubernetes.io/projected/767e9b64-7c11-4116-ac41-6b1399f52f93-kube-api-access-wwvmf\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-h87bk\" (UID: \"767e9b64-7c11-4116-ac41-6b1399f52f93\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.644059 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9g9w\" (UniqueName: \"kubernetes.io/projected/b0bcb6b4-d41a-4576-9768-847372afafcc-kube-api-access-d9g9w\") pod \"test-operator-controller-manager-74d567479f-9gf58\" (UID: \"b0bcb6b4-d41a-4576-9768-847372afafcc\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.673839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwvmf\" (UniqueName: \"kubernetes.io/projected/767e9b64-7c11-4116-ac41-6b1399f52f93-kube-api-access-wwvmf\") pod \"telemetry-operator-controller-manager-f5cf7fcb7-h87bk\" (UID: \"767e9b64-7c11-4116-ac41-6b1399f52f93\") " pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.715453 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.719952 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.731796 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.731950 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.735991 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.736221 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.736397 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-operators\"/\"rabbitmq-cluster-operator-controller-manager-dockercfg-dmxdw\"" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.745529 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.745663 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hctb\" (UniqueName: \"kubernetes.io/projected/1612f31d-fe0f-4756-b5df-2a95dddfcfa9-kube-api-access-5hctb\") pod \"watcher-operator-controller-manager-65d578856c-wknpb\" (UID: \"1612f31d-fe0f-4756-b5df-2a95dddfcfa9\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.745734 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9g9w\" (UniqueName: \"kubernetes.io/projected/b0bcb6b4-d41a-4576-9768-847372afafcc-kube-api-access-d9g9w\") pod \"test-operator-controller-manager-74d567479f-9gf58\" (UID: \"b0bcb6b4-d41a-4576-9768-847372afafcc\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.745767 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.745800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmfk\" (UniqueName: \"kubernetes.io/projected/31b27f63-44bb-4f0a-b48e-cce502308c0b-kube-api-access-kqmfk\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.748150 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.752010 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.778176 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hctb\" (UniqueName: \"kubernetes.io/projected/1612f31d-fe0f-4756-b5df-2a95dddfcfa9-kube-api-access-5hctb\") pod \"watcher-operator-controller-manager-65d578856c-wknpb\" (UID: \"1612f31d-fe0f-4756-b5df-2a95dddfcfa9\") " pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.778819 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9g9w\" (UniqueName: \"kubernetes.io/projected/b0bcb6b4-d41a-4576-9768-847372afafcc-kube-api-access-d9g9w\") pod \"test-operator-controller-manager-74d567479f-9gf58\" (UID: \"b0bcb6b4-d41a-4576-9768-847372afafcc\") " pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.789885 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.817811 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.855765 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmfk\" (UniqueName: \"kubernetes.io/projected/31b27f63-44bb-4f0a-b48e-cce502308c0b-kube-api-access-kqmfk\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.855874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.856000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.856046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.856074 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvxh\" (UniqueName: \"kubernetes.io/projected/9733ae7a-be03-4a43-a5e8-1e154eb4e91f-kube-api-access-kzvxh\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9\" (UID: \"9733ae7a-be03-4a43-a5e8-1e154eb4e91f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.856565 5030 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.856618 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:23.356600318 +0000 UTC m=+927.755912865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "metrics-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.867042 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.867627 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:23.867607575 +0000 UTC m=+928.266920123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.867783 5030 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.867873 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:23.367863428 +0000 UTC m=+927.767175975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.887023 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmfk\" (UniqueName: \"kubernetes.io/projected/31b27f63-44bb-4f0a-b48e-cce502308c0b-kube-api-access-kqmfk\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.922787 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2"] Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.959754 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.959815 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvxh\" (UniqueName: \"kubernetes.io/projected/9733ae7a-be03-4a43-a5e8-1e154eb4e91f-kube-api-access-kzvxh\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9\" (UID: \"9733ae7a-be03-4a43-a5e8-1e154eb4e91f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.961225 5030 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: E0316 13:21:22.961291 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert podName:65a755bb-3a4c-4aaa-a9fd-d69514e1b854 nodeName:}" failed. No retries permitted until 2026-03-16 13:21:23.961273882 +0000 UTC m=+928.360586419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" (UID: "65a755bb-3a4c-4aaa-a9fd-d69514e1b854") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:22 crc kubenswrapper[5030]: I0316 13:21:22.984776 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvxh\" (UniqueName: \"kubernetes.io/projected/9733ae7a-be03-4a43-a5e8-1e154eb4e91f-kube-api-access-kzvxh\") pod \"rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9\" (UID: \"9733ae7a-be03-4a43-a5e8-1e154eb4e91f\") " pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.072804 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.079431 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.084686 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.088164 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.090537 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" event={"ID":"15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe","Type":"ContainerStarted","Data":"ac66b686e26a0c957949dbcbd00613a178ef8494d307753bbc88559f3a1d4058"} Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.106024 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dea77a_4d1e_4b1a_922d_562ecff4eb24.slice/crio-a87f0e6195e7b4b7908bdb9896356835ea0ddd801cf6d58ef925d3de0f12cb7a WatchSource:0}: Error finding container a87f0e6195e7b4b7908bdb9896356835ea0ddd801cf6d58ef925d3de0f12cb7a: Status 404 returned error can't find the container with id a87f0e6195e7b4b7908bdb9896356835ea0ddd801cf6d58ef925d3de0f12cb7a Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.109349 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb96aea_ef66_4411_8824_3317f9e44a8d.slice/crio-d148ea7f620fb318889484c115a5373e2372d9d92dccedfac8312ec864db9008 WatchSource:0}: Error finding container d148ea7f620fb318889484c115a5373e2372d9d92dccedfac8312ec864db9008: Status 404 returned error can't find the container with id d148ea7f620fb318889484c115a5373e2372d9d92dccedfac8312ec864db9008 Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.169386 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.278833 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.319159 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.367017 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.367467 5030 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.367538 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:24.367519875 +0000 UTC m=+928.766832422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "metrics-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.405436 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.413261 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.424286 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn"] Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.426365 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16bd7d26_97ce_4773_9866_35d85ed1f978.slice/crio-17989a455f08b137ca5f24c3194a08adba84b8fd8fac4779c0c761a5de973b15 WatchSource:0}: Error finding container 17989a455f08b137ca5f24c3194a08adba84b8fd8fac4779c0c761a5de973b15: Status 404 returned error can't find the container with id 17989a455f08b137ca5f24c3194a08adba84b8fd8fac4779c0c761a5de973b15 Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.428479 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.445053 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6"] Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.447155 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e928026_eaab_4408_a189_5fceb745b232.slice/crio-f54c6eb7cb1157d228c5697255a591eae6d59ee507113732b181fe8452de466a WatchSource:0}: Error finding container f54c6eb7cb1157d228c5697255a591eae6d59ee507113732b181fe8452de466a: Status 404 returned error can't find the container with id f54c6eb7cb1157d228c5697255a591eae6d59ee507113732b181fe8452de466a Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.469264 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.469469 5030 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.469590 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:24.46954473 +0000 UTC m=+928.868857277 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "webhook-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.556632 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/ironic-operator@sha256:9dd26bc51e7757d84736528d4988a1f980ad50ccb070aef6fc252e32c5c423a8,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hnlvt,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod ironic-operator-controller-manager-997698bf9-kvdhl_openstack-operators(c30b09f1-af80-45c5-a218-2726d37fcc84): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.556874 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl"] Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.558786 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" podUID="c30b09f1-af80-45c5-a218-2726d37fcc84" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.564340 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8"] Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.576708 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/mariadb-operator@sha256:6e7552996253fc66667eaa3eb0e11b4e97145efa2ae577155ceabf8e9913ddc1,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-vmjb6,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod mariadb-operator-controller-manager-5748db694b-2fhf2_openstack-operators(d2c78a21-5083-4ded-a44e-6bd51017e613): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.577869 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" podUID="d2c78a21-5083-4ded-a44e-6bd51017e613" Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.582019 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6ecc43_5300_45aa_9a53_74967162632e.slice/crio-102f4ea10fdd869f19762916d0e5dbecfbea9fea4ccd336658a37836e21a8af6 WatchSource:0}: Error finding container 102f4ea10fdd869f19762916d0e5dbecfbea9fea4ccd336658a37836e21a8af6: Status 404 returned error can't find the container with id 102f4ea10fdd869f19762916d0e5dbecfbea9fea4ccd336658a37836e21a8af6 Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.583936 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2"] Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.584122 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/octavia-operator@sha256:425fd66675becbe0ca2b2fe1a5a6694ac6e0b1cdce9a77a7a37f99785eadc74a,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-c5hbc,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod octavia-operator-controller-manager-7b89675745-w6gzv_openstack-operators(cf6ecc43-5300-45aa-9a53-74967162632e): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.585522 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" podUID="cf6ecc43-5300-45aa-9a53-74967162632e" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.590489 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.662259 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb"] Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.667335 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l"] Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.673577 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-5hctb,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod watcher-operator-controller-manager-65d578856c-wknpb_openstack-operators(1612f31d-fe0f-4756-b5df-2a95dddfcfa9): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.674620 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-g9k64,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod swift-operator-controller-manager-5d89b4d5d5-96l7l_openstack-operators(40eebc4f-195d-495e-a989-4fd7684c3624): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.674686 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" podUID="1612f31d-fe0f-4756-b5df-2a95dddfcfa9" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.676054 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" podUID="40eebc4f-195d-495e-a989-4fd7684c3624" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.679106 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/test-operator-controller-manager-74d567479f-9gf58"] Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.679207 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0bcb6b4_d41a_4576_9768_847372afafcc.slice/crio-b99d2ccdaf769b9ffebbb94adb9870702a7bd1208b911f178e7042b4b3a623f1 WatchSource:0}: Error finding container b99d2ccdaf769b9ffebbb94adb9870702a7bd1208b911f178e7042b4b3a623f1: Status 404 returned error can't find the container with id b99d2ccdaf769b9ffebbb94adb9870702a7bd1208b911f178e7042b4b3a623f1 Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.682804 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:manager,Image:quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42,Command:[/manager],Args:[--leader-elect --health-probe-bind-address=:8081 --metrics-bind-address=127.0.0.1:8080],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{536870912 0} {} BinarySI},},Requests:ResourceList{cpu: {{10 -3} {} 10m DecimalSI},memory: {{268435456 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-d9g9w,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:15,TimeoutSeconds:1,PeriodSeconds:20,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readyz,Port:{0 8081 },Host:,Scheme:HTTP,HTTPHeaders:[]HTTPHeader{},},TCPSocket:nil,GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[MKNOD],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod test-operator-controller-manager-74d567479f-9gf58_openstack-operators(b0bcb6b4-d41a-4576-9768-847372afafcc): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.683973 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" podUID="b0bcb6b4-d41a-4576-9768-847372afafcc" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.724760 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9"] Mar 16 13:21:23 crc kubenswrapper[5030]: W0316 13:21:23.727641 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9733ae7a_be03_4a43_a5e8_1e154eb4e91f.slice/crio-f797f0419b1e55e6dbeb50d3b2963a5b8bf52b2e84e3ea4e1b839886a4330b9b WatchSource:0}: Error finding container f797f0419b1e55e6dbeb50d3b2963a5b8bf52b2e84e3ea4e1b839886a4330b9b: Status 404 returned error can't find the container with id f797f0419b1e55e6dbeb50d3b2963a5b8bf52b2e84e3ea4e1b839886a4330b9b Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.732255 5030 kuberuntime_manager.go:1358] "Unhandled Error" err="container &Container{Name:operator,Image:quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2,Command:[/manager],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:metrics,HostPort:0,ContainerPort:9782,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:OPERATOR_NAMESPACE,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},EnvVar{Name:LEASE_DURATION,Value:30,ValueFrom:nil,},EnvVar{Name:RENEW_DEADLINE,Value:20,ValueFrom:nil,},EnvVar{Name:RETRY_PERIOD,Value:5,ValueFrom:nil,},EnvVar{Name:ENABLE_WEBHOOKS,Value:false,ValueFrom:nil,},EnvVar{Name:METRICS_CERTS,Value:false,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{cpu: {{200 -3} {} 200m DecimalSI},memory: {{524288000 0} {} 500Mi BinarySI},},Requests:ResourceList{cpu: {{5 -3} {} 5m DecimalSI},memory: {{67108864 0} {} BinarySI},},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-kzvxh,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000660000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9_openstack-operators(9733ae7a-be03-4a43-a5e8-1e154eb4e91f): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.733597 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ErrImagePull: \"pull QPS exceeded\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" podUID="9733ae7a-be03-4a43-a5e8-1e154eb4e91f" Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.876751 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.877365 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.877446 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:25.877424006 +0000 UTC m=+930.276736552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: I0316 13:21:23.979104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.979250 5030 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:23 crc kubenswrapper[5030]: E0316 13:21:23.979313 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert podName:65a755bb-3a4c-4aaa-a9fd-d69514e1b854 nodeName:}" failed. No retries permitted until 2026-03-16 13:21:25.979297815 +0000 UTC m=+930.378610363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" (UID: "65a755bb-3a4c-4aaa-a9fd-d69514e1b854") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.104239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" event={"ID":"9733ae7a-be03-4a43-a5e8-1e154eb4e91f","Type":"ContainerStarted","Data":"f797f0419b1e55e6dbeb50d3b2963a5b8bf52b2e84e3ea4e1b839886a4330b9b"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.105464 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" podUID="9733ae7a-be03-4a43-a5e8-1e154eb4e91f" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.107824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" event={"ID":"40eebc4f-195d-495e-a989-4fd7684c3624","Type":"ContainerStarted","Data":"1492eaf97b6f1dbf51c2913b993d49ea59defba522ef05db7e27007f2a6ed0d8"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.110079 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" podUID="40eebc4f-195d-495e-a989-4fd7684c3624" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.110188 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" event={"ID":"70f26644-127c-4815-8b72-7d4e18e4a809","Type":"ContainerStarted","Data":"15dafac0bbdaf6f25b4802238f44f12d7927c32ecd969b630df4acf27773b4df"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.113678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" event={"ID":"0e928026-eaab-4408-a189-5fceb745b232","Type":"ContainerStarted","Data":"f54c6eb7cb1157d228c5697255a591eae6d59ee507113732b181fe8452de466a"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.115118 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" event={"ID":"767e9b64-7c11-4116-ac41-6b1399f52f93","Type":"ContainerStarted","Data":"53622197bb6df7514ffc60640c9b8a060916c9a2344b36cadbc7fb15b1003cae"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.121376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" event={"ID":"16bd7d26-97ce-4773-9866-35d85ed1f978","Type":"ContainerStarted","Data":"17989a455f08b137ca5f24c3194a08adba84b8fd8fac4779c0c761a5de973b15"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.123169 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" event={"ID":"c2559c1e-8b4e-40f5-b4fc-d0fd6950b084","Type":"ContainerStarted","Data":"52ca3444267bd02863ff46ab6fd41b225d4002d7046d6e284b1a85b2272501c0"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.128635 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" event={"ID":"8dd73d63-1019-48db-88da-47a95894a2ae","Type":"ContainerStarted","Data":"ac0d0dfd178eea47c3173599fb687f9631f0e7bfc8fba3eefade8cdec5dae8d3"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.134857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" event={"ID":"efb378d9-327b-4064-b4cb-60d7ea01c7e5","Type":"ContainerStarted","Data":"9a24512ed46fb40d8a8e47c03a519def43ba10cb764834ff334caa992bb88264"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.138266 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" event={"ID":"7cc12ea5-48ad-4e56-8980-2da1ff87da0b","Type":"ContainerStarted","Data":"6501ee2a55d32e40738cf661459f0b75c85ce6ecf1b817744959233ee35ff660"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.140250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" event={"ID":"c9dea77a-4d1e-4b1a-922d-562ecff4eb24","Type":"ContainerStarted","Data":"a87f0e6195e7b4b7908bdb9896356835ea0ddd801cf6d58ef925d3de0f12cb7a"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.142332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" event={"ID":"d72d8146-effa-4874-bddf-6c525d6b1cda","Type":"ContainerStarted","Data":"cb4443c9242186809740267652cb329a3b41fa779d31ee56ee5f64fefb92fd8c"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.151057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" event={"ID":"b0bcb6b4-d41a-4576-9768-847372afafcc","Type":"ContainerStarted","Data":"b99d2ccdaf769b9ffebbb94adb9870702a7bd1208b911f178e7042b4b3a623f1"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.151983 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" event={"ID":"e3f81986-b429-4bae-bdf6-ab4cff5534f9","Type":"ContainerStarted","Data":"4b6a65c338a55065b8a8bcf385f71b80bb5791301ae9f583fd61b58514ba633d"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.152732 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" podUID="b0bcb6b4-d41a-4576-9768-847372afafcc" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.153725 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" event={"ID":"abb96aea-ef66-4411-8824-3317f9e44a8d","Type":"ContainerStarted","Data":"d148ea7f620fb318889484c115a5373e2372d9d92dccedfac8312ec864db9008"} Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.155787 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" event={"ID":"cf6ecc43-5300-45aa-9a53-74967162632e","Type":"ContainerStarted","Data":"102f4ea10fdd869f19762916d0e5dbecfbea9fea4ccd336658a37836e21a8af6"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.157903 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/octavia-operator@sha256:425fd66675becbe0ca2b2fe1a5a6694ac6e0b1cdce9a77a7a37f99785eadc74a\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" podUID="cf6ecc43-5300-45aa-9a53-74967162632e" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.159822 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" event={"ID":"d2c78a21-5083-4ded-a44e-6bd51017e613","Type":"ContainerStarted","Data":"6f4e268622768e0930cdcc03a29542515133754a87f258f6e539e683013da38f"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.164371 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/mariadb-operator@sha256:6e7552996253fc66667eaa3eb0e11b4e97145efa2ae577155ceabf8e9913ddc1\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" podUID="d2c78a21-5083-4ded-a44e-6bd51017e613" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.165567 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" event={"ID":"c30b09f1-af80-45c5-a218-2726d37fcc84","Type":"ContainerStarted","Data":"8659e94955a2335b3f563893debc3627c567f2ad575a82cdb0c9327302dfed21"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.166750 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/ironic-operator@sha256:9dd26bc51e7757d84736528d4988a1f980ad50ccb070aef6fc252e32c5c423a8\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" podUID="c30b09f1-af80-45c5-a218-2726d37fcc84" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.167212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" event={"ID":"1612f31d-fe0f-4756-b5df-2a95dddfcfa9","Type":"ContainerStarted","Data":"e56157db4fdff4d129d8dfe2e3a312e1bc657f1ecf0e8244fadef78a70d1c568"} Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.169500 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" podUID="1612f31d-fe0f-4756-b5df-2a95dddfcfa9" Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.391427 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.392022 5030 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.392133 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:26.392102619 +0000 UTC m=+930.791415166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "metrics-server-cert" not found Mar 16 13:21:24 crc kubenswrapper[5030]: I0316 13:21:24.493252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.493357 5030 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 13:21:24 crc kubenswrapper[5030]: E0316 13:21:24.493585 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:26.493545395 +0000 UTC m=+930.892857942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "webhook-server-cert" not found Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.206568 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/swift-operator@sha256:866844c5b88e1e0518ceb7490cac9d093da3fb8b2f27ba7bd9bd89f946b9ee6e\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" podUID="40eebc4f-195d-495e-a989-4fd7684c3624" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.207467 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/watcher-operator@sha256:d9c55e8c6304a0e32289b5e8c69a87ea59b9968918a5c85b7c384633df82c807\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" podUID="1612f31d-fe0f-4756-b5df-2a95dddfcfa9" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.207747 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/ironic-operator@sha256:9dd26bc51e7757d84736528d4988a1f980ad50ccb070aef6fc252e32c5c423a8\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" podUID="c30b09f1-af80-45c5-a218-2726d37fcc84" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.207977 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/test-operator@sha256:43bd420bc05b4789243740bc75f61e10c7aac7883fc2f82b2d4d50085bc96c42\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" podUID="b0bcb6b4-d41a-4576-9768-847372afafcc" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.208196 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/octavia-operator@sha256:425fd66675becbe0ca2b2fe1a5a6694ac6e0b1cdce9a77a7a37f99785eadc74a\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" podUID="cf6ecc43-5300-45aa-9a53-74967162632e" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.208409 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/mariadb-operator@sha256:6e7552996253fc66667eaa3eb0e11b4e97145efa2ae577155ceabf8e9913ddc1\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" podUID="d2c78a21-5083-4ded-a44e-6bd51017e613" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.208673 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openstack-k8s-operators/rabbitmq-cluster-operator@sha256:893e66303c1b0bc1d00a299a3f0380bad55c8dc813c8a1c6a4aab379f5aa12a2\\\": ErrImagePull: pull QPS exceeded\"" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" podUID="9733ae7a-be03-4a43-a5e8-1e154eb4e91f" Mar 16 13:21:25 crc kubenswrapper[5030]: I0316 13:21:25.939489 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.939730 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:25 crc kubenswrapper[5030]: E0316 13:21:25.939790 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:29.939773339 +0000 UTC m=+934.339085886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: I0316 13:21:26.045074 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.045241 5030 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.045323 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert podName:65a755bb-3a4c-4aaa-a9fd-d69514e1b854 nodeName:}" failed. No retries permitted until 2026-03-16 13:21:30.045304743 +0000 UTC m=+934.444617290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" (UID: "65a755bb-3a4c-4aaa-a9fd-d69514e1b854") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: I0316 13:21:26.451646 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.452004 5030 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.452080 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:30.452063995 +0000 UTC m=+934.851376542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "metrics-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: I0316 13:21:26.557695 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.557949 5030 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 13:21:26 crc kubenswrapper[5030]: E0316 13:21:26.558010 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:30.557995725 +0000 UTC m=+934.957308272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: I0316 13:21:30.023787 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.023921 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.024271 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:38.024246075 +0000 UTC m=+942.423558622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: I0316 13:21:30.126078 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.126275 5030 secret.go:189] Couldn't get secret openstack-operators/openstack-baremetal-operator-webhook-server-cert: secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.126385 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert podName:65a755bb-3a4c-4aaa-a9fd-d69514e1b854 nodeName:}" failed. No retries permitted until 2026-03-16 13:21:38.126356522 +0000 UTC m=+942.525669069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert") pod "openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" (UID: "65a755bb-3a4c-4aaa-a9fd-d69514e1b854") : secret "openstack-baremetal-operator-webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: I0316 13:21:30.532875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.533101 5030 secret.go:189] Couldn't get secret openstack-operators/metrics-server-cert: secret "metrics-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.533212 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:38.533192016 +0000 UTC m=+942.932504563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "metrics-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: I0316 13:21:30.634721 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.634952 5030 secret.go:189] Couldn't get secret openstack-operators/webhook-server-cert: secret "webhook-server-cert" not found Mar 16 13:21:30 crc kubenswrapper[5030]: E0316 13:21:30.635039 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs podName:31b27f63-44bb-4f0a-b48e-cce502308c0b nodeName:}" failed. No retries permitted until 2026-03-16 13:21:38.63501428 +0000 UTC m=+943.034326827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs") pod "openstack-operator-controller-manager-5fbcdbcf94-p4bxq" (UID: "31b27f63-44bb-4f0a-b48e-cce502308c0b") : secret "webhook-server-cert" not found Mar 16 13:21:36 crc kubenswrapper[5030]: I0316 13:21:36.280599 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" event={"ID":"c2559c1e-8b4e-40f5-b4fc-d0fd6950b084","Type":"ContainerStarted","Data":"613dcdfafdb672c917e50cdffa94af517ac1345fba94f82b559868f8a4d97c8f"} Mar 16 13:21:36 crc kubenswrapper[5030]: I0316 13:21:36.281273 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:36 crc kubenswrapper[5030]: I0316 13:21:36.306718 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" podStartSLOduration=2.636235831 podStartE2EDuration="15.30402643s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.316341899 +0000 UTC m=+927.715654447" lastFinishedPulling="2026-03-16 13:21:35.984132498 +0000 UTC m=+940.383445046" observedRunningTime="2026-03-16 13:21:36.300819827 +0000 UTC m=+940.700132364" watchObservedRunningTime="2026-03-16 13:21:36.30402643 +0000 UTC m=+940.703338968" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.287362 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" event={"ID":"70f26644-127c-4815-8b72-7d4e18e4a809","Type":"ContainerStarted","Data":"a88a4eb7199b6d5b5a2a5c5fa0c34de312046dc5a00eebf610395b0e726b9dad"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.288453 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.289530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" event={"ID":"0e928026-eaab-4408-a189-5fceb745b232","Type":"ContainerStarted","Data":"c3fbd8685cee4a679807a5d350f37ef74de6e26af1a06683dabbf23b1255bfe9"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.289882 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.291086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" event={"ID":"15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe","Type":"ContainerStarted","Data":"c92a3126eebbf9a195e6904076cbc36ed41b5b2455d9aea28863049dd038ea29"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.291460 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.292479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" event={"ID":"767e9b64-7c11-4116-ac41-6b1399f52f93","Type":"ContainerStarted","Data":"4e3e8fe15a158214ff9d453f2f98934938e398013a61735fa2c0f59688d8c66f"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.292543 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.293481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" event={"ID":"16bd7d26-97ce-4773-9866-35d85ed1f978","Type":"ContainerStarted","Data":"2889e393c6c1884d6bb487df610e564acb290d55fd1d0b20ba9eb2f8caca0c54"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.293822 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.294973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" event={"ID":"8dd73d63-1019-48db-88da-47a95894a2ae","Type":"ContainerStarted","Data":"100d41980f357cb426c09e18cd2fb14f21a70a630d61b0b4ad1e076e4d419c55"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.295115 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.296376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" event={"ID":"efb378d9-327b-4064-b4cb-60d7ea01c7e5","Type":"ContainerStarted","Data":"d5971558d8da558f04eba9257dbb7d1787c4bd92997bc2c35611eeebabe87f31"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.296670 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.297587 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" event={"ID":"7cc12ea5-48ad-4e56-8980-2da1ff87da0b","Type":"ContainerStarted","Data":"8b81528202832d5b80d6f87e68c2733638830c1e5002c0f419d533ab21949846"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.297915 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.299745 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" event={"ID":"c9dea77a-4d1e-4b1a-922d-562ecff4eb24","Type":"ContainerStarted","Data":"98fdcc92ef1112aaf892cbd3a3fc1dab0a312fb9b3922aedc672e65fd3150dfb"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.300062 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.301103 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" event={"ID":"d72d8146-effa-4874-bddf-6c525d6b1cda","Type":"ContainerStarted","Data":"a19a054504118b736ebada4aad1313a2f5258d31b932078ec03165b24ab352a7"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.301414 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.303878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" event={"ID":"e3f81986-b429-4bae-bdf6-ab4cff5534f9","Type":"ContainerStarted","Data":"abe8129e3355ea54ea163ae6f074db3dfd5db8a39ae3873f910dbe4db47d7e16"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.304229 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.305904 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" event={"ID":"abb96aea-ef66-4411-8824-3317f9e44a8d","Type":"ContainerStarted","Data":"4a6e47c473008a69a04deffb941c01675f3c06303b2e8b264e7ec3c84fb2c523"} Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.305928 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.311671 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" podStartSLOduration=3.392960087 podStartE2EDuration="16.311662816s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.105620355 +0000 UTC m=+927.504932902" lastFinishedPulling="2026-03-16 13:21:36.024323084 +0000 UTC m=+940.423635631" observedRunningTime="2026-03-16 13:21:37.310676012 +0000 UTC m=+941.709988559" watchObservedRunningTime="2026-03-16 13:21:37.311662816 +0000 UTC m=+941.710975363" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.325062 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" podStartSLOduration=2.739378237 podStartE2EDuration="15.325051298s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.441300135 +0000 UTC m=+927.840612682" lastFinishedPulling="2026-03-16 13:21:36.026973196 +0000 UTC m=+940.426285743" observedRunningTime="2026-03-16 13:21:37.322148859 +0000 UTC m=+941.721461406" watchObservedRunningTime="2026-03-16 13:21:37.325051298 +0000 UTC m=+941.724363845" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.343582 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" podStartSLOduration=2.8980827319999998 podStartE2EDuration="15.34357312s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.578142823 +0000 UTC m=+927.977455371" lastFinishedPulling="2026-03-16 13:21:36.023633211 +0000 UTC m=+940.422945759" observedRunningTime="2026-03-16 13:21:37.339903844 +0000 UTC m=+941.739216391" watchObservedRunningTime="2026-03-16 13:21:37.34357312 +0000 UTC m=+941.742885667" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.365923 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" podStartSLOduration=2.765404906 podStartE2EDuration="15.365901599s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.434436068 +0000 UTC m=+927.833748615" lastFinishedPulling="2026-03-16 13:21:36.034932761 +0000 UTC m=+940.434245308" observedRunningTime="2026-03-16 13:21:37.362684345 +0000 UTC m=+941.761996892" watchObservedRunningTime="2026-03-16 13:21:37.365901599 +0000 UTC m=+941.765214146" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.385710 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" podStartSLOduration=2.8087939779999997 podStartE2EDuration="15.385682137s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.450471607 +0000 UTC m=+927.849784154" lastFinishedPulling="2026-03-16 13:21:36.027359766 +0000 UTC m=+940.426672313" observedRunningTime="2026-03-16 13:21:37.37929472 +0000 UTC m=+941.778607267" watchObservedRunningTime="2026-03-16 13:21:37.385682137 +0000 UTC m=+941.784994684" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.400817 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" podStartSLOduration=3.487826139 podStartE2EDuration="16.400801717s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.111351473 +0000 UTC m=+927.510664021" lastFinishedPulling="2026-03-16 13:21:36.024327051 +0000 UTC m=+940.423639599" observedRunningTime="2026-03-16 13:21:37.399034882 +0000 UTC m=+941.798347419" watchObservedRunningTime="2026-03-16 13:21:37.400801717 +0000 UTC m=+941.800114265" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.417819 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" podStartSLOduration=3.522413448 podStartE2EDuration="16.417797168s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.131383667 +0000 UTC m=+927.530696214" lastFinishedPulling="2026-03-16 13:21:36.026767387 +0000 UTC m=+940.426079934" observedRunningTime="2026-03-16 13:21:37.41094836 +0000 UTC m=+941.810260907" watchObservedRunningTime="2026-03-16 13:21:37.417797168 +0000 UTC m=+941.817109715" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.429394 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" podStartSLOduration=3.38135981 podStartE2EDuration="16.429387086s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:22.977071342 +0000 UTC m=+927.376383889" lastFinishedPulling="2026-03-16 13:21:36.025098617 +0000 UTC m=+940.424411165" observedRunningTime="2026-03-16 13:21:37.427160784 +0000 UTC m=+941.826473330" watchObservedRunningTime="2026-03-16 13:21:37.429387086 +0000 UTC m=+941.828699633" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.445414 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" podStartSLOduration=3.83899649 podStartE2EDuration="16.445407066s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.41928583 +0000 UTC m=+927.818598377" lastFinishedPulling="2026-03-16 13:21:36.025696406 +0000 UTC m=+940.425008953" observedRunningTime="2026-03-16 13:21:37.442341228 +0000 UTC m=+941.841653855" watchObservedRunningTime="2026-03-16 13:21:37.445407066 +0000 UTC m=+941.844719612" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.469889 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" podStartSLOduration=3.5812690849999997 podStartE2EDuration="16.469877236s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.111162166 +0000 UTC m=+927.510474713" lastFinishedPulling="2026-03-16 13:21:35.999770318 +0000 UTC m=+940.399082864" observedRunningTime="2026-03-16 13:21:37.463654711 +0000 UTC m=+941.862967257" watchObservedRunningTime="2026-03-16 13:21:37.469877236 +0000 UTC m=+941.869189783" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.482059 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" podStartSLOduration=2.900462424 podStartE2EDuration="15.482032s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.424023703 +0000 UTC m=+927.823336250" lastFinishedPulling="2026-03-16 13:21:36.005593279 +0000 UTC m=+940.404905826" observedRunningTime="2026-03-16 13:21:37.478058479 +0000 UTC m=+941.877371026" watchObservedRunningTime="2026-03-16 13:21:37.482032 +0000 UTC m=+941.881344546" Mar 16 13:21:37 crc kubenswrapper[5030]: I0316 13:21:37.503511 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" podStartSLOduration=3.759894965 podStartE2EDuration="16.503502598s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.329688403 +0000 UTC m=+927.729000950" lastFinishedPulling="2026-03-16 13:21:36.073296036 +0000 UTC m=+940.472608583" observedRunningTime="2026-03-16 13:21:37.499493241 +0000 UTC m=+941.898805787" watchObservedRunningTime="2026-03-16 13:21:37.503502598 +0000 UTC m=+941.902815145" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.068964 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:38 crc kubenswrapper[5030]: E0316 13:21:38.069179 5030 secret.go:189] Couldn't get secret openstack-operators/infra-operator-webhook-server-cert: secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:38 crc kubenswrapper[5030]: E0316 13:21:38.069317 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert podName:7253144c-27eb-4979-a38d-419a993ae47f nodeName:}" failed. No retries permitted until 2026-03-16 13:21:54.069284505 +0000 UTC m=+958.468597043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert") pod "infra-operator-controller-manager-76f8b7ddbd-r98lt" (UID: "7253144c-27eb-4979-a38d-419a993ae47f") : secret "infra-operator-webhook-server-cert" not found Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.170859 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.177826 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65a755bb-3a4c-4aaa-a9fd-d69514e1b854-cert\") pod \"openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v\" (UID: \"65a755bb-3a4c-4aaa-a9fd-d69514e1b854\") " pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.199623 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.580836 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.589009 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-metrics-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:38 crc kubenswrapper[5030]: W0316 13:21:38.639461 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a755bb_3a4c_4aaa_a9fd_d69514e1b854.slice/crio-f1b3a0500798451bbe92aa283c3632ba8e344c193a02c68bd6c88f3071a6d1ac WatchSource:0}: Error finding container f1b3a0500798451bbe92aa283c3632ba8e344c193a02c68bd6c88f3071a6d1ac: Status 404 returned error can't find the container with id f1b3a0500798451bbe92aa283c3632ba8e344c193a02c68bd6c88f3071a6d1ac Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.648078 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v"] Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.682509 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.687249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/31b27f63-44bb-4f0a-b48e-cce502308c0b-webhook-certs\") pod \"openstack-operator-controller-manager-5fbcdbcf94-p4bxq\" (UID: \"31b27f63-44bb-4f0a-b48e-cce502308c0b\") " pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:38 crc kubenswrapper[5030]: I0316 13:21:38.731314 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:39 crc kubenswrapper[5030]: I0316 13:21:39.114732 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq"] Mar 16 13:21:39 crc kubenswrapper[5030]: I0316 13:21:39.342341 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" event={"ID":"31b27f63-44bb-4f0a-b48e-cce502308c0b","Type":"ContainerStarted","Data":"1d9e13ef3afa9d364e9ad5a50523453b2958f5daad0af9db71b0f517cd847b3b"} Mar 16 13:21:39 crc kubenswrapper[5030]: I0316 13:21:39.344601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" event={"ID":"65a755bb-3a4c-4aaa-a9fd-d69514e1b854","Type":"ContainerStarted","Data":"f1b3a0500798451bbe92aa283c3632ba8e344c193a02c68bd6c88f3071a6d1ac"} Mar 16 13:21:41 crc kubenswrapper[5030]: I0316 13:21:41.370131 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" event={"ID":"31b27f63-44bb-4f0a-b48e-cce502308c0b","Type":"ContainerStarted","Data":"a5106221af51b235d2115b00747b5565544f0b821a3ce61c671aac867689bc70"} Mar 16 13:21:41 crc kubenswrapper[5030]: I0316 13:21:41.370454 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:45 crc kubenswrapper[5030]: I0316 13:21:45.982940 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" podStartSLOduration=23.982919916 podStartE2EDuration="23.982919916s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:21:41.405451536 +0000 UTC m=+945.804764083" watchObservedRunningTime="2026-03-16 13:21:45.982919916 +0000 UTC m=+950.382232463" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.309734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-5bf9fb4564-pdshw" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.419760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" event={"ID":"b0bcb6b4-d41a-4576-9768-847372afafcc","Type":"ContainerStarted","Data":"c3ddb26cd4b76511fe058fe8d9ee7f56635059a8d76e494612bf9368a6287aec"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.419962 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.421380 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" event={"ID":"cf6ecc43-5300-45aa-9a53-74967162632e","Type":"ContainerStarted","Data":"26c00077c80bd88e5dd16b61bdeb337f89b2f0c06e921caa1775d54a40691334"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.421569 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.422412 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" event={"ID":"d2c78a21-5083-4ded-a44e-6bd51017e613","Type":"ContainerStarted","Data":"6888be572e1cee871662b0d17218345fa9ea14947a8b5a584011846642a5b1f2"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.422689 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.424349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" event={"ID":"c30b09f1-af80-45c5-a218-2726d37fcc84","Type":"ContainerStarted","Data":"fabcdc48970d0c04fb96240ecca3f40f384184dd09dd8ca990d5052e63d36d4d"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.424659 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.425802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" event={"ID":"1612f31d-fe0f-4756-b5df-2a95dddfcfa9","Type":"ContainerStarted","Data":"37cff2e8cc3b770e41d3cc6a0a3b8d2047d94226554f3b2a65e53d14cb42c440"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.426013 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.427293 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" event={"ID":"9733ae7a-be03-4a43-a5e8-1e154eb4e91f","Type":"ContainerStarted","Data":"d0458f0a20032c44c232eb0dcf94ea489c3236aa84cbf8da7547998422b8aee2"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.429749 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" event={"ID":"40eebc4f-195d-495e-a989-4fd7684c3624","Type":"ContainerStarted","Data":"67d8f1f48f4b6b4df9fb247a33937206f3bbdc54299328ed339f49bedd3b4233"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.429918 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.434392 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" event={"ID":"65a755bb-3a4c-4aaa-a9fd-d69514e1b854","Type":"ContainerStarted","Data":"b3949ee7af9781bcad2db09bcd44ca0e7e09edc0553d4a4acf2128c032061fff"} Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.434484 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.453007 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" podStartSLOduration=2.8505414829999998 podStartE2EDuration="25.452997118s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.682682536 +0000 UTC m=+928.081995083" lastFinishedPulling="2026-03-16 13:21:46.285138172 +0000 UTC m=+950.684450718" observedRunningTime="2026-03-16 13:21:47.441314776 +0000 UTC m=+951.840627324" watchObservedRunningTime="2026-03-16 13:21:47.452997118 +0000 UTC m=+951.852309656" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.465741 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" podStartSLOduration=2.764691318 podStartE2EDuration="25.465727489s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.584032089 +0000 UTC m=+927.983344637" lastFinishedPulling="2026-03-16 13:21:46.28506826 +0000 UTC m=+950.684380808" observedRunningTime="2026-03-16 13:21:47.463728195 +0000 UTC m=+951.863040742" watchObservedRunningTime="2026-03-16 13:21:47.465727489 +0000 UTC m=+951.865040026" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.486983 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" podStartSLOduration=17.804342343 podStartE2EDuration="25.486972882s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:38.642308613 +0000 UTC m=+943.041621160" lastFinishedPulling="2026-03-16 13:21:46.324939152 +0000 UTC m=+950.724251699" observedRunningTime="2026-03-16 13:21:47.485007964 +0000 UTC m=+951.884320510" watchObservedRunningTime="2026-03-16 13:21:47.486972882 +0000 UTC m=+951.886285429" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.502702 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" podStartSLOduration=3.783910928 podStartE2EDuration="26.502690792s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.556490792 +0000 UTC m=+927.955803339" lastFinishedPulling="2026-03-16 13:21:46.275270656 +0000 UTC m=+950.674583203" observedRunningTime="2026-03-16 13:21:47.498351861 +0000 UTC m=+951.897664408" watchObservedRunningTime="2026-03-16 13:21:47.502690792 +0000 UTC m=+951.902003339" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.512615 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9" podStartSLOduration=2.959669215 podStartE2EDuration="25.51260702s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.732140605 +0000 UTC m=+928.131453151" lastFinishedPulling="2026-03-16 13:21:46.285078409 +0000 UTC m=+950.684390956" observedRunningTime="2026-03-16 13:21:47.509326638 +0000 UTC m=+951.908639185" watchObservedRunningTime="2026-03-16 13:21:47.51260702 +0000 UTC m=+951.911919566" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.523627 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" podStartSLOduration=2.915258603 podStartE2EDuration="25.523608336s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.674522712 +0000 UTC m=+928.073835259" lastFinishedPulling="2026-03-16 13:21:46.282872445 +0000 UTC m=+950.682184992" observedRunningTime="2026-03-16 13:21:47.521328263 +0000 UTC m=+951.920640810" watchObservedRunningTime="2026-03-16 13:21:47.523608336 +0000 UTC m=+951.922920883" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.548381 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" podStartSLOduration=3.85115499 podStartE2EDuration="26.548367623s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.576565817 +0000 UTC m=+927.975878363" lastFinishedPulling="2026-03-16 13:21:46.273778449 +0000 UTC m=+950.673090996" observedRunningTime="2026-03-16 13:21:47.545478459 +0000 UTC m=+951.944791006" watchObservedRunningTime="2026-03-16 13:21:47.548367623 +0000 UTC m=+951.947680170" Mar 16 13:21:47 crc kubenswrapper[5030]: I0316 13:21:47.561743 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" podStartSLOduration=2.945629033 podStartE2EDuration="25.561735096s" podCreationTimestamp="2026-03-16 13:21:22 +0000 UTC" firstStartedPulling="2026-03-16 13:21:23.673402227 +0000 UTC m=+928.072714775" lastFinishedPulling="2026-03-16 13:21:46.289508291 +0000 UTC m=+950.688820838" observedRunningTime="2026-03-16 13:21:47.558038748 +0000 UTC m=+951.957351295" watchObservedRunningTime="2026-03-16 13:21:47.561735096 +0000 UTC m=+951.961047643" Mar 16 13:21:48 crc kubenswrapper[5030]: I0316 13:21:48.337140 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-785d77464d-hzfh6" Mar 16 13:21:48 crc kubenswrapper[5030]: I0316 13:21:48.338244 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-848cfb5779-rvhc2" Mar 16 13:21:48 crc kubenswrapper[5030]: I0316 13:21:48.338606 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-f5cf7fcb7-h87bk" Mar 16 13:21:48 crc kubenswrapper[5030]: I0316 13:21:48.339957 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/designate-operator-controller-manager-7cf89c67bb-dqm94" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.348203 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/glance-operator-controller-manager-58d9bbd8cc-24vjm" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349096 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/placement-operator-controller-manager-57fdd4b4cf-2z7l6" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349168 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ovn-operator-controller-manager-6fb6cd45c4-hqxj8" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349212 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/cinder-operator-controller-manager-55bc8cdcc4-xp7rw" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349245 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-79975d4c95-7vrpq" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349285 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/manila-operator-controller-manager-7d6d87b867-w2kh9" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349322 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/neutron-operator-controller-manager-75c6f4bc76-66pvn" Mar 16 13:21:49 crc kubenswrapper[5030]: I0316 13:21:49.349357 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/keystone-operator-controller-manager-6f5b9fd59-485fs" Mar 16 13:21:52 crc kubenswrapper[5030]: I0316 13:21:52.383201 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-manager-5fbcdbcf94-p4bxq" Mar 16 13:21:53 crc kubenswrapper[5030]: E0316 13:21:53.665703 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1147819 actualBytes=10240 Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.157180 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.164006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7253144c-27eb-4979-a38d-419a993ae47f-cert\") pod \"infra-operator-controller-manager-76f8b7ddbd-r98lt\" (UID: \"7253144c-27eb-4979-a38d-419a993ae47f\") " pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.184480 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.287574 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.287812 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:21:54 crc kubenswrapper[5030]: I0316 13:21:54.579965 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt"] Mar 16 13:21:54 crc kubenswrapper[5030]: W0316 13:21:54.584119 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7253144c_27eb_4979_a38d_419a993ae47f.slice/crio-9a332923507bd3eaf0aa59af3daf5c7fb13896f5e7983f39dd12b7e65a6ff1ee WatchSource:0}: Error finding container 9a332923507bd3eaf0aa59af3daf5c7fb13896f5e7983f39dd12b7e65a6ff1ee: Status 404 returned error can't find the container with id 9a332923507bd3eaf0aa59af3daf5c7fb13896f5e7983f39dd12b7e65a6ff1ee Mar 16 13:21:55 crc kubenswrapper[5030]: I0316 13:21:55.497258 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" event={"ID":"7253144c-27eb-4979-a38d-419a993ae47f","Type":"ContainerStarted","Data":"9a332923507bd3eaf0aa59af3daf5c7fb13896f5e7983f39dd12b7e65a6ff1ee"} Mar 16 13:21:57 crc kubenswrapper[5030]: I0316 13:21:57.522496 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" event={"ID":"7253144c-27eb-4979-a38d-419a993ae47f","Type":"ContainerStarted","Data":"dbc51fa83bfc0ad4d8fdada9f49dbc649caab360b0080fd5bb23e2b66deba76d"} Mar 16 13:21:57 crc kubenswrapper[5030]: I0316 13:21:57.523127 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:21:57 crc kubenswrapper[5030]: I0316 13:21:57.541507 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" podStartSLOduration=34.218290476 podStartE2EDuration="36.541481543s" podCreationTimestamp="2026-03-16 13:21:21 +0000 UTC" firstStartedPulling="2026-03-16 13:21:54.586956311 +0000 UTC m=+958.986268858" lastFinishedPulling="2026-03-16 13:21:56.910147377 +0000 UTC m=+961.309459925" observedRunningTime="2026-03-16 13:21:57.537013109 +0000 UTC m=+961.936325656" watchObservedRunningTime="2026-03-16 13:21:57.541481543 +0000 UTC m=+961.940794091" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.447787 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/ironic-operator-controller-manager-997698bf9-kvdhl" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.448226 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-5748db694b-2fhf2" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.448269 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/test-operator-controller-manager-74d567479f-9gf58" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.448991 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/watcher-operator-controller-manager-65d578856c-wknpb" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.449099 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-5d89b4d5d5-96l7l" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.449423 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-7b89675745-w6gzv" Mar 16 13:21:58 crc kubenswrapper[5030]: I0316 13:21:58.450952 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.126418 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561122-6kbjg"] Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.132617 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.134809 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.136790 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.136885 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561122-6kbjg"] Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.138640 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.260775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97d98\" (UniqueName: \"kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98\") pod \"auto-csr-approver-29561122-6kbjg\" (UID: \"86d483d5-dd7e-49ea-8734-96d1a87c7f0f\") " pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.362272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97d98\" (UniqueName: \"kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98\") pod \"auto-csr-approver-29561122-6kbjg\" (UID: \"86d483d5-dd7e-49ea-8734-96d1a87c7f0f\") " pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.379688 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97d98\" (UniqueName: \"kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98\") pod \"auto-csr-approver-29561122-6kbjg\" (UID: \"86d483d5-dd7e-49ea-8734-96d1a87c7f0f\") " pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.450782 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.648797 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561122-6kbjg"] Mar 16 13:22:00 crc kubenswrapper[5030]: W0316 13:22:00.652685 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86d483d5_dd7e_49ea_8734_96d1a87c7f0f.slice/crio-b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097 WatchSource:0}: Error finding container b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097: Status 404 returned error can't find the container with id b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097 Mar 16 13:22:00 crc kubenswrapper[5030]: I0316 13:22:00.654742 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:22:01 crc kubenswrapper[5030]: I0316 13:22:01.567362 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" event={"ID":"86d483d5-dd7e-49ea-8734-96d1a87c7f0f","Type":"ContainerStarted","Data":"b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097"} Mar 16 13:22:02 crc kubenswrapper[5030]: I0316 13:22:02.576245 5030 generic.go:358] "Generic (PLEG): container finished" podID="86d483d5-dd7e-49ea-8734-96d1a87c7f0f" containerID="6abd6a5461e3cd0ce2e8c6b109682567d10d209e8d0139f66a0f262adfb40ac9" exitCode=0 Mar 16 13:22:02 crc kubenswrapper[5030]: I0316 13:22:02.576299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" event={"ID":"86d483d5-dd7e-49ea-8734-96d1a87c7f0f","Type":"ContainerDied","Data":"6abd6a5461e3cd0ce2e8c6b109682567d10d209e8d0139f66a0f262adfb40ac9"} Mar 16 13:22:03 crc kubenswrapper[5030]: I0316 13:22:03.829187 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:03 crc kubenswrapper[5030]: I0316 13:22:03.929028 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97d98\" (UniqueName: \"kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98\") pod \"86d483d5-dd7e-49ea-8734-96d1a87c7f0f\" (UID: \"86d483d5-dd7e-49ea-8734-96d1a87c7f0f\") " Mar 16 13:22:03 crc kubenswrapper[5030]: I0316 13:22:03.935872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98" (OuterVolumeSpecName: "kube-api-access-97d98") pod "86d483d5-dd7e-49ea-8734-96d1a87c7f0f" (UID: "86d483d5-dd7e-49ea-8734-96d1a87c7f0f"). InnerVolumeSpecName "kube-api-access-97d98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.031232 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97d98\" (UniqueName: \"kubernetes.io/projected/86d483d5-dd7e-49ea-8734-96d1a87c7f0f-kube-api-access-97d98\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.594480 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.594492 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561122-6kbjg" event={"ID":"86d483d5-dd7e-49ea-8734-96d1a87c7f0f","Type":"ContainerDied","Data":"b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097"} Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.594599 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9e233e5d0ba8b188fd7e0c92deb61585a3b2a5f6278f241759876cdd1c73097" Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.887295 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561116-pfq4p"] Mar 16 13:22:04 crc kubenswrapper[5030]: I0316 13:22:04.890886 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561116-pfq4p"] Mar 16 13:22:05 crc kubenswrapper[5030]: I0316 13:22:05.953110 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba932c8-123f-453e-9399-7ca6e740f23d" path="/var/lib/kubelet/pods/fba932c8-123f-453e-9399-7ca6e740f23d/volumes" Mar 16 13:22:08 crc kubenswrapper[5030]: I0316 13:22:08.536596 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/infra-operator-controller-manager-76f8b7ddbd-r98lt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.330501 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-tjrdt"] Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.331876 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d483d5-dd7e-49ea-8734-96d1a87c7f0f" containerName="oc" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.331897 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d483d5-dd7e-49ea-8734-96d1a87c7f0f" containerName="oc" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.332074 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="86d483d5-dd7e-49ea-8734-96d1a87c7f0f" containerName="oc" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.335645 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.338669 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.338717 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.338762 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.338843 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.339232 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-tjrdt"] Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.373835 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h25b\" (UniqueName: \"kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.373962 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.374153 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.477010 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h25b\" (UniqueName: \"kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.477104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.477295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.477696 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.478529 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.501648 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h25b\" (UniqueName: \"kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b\") pod \"crc-storage-crc-tjrdt\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:13 crc kubenswrapper[5030]: I0316 13:22:13.651283 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:14 crc kubenswrapper[5030]: I0316 13:22:14.036214 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-tjrdt"] Mar 16 13:22:14 crc kubenswrapper[5030]: I0316 13:22:14.664770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-tjrdt" event={"ID":"e21afe7f-1510-4902-91c5-1cf0361c4be4","Type":"ContainerStarted","Data":"3453d40a5f49753c227c888da610cf31cdac43ecf3adc96542c0f5288936c349"} Mar 16 13:22:16 crc kubenswrapper[5030]: I0316 13:22:16.689518 5030 generic.go:358] "Generic (PLEG): container finished" podID="e21afe7f-1510-4902-91c5-1cf0361c4be4" containerID="3c3bea8b523adc05165c4565001827dbae9643ac92445cc8000debece520f45c" exitCode=0 Mar 16 13:22:16 crc kubenswrapper[5030]: I0316 13:22:16.689580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-tjrdt" event={"ID":"e21afe7f-1510-4902-91c5-1cf0361c4be4","Type":"ContainerDied","Data":"3c3bea8b523adc05165c4565001827dbae9643ac92445cc8000debece520f45c"} Mar 16 13:22:17 crc kubenswrapper[5030]: I0316 13:22:17.915666 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.043600 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h25b\" (UniqueName: \"kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b\") pod \"e21afe7f-1510-4902-91c5-1cf0361c4be4\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.043724 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage\") pod \"e21afe7f-1510-4902-91c5-1cf0361c4be4\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.043758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt\") pod \"e21afe7f-1510-4902-91c5-1cf0361c4be4\" (UID: \"e21afe7f-1510-4902-91c5-1cf0361c4be4\") " Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.044041 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "e21afe7f-1510-4902-91c5-1cf0361c4be4" (UID: "e21afe7f-1510-4902-91c5-1cf0361c4be4"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.044205 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/e21afe7f-1510-4902-91c5-1cf0361c4be4-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.049208 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b" (OuterVolumeSpecName: "kube-api-access-2h25b") pod "e21afe7f-1510-4902-91c5-1cf0361c4be4" (UID: "e21afe7f-1510-4902-91c5-1cf0361c4be4"). InnerVolumeSpecName "kube-api-access-2h25b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.059664 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "e21afe7f-1510-4902-91c5-1cf0361c4be4" (UID: "e21afe7f-1510-4902-91c5-1cf0361c4be4"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.145909 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h25b\" (UniqueName: \"kubernetes.io/projected/e21afe7f-1510-4902-91c5-1cf0361c4be4-kube-api-access-2h25b\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.145936 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/e21afe7f-1510-4902-91c5-1cf0361c4be4-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.706763 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-tjrdt" Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.706748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-tjrdt" event={"ID":"e21afe7f-1510-4902-91c5-1cf0361c4be4","Type":"ContainerDied","Data":"3453d40a5f49753c227c888da610cf31cdac43ecf3adc96542c0f5288936c349"} Mar 16 13:22:18 crc kubenswrapper[5030]: I0316 13:22:18.707184 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3453d40a5f49753c227c888da610cf31cdac43ecf3adc96542c0f5288936c349" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.815718 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-tjrdt"] Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.824650 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-tjrdt"] Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.924792 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-h65qf"] Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.926076 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21afe7f-1510-4902-91c5-1cf0361c4be4" containerName="storage" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.926111 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21afe7f-1510-4902-91c5-1cf0361c4be4" containerName="storage" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.926457 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e21afe7f-1510-4902-91c5-1cf0361c4be4" containerName="storage" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.931415 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.933130 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h65qf"] Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.934429 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.934696 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.934894 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:22:20 crc kubenswrapper[5030]: I0316 13:22:20.935114 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.088294 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.088433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8fft\" (UniqueName: \"kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.088674 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.189982 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.190068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8fft\" (UniqueName: \"kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.190134 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.190302 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.190797 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.207866 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8fft\" (UniqueName: \"kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft\") pod \"crc-storage-crc-h65qf\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.253250 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.645285 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-h65qf"] Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.734763 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h65qf" event={"ID":"28fdde74-84d5-4f97-a45c-2c6623e6cf3c","Type":"ContainerStarted","Data":"3043f1b0f40be3b03386237b36ef11c2d7ec5224f84ca8ec67c9866300172b96"} Mar 16 13:22:21 crc kubenswrapper[5030]: I0316 13:22:21.959093 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21afe7f-1510-4902-91c5-1cf0361c4be4" path="/var/lib/kubelet/pods/e21afe7f-1510-4902-91c5-1cf0361c4be4/volumes" Mar 16 13:22:22 crc kubenswrapper[5030]: I0316 13:22:22.743986 5030 generic.go:358] "Generic (PLEG): container finished" podID="28fdde74-84d5-4f97-a45c-2c6623e6cf3c" containerID="91190a136b062a0638890fcd76d7a0fd38f0453a546e506a72b3f6f0d849bc09" exitCode=0 Mar 16 13:22:22 crc kubenswrapper[5030]: I0316 13:22:22.744125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h65qf" event={"ID":"28fdde74-84d5-4f97-a45c-2c6623e6cf3c","Type":"ContainerDied","Data":"91190a136b062a0638890fcd76d7a0fd38f0453a546e506a72b3f6f0d849bc09"} Mar 16 13:22:23 crc kubenswrapper[5030]: I0316 13:22:23.982463 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.127257 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8fft\" (UniqueName: \"kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft\") pod \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.127327 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage\") pod \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.127742 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt\") pod \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\" (UID: \"28fdde74-84d5-4f97-a45c-2c6623e6cf3c\") " Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.127887 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "28fdde74-84d5-4f97-a45c-2c6623e6cf3c" (UID: "28fdde74-84d5-4f97-a45c-2c6623e6cf3c"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.128272 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.132962 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft" (OuterVolumeSpecName: "kube-api-access-c8fft") pod "28fdde74-84d5-4f97-a45c-2c6623e6cf3c" (UID: "28fdde74-84d5-4f97-a45c-2c6623e6cf3c"). InnerVolumeSpecName "kube-api-access-c8fft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.143858 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "28fdde74-84d5-4f97-a45c-2c6623e6cf3c" (UID: "28fdde74-84d5-4f97-a45c-2c6623e6cf3c"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.229733 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8fft\" (UniqueName: \"kubernetes.io/projected/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-kube-api-access-c8fft\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.229761 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/28fdde74-84d5-4f97-a45c-2c6623e6cf3c-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.286582 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.286662 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.759807 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-h65qf" event={"ID":"28fdde74-84d5-4f97-a45c-2c6623e6cf3c","Type":"ContainerDied","Data":"3043f1b0f40be3b03386237b36ef11c2d7ec5224f84ca8ec67c9866300172b96"} Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.760090 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3043f1b0f40be3b03386237b36ef11c2d7ec5224f84ca8ec67c9866300172b96" Mar 16 13:22:24 crc kubenswrapper[5030]: I0316 13:22:24.760175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-h65qf" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.225224 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.226358 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fdde74-84d5-4f97-a45c-2c6623e6cf3c" containerName="storage" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.226378 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fdde74-84d5-4f97-a45c-2c6623e6cf3c" containerName="storage" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.226502 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="28fdde74-84d5-4f97-a45c-2c6623e6cf3c" containerName="storage" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.231232 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.233637 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq-dnsmasq-dockercfg-rtdh2\"" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.233914 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openshift-service-ca.crt\"" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.234778 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"kube-root-ca.crt\"" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.239102 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq\"" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.257034 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.279834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7v9p\" (UniqueName: \"kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.279882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.289759 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.294369 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.294471 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.297832 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dnsmasq-svc\"" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.381297 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.381343 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d659c\" (UniqueName: \"kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.381382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.381430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7v9p\" (UniqueName: \"kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.381460 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.382303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.399174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7v9p\" (UniqueName: \"kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p\") pod \"dnsmasq-dnsmasq-58748b8b69-zgtr6\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.483423 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.483486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d659c\" (UniqueName: \"kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.483519 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.484438 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.485009 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.499601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d659c\" (UniqueName: \"kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c\") pod \"dnsmasq-dnsmasq-79dcd846c5-ww7gg\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.547250 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.605702 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:27 crc kubenswrapper[5030]: I0316 13:22:27.954806 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:28 crc kubenswrapper[5030]: I0316 13:22:28.015968 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:22:28 crc kubenswrapper[5030]: W0316 13:22:28.019001 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a2a035e_0368_432e_8da0_068309eb5c73.slice/crio-221bd1d8f82bdfba8c40d3e0e3d8dcc09a34ee58b9cc3eda7b3fe70dee1808e9 WatchSource:0}: Error finding container 221bd1d8f82bdfba8c40d3e0e3d8dcc09a34ee58b9cc3eda7b3fe70dee1808e9: Status 404 returned error can't find the container with id 221bd1d8f82bdfba8c40d3e0e3d8dcc09a34ee58b9cc3eda7b3fe70dee1808e9 Mar 16 13:22:28 crc kubenswrapper[5030]: I0316 13:22:28.790055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" event={"ID":"99b5489e-7ca5-491a-bdc2-fe415e1449da","Type":"ContainerStarted","Data":"358bdc92a8f967e4ccd9fb82576f3c36be3eb4d41fa451799a8cd175405c02cd"} Mar 16 13:22:28 crc kubenswrapper[5030]: I0316 13:22:28.791301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" event={"ID":"9a2a035e-0368-432e-8da0-068309eb5c73","Type":"ContainerStarted","Data":"221bd1d8f82bdfba8c40d3e0e3d8dcc09a34ee58b9cc3eda7b3fe70dee1808e9"} Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.372921 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.400106 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.400226 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.403177 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.403414 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-9f5fv\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.403453 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.403525 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.403654 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.404067 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.404218 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.452370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.452937 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.453318 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.453427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.461780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.461938 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w84g\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.462219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.462271 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.462338 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.462359 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.462394 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.568947 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569036 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w84g\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569081 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569141 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569164 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569189 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569214 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569232 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569285 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.569418 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.570083 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.570156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.570752 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.570854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.570863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.576336 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.576767 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.581299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.581522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.590311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w84g\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.614790 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.643058 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.660833 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.661099 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.663951 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.663969 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.664189 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.665470 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.666213 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.666317 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-xjl5j\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.666458 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.725252 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775112 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775159 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775188 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775257 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775375 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775428 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775627 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775866 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jrw\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.775907 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877657 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877703 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jrw\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877848 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877867 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877882 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877909 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.877935 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.882112 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.882669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.883374 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.883610 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.883725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.886415 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.886753 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.886758 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.887058 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.898482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jrw\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.899013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.905420 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-server-0\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:37 crc kubenswrapper[5030]: I0316 13:22:37.985406 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.708540 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.721006 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.721171 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.723349 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.724452 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-mlcpv\"" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.728884 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.734878 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.739167 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797297 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797409 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpfz\" (UniqueName: \"kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797702 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797825 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797908 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.797932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899384 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899580 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpfz\" (UniqueName: \"kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899849 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.899867 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.900093 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.900156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.900482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.901131 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.904697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.906406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.917016 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.917228 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpfz\" (UniqueName: \"kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:38 crc kubenswrapper[5030]: I0316 13:22:38.929357 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.042148 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.527782 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:22:39 crc kubenswrapper[5030]: W0316 13:22:39.531130 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53313e64_d1c5_4aab_adb8_b1480d03bf0a.slice/crio-7e21c664785a4f979bd13ec212e58584510cf8d11fa22c589ad5382d415f960c WatchSource:0}: Error finding container 7e21c664785a4f979bd13ec212e58584510cf8d11fa22c589ad5382d415f960c: Status 404 returned error can't find the container with id 7e21c664785a4f979bd13ec212e58584510cf8d11fa22c589ad5382d415f960c Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.568518 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:22:39 crc kubenswrapper[5030]: W0316 13:22:39.572284 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89282d6e_ff10_4092_b709_a2466e578fd4.slice/crio-97a248d5cb0ff6353e92423cd840359a40c418409da2af9b3673b3d9225bd5d6 WatchSource:0}: Error finding container 97a248d5cb0ff6353e92423cd840359a40c418409da2af9b3673b3d9225bd5d6: Status 404 returned error can't find the container with id 97a248d5cb0ff6353e92423cd840359a40c418409da2af9b3673b3d9225bd5d6 Mar 16 13:22:39 crc kubenswrapper[5030]: W0316 13:22:39.573635 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb397af5f_d66b_45c1_a5a3_225084b4c13b.slice/crio-5f352245f1059f9ac945ebf67ce60d04c6934b235d87469fa06aaf80ed67015e WatchSource:0}: Error finding container 5f352245f1059f9ac945ebf67ce60d04c6934b235d87469fa06aaf80ed67015e: Status 404 returned error can't find the container with id 5f352245f1059f9ac945ebf67ce60d04c6934b235d87469fa06aaf80ed67015e Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.577870 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.867821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerStarted","Data":"5f352245f1059f9ac945ebf67ce60d04c6934b235d87469fa06aaf80ed67015e"} Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.869607 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerStarted","Data":"7e21c664785a4f979bd13ec212e58584510cf8d11fa22c589ad5382d415f960c"} Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.871578 5030 generic.go:358] "Generic (PLEG): container finished" podID="9a2a035e-0368-432e-8da0-068309eb5c73" containerID="327888ad9c617bbde1693a3419ba4b0cddda829356546cd43e9a7b3f52c713e7" exitCode=0 Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.871665 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" event={"ID":"9a2a035e-0368-432e-8da0-068309eb5c73","Type":"ContainerDied","Data":"327888ad9c617bbde1693a3419ba4b0cddda829356546cd43e9a7b3f52c713e7"} Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.874062 5030 generic.go:358] "Generic (PLEG): container finished" podID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerID="55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db" exitCode=0 Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.874309 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" event={"ID":"99b5489e-7ca5-491a-bdc2-fe415e1449da","Type":"ContainerDied","Data":"55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db"} Mar 16 13:22:39 crc kubenswrapper[5030]: I0316 13:22:39.876414 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerStarted","Data":"97a248d5cb0ff6353e92423cd840359a40c418409da2af9b3673b3d9225bd5d6"} Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.138692 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.142009 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.146171 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.146940 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-gw5kp\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.156228 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.163889 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.164129 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.223590 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.223643 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.223669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.223695 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.223790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.224006 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.224110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.224142 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7gw\" (UniqueName: \"kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.325978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326056 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326087 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326135 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326217 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.326237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7gw\" (UniqueName: \"kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.327056 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.327431 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.327780 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.328317 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.328762 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.332687 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.332839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.341778 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7gw\" (UniqueName: \"kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.344311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.444592 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.448931 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.451929 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-bh958\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.452138 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.452414 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.459128 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.462272 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.530078 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.530216 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vqw\" (UniqueName: \"kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.530286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.530327 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.530372 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.632683 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.633152 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vqw\" (UniqueName: \"kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.633279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.633387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.633495 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.634475 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.634501 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.640313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.642844 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.653637 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vqw\" (UniqueName: \"kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw\") pod \"memcached-0\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.654014 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:22:40 crc kubenswrapper[5030]: W0316 13:22:40.661146 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6da8f44b_035c_4ab2_962b_5c44b123929e.slice/crio-a9f86cbc5247f9c0f78cd6402885e6194907e56ab42c00c7dbb96d9ceddb6b1e WatchSource:0}: Error finding container a9f86cbc5247f9c0f78cd6402885e6194907e56ab42c00c7dbb96d9ceddb6b1e: Status 404 returned error can't find the container with id a9f86cbc5247f9c0f78cd6402885e6194907e56ab42c00c7dbb96d9ceddb6b1e Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.762341 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.890347 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerStarted","Data":"a9f86cbc5247f9c0f78cd6402885e6194907e56ab42c00c7dbb96d9ceddb6b1e"} Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.897317 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" event={"ID":"9a2a035e-0368-432e-8da0-068309eb5c73","Type":"ContainerStarted","Data":"08e53d00d10ed6a383dfa47adb0ffe2fa9a036e44402ca4f109c02ededae3f29"} Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.897457 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.901656 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" event={"ID":"99b5489e-7ca5-491a-bdc2-fe415e1449da","Type":"ContainerStarted","Data":"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a"} Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.901941 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.912820 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" podStartSLOduration=2.829938786 podStartE2EDuration="13.912811496s" podCreationTimestamp="2026-03-16 13:22:27 +0000 UTC" firstStartedPulling="2026-03-16 13:22:28.02128497 +0000 UTC m=+992.420597517" lastFinishedPulling="2026-03-16 13:22:39.10415768 +0000 UTC m=+1003.503470227" observedRunningTime="2026-03-16 13:22:40.910105658 +0000 UTC m=+1005.309418205" watchObservedRunningTime="2026-03-16 13:22:40.912811496 +0000 UTC m=+1005.312124044" Mar 16 13:22:40 crc kubenswrapper[5030]: I0316 13:22:40.930981 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" podStartSLOduration=2.6956967990000003 podStartE2EDuration="13.930949464s" podCreationTimestamp="2026-03-16 13:22:27 +0000 UTC" firstStartedPulling="2026-03-16 13:22:27.960439662 +0000 UTC m=+992.359752210" lastFinishedPulling="2026-03-16 13:22:39.195692328 +0000 UTC m=+1003.595004875" observedRunningTime="2026-03-16 13:22:40.925113009 +0000 UTC m=+1005.324425557" watchObservedRunningTime="2026-03-16 13:22:40.930949464 +0000 UTC m=+1005.330262011" Mar 16 13:22:41 crc kubenswrapper[5030]: I0316 13:22:41.192880 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:22:41 crc kubenswrapper[5030]: W0316 13:22:41.194943 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d649e48_1a25_431c_a334_ed9bd902ee85.slice/crio-2504ea4a23ceb634ca5c5574130d68f358f23a92c8d88b8737953973dc4501be WatchSource:0}: Error finding container 2504ea4a23ceb634ca5c5574130d68f358f23a92c8d88b8737953973dc4501be: Status 404 returned error can't find the container with id 2504ea4a23ceb634ca5c5574130d68f358f23a92c8d88b8737953973dc4501be Mar 16 13:22:41 crc kubenswrapper[5030]: I0316 13:22:41.912115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"0d649e48-1a25-431c-a334-ed9bd902ee85","Type":"ContainerStarted","Data":"2504ea4a23ceb634ca5c5574130d68f358f23a92c8d88b8737953973dc4501be"} Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.526090 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.530165 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.531986 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-vq9qg\"" Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.540882 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.669459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dspfn\" (UniqueName: \"kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn\") pod \"kube-state-metrics-0\" (UID: \"89147732-39a0-43c6-9768-5d4fd41e8c30\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.770877 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dspfn\" (UniqueName: \"kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn\") pod \"kube-state-metrics-0\" (UID: \"89147732-39a0-43c6-9768-5d4fd41e8c30\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.788178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dspfn\" (UniqueName: \"kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn\") pod \"kube-state-metrics-0\" (UID: \"89147732-39a0-43c6-9768-5d4fd41e8c30\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:42 crc kubenswrapper[5030]: I0316 13:22:42.865148 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:44 crc kubenswrapper[5030]: I0316 13:22:44.589072 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:22:44 crc kubenswrapper[5030]: W0316 13:22:44.595842 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89147732_39a0_43c6_9768_5d4fd41e8c30.slice/crio-3e893f243bd6883b45beb6ea53dd2dda242c66863059cc9568d5412bfb5894e0 WatchSource:0}: Error finding container 3e893f243bd6883b45beb6ea53dd2dda242c66863059cc9568d5412bfb5894e0: Status 404 returned error can't find the container with id 3e893f243bd6883b45beb6ea53dd2dda242c66863059cc9568d5412bfb5894e0 Mar 16 13:22:44 crc kubenswrapper[5030]: I0316 13:22:44.939254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"0d649e48-1a25-431c-a334-ed9bd902ee85","Type":"ContainerStarted","Data":"4010f2c336c993f9f63a15808e83f0ac33d271d977a61410da43b7ecc626788b"} Mar 16 13:22:44 crc kubenswrapper[5030]: I0316 13:22:44.939409 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:44 crc kubenswrapper[5030]: I0316 13:22:44.940347 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"89147732-39a0-43c6-9768-5d4fd41e8c30","Type":"ContainerStarted","Data":"3e893f243bd6883b45beb6ea53dd2dda242c66863059cc9568d5412bfb5894e0"} Mar 16 13:22:44 crc kubenswrapper[5030]: I0316 13:22:44.956728 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=1.735789526 podStartE2EDuration="4.95671671s" podCreationTimestamp="2026-03-16 13:22:40 +0000 UTC" firstStartedPulling="2026-03-16 13:22:41.197345271 +0000 UTC m=+1005.596657819" lastFinishedPulling="2026-03-16 13:22:44.418272456 +0000 UTC m=+1008.817585003" observedRunningTime="2026-03-16 13:22:44.954707502 +0000 UTC m=+1009.354020048" watchObservedRunningTime="2026-03-16 13:22:44.95671671 +0000 UTC m=+1009.356029257" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.955220 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerStarted","Data":"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda"} Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.964846 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.976109 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.976141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerStarted","Data":"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8"} Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.976305 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.978946 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.979267 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.979422 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.987739 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-rnrqg\"" Mar 16 13:22:45 crc kubenswrapper[5030]: I0316 13:22:45.987890 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.139686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.139900 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.139990 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.140084 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.140174 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.140640 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.140917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.141777 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mth6q\" (UniqueName: \"kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244395 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244468 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244498 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244651 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244686 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mth6q\" (UniqueName: \"kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.244731 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.245143 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.245329 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.245736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.246027 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.252789 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.256423 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.256997 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.263246 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mth6q\" (UniqueName: \"kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.264411 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.298079 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.800282 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.913721 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.914254 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.974535 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.983312 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerStarted","Data":"b09d1b62b39403e4863fb1147266980607d9262cb749205a77a0c7a7168986a7"} Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.990886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerStarted","Data":"1eb7f50851a52bf196d1bb6b656c048204345016f1aef337ec9decad06717063"} Mar 16 13:22:46 crc kubenswrapper[5030]: I0316 13:22:46.991787 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="dnsmasq-dns" containerID="cri-o://d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a" gracePeriod=10 Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.546703 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.670526 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config\") pod \"99b5489e-7ca5-491a-bdc2-fe415e1449da\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.670838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7v9p\" (UniqueName: \"kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p\") pod \"99b5489e-7ca5-491a-bdc2-fe415e1449da\" (UID: \"99b5489e-7ca5-491a-bdc2-fe415e1449da\") " Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.687692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p" (OuterVolumeSpecName: "kube-api-access-v7v9p") pod "99b5489e-7ca5-491a-bdc2-fe415e1449da" (UID: "99b5489e-7ca5-491a-bdc2-fe415e1449da"). InnerVolumeSpecName "kube-api-access-v7v9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.710024 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config" (OuterVolumeSpecName: "config") pod "99b5489e-7ca5-491a-bdc2-fe415e1449da" (UID: "99b5489e-7ca5-491a-bdc2-fe415e1449da"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.778312 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b5489e-7ca5-491a-bdc2-fe415e1449da-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:47 crc kubenswrapper[5030]: I0316 13:22:47.778346 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7v9p\" (UniqueName: \"kubernetes.io/projected/99b5489e-7ca5-491a-bdc2-fe415e1449da-kube-api-access-v7v9p\") on node \"crc\" DevicePath \"\"" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.001354 5030 generic.go:358] "Generic (PLEG): container finished" podID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerID="d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a" exitCode=0 Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.001432 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.001445 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" event={"ID":"99b5489e-7ca5-491a-bdc2-fe415e1449da","Type":"ContainerDied","Data":"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a"} Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.001500 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6" event={"ID":"99b5489e-7ca5-491a-bdc2-fe415e1449da","Type":"ContainerDied","Data":"358bdc92a8f967e4ccd9fb82576f3c36be3eb4d41fa451799a8cd175405c02cd"} Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.001526 5030 scope.go:117] "RemoveContainer" containerID="d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.003750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerStarted","Data":"a6a5290472a16e365d50c2da8b2a455ce53d8ecfb443f3fed946e04524e2faf8"} Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.032021 5030 scope.go:117] "RemoveContainer" containerID="55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.038461 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.043778 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58748b8b69-zgtr6"] Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.057458 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.059907 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="init" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.059929 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="init" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.059959 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="dnsmasq-dns" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.059966 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="dnsmasq-dns" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.060150 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" containerName="dnsmasq-dns" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.064306 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.064809 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.066353 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.066460 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.066655 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-dqntq\"" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.068114 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.068508 5030 scope.go:117] "RemoveContainer" containerID="d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a" Mar 16 13:22:48 crc kubenswrapper[5030]: E0316 13:22:48.068926 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a\": container with ID starting with d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a not found: ID does not exist" containerID="d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.068963 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a"} err="failed to get container status \"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a\": rpc error: code = NotFound desc = could not find container \"d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a\": container with ID starting with d11c546c4d04cf27d057757aa29b94530acfcbd0e96c9f17791d99358635921a not found: ID does not exist" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.068988 5030 scope.go:117] "RemoveContainer" containerID="55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db" Mar 16 13:22:48 crc kubenswrapper[5030]: E0316 13:22:48.069627 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db\": container with ID starting with 55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db not found: ID does not exist" containerID="55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.069652 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db"} err="failed to get container status \"55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db\": rpc error: code = NotFound desc = could not find container \"55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db\": container with ID starting with 55897b632d9db5b1895de43f7aa16249307bf197b0835ef8878dc9a44ca454db not found: ID does not exist" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.188775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.188875 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfrtd\" (UniqueName: \"kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.188970 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.189056 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.189115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.189212 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.189334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.189429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.291751 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.291874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfrtd\" (UniqueName: \"kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.292136 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.292444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293368 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.293965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.294591 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.295407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.298933 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.298944 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.301106 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.308568 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfrtd\" (UniqueName: \"kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.311003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.378448 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:48 crc kubenswrapper[5030]: I0316 13:22:48.778700 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:22:48 crc kubenswrapper[5030]: W0316 13:22:48.778796 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod163ad89a_4fe7_4852_acab_8fb297698207.slice/crio-9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8 WatchSource:0}: Error finding container 9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8: Status 404 returned error can't find the container with id 9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8 Mar 16 13:22:49 crc kubenswrapper[5030]: I0316 13:22:49.016451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"89147732-39a0-43c6-9768-5d4fd41e8c30","Type":"ContainerStarted","Data":"c1786f32986942b62ab3bb537cd96b1139a4f62c3c2a914c50827e5df67466d9"} Mar 16 13:22:49 crc kubenswrapper[5030]: I0316 13:22:49.017944 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:22:49 crc kubenswrapper[5030]: I0316 13:22:49.021025 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerStarted","Data":"9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8"} Mar 16 13:22:49 crc kubenswrapper[5030]: I0316 13:22:49.039007 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=3.673945371 podStartE2EDuration="7.038984623s" podCreationTimestamp="2026-03-16 13:22:42 +0000 UTC" firstStartedPulling="2026-03-16 13:22:44.60052728 +0000 UTC m=+1008.999839816" lastFinishedPulling="2026-03-16 13:22:47.965566521 +0000 UTC m=+1012.364879068" observedRunningTime="2026-03-16 13:22:49.030104866 +0000 UTC m=+1013.429417413" watchObservedRunningTime="2026-03-16 13:22:49.038984623 +0000 UTC m=+1013.438297170" Mar 16 13:22:49 crc kubenswrapper[5030]: I0316 13:22:49.957461 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b5489e-7ca5-491a-bdc2-fe415e1449da" path="/var/lib/kubelet/pods/99b5489e-7ca5-491a-bdc2-fe415e1449da/volumes" Mar 16 13:22:50 crc kubenswrapper[5030]: I0316 13:22:50.032754 5030 generic.go:358] "Generic (PLEG): container finished" podID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerID="b09d1b62b39403e4863fb1147266980607d9262cb749205a77a0c7a7168986a7" exitCode=0 Mar 16 13:22:50 crc kubenswrapper[5030]: I0316 13:22:50.032848 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerDied","Data":"b09d1b62b39403e4863fb1147266980607d9262cb749205a77a0c7a7168986a7"} Mar 16 13:22:50 crc kubenswrapper[5030]: I0316 13:22:50.036137 5030 generic.go:358] "Generic (PLEG): container finished" podID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerID="1eb7f50851a52bf196d1bb6b656c048204345016f1aef337ec9decad06717063" exitCode=0 Mar 16 13:22:50 crc kubenswrapper[5030]: I0316 13:22:50.036175 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerDied","Data":"1eb7f50851a52bf196d1bb6b656c048204345016f1aef337ec9decad06717063"} Mar 16 13:22:50 crc kubenswrapper[5030]: I0316 13:22:50.969736 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.060464 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerStarted","Data":"c1ef8cc5b33acd6f7307c8cd325cd643f2fc1aaf0d76ddc2d0a9409a05d096a6"} Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.063060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerStarted","Data":"cd97a7de341dba228f0fbe410785bc2e337f24936cdccd8de3e7d129c046bc70"} Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.065073 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerStarted","Data":"ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9"} Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.066875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerStarted","Data":"c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5"} Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.084378 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.302920727 podStartE2EDuration="13.084367292s" podCreationTimestamp="2026-03-16 13:22:39 +0000 UTC" firstStartedPulling="2026-03-16 13:22:40.663741229 +0000 UTC m=+1005.063053777" lastFinishedPulling="2026-03-16 13:22:46.445187805 +0000 UTC m=+1010.844500342" observedRunningTime="2026-03-16 13:22:52.077255439 +0000 UTC m=+1016.476567986" watchObservedRunningTime="2026-03-16 13:22:52.084367292 +0000 UTC m=+1016.483679829" Mar 16 13:22:52 crc kubenswrapper[5030]: I0316 13:22:52.099759 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=8.244403246 podStartE2EDuration="15.099747004s" podCreationTimestamp="2026-03-16 13:22:37 +0000 UTC" firstStartedPulling="2026-03-16 13:22:39.584381894 +0000 UTC m=+1003.983694442" lastFinishedPulling="2026-03-16 13:22:46.439725653 +0000 UTC m=+1010.839038200" observedRunningTime="2026-03-16 13:22:52.093312723 +0000 UTC m=+1016.492625271" watchObservedRunningTime="2026-03-16 13:22:52.099747004 +0000 UTC m=+1016.499059550" Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.035542 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1329125 actualBytes=10240 Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.036565 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.064743 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.064933 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.067075 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.067314 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-wfw8n\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.067325 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.068498 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206344 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzn7\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206608 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206647 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.206686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.286439 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.286491 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.286532 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.287019 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.287083 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325" gracePeriod=600 Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.307944 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308027 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308085 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzn7\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308124 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308163 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308212 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.308238 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.308259 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.308319 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift podName:9f209a2b-0fda-47aa-8be7-d116be97132c nodeName:}" failed. No retries permitted until 2026-03-16 13:22:54.808296638 +0000 UTC m=+1019.207609186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift") pod "swift-storage-0" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c") : configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308656 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308771 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.308821 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.319428 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.324768 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzn7\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.324989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.504572 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btf9p"] Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.512444 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.514082 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.514210 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.515205 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btf9p"] Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.515455 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.613453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.613502 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.613594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.613888 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.613955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.614055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.614087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gs6q\" (UniqueName: \"kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717510 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.717601 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gs6q\" (UniqueName: \"kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.718989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.719344 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.720177 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.723018 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.723715 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.725870 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.733343 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gs6q\" (UniqueName: \"kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q\") pod \"swift-ring-rebalance-btf9p\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.818825 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.819024 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.819064 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: E0316 13:22:54.819136 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift podName:9f209a2b-0fda-47aa-8be7-d116be97132c nodeName:}" failed. No retries permitted until 2026-03-16 13:22:55.819114813 +0000 UTC m=+1020.218427361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift") pod "swift-storage-0" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c") : configmap "swift-ring-files" not found Mar 16 13:22:54 crc kubenswrapper[5030]: I0316 13:22:54.825763 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:22:55 crc kubenswrapper[5030]: I0316 13:22:55.107204 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325" exitCode=0 Mar 16 13:22:55 crc kubenswrapper[5030]: I0316 13:22:55.107285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325"} Mar 16 13:22:55 crc kubenswrapper[5030]: I0316 13:22:55.107345 5030 scope.go:117] "RemoveContainer" containerID="f168ddaa70200c65f678c6ca7be33b74e496f083f5f83be7c5e6d03e746ae45d" Mar 16 13:22:55 crc kubenswrapper[5030]: I0316 13:22:55.838811 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:55 crc kubenswrapper[5030]: E0316 13:22:55.839103 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:22:55 crc kubenswrapper[5030]: E0316 13:22:55.839418 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:22:55 crc kubenswrapper[5030]: E0316 13:22:55.839644 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift podName:9f209a2b-0fda-47aa-8be7-d116be97132c nodeName:}" failed. No retries permitted until 2026-03-16 13:22:57.839534415 +0000 UTC m=+1022.238846962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift") pod "swift-storage-0" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c") : configmap "swift-ring-files" not found Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.116990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61"} Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.119643 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerStarted","Data":"2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a"} Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.124839 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerStarted","Data":"c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b"} Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.175589 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.06596037 podStartE2EDuration="9.175570238s" podCreationTimestamp="2026-03-16 13:22:47 +0000 UTC" firstStartedPulling="2026-03-16 13:22:48.78152516 +0000 UTC m=+1013.180837707" lastFinishedPulling="2026-03-16 13:22:55.891135028 +0000 UTC m=+1020.290447575" observedRunningTime="2026-03-16 13:22:56.165703433 +0000 UTC m=+1020.565015981" watchObservedRunningTime="2026-03-16 13:22:56.175570238 +0000 UTC m=+1020.574882785" Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.185255 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=3.514255486 podStartE2EDuration="12.185222768s" podCreationTimestamp="2026-03-16 13:22:44 +0000 UTC" firstStartedPulling="2026-03-16 13:22:47.213805301 +0000 UTC m=+1011.613117849" lastFinishedPulling="2026-03-16 13:22:55.884772583 +0000 UTC m=+1020.284085131" observedRunningTime="2026-03-16 13:22:56.182844727 +0000 UTC m=+1020.582157275" watchObservedRunningTime="2026-03-16 13:22:56.185222768 +0000 UTC m=+1020.584535315" Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.274429 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btf9p"] Mar 16 13:22:56 crc kubenswrapper[5030]: W0316 13:22:56.274779 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod730d4b84_050c_4b47_944b_5e508001667d.slice/crio-47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6 WatchSource:0}: Error finding container 47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6: Status 404 returned error can't find the container with id 47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6 Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.299129 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:56 crc kubenswrapper[5030]: I0316 13:22:56.659257 5030 scope.go:117] "RemoveContainer" containerID="07aa65a8b27ec41810fe6a9076e8717485296d490d538fcb5de56a182ee3b774" Mar 16 13:22:57 crc kubenswrapper[5030]: I0316 13:22:57.137830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" event={"ID":"730d4b84-050c-4b47-944b-5e508001667d","Type":"ContainerStarted","Data":"47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6"} Mar 16 13:22:57 crc kubenswrapper[5030]: I0316 13:22:57.379434 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:57 crc kubenswrapper[5030]: I0316 13:22:57.420204 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:57 crc kubenswrapper[5030]: I0316 13:22:57.883187 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:22:57 crc kubenswrapper[5030]: E0316 13:22:57.883419 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:22:57 crc kubenswrapper[5030]: E0316 13:22:57.883446 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:22:57 crc kubenswrapper[5030]: E0316 13:22:57.883509 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift podName:9f209a2b-0fda-47aa-8be7-d116be97132c nodeName:}" failed. No retries permitted until 2026-03-16 13:23:01.883488013 +0000 UTC m=+1026.282800561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift") pod "swift-storage-0" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c") : configmap "swift-ring-files" not found Mar 16 13:22:58 crc kubenswrapper[5030]: I0316 13:22:58.150311 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:58 crc kubenswrapper[5030]: I0316 13:22:58.185880 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:22:58 crc kubenswrapper[5030]: I0316 13:22:58.299195 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:58 crc kubenswrapper[5030]: I0316 13:22:58.329658 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.042729 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.043362 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.124814 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.194339 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.256005 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.307299 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.324470 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.324592 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.328077 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.328369 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.328507 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.329232 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-zc6qc\"" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415777 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tpn9\" (UniqueName: \"kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415870 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.415999 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.518505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.518698 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.518729 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.518801 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.518826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpn9\" (UniqueName: \"kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.519278 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.519369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.520027 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.520049 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.520026 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.525733 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.526512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.533763 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tpn9\" (UniqueName: \"kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.533815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:22:59 crc kubenswrapper[5030]: I0316 13:22:59.652922 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.170529 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" event={"ID":"730d4b84-050c-4b47-944b-5e508001667d","Type":"ContainerStarted","Data":"a46ed22242ea0e278f996ec05e72462bfdc5f3c22c6a7ac05817baafdf46d274"} Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.189393 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" podStartSLOduration=2.487284385 podStartE2EDuration="6.189377012s" podCreationTimestamp="2026-03-16 13:22:54 +0000 UTC" firstStartedPulling="2026-03-16 13:22:56.277235355 +0000 UTC m=+1020.676547902" lastFinishedPulling="2026-03-16 13:22:59.979327983 +0000 UTC m=+1024.378640529" observedRunningTime="2026-03-16 13:23:00.183934868 +0000 UTC m=+1024.583247435" watchObservedRunningTime="2026-03-16 13:23:00.189377012 +0000 UTC m=+1024.588689549" Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.352932 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:23:00 crc kubenswrapper[5030]: W0316 13:23:00.357616 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee66b746_fdc9_4765_93cd_21aa27cf84f0.slice/crio-d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560 WatchSource:0}: Error finding container d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560: Status 404 returned error can't find the container with id d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560 Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.462577 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.463758 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:23:00 crc kubenswrapper[5030]: I0316 13:23:00.538426 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.056955 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.179251 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-t7p9d"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.251526 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-t7p9d"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.251580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerStarted","Data":"d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560"} Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.251692 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.253666 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.261012 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-fffzm"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.357491 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-fffzm"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.357609 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.358932 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.370182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqgj\" (UniqueName: \"kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.370307 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.472260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqgj\" (UniqueName: \"kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.472491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.472612 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbgj\" (UniqueName: \"kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.472709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.477917 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.493349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqgj\" (UniqueName: \"kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj\") pod \"glance-8247-account-create-update-t7p9d\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.568896 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.573829 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.574080 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbgj\" (UniqueName: \"kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.574629 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.599967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbgj\" (UniqueName: \"kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj\") pod \"glance-db-create-fffzm\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.671749 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.873421 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dpwqs"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.960448 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.970622 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dpwqs"] Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.981452 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:23:01 crc kubenswrapper[5030]: E0316 13:23:01.982097 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:23:01 crc kubenswrapper[5030]: E0316 13:23:01.982115 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:23:01 crc kubenswrapper[5030]: E0316 13:23:01.982181 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift podName:9f209a2b-0fda-47aa-8be7-d116be97132c nodeName:}" failed. No retries permitted until 2026-03-16 13:23:09.982159753 +0000 UTC m=+1034.381472300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift") pod "swift-storage-0" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c") : configmap "swift-ring-files" not found Mar 16 13:23:01 crc kubenswrapper[5030]: I0316 13:23:01.986668 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb"] Mar 16 13:23:02 crc kubenswrapper[5030]: W0316 13:23:02.018632 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfd05d91_655e_41ac_b719_17fdcd5a86e7.slice/crio-134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b WatchSource:0}: Error finding container 134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b: Status 404 returned error can't find the container with id 134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.057620 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.057673 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-t7p9d"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.057812 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.061460 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.083720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.083811 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h6j6\" (UniqueName: \"kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.099150 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-8ckn2"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.190083 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klw66\" (UniqueName: \"kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.190184 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.190259 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.190311 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9h6j6\" (UniqueName: \"kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.191509 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.210214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h6j6\" (UniqueName: \"kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6\") pod \"keystone-db-create-dpwqs\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.248926 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-fffzm"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.249108 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" event={"ID":"dfd05d91-655e-41ac-b719-17fdcd5a86e7","Type":"ContainerStarted","Data":"134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b"} Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.249154 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-8ckn2"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.249174 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-42ck9"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.251892 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.281603 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.291999 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klw66\" (UniqueName: \"kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.292365 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.293118 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.307496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klw66\" (UniqueName: \"kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66\") pod \"keystone-fa3a-account-create-update-kh9sb\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.348690 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-42ck9"] Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.348748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-fffzm" event={"ID":"31d4caad-7cca-47fa-ac67-e805ac52a31e","Type":"ContainerStarted","Data":"42bf594045e87f0c5be36f29c97644d2a6e1133fb6fdd27bee0f53a5964f705c"} Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.348908 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.351633 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.385775 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.393743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.393838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kx5\" (UniqueName: \"kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.495170 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.496091 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.495253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.496231 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kx5\" (UniqueName: \"kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.496270 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7c4\" (UniqueName: \"kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.513005 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kx5\" (UniqueName: \"kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5\") pod \"placement-db-create-8ckn2\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.587738 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.598695 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.599158 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7c4\" (UniqueName: \"kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.600622 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.624365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7c4\" (UniqueName: \"kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4\") pod \"placement-2079-account-create-update-42ck9\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.664275 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.702614 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dpwqs"] Mar 16 13:23:02 crc kubenswrapper[5030]: W0316 13:23:02.726670 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18699fe7_3c02_4efb_bf17_2ed7e45b3656.slice/crio-7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2 WatchSource:0}: Error finding container 7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2: Status 404 returned error can't find the container with id 7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2 Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.784373 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb"] Mar 16 13:23:02 crc kubenswrapper[5030]: W0316 13:23:02.811567 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c34cfb1_6d06_4a48_8de2_b21285e69853.slice/crio-dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184 WatchSource:0}: Error finding container dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184: Status 404 returned error can't find the container with id dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184 Mar 16 13:23:02 crc kubenswrapper[5030]: I0316 13:23:02.853656 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-8ckn2"] Mar 16 13:23:02 crc kubenswrapper[5030]: W0316 13:23:02.853923 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59356801_aa08_452c_a9a2_d85d3ead51f1.slice/crio-c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7 WatchSource:0}: Error finding container c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7: Status 404 returned error can't find the container with id c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7 Mar 16 13:23:03 crc kubenswrapper[5030]: W0316 13:23:03.138882 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88e64fb3_edda_4ad3_af08_92198c11329d.slice/crio-0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603 WatchSource:0}: Error finding container 0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603: Status 404 returned error can't find the container with id 0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603 Mar 16 13:23:03 crc kubenswrapper[5030]: I0316 13:23:03.143295 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-42ck9"] Mar 16 13:23:03 crc kubenswrapper[5030]: I0316 13:23:03.219051 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" event={"ID":"88e64fb3-edda-4ad3-af08-92198c11329d","Type":"ContainerStarted","Data":"0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603"} Mar 16 13:23:03 crc kubenswrapper[5030]: I0316 13:23:03.221516 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" event={"ID":"0c34cfb1-6d06-4a48-8de2-b21285e69853","Type":"ContainerStarted","Data":"dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184"} Mar 16 13:23:03 crc kubenswrapper[5030]: I0316 13:23:03.223343 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" event={"ID":"18699fe7-3c02-4efb-bf17-2ed7e45b3656","Type":"ContainerStarted","Data":"7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2"} Mar 16 13:23:03 crc kubenswrapper[5030]: I0316 13:23:03.224821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-8ckn2" event={"ID":"59356801-aa08-452c-a9a2-d85d3ead51f1","Type":"ContainerStarted","Data":"c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.251210 5030 generic.go:358] "Generic (PLEG): container finished" podID="730d4b84-050c-4b47-944b-5e508001667d" containerID="a46ed22242ea0e278f996ec05e72462bfdc5f3c22c6a7ac05817baafdf46d274" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.251303 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" event={"ID":"730d4b84-050c-4b47-944b-5e508001667d","Type":"ContainerDied","Data":"a46ed22242ea0e278f996ec05e72462bfdc5f3c22c6a7ac05817baafdf46d274"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.255423 5030 generic.go:358] "Generic (PLEG): container finished" podID="dfd05d91-655e-41ac-b719-17fdcd5a86e7" containerID="e2524d4483dadd7cddf183d56dd12de84b3c11dac05a6a3338a688053a74bc3a" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.255602 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" event={"ID":"dfd05d91-655e-41ac-b719-17fdcd5a86e7","Type":"ContainerDied","Data":"e2524d4483dadd7cddf183d56dd12de84b3c11dac05a6a3338a688053a74bc3a"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.256955 5030 generic.go:358] "Generic (PLEG): container finished" podID="88e64fb3-edda-4ad3-af08-92198c11329d" containerID="a19761fa98b6a2702e69ac2d487e3660aebe22071221e5c59327efe5792a826e" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.257091 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" event={"ID":"88e64fb3-edda-4ad3-af08-92198c11329d","Type":"ContainerDied","Data":"a19761fa98b6a2702e69ac2d487e3660aebe22071221e5c59327efe5792a826e"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.258416 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c34cfb1-6d06-4a48-8de2-b21285e69853" containerID="3db4061287a8f73f223d32d5cdc4e23d588088d3f53aa827efff8d3c2a8549df" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.258506 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" event={"ID":"0c34cfb1-6d06-4a48-8de2-b21285e69853","Type":"ContainerDied","Data":"3db4061287a8f73f223d32d5cdc4e23d588088d3f53aa827efff8d3c2a8549df"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.259720 5030 generic.go:358] "Generic (PLEG): container finished" podID="31d4caad-7cca-47fa-ac67-e805ac52a31e" containerID="de6a6c57f89aa1a5e082cf727721a0f22f61e3323c8b3eca3df33ed58848d6bc" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.259832 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-fffzm" event={"ID":"31d4caad-7cca-47fa-ac67-e805ac52a31e","Type":"ContainerDied","Data":"de6a6c57f89aa1a5e082cf727721a0f22f61e3323c8b3eca3df33ed58848d6bc"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.261017 5030 generic.go:358] "Generic (PLEG): container finished" podID="18699fe7-3c02-4efb-bf17-2ed7e45b3656" containerID="96eecbf04f1add18d24bfbfc2961d6cf517cac5e15ee9b5b969930036d7898e8" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.261090 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" event={"ID":"18699fe7-3c02-4efb-bf17-2ed7e45b3656","Type":"ContainerDied","Data":"96eecbf04f1add18d24bfbfc2961d6cf517cac5e15ee9b5b969930036d7898e8"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.262993 5030 generic.go:358] "Generic (PLEG): container finished" podID="59356801-aa08-452c-a9a2-d85d3ead51f1" containerID="151aa972a51c692def200bf0327ada3f9687ac3d3a695d8acfdb5b55858c15eb" exitCode=0 Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.263071 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-8ckn2" event={"ID":"59356801-aa08-452c-a9a2-d85d3ead51f1","Type":"ContainerDied","Data":"151aa972a51c692def200bf0327ada3f9687ac3d3a695d8acfdb5b55858c15eb"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.264674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerStarted","Data":"a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa"} Mar 16 13:23:06 crc kubenswrapper[5030]: I0316 13:23:06.360593 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=1.762916801 podStartE2EDuration="7.360571654s" podCreationTimestamp="2026-03-16 13:22:59 +0000 UTC" firstStartedPulling="2026-03-16 13:23:00.359880438 +0000 UTC m=+1024.759192984" lastFinishedPulling="2026-03-16 13:23:05.95753529 +0000 UTC m=+1030.356847837" observedRunningTime="2026-03-16 13:23:06.354430887 +0000 UTC m=+1030.753743433" watchObservedRunningTime="2026-03-16 13:23:06.360571654 +0000 UTC m=+1030.759884201" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.274699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerStarted","Data":"79fcb8675447df9cfb7d0cebb9d431b613ebca60bc5200d6fa466d198199ac42"} Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.275726 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.634630 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.682108 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-vl5hn"] Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.683215 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e64fb3-edda-4ad3-af08-92198c11329d" containerName="mariadb-account-create-update" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.683231 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e64fb3-edda-4ad3-af08-92198c11329d" containerName="mariadb-account-create-update" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.683445 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="88e64fb3-edda-4ad3-af08-92198c11329d" containerName="mariadb-account-create-update" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.687344 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.689913 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.704268 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-vl5hn"] Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.790153 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.794745 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.806304 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h7c4\" (UniqueName: \"kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4\") pod \"88e64fb3-edda-4ad3-af08-92198c11329d\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.806425 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts\") pod \"88e64fb3-edda-4ad3-af08-92198c11329d\" (UID: \"88e64fb3-edda-4ad3-af08-92198c11329d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.806774 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twhtz\" (UniqueName: \"kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.806884 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.807311 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "88e64fb3-edda-4ad3-af08-92198c11329d" (UID: "88e64fb3-edda-4ad3-af08-92198c11329d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.813581 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4" (OuterVolumeSpecName: "kube-api-access-5h7c4") pod "88e64fb3-edda-4ad3-af08-92198c11329d" (UID: "88e64fb3-edda-4ad3-af08-92198c11329d"). InnerVolumeSpecName "kube-api-access-5h7c4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.832113 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.835713 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.856710 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.863843 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.908597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.908747 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.908773 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts\") pod \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.908793 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.908963 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdbgj\" (UniqueName: \"kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj\") pod \"31d4caad-7cca-47fa-ac67-e805ac52a31e\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909009 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gs6q\" (UniqueName: \"kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909035 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klw66\" (UniqueName: \"kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66\") pod \"0c34cfb1-6d06-4a48-8de2-b21285e69853\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909099 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts\") pod \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mqgj\" (UniqueName: \"kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj\") pod \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\" (UID: \"dfd05d91-655e-41ac-b719-17fdcd5a86e7\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909229 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909275 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4kx5\" (UniqueName: \"kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5\") pod \"59356801-aa08-452c-a9a2-d85d3ead51f1\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909278 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909307 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h6j6\" (UniqueName: \"kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6\") pod \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\" (UID: \"18699fe7-3c02-4efb-bf17-2ed7e45b3656\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909289 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dfd05d91-655e-41ac-b719-17fdcd5a86e7" (UID: "dfd05d91-655e-41ac-b719-17fdcd5a86e7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts\") pod \"59356801-aa08-452c-a9a2-d85d3ead51f1\" (UID: \"59356801-aa08-452c-a9a2-d85d3ead51f1\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909383 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf\") pod \"730d4b84-050c-4b47-944b-5e508001667d\" (UID: \"730d4b84-050c-4b47-944b-5e508001667d\") " Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909697 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twhtz\" (UniqueName: \"kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909775 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.909891 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "18699fe7-3c02-4efb-bf17-2ed7e45b3656" (UID: "18699fe7-3c02-4efb-bf17-2ed7e45b3656"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.910120 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "59356801-aa08-452c-a9a2-d85d3ead51f1" (UID: "59356801-aa08-452c-a9a2-d85d3ead51f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.910836 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.911179 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.911973 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dfd05d91-655e-41ac-b719-17fdcd5a86e7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.911993 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/18699fe7-3c02-4efb-bf17-2ed7e45b3656-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912002 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/730d4b84-050c-4b47-944b-5e508001667d-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912012 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h7c4\" (UniqueName: \"kubernetes.io/projected/88e64fb3-edda-4ad3-af08-92198c11329d-kube-api-access-5h7c4\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912022 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59356801-aa08-452c-a9a2-d85d3ead51f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912031 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/88e64fb3-edda-4ad3-af08-92198c11329d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912049 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.912706 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj" (OuterVolumeSpecName: "kube-api-access-hdbgj") pod "31d4caad-7cca-47fa-ac67-e805ac52a31e" (UID: "31d4caad-7cca-47fa-ac67-e805ac52a31e"). InnerVolumeSpecName "kube-api-access-hdbgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.913195 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5" (OuterVolumeSpecName: "kube-api-access-k4kx5") pod "59356801-aa08-452c-a9a2-d85d3ead51f1" (UID: "59356801-aa08-452c-a9a2-d85d3ead51f1"). InnerVolumeSpecName "kube-api-access-k4kx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.914139 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q" (OuterVolumeSpecName: "kube-api-access-9gs6q") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "kube-api-access-9gs6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.914635 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj" (OuterVolumeSpecName: "kube-api-access-8mqgj") pod "dfd05d91-655e-41ac-b719-17fdcd5a86e7" (UID: "dfd05d91-655e-41ac-b719-17fdcd5a86e7"). InnerVolumeSpecName "kube-api-access-8mqgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.916380 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6" (OuterVolumeSpecName: "kube-api-access-9h6j6") pod "18699fe7-3c02-4efb-bf17-2ed7e45b3656" (UID: "18699fe7-3c02-4efb-bf17-2ed7e45b3656"). InnerVolumeSpecName "kube-api-access-9h6j6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.917669 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66" (OuterVolumeSpecName: "kube-api-access-klw66") pod "0c34cfb1-6d06-4a48-8de2-b21285e69853" (UID: "0c34cfb1-6d06-4a48-8de2-b21285e69853"). InnerVolumeSpecName "kube-api-access-klw66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.920241 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.926391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twhtz\" (UniqueName: \"kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz\") pod \"root-account-create-update-vl5hn\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.930746 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts" (OuterVolumeSpecName: "scripts") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.935378 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:07 crc kubenswrapper[5030]: I0316 13:23:07.939944 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "730d4b84-050c-4b47-944b-5e508001667d" (UID: "730d4b84-050c-4b47-944b-5e508001667d"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.014116 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts\") pod \"31d4caad-7cca-47fa-ac67-e805ac52a31e\" (UID: \"31d4caad-7cca-47fa-ac67-e805ac52a31e\") " Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.014251 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts\") pod \"0c34cfb1-6d06-4a48-8de2-b21285e69853\" (UID: \"0c34cfb1-6d06-4a48-8de2-b21285e69853\") " Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.014510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "31d4caad-7cca-47fa-ac67-e805ac52a31e" (UID: "31d4caad-7cca-47fa-ac67-e805ac52a31e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.014721 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0c34cfb1-6d06-4a48-8de2-b21285e69853" (UID: "0c34cfb1-6d06-4a48-8de2-b21285e69853"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015305 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mqgj\" (UniqueName: \"kubernetes.io/projected/dfd05d91-655e-41ac-b719-17fdcd5a86e7-kube-api-access-8mqgj\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015333 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015344 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4kx5\" (UniqueName: \"kubernetes.io/projected/59356801-aa08-452c-a9a2-d85d3ead51f1-kube-api-access-k4kx5\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015374 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h6j6\" (UniqueName: \"kubernetes.io/projected/18699fe7-3c02-4efb-bf17-2ed7e45b3656-kube-api-access-9h6j6\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015385 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015394 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/31d4caad-7cca-47fa-ac67-e805ac52a31e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015403 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c34cfb1-6d06-4a48-8de2-b21285e69853-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015415 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/730d4b84-050c-4b47-944b-5e508001667d-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015427 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/730d4b84-050c-4b47-944b-5e508001667d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015436 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdbgj\" (UniqueName: \"kubernetes.io/projected/31d4caad-7cca-47fa-ac67-e805ac52a31e-kube-api-access-hdbgj\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015444 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gs6q\" (UniqueName: \"kubernetes.io/projected/730d4b84-050c-4b47-944b-5e508001667d-kube-api-access-9gs6q\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.015452 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klw66\" (UniqueName: \"kubernetes.io/projected/0c34cfb1-6d06-4a48-8de2-b21285e69853-kube-api-access-klw66\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.017335 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.286100 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.286107 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2079-account-create-update-42ck9" event={"ID":"88e64fb3-edda-4ad3-af08-92198c11329d","Type":"ContainerDied","Data":"0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.286492 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ff56bfa5d88e3638e34d0159cbda2f2de6b7b78b127baa55dc3c8a8b5c73603" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.289589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" event={"ID":"0c34cfb1-6d06-4a48-8de2-b21285e69853","Type":"ContainerDied","Data":"dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.289643 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc9fbe29b23ed9292fad0a8b18f9eabf53aed7e53a84f857e7136b39eb2e9184" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.289605 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.293932 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-fffzm" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.294029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-fffzm" event={"ID":"31d4caad-7cca-47fa-ac67-e805ac52a31e","Type":"ContainerDied","Data":"42bf594045e87f0c5be36f29c97644d2a6e1133fb6fdd27bee0f53a5964f705c"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.294119 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42bf594045e87f0c5be36f29c97644d2a6e1133fb6fdd27bee0f53a5964f705c" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.299777 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.299824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-dpwqs" event={"ID":"18699fe7-3c02-4efb-bf17-2ed7e45b3656","Type":"ContainerDied","Data":"7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.299861 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7108106920dae497c62cc470e3a8ba96d7951f1f65d8a2ae61defbb1d391a1f2" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.307774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-8ckn2" event={"ID":"59356801-aa08-452c-a9a2-d85d3ead51f1","Type":"ContainerDied","Data":"c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.307805 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8276bc97ebed42ca5c1a015bc62dd7d52a64dab40eaa064ad559aa0c7b890c7" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.307775 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-8ckn2" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.314868 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" event={"ID":"730d4b84-050c-4b47-944b-5e508001667d","Type":"ContainerDied","Data":"47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.314911 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47dff57e835573bf74d40b3fcba7d50a10265ba28a71682dc0fca2afe6aa4ed6" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.315880 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btf9p" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.317587 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" event={"ID":"dfd05d91-655e-41ac-b719-17fdcd5a86e7","Type":"ContainerDied","Data":"134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b"} Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.317620 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="134f19225731b710aa8bd58cc39a0e7711f9d6746f4862da3a63c18b27e5089b" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.317722 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-t7p9d" Mar 16 13:23:08 crc kubenswrapper[5030]: I0316 13:23:08.406570 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-vl5hn"] Mar 16 13:23:09 crc kubenswrapper[5030]: I0316 13:23:09.327542 5030 generic.go:358] "Generic (PLEG): container finished" podID="395e5b93-0ca4-43ed-8a6a-5797fcb492b8" containerID="a40e997a8ae67574bd07b0d721239bd9ed8e456f0474799f797149c1b36c7d4a" exitCode=0 Mar 16 13:23:09 crc kubenswrapper[5030]: I0316 13:23:09.327659 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" event={"ID":"395e5b93-0ca4-43ed-8a6a-5797fcb492b8","Type":"ContainerDied","Data":"a40e997a8ae67574bd07b0d721239bd9ed8e456f0474799f797149c1b36c7d4a"} Mar 16 13:23:09 crc kubenswrapper[5030]: I0316 13:23:09.327915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" event={"ID":"395e5b93-0ca4-43ed-8a6a-5797fcb492b8","Type":"ContainerStarted","Data":"ac4f2f166e3c43e2fa294ca1e65791a72239a12650eb5a23e6362330829e9295"} Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.051287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.058818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"swift-storage-0\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.281046 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.658452 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.684974 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.762255 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twhtz\" (UniqueName: \"kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz\") pod \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.762430 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts\") pod \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\" (UID: \"395e5b93-0ca4-43ed-8a6a-5797fcb492b8\") " Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.763232 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "395e5b93-0ca4-43ed-8a6a-5797fcb492b8" (UID: "395e5b93-0ca4-43ed-8a6a-5797fcb492b8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.767929 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz" (OuterVolumeSpecName: "kube-api-access-twhtz") pod "395e5b93-0ca4-43ed-8a6a-5797fcb492b8" (UID: "395e5b93-0ca4-43ed-8a6a-5797fcb492b8"). InnerVolumeSpecName "kube-api-access-twhtz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.865020 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:10 crc kubenswrapper[5030]: I0316 13:23:10.865068 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twhtz\" (UniqueName: \"kubernetes.io/projected/395e5b93-0ca4-43ed-8a6a-5797fcb492b8-kube-api-access-twhtz\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.344746 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.344780 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-vl5hn" event={"ID":"395e5b93-0ca4-43ed-8a6a-5797fcb492b8","Type":"ContainerDied","Data":"ac4f2f166e3c43e2fa294ca1e65791a72239a12650eb5a23e6362330829e9295"} Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.344828 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac4f2f166e3c43e2fa294ca1e65791a72239a12650eb5a23e6362330829e9295" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.346086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"5db588dc219248be9a8ea8e75de0e0fc8b2da94839d88d7fe1d3af1af2c2363a"} Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.436380 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-s72j8"] Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437770 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18699fe7-3c02-4efb-bf17-2ed7e45b3656" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437792 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="18699fe7-3c02-4efb-bf17-2ed7e45b3656" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437810 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfd05d91-655e-41ac-b719-17fdcd5a86e7" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437818 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfd05d91-655e-41ac-b719-17fdcd5a86e7" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437849 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395e5b93-0ca4-43ed-8a6a-5797fcb492b8" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437855 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="395e5b93-0ca4-43ed-8a6a-5797fcb492b8" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437866 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59356801-aa08-452c-a9a2-d85d3ead51f1" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437873 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="59356801-aa08-452c-a9a2-d85d3ead51f1" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437900 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31d4caad-7cca-47fa-ac67-e805ac52a31e" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437906 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="31d4caad-7cca-47fa-ac67-e805ac52a31e" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437914 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c34cfb1-6d06-4a48-8de2-b21285e69853" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437920 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c34cfb1-6d06-4a48-8de2-b21285e69853" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437941 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="730d4b84-050c-4b47-944b-5e508001667d" containerName="swift-ring-rebalance" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.437949 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="730d4b84-050c-4b47-944b-5e508001667d" containerName="swift-ring-rebalance" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438140 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="395e5b93-0ca4-43ed-8a6a-5797fcb492b8" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438153 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="31d4caad-7cca-47fa-ac67-e805ac52a31e" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438159 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="730d4b84-050c-4b47-944b-5e508001667d" containerName="swift-ring-rebalance" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438167 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c34cfb1-6d06-4a48-8de2-b21285e69853" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438174 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="59356801-aa08-452c-a9a2-d85d3ead51f1" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438181 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="18699fe7-3c02-4efb-bf17-2ed7e45b3656" containerName="mariadb-database-create" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.438189 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dfd05d91-655e-41ac-b719-17fdcd5a86e7" containerName="mariadb-account-create-update" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.443081 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.446741 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.446952 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-xt9fg\"" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.447230 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-s72j8"] Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.473457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.473529 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.473582 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwtf\" (UniqueName: \"kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.473631 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.575134 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.575546 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.575600 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwtf\" (UniqueName: \"kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.575625 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.581413 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.581587 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.582002 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.589927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwtf\" (UniqueName: \"kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf\") pod \"glance-db-sync-s72j8\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:11 crc kubenswrapper[5030]: I0316 13:23:11.758915 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:12 crc kubenswrapper[5030]: I0316 13:23:12.181278 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-s72j8"] Mar 16 13:23:12 crc kubenswrapper[5030]: W0316 13:23:12.205632 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb91bd97_9fbb_4925_9af5_53310afb08ec.slice/crio-322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687 WatchSource:0}: Error finding container 322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687: Status 404 returned error can't find the container with id 322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687 Mar 16 13:23:12 crc kubenswrapper[5030]: I0316 13:23:12.352724 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-s72j8" event={"ID":"eb91bd97-9fbb-4925-9af5-53310afb08ec","Type":"ContainerStarted","Data":"322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687"} Mar 16 13:23:13 crc kubenswrapper[5030]: I0316 13:23:13.362698 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e"} Mar 16 13:23:13 crc kubenswrapper[5030]: I0316 13:23:13.362947 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"b82396b234410667a2b6ffa231b6520a5b7a6d7f1757babf3ecda8d988b304cb"} Mar 16 13:23:13 crc kubenswrapper[5030]: I0316 13:23:13.362957 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd"} Mar 16 13:23:13 crc kubenswrapper[5030]: I0316 13:23:13.362966 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"59e52a58cff306c5b3794d240bea25619b6c04674c92596e8d1b304639b5367e"} Mar 16 13:23:14 crc kubenswrapper[5030]: I0316 13:23:14.124661 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-vl5hn"] Mar 16 13:23:14 crc kubenswrapper[5030]: I0316 13:23:14.129241 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-vl5hn"] Mar 16 13:23:15 crc kubenswrapper[5030]: I0316 13:23:15.387354 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"febf3f401efcc4f0a20b014dfd019f996fa60d2011460fbcaf9fd5210f3ba917"} Mar 16 13:23:15 crc kubenswrapper[5030]: I0316 13:23:15.388014 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6"} Mar 16 13:23:15 crc kubenswrapper[5030]: I0316 13:23:15.388026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"ff495157508b1452e3738b26774988eacc4476672774db1d76cca80f03b7f4bd"} Mar 16 13:23:15 crc kubenswrapper[5030]: I0316 13:23:15.388038 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"27689210a9f998283768d42cc2924bb48afccb7a8d050492cbb021aaed5cd87c"} Mar 16 13:23:15 crc kubenswrapper[5030]: I0316 13:23:15.957514 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395e5b93-0ca4-43ed-8a6a-5797fcb492b8" path="/var/lib/kubelet/pods/395e5b93-0ca4-43ed-8a6a-5797fcb492b8/volumes" Mar 16 13:23:17 crc kubenswrapper[5030]: E0316 13:23:17.041787 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89282d6e_ff10_4092_b709_a2466e578fd4.slice/crio-conmon-243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.438939 5030 generic.go:358] "Generic (PLEG): container finished" podID="89282d6e-ff10-4092-b709-a2466e578fd4" containerID="243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda" exitCode=0 Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.438995 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerDied","Data":"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449634 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"59f2a7582ee7f1278fdf022a8d7af1323dc67f0a66fc35069516a2cfcafee453"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"1704842157f40733908dd4ed5867072e53a2bbe14d7f0e8ae69852982791aceb"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449720 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"72bc4662c978aa84acde832f34da75c1468516be07838a280b075621c30f6913"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449729 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"73801e700d8011bc159c00aaa6593343e45ac149660f216ba6e9790c295dbcb3"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449739 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"dac4f687851ec775f6ceee6b03795d0d3a5d69ecffcecd2474ba573ade326558"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.449748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerStarted","Data":"0cb5f47a58a27d974724912b597af41894fc9e1c24f5bf3b16e9d27f09518a1a"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.452425 5030 generic.go:358] "Generic (PLEG): container finished" podID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerID="9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8" exitCode=0 Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.452828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerDied","Data":"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8"} Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.503937 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=19.914062871 podStartE2EDuration="25.503918848s" podCreationTimestamp="2026-03-16 13:22:52 +0000 UTC" firstStartedPulling="2026-03-16 13:23:10.691092578 +0000 UTC m=+1035.090405125" lastFinishedPulling="2026-03-16 13:23:16.280948555 +0000 UTC m=+1040.680261102" observedRunningTime="2026-03-16 13:23:17.491733827 +0000 UTC m=+1041.891046364" watchObservedRunningTime="2026-03-16 13:23:17.503918848 +0000 UTC m=+1041.903231396" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.743853 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.753279 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.755020 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.755623 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.893052 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjh76\" (UniqueName: \"kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.893290 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.893378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.893429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.995209 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.995273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.995312 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.995484 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjh76\" (UniqueName: \"kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.996313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.996369 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:17 crc kubenswrapper[5030]: I0316 13:23:17.996422 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.013746 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjh76\" (UniqueName: \"kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76\") pod \"dnsmasq-dnsmasq-76f67dbd4f-xsfzq\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.069451 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.372808 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.468521 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerStarted","Data":"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e"} Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.469068 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.471099 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerStarted","Data":"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429"} Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.471481 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.495052 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.656622049 podStartE2EDuration="42.495031178s" podCreationTimestamp="2026-03-16 13:22:36 +0000 UTC" firstStartedPulling="2026-03-16 13:22:39.57447262 +0000 UTC m=+1003.973785167" lastFinishedPulling="2026-03-16 13:22:44.412881749 +0000 UTC m=+1008.812194296" observedRunningTime="2026-03-16 13:23:18.491000379 +0000 UTC m=+1042.890312925" watchObservedRunningTime="2026-03-16 13:23:18.495031178 +0000 UTC m=+1042.894343725" Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.515590 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:23:18 crc kubenswrapper[5030]: I0316 13:23:18.520196 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.631707596 podStartE2EDuration="42.520179876s" podCreationTimestamp="2026-03-16 13:22:36 +0000 UTC" firstStartedPulling="2026-03-16 13:22:39.534478573 +0000 UTC m=+1003.933791120" lastFinishedPulling="2026-03-16 13:22:44.422950853 +0000 UTC m=+1008.822263400" observedRunningTime="2026-03-16 13:23:18.518406082 +0000 UTC m=+1042.917718629" watchObservedRunningTime="2026-03-16 13:23:18.520179876 +0000 UTC m=+1042.919492423" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.130203 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-dwb88"] Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.136217 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.138734 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.139465 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-dwb88"] Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.229758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4tr\" (UniqueName: \"kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.230135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.331298 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.331447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4tr\" (UniqueName: \"kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.331966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.352315 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4tr\" (UniqueName: \"kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr\") pod \"root-account-create-update-dwb88\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.450366 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.483700 5030 generic.go:358] "Generic (PLEG): container finished" podID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerID="f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae" exitCode=0 Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.483986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" event={"ID":"b065a85f-f473-459d-bd68-74d1b57ce27b","Type":"ContainerDied","Data":"f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae"} Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.484078 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" event={"ID":"b065a85f-f473-459d-bd68-74d1b57ce27b","Type":"ContainerStarted","Data":"54e666738a4dddcf2efe0a01dc9632f324a2ea484bf26cef508061e60a5293b1"} Mar 16 13:23:19 crc kubenswrapper[5030]: I0316 13:23:19.875884 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-dwb88"] Mar 16 13:23:19 crc kubenswrapper[5030]: W0316 13:23:19.876379 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda54bef24_5038_4823_bb3d_c11b5554c6d0.slice/crio-7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0 WatchSource:0}: Error finding container 7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0: Status 404 returned error can't find the container with id 7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0 Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.497716 5030 generic.go:358] "Generic (PLEG): container finished" podID="a54bef24-5038-4823-bb3d-c11b5554c6d0" containerID="5f152614e6d0dd672732d2eec2b354582233088ed1bef901b75576d907482b9e" exitCode=0 Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.497812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-dwb88" event={"ID":"a54bef24-5038-4823-bb3d-c11b5554c6d0","Type":"ContainerDied","Data":"5f152614e6d0dd672732d2eec2b354582233088ed1bef901b75576d907482b9e"} Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.498157 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-dwb88" event={"ID":"a54bef24-5038-4823-bb3d-c11b5554c6d0","Type":"ContainerStarted","Data":"7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0"} Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.501443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" event={"ID":"b065a85f-f473-459d-bd68-74d1b57ce27b","Type":"ContainerStarted","Data":"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554"} Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.501805 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:20 crc kubenswrapper[5030]: I0316 13:23:20.538351 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" podStartSLOduration=3.538338155 podStartE2EDuration="3.538338155s" podCreationTimestamp="2026-03-16 13:23:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:23:20.533197138 +0000 UTC m=+1044.932509685" watchObservedRunningTime="2026-03-16 13:23:20.538338155 +0000 UTC m=+1044.937650702" Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.806867 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.874896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts\") pod \"a54bef24-5038-4823-bb3d-c11b5554c6d0\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.874989 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv4tr\" (UniqueName: \"kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr\") pod \"a54bef24-5038-4823-bb3d-c11b5554c6d0\" (UID: \"a54bef24-5038-4823-bb3d-c11b5554c6d0\") " Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.875474 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a54bef24-5038-4823-bb3d-c11b5554c6d0" (UID: "a54bef24-5038-4823-bb3d-c11b5554c6d0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.879866 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr" (OuterVolumeSpecName: "kube-api-access-wv4tr") pod "a54bef24-5038-4823-bb3d-c11b5554c6d0" (UID: "a54bef24-5038-4823-bb3d-c11b5554c6d0"). InnerVolumeSpecName "kube-api-access-wv4tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.977179 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a54bef24-5038-4823-bb3d-c11b5554c6d0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:21 crc kubenswrapper[5030]: I0316 13:23:21.977215 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv4tr\" (UniqueName: \"kubernetes.io/projected/a54bef24-5038-4823-bb3d-c11b5554c6d0-kube-api-access-wv4tr\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:22 crc kubenswrapper[5030]: I0316 13:23:22.518940 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-dwb88" Mar 16 13:23:22 crc kubenswrapper[5030]: I0316 13:23:22.518972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-dwb88" event={"ID":"a54bef24-5038-4823-bb3d-c11b5554c6d0","Type":"ContainerDied","Data":"7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0"} Mar 16 13:23:22 crc kubenswrapper[5030]: I0316 13:23:22.519024 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d548e1440ce528d18aa8314d38db9fb8cd1db0cd1791fe4e07b223cce14efe0" Mar 16 13:23:26 crc kubenswrapper[5030]: I0316 13:23:26.510903 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:23:26 crc kubenswrapper[5030]: I0316 13:23:26.565579 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:23:26 crc kubenswrapper[5030]: I0316 13:23:26.565933 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="dnsmasq-dns" containerID="cri-o://08e53d00d10ed6a383dfa47adb0ffe2fa9a036e44402ca4f109c02ededae3f29" gracePeriod=10 Mar 16 13:23:26 crc kubenswrapper[5030]: I0316 13:23:26.913146 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.217.0.102:5353: connect: connection refused" Mar 16 13:23:27 crc kubenswrapper[5030]: I0316 13:23:27.567297 5030 generic.go:358] "Generic (PLEG): container finished" podID="9a2a035e-0368-432e-8da0-068309eb5c73" containerID="08e53d00d10ed6a383dfa47adb0ffe2fa9a036e44402ca4f109c02ededae3f29" exitCode=0 Mar 16 13:23:27 crc kubenswrapper[5030]: I0316 13:23:27.567382 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" event={"ID":"9a2a035e-0368-432e-8da0-068309eb5c73","Type":"ContainerDied","Data":"08e53d00d10ed6a383dfa47adb0ffe2fa9a036e44402ca4f109c02ededae3f29"} Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.016085 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.197447 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc\") pod \"9a2a035e-0368-432e-8da0-068309eb5c73\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.197961 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config\") pod \"9a2a035e-0368-432e-8da0-068309eb5c73\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.198022 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d659c\" (UniqueName: \"kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c\") pod \"9a2a035e-0368-432e-8da0-068309eb5c73\" (UID: \"9a2a035e-0368-432e-8da0-068309eb5c73\") " Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.204290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c" (OuterVolumeSpecName: "kube-api-access-d659c") pod "9a2a035e-0368-432e-8da0-068309eb5c73" (UID: "9a2a035e-0368-432e-8da0-068309eb5c73"). InnerVolumeSpecName "kube-api-access-d659c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.231686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config" (OuterVolumeSpecName: "config") pod "9a2a035e-0368-432e-8da0-068309eb5c73" (UID: "9a2a035e-0368-432e-8da0-068309eb5c73"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.235335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "9a2a035e-0368-432e-8da0-068309eb5c73" (UID: "9a2a035e-0368-432e-8da0-068309eb5c73"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.300614 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.300644 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a2a035e-0368-432e-8da0-068309eb5c73-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.300656 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d659c\" (UniqueName: \"kubernetes.io/projected/9a2a035e-0368-432e-8da0-068309eb5c73-kube-api-access-d659c\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.581412 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.581650 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg" event={"ID":"9a2a035e-0368-432e-8da0-068309eb5c73","Type":"ContainerDied","Data":"221bd1d8f82bdfba8c40d3e0e3d8dcc09a34ee58b9cc3eda7b3fe70dee1808e9"} Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.581739 5030 scope.go:117] "RemoveContainer" containerID="08e53d00d10ed6a383dfa47adb0ffe2fa9a036e44402ca4f109c02ededae3f29" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.585024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-s72j8" event={"ID":"eb91bd97-9fbb-4925-9af5-53310afb08ec","Type":"ContainerStarted","Data":"ec72be981bb2ecb158f3559793f0c849c8180922b1e6fc527a1ec72ae1108818"} Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.604606 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-s72j8" podStartSLOduration=2.000947124 podStartE2EDuration="17.604578264s" podCreationTimestamp="2026-03-16 13:23:11 +0000 UTC" firstStartedPulling="2026-03-16 13:23:12.217188846 +0000 UTC m=+1036.616501393" lastFinishedPulling="2026-03-16 13:23:27.820819987 +0000 UTC m=+1052.220132533" observedRunningTime="2026-03-16 13:23:28.601266256 +0000 UTC m=+1053.000578823" watchObservedRunningTime="2026-03-16 13:23:28.604578264 +0000 UTC m=+1053.003890810" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.606197 5030 scope.go:117] "RemoveContainer" containerID="327888ad9c617bbde1693a3419ba4b0cddda829356546cd43e9a7b3f52c713e7" Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.626709 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:23:28 crc kubenswrapper[5030]: I0316 13:23:28.632327 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-ww7gg"] Mar 16 13:23:29 crc kubenswrapper[5030]: I0316 13:23:29.488752 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:23:29 crc kubenswrapper[5030]: I0316 13:23:29.490698 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:23:29 crc kubenswrapper[5030]: I0316 13:23:29.957997 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" path="/var/lib/kubelet/pods/9a2a035e-0368-432e-8da0-068309eb5c73/volumes" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.122349 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5frv7"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123231 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54bef24-5038-4823-bb3d-c11b5554c6d0" containerName="mariadb-account-create-update" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123248 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54bef24-5038-4823-bb3d-c11b5554c6d0" containerName="mariadb-account-create-update" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123295 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="dnsmasq-dns" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123300 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="dnsmasq-dns" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123310 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="init" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123315 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="init" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123481 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a54bef24-5038-4823-bb3d-c11b5554c6d0" containerName="mariadb-account-create-update" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.123495 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a2a035e-0368-432e-8da0-068309eb5c73" containerName="dnsmasq-dns" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.126516 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.138622 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5frv7"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.145802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rh9h\" (UniqueName: \"kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.145964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.247807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rh9h\" (UniqueName: \"kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.247879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.248587 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.256232 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.260310 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.263530 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.282892 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rh9h\" (UniqueName: \"kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h\") pod \"cinder-db-create-5frv7\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.282988 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.295724 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mj7nk"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.299511 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.326936 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mj7nk"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.332345 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-tcwvn"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.344897 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.348709 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-tcwvn"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349749 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349782 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349826 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twq5z\" (UniqueName: \"kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349844 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnps5\" (UniqueName: \"kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.349897 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvqv\" (UniqueName: \"kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.350470 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-sjm45"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.353681 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.355217 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.375022 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-sjm45"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.444545 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.450178 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-nqn29"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.452878 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twq5z\" (UniqueName: \"kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.452937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnps5\" (UniqueName: \"kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453002 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sl4t\" (UniqueName: \"kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvqv\" (UniqueName: \"kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453286 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.453337 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.454095 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.455113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.455410 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.475965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twq5z\" (UniqueName: \"kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z\") pod \"cinder-fdd0-account-create-update-hxlcj\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.478704 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnps5\" (UniqueName: \"kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5\") pod \"neutron-db-create-mj7nk\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.482937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvqv\" (UniqueName: \"kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv\") pod \"barbican-db-create-tcwvn\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.487197 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-nqn29"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.487310 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.492888 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.523384 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-tdwtn"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.531040 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-tdwtn"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.531185 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.532873 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.533627 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.536435 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.536669 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-6pvvd\"" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555649 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555742 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sl4t\" (UniqueName: \"kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555769 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555792 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw4zm\" (UniqueName: \"kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555829 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.555860 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vml8b\" (UniqueName: \"kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.556015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.556933 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.580671 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sl4t\" (UniqueName: \"kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t\") pod \"barbican-449a-account-create-update-sjm45\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.602707 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.632573 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658452 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658501 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658524 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw4zm\" (UniqueName: \"kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vml8b\" (UniqueName: \"kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.658929 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.669535 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.669669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.679508 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.680098 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.681131 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vml8b\" (UniqueName: \"kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b\") pod \"keystone-db-sync-tdwtn\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.699846 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw4zm\" (UniqueName: \"kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm\") pod \"neutron-3924-account-create-update-nqn29\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.849855 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.855127 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.937598 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5frv7"] Mar 16 13:23:31 crc kubenswrapper[5030]: I0316 13:23:31.962657 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj"] Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.075726 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mj7nk"] Mar 16 13:23:32 crc kubenswrapper[5030]: W0316 13:23:32.219627 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99da41f4_ec63_4dcf_9a4b_406a7e2c74f8.slice/crio-40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7 WatchSource:0}: Error finding container 40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7: Status 404 returned error can't find the container with id 40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7 Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.220682 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-tcwvn"] Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.315878 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-sjm45"] Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.369108 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-tdwtn"] Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.377562 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-nqn29"] Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.629681 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" event={"ID":"abd02f5c-7b03-47c9-9bed-d837b6d1b66f","Type":"ContainerStarted","Data":"3fef89f5b08ff6a186dc03cdaf675143c642a3ec6c8705ebbef7d84a1da4280e"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.631265 5030 generic.go:358] "Generic (PLEG): container finished" podID="aeec32ba-d979-49a9-8ad3-c8eb36978ae2" containerID="4882038dd1f6cc0950ae53b1f1dcb0276ad17a63c21299344097ac2a9f506774" exitCode=0 Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.631387 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5frv7" event={"ID":"aeec32ba-d979-49a9-8ad3-c8eb36978ae2","Type":"ContainerDied","Data":"4882038dd1f6cc0950ae53b1f1dcb0276ad17a63c21299344097ac2a9f506774"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.631455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5frv7" event={"ID":"aeec32ba-d979-49a9-8ad3-c8eb36978ae2","Type":"ContainerStarted","Data":"25ddff876e1c52e57bbe05157a24550c13b9124dcb7b827f0656edd6b5ba6b03"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.632959 5030 generic.go:358] "Generic (PLEG): container finished" podID="c346155b-e36c-45a4-9396-499101acd0e7" containerID="82db00f32c8c63cb49cb3c25884311387e32089d4a6d91059fdcc7c52d1424cd" exitCode=0 Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.633057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" event={"ID":"c346155b-e36c-45a4-9396-499101acd0e7","Type":"ContainerDied","Data":"82db00f32c8c63cb49cb3c25884311387e32089d4a6d91059fdcc7c52d1424cd"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.633109 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" event={"ID":"c346155b-e36c-45a4-9396-499101acd0e7","Type":"ContainerStarted","Data":"db49d8506b91e93e57c1597761a7d2397f95ac8e7ad514180f4d919edc152f76"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.634968 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb91bd97-9fbb-4925-9af5-53310afb08ec" containerID="ec72be981bb2ecb158f3559793f0c849c8180922b1e6fc527a1ec72ae1108818" exitCode=0 Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.635059 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-s72j8" event={"ID":"eb91bd97-9fbb-4925-9af5-53310afb08ec","Type":"ContainerDied","Data":"ec72be981bb2ecb158f3559793f0c849c8180922b1e6fc527a1ec72ae1108818"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.636137 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" event={"ID":"37fb310c-855c-4095-ae8d-ec43a57fbdc7","Type":"ContainerStarted","Data":"7d85e7bfc5873012d82e018f43ceb2d36cc7badd875fa424a09b4d7310fde288"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.641010 5030 generic.go:358] "Generic (PLEG): container finished" podID="1170a347-14fc-4744-91aa-f0e3aef55814" containerID="e35825ee9ef0e298e9003e305fa662e0eedce9e0465e0919927342d4166c47f7" exitCode=0 Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.641150 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" event={"ID":"1170a347-14fc-4744-91aa-f0e3aef55814","Type":"ContainerDied","Data":"e35825ee9ef0e298e9003e305fa662e0eedce9e0465e0919927342d4166c47f7"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.641189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" event={"ID":"1170a347-14fc-4744-91aa-f0e3aef55814","Type":"ContainerStarted","Data":"edc3a18da62a906837cee9e613db29673b232f5f9a0dbf9089260ef4a9f51946"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.642853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" event={"ID":"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8","Type":"ContainerStarted","Data":"40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7"} Mar 16 13:23:32 crc kubenswrapper[5030]: I0316 13:23:32.644457 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" event={"ID":"899c0d58-6271-492f-b005-9776aa720374","Type":"ContainerStarted","Data":"8d68bc944ae7cec48c1e70e5b6860e19fd19187caf4372f6f7d1878f14d36148"} Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.654194 5030 generic.go:358] "Generic (PLEG): container finished" podID="37fb310c-855c-4095-ae8d-ec43a57fbdc7" containerID="f77227176351f9a70ba2fa4b6cbba0937201bb733f07507ce91c7cd65e9d3a0f" exitCode=0 Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.654315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" event={"ID":"37fb310c-855c-4095-ae8d-ec43a57fbdc7","Type":"ContainerDied","Data":"f77227176351f9a70ba2fa4b6cbba0937201bb733f07507ce91c7cd65e9d3a0f"} Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.657759 5030 generic.go:358] "Generic (PLEG): container finished" podID="99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" containerID="9d06f49392371fdbf3db80072d2345373b4e2e2c4f74c9e46410d9e0df837e57" exitCode=0 Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.657826 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" event={"ID":"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8","Type":"ContainerDied","Data":"9d06f49392371fdbf3db80072d2345373b4e2e2c4f74c9e46410d9e0df837e57"} Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.660038 5030 generic.go:358] "Generic (PLEG): container finished" podID="899c0d58-6271-492f-b005-9776aa720374" containerID="e46c5e54e3492f3557ef19d5fe7f6aa7298b41f8b7461bbed7d3821ce011807c" exitCode=0 Mar 16 13:23:33 crc kubenswrapper[5030]: I0316 13:23:33.660355 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" event={"ID":"899c0d58-6271-492f-b005-9776aa720374","Type":"ContainerDied","Data":"e46c5e54e3492f3557ef19d5fe7f6aa7298b41f8b7461bbed7d3821ce011807c"} Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.061672 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.065335 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.069889 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.077376 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.114706 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twq5z\" (UniqueName: \"kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z\") pod \"c346155b-e36c-45a4-9396-499101acd0e7\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.114777 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rh9h\" (UniqueName: \"kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h\") pod \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.114881 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts\") pod \"c346155b-e36c-45a4-9396-499101acd0e7\" (UID: \"c346155b-e36c-45a4-9396-499101acd0e7\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.114915 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnps5\" (UniqueName: \"kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5\") pod \"1170a347-14fc-4744-91aa-f0e3aef55814\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115118 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data\") pod \"eb91bd97-9fbb-4925-9af5-53310afb08ec\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle\") pod \"eb91bd97-9fbb-4925-9af5-53310afb08ec\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115205 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts\") pod \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\" (UID: \"aeec32ba-d979-49a9-8ad3-c8eb36978ae2\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qwtf\" (UniqueName: \"kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf\") pod \"eb91bd97-9fbb-4925-9af5-53310afb08ec\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115364 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts\") pod \"1170a347-14fc-4744-91aa-f0e3aef55814\" (UID: \"1170a347-14fc-4744-91aa-f0e3aef55814\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.115560 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data\") pod \"eb91bd97-9fbb-4925-9af5-53310afb08ec\" (UID: \"eb91bd97-9fbb-4925-9af5-53310afb08ec\") " Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.120888 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "aeec32ba-d979-49a9-8ad3-c8eb36978ae2" (UID: "aeec32ba-d979-49a9-8ad3-c8eb36978ae2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.124758 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "1170a347-14fc-4744-91aa-f0e3aef55814" (UID: "1170a347-14fc-4744-91aa-f0e3aef55814"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.125199 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "eb91bd97-9fbb-4925-9af5-53310afb08ec" (UID: "eb91bd97-9fbb-4925-9af5-53310afb08ec"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.125460 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z" (OuterVolumeSpecName: "kube-api-access-twq5z") pod "c346155b-e36c-45a4-9396-499101acd0e7" (UID: "c346155b-e36c-45a4-9396-499101acd0e7"). InnerVolumeSpecName "kube-api-access-twq5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.126112 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h" (OuterVolumeSpecName: "kube-api-access-9rh9h") pod "aeec32ba-d979-49a9-8ad3-c8eb36978ae2" (UID: "aeec32ba-d979-49a9-8ad3-c8eb36978ae2"). InnerVolumeSpecName "kube-api-access-9rh9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.127834 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf" (OuterVolumeSpecName: "kube-api-access-6qwtf") pod "eb91bd97-9fbb-4925-9af5-53310afb08ec" (UID: "eb91bd97-9fbb-4925-9af5-53310afb08ec"). InnerVolumeSpecName "kube-api-access-6qwtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.130809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c346155b-e36c-45a4-9396-499101acd0e7" (UID: "c346155b-e36c-45a4-9396-499101acd0e7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.131819 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5" (OuterVolumeSpecName: "kube-api-access-pnps5") pod "1170a347-14fc-4744-91aa-f0e3aef55814" (UID: "1170a347-14fc-4744-91aa-f0e3aef55814"). InnerVolumeSpecName "kube-api-access-pnps5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.150489 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb91bd97-9fbb-4925-9af5-53310afb08ec" (UID: "eb91bd97-9fbb-4925-9af5-53310afb08ec"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.163133 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data" (OuterVolumeSpecName: "config-data") pod "eb91bd97-9fbb-4925-9af5-53310afb08ec" (UID: "eb91bd97-9fbb-4925-9af5-53310afb08ec"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217867 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qwtf\" (UniqueName: \"kubernetes.io/projected/eb91bd97-9fbb-4925-9af5-53310afb08ec-kube-api-access-6qwtf\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217906 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/1170a347-14fc-4744-91aa-f0e3aef55814-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217921 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217935 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twq5z\" (UniqueName: \"kubernetes.io/projected/c346155b-e36c-45a4-9396-499101acd0e7-kube-api-access-twq5z\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217945 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rh9h\" (UniqueName: \"kubernetes.io/projected/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-kube-api-access-9rh9h\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217956 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c346155b-e36c-45a4-9396-499101acd0e7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217966 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnps5\" (UniqueName: \"kubernetes.io/projected/1170a347-14fc-4744-91aa-f0e3aef55814-kube-api-access-pnps5\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217978 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.217991 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb91bd97-9fbb-4925-9af5-53310afb08ec-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.218004 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aeec32ba-d979-49a9-8ad3-c8eb36978ae2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.671912 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-5frv7" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.671924 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-5frv7" event={"ID":"aeec32ba-d979-49a9-8ad3-c8eb36978ae2","Type":"ContainerDied","Data":"25ddff876e1c52e57bbe05157a24550c13b9124dcb7b827f0656edd6b5ba6b03"} Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.671996 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25ddff876e1c52e57bbe05157a24550c13b9124dcb7b827f0656edd6b5ba6b03" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.674302 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" event={"ID":"c346155b-e36c-45a4-9396-499101acd0e7","Type":"ContainerDied","Data":"db49d8506b91e93e57c1597761a7d2397f95ac8e7ad514180f4d919edc152f76"} Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.674372 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db49d8506b91e93e57c1597761a7d2397f95ac8e7ad514180f4d919edc152f76" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.674315 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.677009 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-s72j8" event={"ID":"eb91bd97-9fbb-4925-9af5-53310afb08ec","Type":"ContainerDied","Data":"322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687"} Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.677069 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="322395a7462b0475d026b694c1853467ff595c05cf556c5596628050ef10f687" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.677139 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-s72j8" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.680408 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" event={"ID":"1170a347-14fc-4744-91aa-f0e3aef55814","Type":"ContainerDied","Data":"edc3a18da62a906837cee9e613db29673b232f5f9a0dbf9089260ef4a9f51946"} Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.680481 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edc3a18da62a906837cee9e613db29673b232f5f9a0dbf9089260ef4a9f51946" Mar 16 13:23:34 crc kubenswrapper[5030]: I0316 13:23:34.680591 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-mj7nk" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.127773 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.236755 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.238335 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts\") pod \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.238918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlvqv\" (UniqueName: \"kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv\") pod \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\" (UID: \"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.238959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" (UID: "99da41f4-ec63-4dcf-9a4b-406a7e2c74f8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.240863 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.243541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv" (OuterVolumeSpecName: "kube-api-access-rlvqv") pod "99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" (UID: "99da41f4-ec63-4dcf-9a4b-406a7e2c74f8"). InnerVolumeSpecName "kube-api-access-rlvqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.243640 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344037 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sl4t\" (UniqueName: \"kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t\") pod \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344243 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts\") pod \"899c0d58-6271-492f-b005-9776aa720374\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344346 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts\") pod \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\" (UID: \"37fb310c-855c-4095-ae8d-ec43a57fbdc7\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344386 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw4zm\" (UniqueName: \"kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm\") pod \"899c0d58-6271-492f-b005-9776aa720374\" (UID: \"899c0d58-6271-492f-b005-9776aa720374\") " Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344977 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlvqv\" (UniqueName: \"kubernetes.io/projected/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8-kube-api-access-rlvqv\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.344977 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "37fb310c-855c-4095-ae8d-ec43a57fbdc7" (UID: "37fb310c-855c-4095-ae8d-ec43a57fbdc7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.345168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "899c0d58-6271-492f-b005-9776aa720374" (UID: "899c0d58-6271-492f-b005-9776aa720374"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.348744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t" (OuterVolumeSpecName: "kube-api-access-4sl4t") pod "37fb310c-855c-4095-ae8d-ec43a57fbdc7" (UID: "37fb310c-855c-4095-ae8d-ec43a57fbdc7"). InnerVolumeSpecName "kube-api-access-4sl4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.348864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm" (OuterVolumeSpecName: "kube-api-access-sw4zm") pod "899c0d58-6271-492f-b005-9776aa720374" (UID: "899c0d58-6271-492f-b005-9776aa720374"). InnerVolumeSpecName "kube-api-access-sw4zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.447462 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/899c0d58-6271-492f-b005-9776aa720374-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.447495 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/37fb310c-855c-4095-ae8d-ec43a57fbdc7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.447508 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw4zm\" (UniqueName: \"kubernetes.io/projected/899c0d58-6271-492f-b005-9776aa720374-kube-api-access-sw4zm\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.447530 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sl4t\" (UniqueName: \"kubernetes.io/projected/37fb310c-855c-4095-ae8d-ec43a57fbdc7-kube-api-access-4sl4t\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.692021 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.692111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-449a-account-create-update-sjm45" event={"ID":"37fb310c-855c-4095-ae8d-ec43a57fbdc7","Type":"ContainerDied","Data":"7d85e7bfc5873012d82e018f43ceb2d36cc7badd875fa424a09b4d7310fde288"} Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.692172 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d85e7bfc5873012d82e018f43ceb2d36cc7badd875fa424a09b4d7310fde288" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.695091 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" event={"ID":"99da41f4-ec63-4dcf-9a4b-406a7e2c74f8","Type":"ContainerDied","Data":"40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7"} Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.695126 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-tcwvn" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.695158 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40fc4c62b3dba6c248f81b7aab6f3beb176faa2e5356dcf998c23fb0de0e70e7" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.698109 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" event={"ID":"899c0d58-6271-492f-b005-9776aa720374","Type":"ContainerDied","Data":"8d68bc944ae7cec48c1e70e5b6860e19fd19187caf4372f6f7d1878f14d36148"} Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.698131 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d68bc944ae7cec48c1e70e5b6860e19fd19187caf4372f6f7d1878f14d36148" Mar 16 13:23:35 crc kubenswrapper[5030]: I0316 13:23:35.698181 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-nqn29" Mar 16 13:23:38 crc kubenswrapper[5030]: I0316 13:23:38.723599 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" event={"ID":"abd02f5c-7b03-47c9-9bed-d837b6d1b66f","Type":"ContainerStarted","Data":"bbe6774c8f150b12cb2463c6bb3430b81b09ba392e78a838a531ad23ea931c0a"} Mar 16 13:23:38 crc kubenswrapper[5030]: I0316 13:23:38.742178 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" podStartSLOduration=1.948885474 podStartE2EDuration="7.742161957s" podCreationTimestamp="2026-03-16 13:23:31 +0000 UTC" firstStartedPulling="2026-03-16 13:23:32.391037323 +0000 UTC m=+1056.790349870" lastFinishedPulling="2026-03-16 13:23:38.184313807 +0000 UTC m=+1062.583626353" observedRunningTime="2026-03-16 13:23:38.73815858 +0000 UTC m=+1063.137471127" watchObservedRunningTime="2026-03-16 13:23:38.742161957 +0000 UTC m=+1063.141474505" Mar 16 13:23:40 crc kubenswrapper[5030]: I0316 13:23:40.744338 5030 generic.go:358] "Generic (PLEG): container finished" podID="abd02f5c-7b03-47c9-9bed-d837b6d1b66f" containerID="bbe6774c8f150b12cb2463c6bb3430b81b09ba392e78a838a531ad23ea931c0a" exitCode=0 Mar 16 13:23:40 crc kubenswrapper[5030]: I0316 13:23:40.744433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" event={"ID":"abd02f5c-7b03-47c9-9bed-d837b6d1b66f","Type":"ContainerDied","Data":"bbe6774c8f150b12cb2463c6bb3430b81b09ba392e78a838a531ad23ea931c0a"} Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.025460 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.165304 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data\") pod \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.165371 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle\") pod \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.165434 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vml8b\" (UniqueName: \"kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b\") pod \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\" (UID: \"abd02f5c-7b03-47c9-9bed-d837b6d1b66f\") " Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.173637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b" (OuterVolumeSpecName: "kube-api-access-vml8b") pod "abd02f5c-7b03-47c9-9bed-d837b6d1b66f" (UID: "abd02f5c-7b03-47c9-9bed-d837b6d1b66f"). InnerVolumeSpecName "kube-api-access-vml8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.190767 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abd02f5c-7b03-47c9-9bed-d837b6d1b66f" (UID: "abd02f5c-7b03-47c9-9bed-d837b6d1b66f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.204898 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data" (OuterVolumeSpecName: "config-data") pod "abd02f5c-7b03-47c9-9bed-d837b6d1b66f" (UID: "abd02f5c-7b03-47c9-9bed-d837b6d1b66f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.268919 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.268975 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.268994 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vml8b\" (UniqueName: \"kubernetes.io/projected/abd02f5c-7b03-47c9-9bed-d837b6d1b66f-kube-api-access-vml8b\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.765718 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.765713 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-tdwtn" event={"ID":"abd02f5c-7b03-47c9-9bed-d837b6d1b66f","Type":"ContainerDied","Data":"3fef89f5b08ff6a186dc03cdaf675143c642a3ec6c8705ebbef7d84a1da4280e"} Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.765793 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fef89f5b08ff6a186dc03cdaf675143c642a3ec6c8705ebbef7d84a1da4280e" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.960532 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tnbfc"] Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961518 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeec32ba-d979-49a9-8ad3-c8eb36978ae2" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961543 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeec32ba-d979-49a9-8ad3-c8eb36978ae2" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961575 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd02f5c-7b03-47c9-9bed-d837b6d1b66f" containerName="keystone-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961581 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd02f5c-7b03-47c9-9bed-d837b6d1b66f" containerName="keystone-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961599 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb91bd97-9fbb-4925-9af5-53310afb08ec" containerName="glance-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961605 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb91bd97-9fbb-4925-9af5-53310afb08ec" containerName="glance-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961612 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961617 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961624 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fb310c-855c-4095-ae8d-ec43a57fbdc7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961630 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fb310c-855c-4095-ae8d-ec43a57fbdc7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961643 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1170a347-14fc-4744-91aa-f0e3aef55814" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961648 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1170a347-14fc-4744-91aa-f0e3aef55814" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961660 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="899c0d58-6271-492f-b005-9776aa720374" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961666 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="899c0d58-6271-492f-b005-9776aa720374" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961675 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c346155b-e36c-45a4-9396-499101acd0e7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961680 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c346155b-e36c-45a4-9396-499101acd0e7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961849 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961859 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="899c0d58-6271-492f-b005-9776aa720374" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961869 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="abd02f5c-7b03-47c9-9bed-d837b6d1b66f" containerName="keystone-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961877 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="37fb310c-855c-4095-ae8d-ec43a57fbdc7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961884 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb91bd97-9fbb-4925-9af5-53310afb08ec" containerName="glance-db-sync" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961893 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c346155b-e36c-45a4-9396-499101acd0e7" containerName="mariadb-account-create-update" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961903 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1170a347-14fc-4744-91aa-f0e3aef55814" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.961910 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="aeec32ba-d979-49a9-8ad3-c8eb36978ae2" containerName="mariadb-database-create" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.974577 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.976362 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.978076 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.981177 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.983269 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-6pvvd\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.983526 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:23:42 crc kubenswrapper[5030]: I0316 13:23:42.987972 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tnbfc"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.084454 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.084515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.084639 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.084728 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.085078 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptc5t\" (UniqueName: \"kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.085144 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.118759 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-hc75v"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.144157 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2csq4"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.145139 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.148495 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.149650 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.149990 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.150312 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-c9qdn\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.152333 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-xmdgt\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.152480 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.152579 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-hc75v"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.154929 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.176061 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2csq4"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186594 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186673 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186703 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptc5t\" (UniqueName: \"kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.186879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.197402 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.202752 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.210520 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.211251 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.212066 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.213175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.214039 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.218826 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.218909 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.219608 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.226966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptc5t\" (UniqueName: \"kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t\") pod \"keystone-bootstrap-tnbfc\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.231638 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-s4c6l"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.253610 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-s4c6l"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.253649 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvcsr"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.253666 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.256612 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.257008 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.257192 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-4bdzx\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.259756 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvcsr"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.259867 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.261602 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.262191 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-5vxxq\"" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288268 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfgm5\" (UniqueName: \"kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288582 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288609 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk47m\" (UniqueName: \"kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.288711 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.289006 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390817 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfwg\" (UniqueName: \"kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390876 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390916 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390944 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.390995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391019 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391048 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391092 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68jn\" (UniqueName: \"kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391109 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfgm5\" (UniqueName: \"kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391183 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391226 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391244 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391266 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pk47m\" (UniqueName: \"kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391300 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8gl6\" (UniqueName: \"kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.391339 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.392689 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.397273 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.398155 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.400010 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.400094 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.403161 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.404031 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.415604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk47m\" (UniqueName: \"kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m\") pod \"neutron-db-sync-hc75v\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.415945 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfgm5\" (UniqueName: \"kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5\") pod \"cinder-db-sync-2csq4\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.479841 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.492664 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.492709 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.492742 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8gl6\" (UniqueName: \"kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.492919 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfwg\" (UniqueName: \"kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493007 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493334 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493377 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493419 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493473 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493570 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493595 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.493620 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p68jn\" (UniqueName: \"kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.494462 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.494588 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.494931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.496247 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.496593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.496597 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.499967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.500645 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.502401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.502431 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.502722 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.502742 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.506276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8gl6\" (UniqueName: \"kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6\") pod \"placement-db-sync-s4c6l\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.507659 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfwg\" (UniqueName: \"kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg\") pod \"ceilometer-0\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.511462 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68jn\" (UniqueName: \"kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn\") pod \"barbican-db-sync-fvcsr\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.584203 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.585656 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.595067 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:23:43 crc kubenswrapper[5030]: W0316 13:23:43.740095 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36fd876d_311b_49f5_b78a_7bb6f4dac544.slice/crio-a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa WatchSource:0}: Error finding container a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa: Status 404 returned error can't find the container with id a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.742287 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tnbfc"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.785974 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" event={"ID":"36fd876d-311b-49f5-b78a-7bb6f4dac544","Type":"ContainerStarted","Data":"a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa"} Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.899888 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-hc75v"] Mar 16 13:23:43 crc kubenswrapper[5030]: I0316 13:23:43.980134 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2csq4"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.049119 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.056891 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.059985 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.060303 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.060584 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.060730 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-xt9fg\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.063864 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.071849 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.116059 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-s4c6l"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.126405 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.133095 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.133248 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.135768 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.137225 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.179389 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvcsr"] Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.210710 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xzck\" (UniqueName: \"kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.210977 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.210998 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.211015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.211049 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.211091 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.211127 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.211180 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312584 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312678 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312747 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312779 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312825 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312851 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312943 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xzck\" (UniqueName: \"kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.312999 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313016 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313127 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghf57\" (UniqueName: \"kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.313570 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.316084 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.317207 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.324313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.330793 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.331424 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.335216 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.349236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xzck\" (UniqueName: \"kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.381706 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415020 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415073 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghf57\" (UniqueName: \"kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415213 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415281 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415753 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415815 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.415843 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.416002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.416383 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.420509 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.421239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.422046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.429382 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.431751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghf57\" (UniqueName: \"kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.445704 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.676264 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.744919 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.811509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" event={"ID":"153a0988-98b5-4ea1-b066-0b754566bfd3","Type":"ContainerStarted","Data":"7aaa33d766104f2e1486576bc9bc34dc6d01a50d9328961b0a6d1b804d84b460"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.815536 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" event={"ID":"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb","Type":"ContainerStarted","Data":"19ea9ccb4b96c925aacc7c8b1fb8719ae3dbf9e8aec6a1f3296793b97e59ff8f"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.815621 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" event={"ID":"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb","Type":"ContainerStarted","Data":"8a2bd0f23e16d1ca867b8fd28fd1ba17ecc1db7343271b574de0419805366866"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.817837 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" event={"ID":"36fd876d-311b-49f5-b78a-7bb6f4dac544","Type":"ContainerStarted","Data":"63d8104a12db77ce8b29b21242600360c8c210e5397fbe0339ff1df3fb9452eb"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.819616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" event={"ID":"af329639-82ba-4b13-8c6f-a20650cf518d","Type":"ContainerStarted","Data":"75fb29613d25341b1a01f90382fc03ef0a2c9b7cdaf35f4c7c525dbdcb462f49"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.821595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" event={"ID":"7730c44c-bbf1-4c58-b917-d1ce3efa6590","Type":"ContainerStarted","Data":"bd3caa769de0b1d2f5cc1c0aa4a38cbba96f2e8cc4bcafd8fe12bf37d20a14ef"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.825544 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerStarted","Data":"67fd9513846f656f6a7c995248e86e3a804a2c388006b29d3efbf9a922ac1406"} Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.837786 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" podStartSLOduration=1.8377684140000001 podStartE2EDuration="1.837768414s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:23:44.833319088 +0000 UTC m=+1069.232631634" watchObservedRunningTime="2026-03-16 13:23:44.837768414 +0000 UTC m=+1069.237080960" Mar 16 13:23:44 crc kubenswrapper[5030]: I0316 13:23:44.858246 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" podStartSLOduration=2.858231151 podStartE2EDuration="2.858231151s" podCreationTimestamp="2026-03-16 13:23:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:23:44.85324233 +0000 UTC m=+1069.252554877" watchObservedRunningTime="2026-03-16 13:23:44.858231151 +0000 UTC m=+1069.257543698" Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.088240 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.118190 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:45 crc kubenswrapper[5030]: W0316 13:23:45.119436 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3351626_31d9_4357_825a_e4eeb59834c9.slice/crio-7f6380504f2679c247b3fd8f3eecb2e9e3305324a21c9f700e5ab2d1f795fcaf WatchSource:0}: Error finding container 7f6380504f2679c247b3fd8f3eecb2e9e3305324a21c9f700e5ab2d1f795fcaf: Status 404 returned error can't find the container with id 7f6380504f2679c247b3fd8f3eecb2e9e3305324a21c9f700e5ab2d1f795fcaf Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.156802 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.172467 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.248581 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.873434 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerStarted","Data":"7f6380504f2679c247b3fd8f3eecb2e9e3305324a21c9f700e5ab2d1f795fcaf"} Mar 16 13:23:45 crc kubenswrapper[5030]: I0316 13:23:45.879959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerStarted","Data":"6c9739f4ce01302a468585aca7a1cfbde6b27f3a6df0d1e667814f955e88f887"} Mar 16 13:23:46 crc kubenswrapper[5030]: I0316 13:23:46.899203 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerStarted","Data":"4ca006be15a323c7328ab941da23361c2abc36bfd218d801170a22db512b2e2f"} Mar 16 13:23:46 crc kubenswrapper[5030]: I0316 13:23:46.903992 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerStarted","Data":"f63ead17b9ed1b85df21352b5903a97d67c3bfe08da88778cb93de25c057de5b"} Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.936242 5030 generic.go:358] "Generic (PLEG): container finished" podID="36fd876d-311b-49f5-b78a-7bb6f4dac544" containerID="63d8104a12db77ce8b29b21242600360c8c210e5397fbe0339ff1df3fb9452eb" exitCode=0 Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.936322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" event={"ID":"36fd876d-311b-49f5-b78a-7bb6f4dac544","Type":"ContainerDied","Data":"63d8104a12db77ce8b29b21242600360c8c210e5397fbe0339ff1df3fb9452eb"} Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.939066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerStarted","Data":"f945558c1f17f5f792323ef710aa3e29e777fcc63d42e218478c1da17749a73d"} Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.939262 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-log" containerID="cri-o://f63ead17b9ed1b85df21352b5903a97d67c3bfe08da88778cb93de25c057de5b" gracePeriod=30 Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.939336 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-httpd" containerID="cri-o://f945558c1f17f5f792323ef710aa3e29e777fcc63d42e218478c1da17749a73d" gracePeriod=30 Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.942271 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerStarted","Data":"eac61c1708e728fcd096057220c973a75b81a3a8766eff06a9a4e409b58faf08"} Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.942767 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-httpd" containerID="cri-o://eac61c1708e728fcd096057220c973a75b81a3a8766eff06a9a4e409b58faf08" gracePeriod=30 Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.942769 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-log" containerID="cri-o://4ca006be15a323c7328ab941da23361c2abc36bfd218d801170a22db512b2e2f" gracePeriod=30 Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.972206 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.972192846 podStartE2EDuration="4.972192846s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:23:47.969890457 +0000 UTC m=+1072.369203004" watchObservedRunningTime="2026-03-16 13:23:47.972192846 +0000 UTC m=+1072.371505393" Mar 16 13:23:47 crc kubenswrapper[5030]: I0316 13:23:47.998178 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.998155024 podStartE2EDuration="4.998155024s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:23:47.984776869 +0000 UTC m=+1072.384089416" watchObservedRunningTime="2026-03-16 13:23:47.998155024 +0000 UTC m=+1072.397467712" Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.966133 5030 generic.go:358] "Generic (PLEG): container finished" podID="f3351626-31d9-4357-825a-e4eeb59834c9" containerID="eac61c1708e728fcd096057220c973a75b81a3a8766eff06a9a4e409b58faf08" exitCode=0 Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.966175 5030 generic.go:358] "Generic (PLEG): container finished" podID="f3351626-31d9-4357-825a-e4eeb59834c9" containerID="4ca006be15a323c7328ab941da23361c2abc36bfd218d801170a22db512b2e2f" exitCode=143 Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.966211 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerDied","Data":"eac61c1708e728fcd096057220c973a75b81a3a8766eff06a9a4e409b58faf08"} Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.966259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerDied","Data":"4ca006be15a323c7328ab941da23361c2abc36bfd218d801170a22db512b2e2f"} Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.970985 5030 generic.go:358] "Generic (PLEG): container finished" podID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerID="f945558c1f17f5f792323ef710aa3e29e777fcc63d42e218478c1da17749a73d" exitCode=0 Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.971017 5030 generic.go:358] "Generic (PLEG): container finished" podID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerID="f63ead17b9ed1b85df21352b5903a97d67c3bfe08da88778cb93de25c057de5b" exitCode=143 Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.971429 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerDied","Data":"f945558c1f17f5f792323ef710aa3e29e777fcc63d42e218478c1da17749a73d"} Mar 16 13:23:48 crc kubenswrapper[5030]: I0316 13:23:48.971477 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerDied","Data":"f63ead17b9ed1b85df21352b5903a97d67c3bfe08da88778cb93de25c057de5b"} Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.015256 5030 generic.go:358] "Generic (PLEG): container finished" podID="2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" containerID="19ea9ccb4b96c925aacc7c8b1fb8719ae3dbf9e8aec6a1f3296793b97e59ff8f" exitCode=0 Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.016000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" event={"ID":"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb","Type":"ContainerDied","Data":"19ea9ccb4b96c925aacc7c8b1fb8719ae3dbf9e8aec6a1f3296793b97e59ff8f"} Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.300883 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414436 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414671 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414697 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptc5t\" (UniqueName: \"kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414817 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.414864 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data\") pod \"36fd876d-311b-49f5-b78a-7bb6f4dac544\" (UID: \"36fd876d-311b-49f5-b78a-7bb6f4dac544\") " Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.421450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.421711 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.422098 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t" (OuterVolumeSpecName: "kube-api-access-ptc5t") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "kube-api-access-ptc5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.428454 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts" (OuterVolumeSpecName: "scripts") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.441099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data" (OuterVolumeSpecName: "config-data") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.441384 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "36fd876d-311b-49f5-b78a-7bb6f4dac544" (UID: "36fd876d-311b-49f5-b78a-7bb6f4dac544"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517614 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517662 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517672 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptc5t\" (UniqueName: \"kubernetes.io/projected/36fd876d-311b-49f5-b78a-7bb6f4dac544-kube-api-access-ptc5t\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517680 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517689 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:52 crc kubenswrapper[5030]: I0316 13:23:52.517697 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36fd876d-311b-49f5-b78a-7bb6f4dac544-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.028740 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.029518 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tnbfc" event={"ID":"36fd876d-311b-49f5-b78a-7bb6f4dac544","Type":"ContainerDied","Data":"a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa"} Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.029569 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a17c115a8fc383126d09f93cb26b592031ff39730df253043bf2b05091a524aa" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.490793 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tnbfc"] Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.496025 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tnbfc"] Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.588504 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zn5v7"] Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.595489 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36fd876d-311b-49f5-b78a-7bb6f4dac544" containerName="keystone-bootstrap" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.595510 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fd876d-311b-49f5-b78a-7bb6f4dac544" containerName="keystone-bootstrap" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.595705 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="36fd876d-311b-49f5-b78a-7bb6f4dac544" containerName="keystone-bootstrap" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.613438 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.616789 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zn5v7"] Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.622009 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.622132 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.622335 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.622690 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-6pvvd\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.622720 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpzzh\" (UniqueName: \"kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741134 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741266 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741315 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741351 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.741424 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843422 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzzh\" (UniqueName: \"kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843865 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843922 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.843971 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.849893 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.850014 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.850211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.854002 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.854497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.857959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzzh\" (UniqueName: \"kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh\") pod \"keystone-bootstrap-zn5v7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: E0316 13:23:53.910667 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1438139 actualBytes=10240 Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.943912 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:23:53 crc kubenswrapper[5030]: I0316 13:23:53.959694 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fd876d-311b-49f5-b78a-7bb6f4dac544" path="/var/lib/kubelet/pods/36fd876d-311b-49f5-b78a-7bb6f4dac544/volumes" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.357486 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.363524 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.453907 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454127 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454279 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454345 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle\") pod \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454395 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454426 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghf57\" (UniqueName: \"kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454528 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.454690 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk47m\" (UniqueName: \"kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m\") pod \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.455304 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run\") pod \"4f8873e5-3a63-46bb-90e7-270be80bcc67\" (UID: \"4f8873e5-3a63-46bb-90e7-270be80bcc67\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.455379 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config\") pod \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\" (UID: \"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb\") " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.455027 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs" (OuterVolumeSpecName: "logs") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.456193 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.456403 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.461431 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.462828 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m" (OuterVolumeSpecName: "kube-api-access-pk47m") pod "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" (UID: "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb"). InnerVolumeSpecName "kube-api-access-pk47m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.464897 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts" (OuterVolumeSpecName: "scripts") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.473815 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57" (OuterVolumeSpecName: "kube-api-access-ghf57") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "kube-api-access-ghf57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.491993 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.493114 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" (UID: "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.495450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config" (OuterVolumeSpecName: "config") pod "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" (UID: "2cb6fc47-7f95-4c05-96e0-02f0cde23fbb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.497306 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.513877 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data" (OuterVolumeSpecName: "config-data") pod "4f8873e5-3a63-46bb-90e7-270be80bcc67" (UID: "4f8873e5-3a63-46bb-90e7-270be80bcc67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.558923 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4f8873e5-3a63-46bb-90e7-270be80bcc67-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.558945 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.558958 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.558991 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559001 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559011 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559020 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559029 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghf57\" (UniqueName: \"kubernetes.io/projected/4f8873e5-3a63-46bb-90e7-270be80bcc67-kube-api-access-ghf57\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559038 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f8873e5-3a63-46bb-90e7-270be80bcc67-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.559047 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk47m\" (UniqueName: \"kubernetes.io/projected/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb-kube-api-access-pk47m\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.571722 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:23:54 crc kubenswrapper[5030]: I0316 13:23:54.660571 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.053106 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.053097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4f8873e5-3a63-46bb-90e7-270be80bcc67","Type":"ContainerDied","Data":"6c9739f4ce01302a468585aca7a1cfbde6b27f3a6df0d1e667814f955e88f887"} Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.053314 5030 scope.go:117] "RemoveContainer" containerID="f945558c1f17f5f792323ef710aa3e29e777fcc63d42e218478c1da17749a73d" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.057365 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" event={"ID":"2cb6fc47-7f95-4c05-96e0-02f0cde23fbb","Type":"ContainerDied","Data":"8a2bd0f23e16d1ca867b8fd28fd1ba17ecc1db7343271b574de0419805366866"} Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.057412 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-hc75v" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.057418 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a2bd0f23e16d1ca867b8fd28fd1ba17ecc1db7343271b574de0419805366866" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.093067 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.100105 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.115345 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116294 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-httpd" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116307 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-httpd" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116325 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" containerName="neutron-db-sync" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116330 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" containerName="neutron-db-sync" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116346 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-log" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116351 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-log" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116522 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" containerName="neutron-db-sync" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116535 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-log" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.116562 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" containerName="glance-httpd" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.245760 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.246097 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.249162 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.249493 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.373627 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2xk\" (UniqueName: \"kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.373692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.373788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.373889 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.374083 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.374137 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.374240 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.374298 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.478349 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.478506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.478543 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.478770 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.478835 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.479188 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2xk\" (UniqueName: \"kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.479307 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.479944 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.480424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.480616 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.481170 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.488637 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.491261 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.494785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.495029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.502605 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2xk\" (UniqueName: \"kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.515742 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.566685 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.693067 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.798162 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.798383 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.801069 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-c9qdn\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.801623 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.801708 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.801848 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.891801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw4pr\" (UniqueName: \"kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.891863 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.891924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.892001 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.892047 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.968525 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f8873e5-3a63-46bb-90e7-270be80bcc67" path="/var/lib/kubelet/pods/4f8873e5-3a63-46bb-90e7-270be80bcc67/volumes" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.993763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw4pr\" (UniqueName: \"kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.993816 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.993890 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.994000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.994078 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.997176 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.997403 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.997640 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:23:55 crc kubenswrapper[5030]: I0316 13:23:55.999338 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.008588 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.009044 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.010391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw4pr\" (UniqueName: \"kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.012955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config\") pod \"neutron-5dddb55dfc-qk6lf\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.123048 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-c9qdn\"" Mar 16 13:23:56 crc kubenswrapper[5030]: I0316 13:23:56.131370 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.010469 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.100983 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.101132 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.103068 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.103232 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdh5\" (UniqueName: \"kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138447 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138537 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.138573 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.181587 5030 scope.go:117] "RemoveContainer" containerID="f63ead17b9ed1b85df21352b5903a97d67c3bfe08da88778cb93de25c057de5b" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.230191 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.239999 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240112 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xzck\" (UniqueName: \"kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240272 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240338 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240405 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240450 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240564 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240660 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs\") pod \"f3351626-31d9-4357-825a-e4eeb59834c9\" (UID: \"f3351626-31d9-4357-825a-e4eeb59834c9\") " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240760 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.240977 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.241106 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.241143 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.241208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdh5\" (UniqueName: \"kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.241331 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.241389 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.245138 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs" (OuterVolumeSpecName: "logs") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.245180 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.248731 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck" (OuterVolumeSpecName: "kube-api-access-5xzck") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "kube-api-access-5xzck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.252203 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.251729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.253068 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts" (OuterVolumeSpecName: "scripts") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.255401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.278918 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.281454 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdh5\" (UniqueName: \"kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.281645 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.281900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config\") pod \"neutron-6897c78d86-vjc9l\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.296790 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.308421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data" (OuterVolumeSpecName: "config-data") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.313015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f3351626-31d9-4357-825a-e4eeb59834c9" (UID: "f3351626-31d9-4357-825a-e4eeb59834c9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346406 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346449 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f3351626-31d9-4357-825a-e4eeb59834c9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346461 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346474 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xzck\" (UniqueName: \"kubernetes.io/projected/f3351626-31d9-4357-825a-e4eeb59834c9-kube-api-access-5xzck\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346488 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346498 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f3351626-31d9-4357-825a-e4eeb59834c9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.346535 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.366404 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.416686 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:23:58 crc kubenswrapper[5030]: I0316 13:23:58.447951 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.097467 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f3351626-31d9-4357-825a-e4eeb59834c9","Type":"ContainerDied","Data":"7f6380504f2679c247b3fd8f3eecb2e9e3305324a21c9f700e5ab2d1f795fcaf"} Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.097752 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.131013 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.137116 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.144903 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.145772 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-httpd" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.145793 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-httpd" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.145850 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-log" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.145856 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-log" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.146018 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-log" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.146042 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" containerName="glance-httpd" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.153074 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.154761 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.155118 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.157521 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264272 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264344 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qqx\" (UniqueName: \"kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264518 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264592 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264638 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.264681 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367067 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85qqx\" (UniqueName: \"kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367119 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367217 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367246 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367363 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367431 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.367894 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.368523 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.368567 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.381298 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.381763 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.381863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.383502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.387244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qqx\" (UniqueName: \"kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.397342 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.483454 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:23:59 crc kubenswrapper[5030]: I0316 13:23:59.959141 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3351626-31d9-4357-825a-e4eeb59834c9" path="/var/lib/kubelet/pods/f3351626-31d9-4357-825a-e4eeb59834c9/volumes" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.124419 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561124-xqhfm"] Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.135737 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561124-xqhfm"] Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.135838 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.140135 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.140395 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.143969 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.181097 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6m25\" (UniqueName: \"kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25\") pod \"auto-csr-approver-29561124-xqhfm\" (UID: \"a6c03aa3-3751-4cda-a944-d0a561269a82\") " pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.283313 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6m25\" (UniqueName: \"kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25\") pod \"auto-csr-approver-29561124-xqhfm\" (UID: \"a6c03aa3-3751-4cda-a944-d0a561269a82\") " pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.299792 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6m25\" (UniqueName: \"kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25\") pod \"auto-csr-approver-29561124-xqhfm\" (UID: \"a6c03aa3-3751-4cda-a944-d0a561269a82\") " pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:00 crc kubenswrapper[5030]: I0316 13:24:00.455948 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:04 crc kubenswrapper[5030]: I0316 13:24:04.720956 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zn5v7"] Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.263202 5030 scope.go:117] "RemoveContainer" containerID="eac61c1708e728fcd096057220c973a75b81a3a8766eff06a9a4e409b58faf08" Mar 16 13:24:05 crc kubenswrapper[5030]: W0316 13:24:05.268980 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc8e2b24_c627_4b5f_bad9_a5b38399f8c7.slice/crio-5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c WatchSource:0}: Error finding container 5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c: Status 404 returned error can't find the container with id 5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.288702 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.317643 5030 scope.go:117] "RemoveContainer" containerID="4ca006be15a323c7328ab941da23361c2abc36bfd218d801170a22db512b2e2f" Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.678283 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:24:05 crc kubenswrapper[5030]: W0316 13:24:05.694867 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9b7a91d_a3f6_47ca_b178_e8aa1f1fc85f.slice/crio-339c7be51b45286adf12565ee0400dd34114e2618afd1209c9a935f17cfdd8d1 WatchSource:0}: Error finding container 339c7be51b45286adf12565ee0400dd34114e2618afd1209c9a935f17cfdd8d1: Status 404 returned error can't find the container with id 339c7be51b45286adf12565ee0400dd34114e2618afd1209c9a935f17cfdd8d1 Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.784809 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561124-xqhfm"] Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.789623 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.886128 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:24:05 crc kubenswrapper[5030]: I0316 13:24:05.895239 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:24:05 crc kubenswrapper[5030]: W0316 13:24:05.903314 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0869b9d9_5b75_473c_980a_2c2a7d735ba5.slice/crio-9de493c7ae0aed88d25ce4e88f8c5a01ebe069463e371b3ddb9616243b79838a WatchSource:0}: Error finding container 9de493c7ae0aed88d25ce4e88f8c5a01ebe069463e371b3ddb9616243b79838a: Status 404 returned error can't find the container with id 9de493c7ae0aed88d25ce4e88f8c5a01ebe069463e371b3ddb9616243b79838a Mar 16 13:24:05 crc kubenswrapper[5030]: W0316 13:24:05.912713 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d87382_e395_460d_b200_da5fc695112e.slice/crio-81fc11c7a225befc1b7ed152f24d59eb7c61a97f525a5fe6006f58c84daedd04 WatchSource:0}: Error finding container 81fc11c7a225befc1b7ed152f24d59eb7c61a97f525a5fe6006f58c84daedd04: Status 404 returned error can't find the container with id 81fc11c7a225befc1b7ed152f24d59eb7c61a97f525a5fe6006f58c84daedd04 Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.171254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerStarted","Data":"81fc11c7a225befc1b7ed152f24d59eb7c61a97f525a5fe6006f58c84daedd04"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.174191 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" event={"ID":"af329639-82ba-4b13-8c6f-a20650cf518d","Type":"ContainerStarted","Data":"de4d712802cd08f4c434ff0b0ce8bc6c035ad10788cb2674d81fe90fe411a59c"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.179428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" event={"ID":"7730c44c-bbf1-4c58-b917-d1ce3efa6590","Type":"ContainerStarted","Data":"85d38f1a0d5bf34c9f33b986e904c30877828bb187767fa9b5e2d4d1d27d718e"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.205170 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerStarted","Data":"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.206871 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" podStartSLOduration=9.183765599000001 podStartE2EDuration="23.206851993s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="2026-03-16 13:23:44.118843729 +0000 UTC m=+1068.518156275" lastFinishedPulling="2026-03-16 13:23:58.141930121 +0000 UTC m=+1082.541242669" observedRunningTime="2026-03-16 13:24:06.188612835 +0000 UTC m=+1090.587925373" watchObservedRunningTime="2026-03-16 13:24:06.206851993 +0000 UTC m=+1090.606164539" Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.213994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" event={"ID":"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7","Type":"ContainerStarted","Data":"1c3eaab187f0425aa62de437b371e6c07798e47404c1adf3f564edabdba98e8e"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.214066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" event={"ID":"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7","Type":"ContainerStarted","Data":"5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.219111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerStarted","Data":"7cb026f33377be0a61f743f7620d8e600836a6c8c5a72279227ef694955be0c5"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.219159 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerStarted","Data":"6681b9372c7cc62c3ada5af0c556eb420de48e50682cac1862cb7b33cd843597"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.220216 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" podStartSLOduration=2.143281922 podStartE2EDuration="23.220206653s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="2026-03-16 13:23:44.208897963 +0000 UTC m=+1068.608210511" lastFinishedPulling="2026-03-16 13:24:05.285822695 +0000 UTC m=+1089.685135242" observedRunningTime="2026-03-16 13:24:06.202966506 +0000 UTC m=+1090.602279053" watchObservedRunningTime="2026-03-16 13:24:06.220206653 +0000 UTC m=+1090.619519201" Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.223389 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" event={"ID":"a6c03aa3-3751-4cda-a944-d0a561269a82","Type":"ContainerStarted","Data":"b30d69eb1e4209cfef497690b3a85280e4d44804c95bb56456090020b70b42ce"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.235379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerStarted","Data":"339c7be51b45286adf12565ee0400dd34114e2618afd1209c9a935f17cfdd8d1"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.240162 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerStarted","Data":"9de493c7ae0aed88d25ce4e88f8c5a01ebe069463e371b3ddb9616243b79838a"} Mar 16 13:24:06 crc kubenswrapper[5030]: I0316 13:24:06.254174 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" podStartSLOduration=13.254154327 podStartE2EDuration="13.254154327s" podCreationTimestamp="2026-03-16 13:23:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:06.231458782 +0000 UTC m=+1090.630771368" watchObservedRunningTime="2026-03-16 13:24:06.254154327 +0000 UTC m=+1090.653466875" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.261525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerStarted","Data":"bf80b8cf468fd33fa53393ea23b03f7d5efa9196a220b7bb218d18f1006bf3cc"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.262159 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.267830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" event={"ID":"153a0988-98b5-4ea1-b066-0b754566bfd3","Type":"ContainerStarted","Data":"ad042e39fd32034a8827951f4b6bc2b1e662a22c2b751ca4b7409760e088ae0f"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.272512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerStarted","Data":"e52b42ff212eadd8d8f3817e8be04e31e89df58e5ad9fda1dd4278d8c0b7dffc"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.272542 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerStarted","Data":"b8fb4f8fa4e38f0365461f3d55fa251a66c71a6da73229cd605c8cd9cbf8b28a"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.275352 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerStarted","Data":"bdf9b90646e6aaef20c521364c6e15347f1f3c1b613cb62dfcbf449c33e10d62"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.275375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerStarted","Data":"9bfb94dfe0f13bbd6b69119c4383897a1a4a160d2604e1032da93835bac87b1a"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.275763 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.287283 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" podStartSLOduration=12.287270811 podStartE2EDuration="12.287270811s" podCreationTimestamp="2026-03-16 13:23:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:07.276929595 +0000 UTC m=+1091.676242142" watchObservedRunningTime="2026-03-16 13:24:07.287270811 +0000 UTC m=+1091.686583358" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.292970 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerStarted","Data":"f7b6c723825e64c4f191cc08a5c95b024c6be5bc5b535819d35df87d34cac345"} Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.303171 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=12.303153386 podStartE2EDuration="12.303153386s" podCreationTimestamp="2026-03-16 13:23:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:07.295303766 +0000 UTC m=+1091.694616323" watchObservedRunningTime="2026-03-16 13:24:07.303153386 +0000 UTC m=+1091.702465933" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.326016 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" podStartSLOduration=2.90807101 podStartE2EDuration="24.325972544s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="2026-03-16 13:23:43.982423427 +0000 UTC m=+1068.381735964" lastFinishedPulling="2026-03-16 13:24:05.400324951 +0000 UTC m=+1089.799637498" observedRunningTime="2026-03-16 13:24:07.315303202 +0000 UTC m=+1091.714615749" watchObservedRunningTime="2026-03-16 13:24:07.325972544 +0000 UTC m=+1091.725285091" Mar 16 13:24:07 crc kubenswrapper[5030]: I0316 13:24:07.337702 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" podStartSLOduration=10.337689597 podStartE2EDuration="10.337689597s" podCreationTimestamp="2026-03-16 13:23:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:07.332005729 +0000 UTC m=+1091.731318276" watchObservedRunningTime="2026-03-16 13:24:07.337689597 +0000 UTC m=+1091.737002144" Mar 16 13:24:08 crc kubenswrapper[5030]: E0316 13:24:08.037620 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6c03aa3_3751_4cda_a944_d0a561269a82.slice/crio-conmon-1d2f58014296e00a29c7d6d35e1fac9bea1b25227a3a049e601087265c03eea0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6c03aa3_3751_4cda_a944_d0a561269a82.slice/crio-1d2f58014296e00a29c7d6d35e1fac9bea1b25227a3a049e601087265c03eea0.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.301704 5030 generic.go:358] "Generic (PLEG): container finished" podID="af329639-82ba-4b13-8c6f-a20650cf518d" containerID="de4d712802cd08f4c434ff0b0ce8bc6c035ad10788cb2674d81fe90fe411a59c" exitCode=0 Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.301790 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" event={"ID":"af329639-82ba-4b13-8c6f-a20650cf518d","Type":"ContainerDied","Data":"de4d712802cd08f4c434ff0b0ce8bc6c035ad10788cb2674d81fe90fe411a59c"} Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.304786 5030 generic.go:358] "Generic (PLEG): container finished" podID="7730c44c-bbf1-4c58-b917-d1ce3efa6590" containerID="85d38f1a0d5bf34c9f33b986e904c30877828bb187767fa9b5e2d4d1d27d718e" exitCode=0 Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.304875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" event={"ID":"7730c44c-bbf1-4c58-b917-d1ce3efa6590","Type":"ContainerDied","Data":"85d38f1a0d5bf34c9f33b986e904c30877828bb187767fa9b5e2d4d1d27d718e"} Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.306223 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerStarted","Data":"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246"} Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.307697 5030 generic.go:358] "Generic (PLEG): container finished" podID="a6c03aa3-3751-4cda-a944-d0a561269a82" containerID="1d2f58014296e00a29c7d6d35e1fac9bea1b25227a3a049e601087265c03eea0" exitCode=0 Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.307839 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" event={"ID":"a6c03aa3-3751-4cda-a944-d0a561269a82","Type":"ContainerDied","Data":"1d2f58014296e00a29c7d6d35e1fac9bea1b25227a3a049e601087265c03eea0"} Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.309327 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerStarted","Data":"7c864b50f5b76910dd637af7b286a957e7268814f6ea45edf4c9d3b029e0dd3e"} Mar 16 13:24:08 crc kubenswrapper[5030]: I0316 13:24:08.399601 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=9.399584946 podStartE2EDuration="9.399584946s" podCreationTimestamp="2026-03-16 13:23:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:08.383146475 +0000 UTC m=+1092.782459021" watchObservedRunningTime="2026-03-16 13:24:08.399584946 +0000 UTC m=+1092.798897503" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.319810 5030 generic.go:358] "Generic (PLEG): container finished" podID="153a0988-98b5-4ea1-b066-0b754566bfd3" containerID="ad042e39fd32034a8827951f4b6bc2b1e662a22c2b751ca4b7409760e088ae0f" exitCode=0 Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.319913 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" event={"ID":"153a0988-98b5-4ea1-b066-0b754566bfd3","Type":"ContainerDied","Data":"ad042e39fd32034a8827951f4b6bc2b1e662a22c2b751ca4b7409760e088ae0f"} Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.323032 5030 generic.go:358] "Generic (PLEG): container finished" podID="bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" containerID="1c3eaab187f0425aa62de437b371e6c07798e47404c1adf3f564edabdba98e8e" exitCode=0 Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.323111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" event={"ID":"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7","Type":"ContainerDied","Data":"1c3eaab187f0425aa62de437b371e6c07798e47404c1adf3f564edabdba98e8e"} Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.484606 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.484849 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.511908 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.525756 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.708879 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.794335 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8gl6\" (UniqueName: \"kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6\") pod \"af329639-82ba-4b13-8c6f-a20650cf518d\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.794412 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts\") pod \"af329639-82ba-4b13-8c6f-a20650cf518d\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.794490 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs\") pod \"af329639-82ba-4b13-8c6f-a20650cf518d\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.794697 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data\") pod \"af329639-82ba-4b13-8c6f-a20650cf518d\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.794806 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle\") pod \"af329639-82ba-4b13-8c6f-a20650cf518d\" (UID: \"af329639-82ba-4b13-8c6f-a20650cf518d\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.795154 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs" (OuterVolumeSpecName: "logs") pod "af329639-82ba-4b13-8c6f-a20650cf518d" (UID: "af329639-82ba-4b13-8c6f-a20650cf518d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.800907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts" (OuterVolumeSpecName: "scripts") pod "af329639-82ba-4b13-8c6f-a20650cf518d" (UID: "af329639-82ba-4b13-8c6f-a20650cf518d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.801342 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6" (OuterVolumeSpecName: "kube-api-access-c8gl6") pod "af329639-82ba-4b13-8c6f-a20650cf518d" (UID: "af329639-82ba-4b13-8c6f-a20650cf518d"). InnerVolumeSpecName "kube-api-access-c8gl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.813013 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.817574 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.820964 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "af329639-82ba-4b13-8c6f-a20650cf518d" (UID: "af329639-82ba-4b13-8c6f-a20650cf518d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.821640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data" (OuterVolumeSpecName: "config-data") pod "af329639-82ba-4b13-8c6f-a20650cf518d" (UID: "af329639-82ba-4b13-8c6f-a20650cf518d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.896522 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data\") pod \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.896589 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6m25\" (UniqueName: \"kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25\") pod \"a6c03aa3-3751-4cda-a944-d0a561269a82\" (UID: \"a6c03aa3-3751-4cda-a944-d0a561269a82\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.896620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p68jn\" (UniqueName: \"kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn\") pod \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.897204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle\") pod \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\" (UID: \"7730c44c-bbf1-4c58-b917-d1ce3efa6590\") " Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.898420 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.898439 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8gl6\" (UniqueName: \"kubernetes.io/projected/af329639-82ba-4b13-8c6f-a20650cf518d-kube-api-access-c8gl6\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.898452 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.898462 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af329639-82ba-4b13-8c6f-a20650cf518d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.898487 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af329639-82ba-4b13-8c6f-a20650cf518d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.900204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "7730c44c-bbf1-4c58-b917-d1ce3efa6590" (UID: "7730c44c-bbf1-4c58-b917-d1ce3efa6590"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.902796 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25" (OuterVolumeSpecName: "kube-api-access-h6m25") pod "a6c03aa3-3751-4cda-a944-d0a561269a82" (UID: "a6c03aa3-3751-4cda-a944-d0a561269a82"). InnerVolumeSpecName "kube-api-access-h6m25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.903360 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn" (OuterVolumeSpecName: "kube-api-access-p68jn") pod "7730c44c-bbf1-4c58-b917-d1ce3efa6590" (UID: "7730c44c-bbf1-4c58-b917-d1ce3efa6590"). InnerVolumeSpecName "kube-api-access-p68jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:09 crc kubenswrapper[5030]: I0316 13:24:09.926409 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7730c44c-bbf1-4c58-b917-d1ce3efa6590" (UID: "7730c44c-bbf1-4c58-b917-d1ce3efa6590"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.000038 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6m25\" (UniqueName: \"kubernetes.io/projected/a6c03aa3-3751-4cda-a944-d0a561269a82-kube-api-access-h6m25\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.000081 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p68jn\" (UniqueName: \"kubernetes.io/projected/7730c44c-bbf1-4c58-b917-d1ce3efa6590-kube-api-access-p68jn\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.000096 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.000107 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/7730c44c-bbf1-4c58-b917-d1ce3efa6590-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.332938 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.332992 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561124-xqhfm" event={"ID":"a6c03aa3-3751-4cda-a944-d0a561269a82","Type":"ContainerDied","Data":"b30d69eb1e4209cfef497690b3a85280e4d44804c95bb56456090020b70b42ce"} Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.333042 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b30d69eb1e4209cfef497690b3a85280e4d44804c95bb56456090020b70b42ce" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.341058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" event={"ID":"af329639-82ba-4b13-8c6f-a20650cf518d","Type":"ContainerDied","Data":"75fb29613d25341b1a01f90382fc03ef0a2c9b7cdaf35f4c7c525dbdcb462f49"} Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.341115 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75fb29613d25341b1a01f90382fc03ef0a2c9b7cdaf35f4c7c525dbdcb462f49" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.341162 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-s4c6l" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.352034 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.352633 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-fvcsr" event={"ID":"7730c44c-bbf1-4c58-b917-d1ce3efa6590","Type":"ContainerDied","Data":"bd3caa769de0b1d2f5cc1c0aa4a38cbba96f2e8cc4bcafd8fe12bf37d20a14ef"} Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.352653 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd3caa769de0b1d2f5cc1c0aa4a38cbba96f2e8cc4bcafd8fe12bf37d20a14ef" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.353209 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.353434 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.478185 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479209 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c03aa3-3751-4cda-a944-d0a561269a82" containerName="oc" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c03aa3-3751-4cda-a944-d0a561269a82" containerName="oc" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479244 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7730c44c-bbf1-4c58-b917-d1ce3efa6590" containerName="barbican-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479251 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7730c44c-bbf1-4c58-b917-d1ce3efa6590" containerName="barbican-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479264 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af329639-82ba-4b13-8c6f-a20650cf518d" containerName="placement-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479270 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="af329639-82ba-4b13-8c6f-a20650cf518d" containerName="placement-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479463 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7730c44c-bbf1-4c58-b917-d1ce3efa6590" containerName="barbican-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479472 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6c03aa3-3751-4cda-a944-d0a561269a82" containerName="oc" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.479489 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="af329639-82ba-4b13-8c6f-a20650cf518d" containerName="placement-db-sync" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.489320 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.500038 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.500498 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-4bdzx\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.500686 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.500807 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.502320 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.511906 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.578011 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.591264 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.603713 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.604318 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.610834 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-5vxxq\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.616770 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.616824 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.616862 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.616945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.616959 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzth5\" (UniqueName: \"kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.617028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.617093 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.679318 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.695771 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729047 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729185 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729243 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jd8x\" (UniqueName: \"kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729661 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729805 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.729826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzth5\" (UniqueName: \"kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.730881 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.748869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.749260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.749291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.757041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.760291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.760940 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.761102 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.769035 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzth5\" (UniqueName: \"kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5\") pod \"placement-8699bb6694-6td9g\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.778975 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.835766 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.835911 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836036 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836109 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jd8x\" (UniqueName: \"kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836276 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836430 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47vx\" (UniqueName: \"kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.836578 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.837359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.858424 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jd8x\" (UniqueName: \"kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.861370 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.863426 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.863654 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data\") pod \"barbican-worker-796d77cb7f-w5464\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.873140 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.883103 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.891972 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.892136 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.899346 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.913770 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.937743 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.937979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfgm5\" (UniqueName: \"kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938117 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938174 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938227 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts\") pod \"153a0988-98b5-4ea1-b066-0b754566bfd3\" (UID: \"153a0988-98b5-4ea1-b066-0b754566bfd3\") " Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938522 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.938829 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939248 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939340 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939521 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgzn\" (UniqueName: \"kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939730 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939814 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k47vx\" (UniqueName: \"kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.939969 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.940611 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561118-7rlrb"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.951088 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561118-7rlrb"] Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.951857 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.951164 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.955494 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5" (OuterVolumeSpecName: "kube-api-access-vfgm5") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "kube-api-access-vfgm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.956349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.958603 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.960579 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts" (OuterVolumeSpecName: "scripts") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.966241 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.967152 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:10 crc kubenswrapper[5030]: I0316 13:24:10.973299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47vx\" (UniqueName: \"kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx\") pod \"barbican-keystone-listener-9b9458658-n4vh5\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.003847 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.009878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data" (OuterVolumeSpecName: "config-data") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.013168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "153a0988-98b5-4ea1-b066-0b754566bfd3" (UID: "153a0988-98b5-4ea1-b066-0b754566bfd3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.033593 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042295 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042416 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpzzh\" (UniqueName: \"kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042504 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042566 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042768 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.042915 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data\") pod \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\" (UID: \"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7\") " Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043190 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043313 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgzn\" (UniqueName: \"kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043421 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043570 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043587 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfgm5\" (UniqueName: \"kubernetes.io/projected/153a0988-98b5-4ea1-b066-0b754566bfd3-kube-api-access-vfgm5\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043599 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043609 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/153a0988-98b5-4ea1-b066-0b754566bfd3-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043617 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.043628 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/153a0988-98b5-4ea1-b066-0b754566bfd3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.046956 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.051706 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.052760 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh" (OuterVolumeSpecName: "kube-api-access-tpzzh") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "kube-api-access-tpzzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.055163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.056680 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts" (OuterVolumeSpecName: "scripts") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.060128 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.064249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.066323 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.069206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgzn\" (UniqueName: \"kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn\") pod \"barbican-api-77dd4ffd68-lrn5g\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.076156 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.090651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data" (OuterVolumeSpecName: "config-data") pod "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" (UID: "bc8e2b24-c627-4b5f-bad9-a5b38399f8c7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.127997 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146348 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146376 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146574 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146583 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146592 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpzzh\" (UniqueName: \"kubernetes.io/projected/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-kube-api-access-tpzzh\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.146601 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.229101 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.376037 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.379273 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.379463 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2csq4" event={"ID":"153a0988-98b5-4ea1-b066-0b754566bfd3","Type":"ContainerDied","Data":"7aaa33d766104f2e1486576bc9bc34dc6d01a50d9328961b0a6d1b804d84b460"} Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.379506 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aaa33d766104f2e1486576bc9bc34dc6d01a50d9328961b0a6d1b804d84b460" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.397027 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.397067 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-zn5v7" event={"ID":"bc8e2b24-c627-4b5f-bad9-a5b38399f8c7","Type":"ContainerDied","Data":"5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c"} Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.397133 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5acfbd9bb6cc58c996dfe03c355cdec58409f3bc2aad75af9bff92a49d53e53c" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.510641 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511674 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" containerName="keystone-bootstrap" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511694 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" containerName="keystone-bootstrap" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511703 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="153a0988-98b5-4ea1-b066-0b754566bfd3" containerName="cinder-db-sync" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511708 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="153a0988-98b5-4ea1-b066-0b754566bfd3" containerName="cinder-db-sync" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511900 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="153a0988-98b5-4ea1-b066-0b754566bfd3" containerName="cinder-db-sync" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.511917 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" containerName="keystone-bootstrap" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.515367 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.522271 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.522403 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:24:11 crc kubenswrapper[5030]: W0316 13:24:11.522484 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod142e25ce_1185_4a65_a83e_92eddf8cdc1d.slice/crio-e94cd3463a998bc5981aead4e770502bdc37c41a2ab2381f19914f968738f70a WatchSource:0}: Error finding container e94cd3463a998bc5981aead4e770502bdc37c41a2ab2381f19914f968738f70a: Status 404 returned error can't find the container with id e94cd3463a998bc5981aead4e770502bdc37c41a2ab2381f19914f968738f70a Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.522598 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.525190 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.525366 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.529294 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-6pvvd\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.545766 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557529 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557603 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557628 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557690 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.557799 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdfwp\" (UniqueName: \"kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.558957 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.559119 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.624217 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.640953 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.641984 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.648122 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.648403 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-xmdgt\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.648361 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.648316 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662037 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdfwp\" (UniqueName: \"kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662085 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662138 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662205 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662227 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662270 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662365 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-874cw\" (UniqueName: \"kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662416 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.662514 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.674958 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.676991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.677756 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.682781 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.683186 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.683777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.687699 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdfwp\" (UniqueName: \"kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.690215 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data\") pod \"keystone-5c648c5fc-4kfz8\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: W0316 13:24:11.699323 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986d72a5_6f24_494d_b1bd_0ab78af24f91.slice/crio-dac9f94e8a1b21b8670b573ce653a8c7f6e74c7c209d3d045221d516768c04aa WatchSource:0}: Error finding container dac9f94e8a1b21b8670b573ce653a8c7f6e74c7c209d3d045221d516768c04aa: Status 404 returned error can't find the container with id dac9f94e8a1b21b8670b573ce653a8c7f6e74c7c209d3d045221d516768c04aa Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.715207 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.734472 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.764882 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.764920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.765126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.765242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-874cw\" (UniqueName: \"kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.765265 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.765289 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.777364 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.777433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.786221 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.786228 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.787240 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.796101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-874cw\" (UniqueName: \"kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw\") pod \"cinder-scheduler-0\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.850175 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.858823 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.912524 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.921409 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.925265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.927103 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.969785 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39b588c-93ce-463a-aef8-95fced91a4f3" path="/var/lib/kubelet/pods/f39b588c-93ce-463a-aef8-95fced91a4f3/volumes" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.988931 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.989030 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.989179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.990379 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdtrl\" (UniqueName: \"kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.990578 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.990642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:11 crc kubenswrapper[5030]: I0316 13:24:11.990739 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.092564 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.092813 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.092857 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.092875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdtrl\" (UniqueName: \"kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.092938 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.093216 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.093277 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.093369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.093794 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.099251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.101124 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.108029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.110029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdtrl\" (UniqueName: \"kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.116542 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data\") pod \"cinder-api-0\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.244090 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.399195 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.425130 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497171 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerStarted","Data":"02355d4d92a2ad9be9f049a402567674a05326d689eed4afc34aaac08fb1c5d3"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497229 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerStarted","Data":"011cc37f7c80473400d6b85f83ec6e0c0a94c550bb6f186fa21cbb61384dfcd9"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerStarted","Data":"dac9f94e8a1b21b8670b573ce653a8c7f6e74c7c209d3d045221d516768c04aa"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497260 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerStarted","Data":"e94cd3463a998bc5981aead4e770502bdc37c41a2ab2381f19914f968738f70a"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.497286 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.500777 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512451 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512488 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerStarted","Data":"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512507 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512518 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerStarted","Data":"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512539 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerStarted","Data":"41fff474c8159eb9484bfbd3d6ded2c55f6a77e6fc218fe126b0dd6f5fb979cd"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.512563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerStarted","Data":"63e43cafc00c3b4916f8b0b54e8ed171d583edb60c20b6b4629e00fcc7cb8fc0"} Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.518138 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.534811 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.547355 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podStartSLOduration=2.547333864 podStartE2EDuration="2.547333864s" podCreationTimestamp="2026-03-16 13:24:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:12.500268835 +0000 UTC m=+1096.899581381" watchObservedRunningTime="2026-03-16 13:24:12.547333864 +0000 UTC m=+1096.946646411" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.579856 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" podStartSLOduration=2.579840769 podStartE2EDuration="2.579840769s" podCreationTimestamp="2026-03-16 13:24:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:12.520998754 +0000 UTC m=+1096.920311301" watchObservedRunningTime="2026-03-16 13:24:12.579840769 +0000 UTC m=+1096.979153316" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.592695 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.613601 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617150 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6zj\" (UniqueName: \"kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617248 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617277 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617292 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617353 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617368 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kg5\" (UniqueName: \"kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617385 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617462 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.617592 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.627428 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.719822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.719880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.719934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8w9\" (UniqueName: \"kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.719955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.719981 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720017 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720210 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6zj\" (UniqueName: \"kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720280 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720321 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720424 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720448 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720501 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kg5\" (UniqueName: \"kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.720897 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.727020 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.727069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.728282 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.728722 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.735006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6zj\" (UniqueName: \"kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.736132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data\") pod \"barbican-keystone-listener-76ff475c8b-zxw2w\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.737026 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.749036 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kg5\" (UniqueName: \"kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5\") pod \"barbican-worker-84c74787d9-2vq7x\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.772001 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.822277 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8w9\" (UniqueName: \"kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.822329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.822370 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.822412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.822477 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.824153 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.836328 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.837187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8w9\" (UniqueName: \"kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.837456 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.837987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom\") pod \"barbican-api-6f6766d59b-kb4fz\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.893651 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:24:12 crc kubenswrapper[5030]: I0316 13:24:12.921006 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:24:13 crc kubenswrapper[5030]: I0316 13:24:13.002846 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:13 crc kubenswrapper[5030]: I0316 13:24:13.481352 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:14 crc kubenswrapper[5030]: I0316 13:24:14.330119 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:24:15 crc kubenswrapper[5030]: I0316 13:24:15.487416 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:15 crc kubenswrapper[5030]: I0316 13:24:15.567235 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:15 crc kubenswrapper[5030]: I0316 13:24:15.567300 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:15 crc kubenswrapper[5030]: I0316 13:24:15.601481 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:15 crc kubenswrapper[5030]: I0316 13:24:15.603579 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:16 crc kubenswrapper[5030]: I0316 13:24:16.539938 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:16 crc kubenswrapper[5030]: I0316 13:24:16.539999 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.121949 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.122248 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" containerID="cri-o://011cc37f7c80473400d6b85f83ec6e0c0a94c550bb6f186fa21cbb61384dfcd9" gracePeriod=30 Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.122785 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" containerID="cri-o://02355d4d92a2ad9be9f049a402567674a05326d689eed4afc34aaac08fb1c5d3" gracePeriod=30 Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.148107 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.150935 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.148:9311/healthcheck\": EOF" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.151623 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.148:9311/healthcheck\": EOF" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.159695 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.160822 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.162695 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.162733 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.216934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217020 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217247 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217261 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.217337 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nbdz\" (UniqueName: \"kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: W0316 13:24:17.300722 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e9552d_0d8c_4470_aba5_9c9fbbf59707.slice/crio-4eeaf720221dc88a626126abc2ec233a1cd970a904a1173dba071c94d885494f WatchSource:0}: Error finding container 4eeaf720221dc88a626126abc2ec233a1cd970a904a1173dba071c94d885494f: Status 404 returned error can't find the container with id 4eeaf720221dc88a626126abc2ec233a1cd970a904a1173dba071c94d885494f Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326515 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326584 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326610 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6nbdz\" (UniqueName: \"kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326712 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.326808 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.344391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.347032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.355001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.361210 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.361730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.364117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nbdz\" (UniqueName: \"kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.375418 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs\") pod \"barbican-api-c4ff8c868-5x9pd\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.483048 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.601574 5030 generic.go:358] "Generic (PLEG): container finished" podID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerID="011cc37f7c80473400d6b85f83ec6e0c0a94c550bb6f186fa21cbb61384dfcd9" exitCode=143 Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.602351 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerDied","Data":"011cc37f7c80473400d6b85f83ec6e0c0a94c550bb6f186fa21cbb61384dfcd9"} Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.634311 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerStarted","Data":"4eeaf720221dc88a626126abc2ec233a1cd970a904a1173dba071c94d885494f"} Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.636404 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" event={"ID":"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5","Type":"ContainerStarted","Data":"87eab5fffa838e309482555766d154205c30a858dbfeb59fa8acfc6bfdc27307"} Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.666225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerStarted","Data":"4bf25f2af58e2a6234b7ff213ad5a21ff2053ba443fc5073f124a9a8e5da4324"} Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.856306 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.909468 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:24:17 crc kubenswrapper[5030]: W0316 13:24:17.943657 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ee5b58_8044_4e80_a667_663f2f57f6e5.slice/crio-833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca WatchSource:0}: Error finding container 833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca: Status 404 returned error can't find the container with id 833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca Mar 16 13:24:17 crc kubenswrapper[5030]: I0316 13:24:17.986446 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.078393 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:24:18 crc kubenswrapper[5030]: W0316 13:24:18.104882 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0167208_7974_4db5_89be_eafc7e5412f9.slice/crio-27bcff6ff1b7e1d16238eef527ca1e621a1683d1d3c6eab5764e0e7874d546af WatchSource:0}: Error finding container 27bcff6ff1b7e1d16238eef527ca1e621a1683d1d3c6eab5764e0e7874d546af: Status 404 returned error can't find the container with id 27bcff6ff1b7e1d16238eef527ca1e621a1683d1d3c6eab5764e0e7874d546af Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.416537 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.491679 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.675801 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerStarted","Data":"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.675849 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerStarted","Data":"364c311b352c96fe0a9bb3f7324e92e768a9694b5d1d79873b203f7dd5d5566f"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.677465 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerStarted","Data":"83080ddab2db7df5746de5c8c2fe419d2e8ed3909d84ccd83d0601fc4ee659f3"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.678978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerStarted","Data":"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.679034 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerStarted","Data":"27bcff6ff1b7e1d16238eef527ca1e621a1683d1d3c6eab5764e0e7874d546af"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.680479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerStarted","Data":"833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.682985 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerStarted","Data":"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.684501 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerStarted","Data":"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.686851 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" event={"ID":"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5","Type":"ContainerStarted","Data":"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9"} Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.687054 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:18 crc kubenswrapper[5030]: I0316 13:24:18.707259 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" podStartSLOduration=7.707247641 podStartE2EDuration="7.707247641s" podCreationTimestamp="2026-03-16 13:24:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:18.706663673 +0000 UTC m=+1103.105976220" watchObservedRunningTime="2026-03-16 13:24:18.707247641 +0000 UTC m=+1103.106560188" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.725228 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerStarted","Data":"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c"} Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.726178 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.726205 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.745908 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" podStartSLOduration=2.745892639 podStartE2EDuration="2.745892639s" podCreationTimestamp="2026-03-16 13:24:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:19.744341673 +0000 UTC m=+1104.143654220" watchObservedRunningTime="2026-03-16 13:24:19.745892639 +0000 UTC m=+1104.145205186" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.756663 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerStarted","Data":"f4e98c92cdbe24b70cac2d6f5073c2dff6eb434f2a726c5c09fa269d5aa2c6dc"} Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.759694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerStarted","Data":"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788"} Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.763044 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerStarted","Data":"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee"} Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.780074 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerStarted","Data":"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677"} Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.780116 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.780579 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.785826 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" podStartSLOduration=2.26013319 podStartE2EDuration="9.785814297s" podCreationTimestamp="2026-03-16 13:24:10 +0000 UTC" firstStartedPulling="2026-03-16 13:24:11.525032297 +0000 UTC m=+1095.924344844" lastFinishedPulling="2026-03-16 13:24:19.050713404 +0000 UTC m=+1103.450025951" observedRunningTime="2026-03-16 13:24:19.771932795 +0000 UTC m=+1104.171245342" watchObservedRunningTime="2026-03-16 13:24:19.785814297 +0000 UTC m=+1104.185126844" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.829845 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" podStartSLOduration=2.451035026 podStartE2EDuration="9.82982862s" podCreationTimestamp="2026-03-16 13:24:10 +0000 UTC" firstStartedPulling="2026-03-16 13:24:11.724151345 +0000 UTC m=+1096.123463892" lastFinishedPulling="2026-03-16 13:24:19.102944939 +0000 UTC m=+1103.502257486" observedRunningTime="2026-03-16 13:24:19.795714372 +0000 UTC m=+1104.195026919" watchObservedRunningTime="2026-03-16 13:24:19.82982862 +0000 UTC m=+1104.229141157" Mar 16 13:24:19 crc kubenswrapper[5030]: I0316 13:24:19.831307 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podStartSLOduration=7.831301439 podStartE2EDuration="7.831301439s" podCreationTimestamp="2026-03-16 13:24:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:19.821106358 +0000 UTC m=+1104.220418906" watchObservedRunningTime="2026-03-16 13:24:19.831301439 +0000 UTC m=+1104.230613987" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.792339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerStarted","Data":"702f7b29fbd473ea5b18b1d283206cddf84ab25b8ce8f2d3fc07e9a31dac1c6b"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.797127 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerStarted","Data":"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.799930 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerStarted","Data":"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.799946 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api-log" containerID="cri-o://db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" gracePeriod=30 Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.800008 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api" containerID="cri-o://549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" gracePeriod=30 Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.800057 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.811617 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" podStartSLOduration=7.674618056 podStartE2EDuration="8.811599494s" podCreationTimestamp="2026-03-16 13:24:12 +0000 UTC" firstStartedPulling="2026-03-16 13:24:17.967542039 +0000 UTC m=+1102.366854586" lastFinishedPulling="2026-03-16 13:24:19.104523477 +0000 UTC m=+1103.503836024" observedRunningTime="2026-03-16 13:24:20.809877316 +0000 UTC m=+1105.209189883" watchObservedRunningTime="2026-03-16 13:24:20.811599494 +0000 UTC m=+1105.210912041" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.820505 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerStarted","Data":"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.833497 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=9.833487632 podStartE2EDuration="9.833487632s" podCreationTimestamp="2026-03-16 13:24:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:20.82436079 +0000 UTC m=+1105.223673337" watchObservedRunningTime="2026-03-16 13:24:20.833487632 +0000 UTC m=+1105.232800179" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.837308 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerStarted","Data":"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.837361 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerStarted","Data":"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.840165 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.848027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerStarted","Data":"fd603db9017ea18e32e104394c13a6249a68273e9c7dfd4b3469595d93092066"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.848057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerStarted","Data":"bc20eaaadeb3ad1b260d080bfced970205680d1af449e78b8968357099595a03"} Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.862975 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=8.072337685 podStartE2EDuration="9.862957947s" podCreationTimestamp="2026-03-16 13:24:11 +0000 UTC" firstStartedPulling="2026-03-16 13:24:17.300981118 +0000 UTC m=+1101.700293664" lastFinishedPulling="2026-03-16 13:24:19.091601379 +0000 UTC m=+1103.490913926" observedRunningTime="2026-03-16 13:24:20.861018922 +0000 UTC m=+1105.260331469" watchObservedRunningTime="2026-03-16 13:24:20.862957947 +0000 UTC m=+1105.262270494" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.879951 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" podStartSLOduration=7.639357294 podStartE2EDuration="8.879932677s" podCreationTimestamp="2026-03-16 13:24:12 +0000 UTC" firstStartedPulling="2026-03-16 13:24:17.863956801 +0000 UTC m=+1102.263269347" lastFinishedPulling="2026-03-16 13:24:19.104532184 +0000 UTC m=+1103.503844730" observedRunningTime="2026-03-16 13:24:20.878147389 +0000 UTC m=+1105.277459936" watchObservedRunningTime="2026-03-16 13:24:20.879932677 +0000 UTC m=+1105.279245223" Mar 16 13:24:20 crc kubenswrapper[5030]: I0316 13:24:20.908137 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.629925 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.756961 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757281 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757315 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757341 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757375 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.757410 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdtrl\" (UniqueName: \"kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl\") pod \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\" (UID: \"97e9552d-0d8c-4470-aba5-9c9fbbf59707\") " Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.759977 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.760363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs" (OuterVolumeSpecName: "logs") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.766464 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts" (OuterVolumeSpecName: "scripts") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.768776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.768967 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl" (OuterVolumeSpecName: "kube-api-access-wdtrl") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "kube-api-access-wdtrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.796934 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.811183 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data" (OuterVolumeSpecName: "config-data") pod "97e9552d-0d8c-4470-aba5-9c9fbbf59707" (UID: "97e9552d-0d8c-4470-aba5-9c9fbbf59707"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.850901 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861113 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/97e9552d-0d8c-4470-aba5-9c9fbbf59707-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861143 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861155 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861168 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861178 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/97e9552d-0d8c-4470-aba5-9c9fbbf59707-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861186 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/97e9552d-0d8c-4470-aba5-9c9fbbf59707-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.861197 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdtrl\" (UniqueName: \"kubernetes.io/projected/97e9552d-0d8c-4470-aba5-9c9fbbf59707-kube-api-access-wdtrl\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864396 5030 generic.go:358] "Generic (PLEG): container finished" podID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerID="549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" exitCode=0 Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864440 5030 generic.go:358] "Generic (PLEG): container finished" podID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerID="db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" exitCode=143 Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerDied","Data":"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19"} Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerDied","Data":"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24"} Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864679 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"97e9552d-0d8c-4470-aba5-9c9fbbf59707","Type":"ContainerDied","Data":"4eeaf720221dc88a626126abc2ec233a1cd970a904a1173dba071c94d885494f"} Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864703 5030 scope.go:117] "RemoveContainer" containerID="549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.864748 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.930789 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.936366 5030 scope.go:117] "RemoveContainer" containerID="db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.995965 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.996118 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.996638 5030 scope.go:117] "RemoveContainer" containerID="549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" Mar 16 13:24:21 crc kubenswrapper[5030]: E0316 13:24:21.997113 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19\": container with ID starting with 549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19 not found: ID does not exist" containerID="549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.997149 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19"} err="failed to get container status \"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19\": rpc error: code = NotFound desc = could not find container \"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19\": container with ID starting with 549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19 not found: ID does not exist" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.997170 5030 scope.go:117] "RemoveContainer" containerID="db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" Mar 16 13:24:21 crc kubenswrapper[5030]: E0316 13:24:21.997479 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24\": container with ID starting with db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24 not found: ID does not exist" containerID="db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.997527 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24"} err="failed to get container status \"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24\": rpc error: code = NotFound desc = could not find container \"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24\": container with ID starting with db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24 not found: ID does not exist" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.997541 5030 scope.go:117] "RemoveContainer" containerID="549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.998490 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19"} err="failed to get container status \"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19\": rpc error: code = NotFound desc = could not find container \"549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19\": container with ID starting with 549e44e53300e91fe3e04b6f1c7a23159f0c15e71499a94eb3fd0a8bcfa5ee19 not found: ID does not exist" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.998536 5030 scope.go:117] "RemoveContainer" containerID="db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24" Mar 16 13:24:21 crc kubenswrapper[5030]: I0316 13:24:21.999280 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24"} err="failed to get container status \"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24\": rpc error: code = NotFound desc = could not find container \"db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24\": container with ID starting with db7a28a132a71bdbbb1746807e5ac88be32641edbd6c6f0ee4163e1b17c9dc24 not found: ID does not exist" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.000652 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.000682 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.000734 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api-log" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.000741 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api-log" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.001179 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api-log" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.001198 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" containerName="cinder-api" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.008231 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.008355 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.010962 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.011146 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.011207 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185355 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185507 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185586 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185611 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185746 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.185786 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8lcl\" (UniqueName: \"kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287361 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287490 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8lcl\" (UniqueName: \"kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287578 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287608 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287646 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287677 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.287721 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.288312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.293248 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.293393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.293658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.295190 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.295443 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.295717 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.306363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8lcl\" (UniqueName: \"kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl\") pod \"cinder-api-0\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.325008 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.538804 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.148:9311/healthcheck\": read tcp 10.217.0.2:41118->10.217.0.148:9311: read: connection reset by peer" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.538858 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.148:9311/healthcheck\": read tcp 10.217.0.2:41132->10.217.0.148:9311: read: connection reset by peer" Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.773957 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.888641 5030 generic.go:358] "Generic (PLEG): container finished" podID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerID="02355d4d92a2ad9be9f049a402567674a05326d689eed4afc34aaac08fb1c5d3" exitCode=0 Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.888684 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerDied","Data":"02355d4d92a2ad9be9f049a402567674a05326d689eed4afc34aaac08fb1c5d3"} Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.895757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerStarted","Data":"c9aea36fade84c7457a7d451931ce1bb5a81ab1eda1c385e3470e8410d27f089"} Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.896461 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker-log" containerID="cri-o://caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" gracePeriod=30 Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.896618 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker" containerID="cri-o://4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" gracePeriod=30 Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.897198 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener-log" containerID="cri-o://43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" gracePeriod=30 Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.897242 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener" containerID="cri-o://4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" gracePeriod=30 Mar 16 13:24:22 crc kubenswrapper[5030]: I0316 13:24:22.914420 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.105429 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs\") pod \"986d72a5-6f24-494d-b1bd-0ab78af24f91\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.105638 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle\") pod \"986d72a5-6f24-494d-b1bd-0ab78af24f91\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.105793 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom\") pod \"986d72a5-6f24-494d-b1bd-0ab78af24f91\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.105845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data\") pod \"986d72a5-6f24-494d-b1bd-0ab78af24f91\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.105892 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxgzn\" (UniqueName: \"kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn\") pod \"986d72a5-6f24-494d-b1bd-0ab78af24f91\" (UID: \"986d72a5-6f24-494d-b1bd-0ab78af24f91\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.106734 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs" (OuterVolumeSpecName: "logs") pod "986d72a5-6f24-494d-b1bd-0ab78af24f91" (UID: "986d72a5-6f24-494d-b1bd-0ab78af24f91"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.111937 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn" (OuterVolumeSpecName: "kube-api-access-vxgzn") pod "986d72a5-6f24-494d-b1bd-0ab78af24f91" (UID: "986d72a5-6f24-494d-b1bd-0ab78af24f91"). InnerVolumeSpecName "kube-api-access-vxgzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.112698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "986d72a5-6f24-494d-b1bd-0ab78af24f91" (UID: "986d72a5-6f24-494d-b1bd-0ab78af24f91"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.130187 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "986d72a5-6f24-494d-b1bd-0ab78af24f91" (UID: "986d72a5-6f24-494d-b1bd-0ab78af24f91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.145880 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data" (OuterVolumeSpecName: "config-data") pod "986d72a5-6f24-494d-b1bd-0ab78af24f91" (UID: "986d72a5-6f24-494d-b1bd-0ab78af24f91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.208874 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/986d72a5-6f24-494d-b1bd-0ab78af24f91-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.208914 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.208929 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.208941 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/986d72a5-6f24-494d-b1bd-0ab78af24f91-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.208951 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxgzn\" (UniqueName: \"kubernetes.io/projected/986d72a5-6f24-494d-b1bd-0ab78af24f91-kube-api-access-vxgzn\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.390498 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.514544 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data\") pod \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.514676 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle\") pod \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.514791 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs\") pod \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.514943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom\") pod \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.515055 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jd8x\" (UniqueName: \"kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x\") pod \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\" (UID: \"142e25ce-1185-4a65-a83e-92eddf8cdc1d\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.517472 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs" (OuterVolumeSpecName: "logs") pod "142e25ce-1185-4a65-a83e-92eddf8cdc1d" (UID: "142e25ce-1185-4a65-a83e-92eddf8cdc1d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.519788 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x" (OuterVolumeSpecName: "kube-api-access-8jd8x") pod "142e25ce-1185-4a65-a83e-92eddf8cdc1d" (UID: "142e25ce-1185-4a65-a83e-92eddf8cdc1d"). InnerVolumeSpecName "kube-api-access-8jd8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.521039 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "142e25ce-1185-4a65-a83e-92eddf8cdc1d" (UID: "142e25ce-1185-4a65-a83e-92eddf8cdc1d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.556062 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "142e25ce-1185-4a65-a83e-92eddf8cdc1d" (UID: "142e25ce-1185-4a65-a83e-92eddf8cdc1d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.560864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data" (OuterVolumeSpecName: "config-data") pod "142e25ce-1185-4a65-a83e-92eddf8cdc1d" (UID: "142e25ce-1185-4a65-a83e-92eddf8cdc1d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.617259 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/142e25ce-1185-4a65-a83e-92eddf8cdc1d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.617571 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.617586 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jd8x\" (UniqueName: \"kubernetes.io/projected/142e25ce-1185-4a65-a83e-92eddf8cdc1d-kube-api-access-8jd8x\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.617596 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.617605 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/142e25ce-1185-4a65-a83e-92eddf8cdc1d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.803726 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.820755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle\") pod \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.820808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k47vx\" (UniqueName: \"kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx\") pod \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.821353 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom\") pod \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.821432 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data\") pod \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.821533 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs\") pod \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\" (UID: \"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a\") " Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.822311 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs" (OuterVolumeSpecName: "logs") pod "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" (UID: "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.840733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx" (OuterVolumeSpecName: "kube-api-access-k47vx") pod "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" (UID: "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a"). InnerVolumeSpecName "kube-api-access-k47vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.848294 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" (UID: "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.853675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" (UID: "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.860601 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data" (OuterVolumeSpecName: "config-data") pod "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" (UID: "b9f87cbe-d83e-456c-acc9-66dbad0e0d8a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917360 5030 generic.go:358] "Generic (PLEG): container finished" podID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerID="4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" exitCode=0 Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917397 5030 generic.go:358] "Generic (PLEG): container finished" podID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerID="caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" exitCode=143 Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917482 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917534 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerDied","Data":"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerDied","Data":"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917608 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464" event={"ID":"142e25ce-1185-4a65-a83e-92eddf8cdc1d","Type":"ContainerDied","Data":"e94cd3463a998bc5981aead4e770502bdc37c41a2ab2381f19914f968738f70a"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.917630 5030 scope.go:117] "RemoveContainer" containerID="4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.923752 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.923782 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.923796 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k47vx\" (UniqueName: \"kubernetes.io/projected/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-kube-api-access-k47vx\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.923806 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.923816 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.926863 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerStarted","Data":"5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.934735 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerID="4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" exitCode=0 Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.934775 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerID="43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" exitCode=143 Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.935129 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerDied","Data":"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.935232 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerDied","Data":"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.935148 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.935254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5" event={"ID":"b9f87cbe-d83e-456c-acc9-66dbad0e0d8a","Type":"ContainerDied","Data":"63e43cafc00c3b4916f8b0b54e8ed171d583edb60c20b6b4629e00fcc7cb8fc0"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.938182 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" event={"ID":"986d72a5-6f24-494d-b1bd-0ab78af24f91","Type":"ContainerDied","Data":"dac9f94e8a1b21b8670b573ce653a8c7f6e74c7c209d3d045221d516768c04aa"} Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.938310 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.952781 5030 scope.go:117] "RemoveContainer" containerID="caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.986039 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e9552d-0d8c-4470-aba5-9c9fbbf59707" path="/var/lib/kubelet/pods/97e9552d-0d8c-4470-aba5-9c9fbbf59707/volumes" Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.987839 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:23 crc kubenswrapper[5030]: I0316 13:24:23.987868 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-796d77cb7f-w5464"] Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.004491 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.006557 5030 scope.go:117] "RemoveContainer" containerID="4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" Mar 16 13:24:24 crc kubenswrapper[5030]: E0316 13:24:24.006956 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c\": container with ID starting with 4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c not found: ID does not exist" containerID="4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.007039 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c"} err="failed to get container status \"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c\": rpc error: code = NotFound desc = could not find container \"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c\": container with ID starting with 4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.007082 5030 scope.go:117] "RemoveContainer" containerID="caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" Mar 16 13:24:24 crc kubenswrapper[5030]: E0316 13:24:24.007794 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788\": container with ID starting with caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788 not found: ID does not exist" containerID="caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.007831 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788"} err="failed to get container status \"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788\": rpc error: code = NotFound desc = could not find container \"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788\": container with ID starting with caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788 not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.007858 5030 scope.go:117] "RemoveContainer" containerID="4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.008089 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c"} err="failed to get container status \"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c\": rpc error: code = NotFound desc = could not find container \"4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c\": container with ID starting with 4db0e5d65b2d07a66c45664ee48a56ff338b26f88f6a9457a73b33a1a465bd5c not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.008119 5030 scope.go:117] "RemoveContainer" containerID="caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.008314 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788"} err="failed to get container status \"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788\": rpc error: code = NotFound desc = could not find container \"caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788\": container with ID starting with caffbfdf9a09300de329ee6a7118fc761c73a794a408286ad62d5ec447f5e788 not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.008338 5030 scope.go:117] "RemoveContainer" containerID="4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.018386 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-77dd4ffd68-lrn5g"] Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.027817 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.032506 5030 scope.go:117] "RemoveContainer" containerID="43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.035370 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b9458658-n4vh5"] Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.051600 5030 scope.go:117] "RemoveContainer" containerID="4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" Mar 16 13:24:24 crc kubenswrapper[5030]: E0316 13:24:24.052020 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839\": container with ID starting with 4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839 not found: ID does not exist" containerID="4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052083 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839"} err="failed to get container status \"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839\": rpc error: code = NotFound desc = could not find container \"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839\": container with ID starting with 4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839 not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052112 5030 scope.go:117] "RemoveContainer" containerID="43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" Mar 16 13:24:24 crc kubenswrapper[5030]: E0316 13:24:24.052410 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee\": container with ID starting with 43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee not found: ID does not exist" containerID="43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052440 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee"} err="failed to get container status \"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee\": rpc error: code = NotFound desc = could not find container \"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee\": container with ID starting with 43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052463 5030 scope.go:117] "RemoveContainer" containerID="4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052765 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839"} err="failed to get container status \"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839\": rpc error: code = NotFound desc = could not find container \"4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839\": container with ID starting with 4ed639adec33fb93fd5a80f72a4acfa0f921f125441cbd85c72ac1925b494839 not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.052797 5030 scope.go:117] "RemoveContainer" containerID="43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.053106 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee"} err="failed to get container status \"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee\": rpc error: code = NotFound desc = could not find container \"43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee\": container with ID starting with 43778455bb46ad5accf2e6b75884db446bbc7e823e584ce44b550778ceec57ee not found: ID does not exist" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.053129 5030 scope.go:117] "RemoveContainer" containerID="02355d4d92a2ad9be9f049a402567674a05326d689eed4afc34aaac08fb1c5d3" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.070628 5030 scope.go:117] "RemoveContainer" containerID="011cc37f7c80473400d6b85f83ec6e0c0a94c550bb6f186fa21cbb61384dfcd9" Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.966267 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerStarted","Data":"a3da06a2dce939d5a51ed26dadadc2c389616533e46cc1ea2b029b2bcb00cdb0"} Mar 16 13:24:24 crc kubenswrapper[5030]: I0316 13:24:24.967806 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:25 crc kubenswrapper[5030]: I0316 13:24:25.966743 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" path="/var/lib/kubelet/pods/142e25ce-1185-4a65-a83e-92eddf8cdc1d/volumes" Mar 16 13:24:25 crc kubenswrapper[5030]: I0316 13:24:25.969237 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" path="/var/lib/kubelet/pods/986d72a5-6f24-494d-b1bd-0ab78af24f91/volumes" Mar 16 13:24:25 crc kubenswrapper[5030]: I0316 13:24:25.970124 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" path="/var/lib/kubelet/pods/b9f87cbe-d83e-456c-acc9-66dbad0e0d8a/volumes" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.082435 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.085019 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.096734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.104901 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=6.104882489 podStartE2EDuration="6.104882489s" podCreationTimestamp="2026-03-16 13:24:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:24.986983072 +0000 UTC m=+1109.386295619" watchObservedRunningTime="2026-03-16 13:24:27.104882489 +0000 UTC m=+1111.504195036" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.179692 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.188699 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.188999 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" containerID="cri-o://a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe" gracePeriod=30 Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.189335 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" containerID="cri-o://79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677" gracePeriod=30 Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.199638 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": EOF" Mar 16 13:24:27 crc kubenswrapper[5030]: I0316 13:24:27.200423 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": EOF" Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.001997 5030 generic.go:358] "Generic (PLEG): container finished" podID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerID="a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe" exitCode=143 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.002215 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerDied","Data":"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe"} Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007013 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerStarted","Data":"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232"} Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007154 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-central-agent" containerID="cri-o://22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007220 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007277 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="proxy-httpd" containerID="cri-o://efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007338 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="sg-core" containerID="cri-o://2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007397 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-notification-agent" containerID="cri-o://8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.007738 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="cinder-scheduler" containerID="cri-o://3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.008454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="probe" containerID="cri-o://9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca" gracePeriod=30 Mar 16 13:24:28 crc kubenswrapper[5030]: I0316 13:24:28.039137 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.538073118 podStartE2EDuration="45.03912136s" podCreationTimestamp="2026-03-16 13:23:43 +0000 UTC" firstStartedPulling="2026-03-16 13:23:44.056404108 +0000 UTC m=+1068.455716655" lastFinishedPulling="2026-03-16 13:24:27.557452349 +0000 UTC m=+1111.956764897" observedRunningTime="2026-03-16 13:24:28.027181653 +0000 UTC m=+1112.426494199" watchObservedRunningTime="2026-03-16 13:24:28.03912136 +0000 UTC m=+1112.438433907" Mar 16 13:24:28 crc kubenswrapper[5030]: E0316 13:24:28.490950 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6ff100c_4212_4fed_a57e_49632546fa37.slice/crio-conmon-9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e112945_f42e_4444_a7f0_2b6d01a11f2c.slice/crio-conmon-22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.019355 5030 generic.go:358] "Generic (PLEG): container finished" podID="e6ff100c-4212-4fed-a57e-49632546fa37" containerID="9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca" exitCode=0 Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.019450 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerDied","Data":"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca"} Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023335 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerID="efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232" exitCode=0 Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023362 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerID="2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07" exitCode=2 Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023369 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerID="22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8" exitCode=0 Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023528 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerDied","Data":"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232"} Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023626 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerDied","Data":"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07"} Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.023697 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerDied","Data":"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8"} Mar 16 13:24:29 crc kubenswrapper[5030]: I0316 13:24:29.980627 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.039268 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerID="8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246" exitCode=0 Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.039334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerDied","Data":"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246"} Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.039414 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.039445 5030 scope.go:117] "RemoveContainer" containerID="efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.039425 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0e112945-f42e-4444-a7f0-2b6d01a11f2c","Type":"ContainerDied","Data":"67fd9513846f656f6a7c995248e86e3a804a2c388006b29d3efbf9a922ac1406"} Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.065808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjfwg\" (UniqueName: \"kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.065889 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.065920 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066012 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066305 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle\") pod \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\" (UID: \"0e112945-f42e-4444-a7f0-2b6d01a11f2c\") " Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.066663 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.067004 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.067020 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0e112945-f42e-4444-a7f0-2b6d01a11f2c-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.067869 5030 scope.go:117] "RemoveContainer" containerID="2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.072892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg" (OuterVolumeSpecName: "kube-api-access-pjfwg") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "kube-api-access-pjfwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.078279 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts" (OuterVolumeSpecName: "scripts") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.095608 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.130256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.141474 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data" (OuterVolumeSpecName: "config-data") pod "0e112945-f42e-4444-a7f0-2b6d01a11f2c" (UID: "0e112945-f42e-4444-a7f0-2b6d01a11f2c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.150135 5030 scope.go:117] "RemoveContainer" containerID="8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169435 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169459 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjfwg\" (UniqueName: \"kubernetes.io/projected/0e112945-f42e-4444-a7f0-2b6d01a11f2c-kube-api-access-pjfwg\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169467 5030 scope.go:117] "RemoveContainer" containerID="22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169472 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169609 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.169626 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0e112945-f42e-4444-a7f0-2b6d01a11f2c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.186395 5030 scope.go:117] "RemoveContainer" containerID="efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232" Mar 16 13:24:30 crc kubenswrapper[5030]: E0316 13:24:30.186872 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232\": container with ID starting with efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232 not found: ID does not exist" containerID="efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.186909 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232"} err="failed to get container status \"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232\": rpc error: code = NotFound desc = could not find container \"efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232\": container with ID starting with efce22eaae6962aac56f0c49c0e5b8d64d7bbb4c8a9aeb69b8a0f54394ccc232 not found: ID does not exist" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.186931 5030 scope.go:117] "RemoveContainer" containerID="2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07" Mar 16 13:24:30 crc kubenswrapper[5030]: E0316 13:24:30.187273 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07\": container with ID starting with 2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07 not found: ID does not exist" containerID="2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.187312 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07"} err="failed to get container status \"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07\": rpc error: code = NotFound desc = could not find container \"2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07\": container with ID starting with 2948706c5e40c18ae03fbf0112ca04578d2ead7b279cc9ce0ea8dbce29052d07 not found: ID does not exist" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.187339 5030 scope.go:117] "RemoveContainer" containerID="8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246" Mar 16 13:24:30 crc kubenswrapper[5030]: E0316 13:24:30.187628 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246\": container with ID starting with 8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246 not found: ID does not exist" containerID="8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.187664 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246"} err="failed to get container status \"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246\": rpc error: code = NotFound desc = could not find container \"8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246\": container with ID starting with 8d16a4284e28157c01e8585c72a77e0cb50ebcbb09223d240f8a2cf2c503e246 not found: ID does not exist" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.187685 5030 scope.go:117] "RemoveContainer" containerID="22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8" Mar 16 13:24:30 crc kubenswrapper[5030]: E0316 13:24:30.187976 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8\": container with ID starting with 22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8 not found: ID does not exist" containerID="22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.188006 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8"} err="failed to get container status \"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8\": rpc error: code = NotFound desc = could not find container \"22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8\": container with ID starting with 22f4981a99d7a483dec27b5273968c9c4f69c90649baa9da145870a7c40d1ce8 not found: ID does not exist" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.375366 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.391995 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.412132 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413165 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413186 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413205 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413216 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413222 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413229 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="proxy-httpd" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413234 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="proxy-httpd" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413246 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413254 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413263 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413268 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413275 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413282 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413292 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-notification-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413298 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-notification-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413319 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="sg-core" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413324 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="sg-core" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413342 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-central-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413348 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-central-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413484 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413494 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="986d72a5-6f24-494d-b1bd-0ab78af24f91" containerName="barbican-api-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413505 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413516 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="proxy-httpd" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413524 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9f87cbe-d83e-456c-acc9-66dbad0e0d8a" containerName="barbican-keystone-listener-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413533 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-notification-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413545 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker-log" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413565 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="ceilometer-central-agent" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413573 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="142e25ce-1185-4a65-a83e-92eddf8cdc1d" containerName="barbican-worker" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.413581 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" containerName="sg-core" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.418578 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.421477 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.422061 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.426302 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.475478 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.475600 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcmrb\" (UniqueName: \"kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.475650 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.475857 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.476024 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.476121 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.476149 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577540 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcmrb\" (UniqueName: \"kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577639 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577922 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577938 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.577978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.578511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.578575 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.581995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.582180 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.587151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.588319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.592657 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcmrb\" (UniqueName: \"kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb\") pod \"ceilometer-0\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.739346 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:30 crc kubenswrapper[5030]: I0316 13:24:30.988105 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.057416 5030 generic.go:358] "Generic (PLEG): container finished" podID="e6ff100c-4212-4fed-a57e-49632546fa37" containerID="3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73" exitCode=0 Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.057766 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerDied","Data":"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73"} Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.057802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e6ff100c-4212-4fed-a57e-49632546fa37","Type":"ContainerDied","Data":"4bf25f2af58e2a6234b7ff213ad5a21ff2053ba443fc5073f124a9a8e5da4324"} Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.057823 5030 scope.go:117] "RemoveContainer" containerID="9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.057943 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086528 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-874cw\" (UniqueName: \"kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086658 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086800 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086877 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.086979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id\") pod \"e6ff100c-4212-4fed-a57e-49632546fa37\" (UID: \"e6ff100c-4212-4fed-a57e-49632546fa37\") " Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.090811 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.095352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw" (OuterVolumeSpecName: "kube-api-access-874cw") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "kube-api-access-874cw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.095564 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts" (OuterVolumeSpecName: "scripts") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.099723 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.103958 5030 scope.go:117] "RemoveContainer" containerID="3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.127793 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.133929 5030 scope.go:117] "RemoveContainer" containerID="9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca" Mar 16 13:24:31 crc kubenswrapper[5030]: E0316 13:24:31.134966 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca\": container with ID starting with 9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca not found: ID does not exist" containerID="9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.135003 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca"} err="failed to get container status \"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca\": rpc error: code = NotFound desc = could not find container \"9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca\": container with ID starting with 9c59043fcfc9c96cbf15493fc3dcd8312776ec5f1a4585057328c636b991e9ca not found: ID does not exist" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.135050 5030 scope.go:117] "RemoveContainer" containerID="3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73" Mar 16 13:24:31 crc kubenswrapper[5030]: E0316 13:24:31.135641 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73\": container with ID starting with 3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73 not found: ID does not exist" containerID="3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.135789 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73"} err="failed to get container status \"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73\": rpc error: code = NotFound desc = could not find container \"3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73\": container with ID starting with 3d9c86959ea32a38cd5540d219df9f0d495ed2c4d4c2bfd3621079d879cdcf73 not found: ID does not exist" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.163153 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:31 crc kubenswrapper[5030]: W0316 13:24:31.166239 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1fdd221_6e5b_4328_875d_96b588cbdd46.slice/crio-ac41fece9af68b5c24e9b1413324274269a26736aa711f210e4af6e6034f8d4e WatchSource:0}: Error finding container ac41fece9af68b5c24e9b1413324274269a26736aa711f210e4af6e6034f8d4e: Status 404 returned error can't find the container with id ac41fece9af68b5c24e9b1413324274269a26736aa711f210e4af6e6034f8d4e Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.176831 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data" (OuterVolumeSpecName: "config-data") pod "e6ff100c-4212-4fed-a57e-49632546fa37" (UID: "e6ff100c-4212-4fed-a57e-49632546fa37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190483 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190507 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190517 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190530 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6ff100c-4212-4fed-a57e-49632546fa37-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190538 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e6ff100c-4212-4fed-a57e-49632546fa37-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.190558 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-874cw\" (UniqueName: \"kubernetes.io/projected/e6ff100c-4212-4fed-a57e-49632546fa37-kube-api-access-874cw\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.392927 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.400698 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.412670 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413594 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="probe" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413611 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="probe" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413628 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="cinder-scheduler" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413634 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="cinder-scheduler" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413785 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="cinder-scheduler" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.413803 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" containerName="probe" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.417678 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.419369 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.421918 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497020 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzd95\" (UniqueName: \"kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497099 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497252 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.497419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.594802 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:60154->10.217.0.154:9311: read: connection reset by peer" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.594845 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.154:9311/healthcheck\": read tcp 10.217.0.2:60166->10.217.0.154:9311: read: connection reset by peer" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.599412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.599480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.599684 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.599771 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.599876 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.600359 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzd95\" (UniqueName: \"kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.600514 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.604728 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.605178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.607519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.607732 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.619286 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzd95\" (UniqueName: \"kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95\") pod \"cinder-scheduler-0\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.739923 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.881507 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.960627 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e112945-f42e-4444-a7f0-2b6d01a11f2c" path="/var/lib/kubelet/pods/0e112945-f42e-4444-a7f0-2b6d01a11f2c/volumes" Mar 16 13:24:31 crc kubenswrapper[5030]: I0316 13:24:31.962296 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ff100c-4212-4fed-a57e-49632546fa37" path="/var/lib/kubelet/pods/e6ff100c-4212-4fed-a57e-49632546fa37/volumes" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.011617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle\") pod \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.011794 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom\") pod \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.012100 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs\") pod \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.012155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs8w9\" (UniqueName: \"kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9\") pod \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.012277 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data\") pod \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\" (UID: \"abfd180c-c7bf-416e-9e0d-c0d8d1834f25\") " Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.013183 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs" (OuterVolumeSpecName: "logs") pod "abfd180c-c7bf-416e-9e0d-c0d8d1834f25" (UID: "abfd180c-c7bf-416e-9e0d-c0d8d1834f25"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.017640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9" (OuterVolumeSpecName: "kube-api-access-fs8w9") pod "abfd180c-c7bf-416e-9e0d-c0d8d1834f25" (UID: "abfd180c-c7bf-416e-9e0d-c0d8d1834f25"). InnerVolumeSpecName "kube-api-access-fs8w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.018215 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "abfd180c-c7bf-416e-9e0d-c0d8d1834f25" (UID: "abfd180c-c7bf-416e-9e0d-c0d8d1834f25"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.036861 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "abfd180c-c7bf-416e-9e0d-c0d8d1834f25" (UID: "abfd180c-c7bf-416e-9e0d-c0d8d1834f25"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.053370 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data" (OuterVolumeSpecName: "config-data") pod "abfd180c-c7bf-416e-9e0d-c0d8d1834f25" (UID: "abfd180c-c7bf-416e-9e0d-c0d8d1834f25"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.070241 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerStarted","Data":"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2"} Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.070314 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerStarted","Data":"ac41fece9af68b5c24e9b1413324274269a26736aa711f210e4af6e6034f8d4e"} Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.073261 5030 generic.go:358] "Generic (PLEG): container finished" podID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerID="79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677" exitCode=0 Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.073375 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.073362 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerDied","Data":"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677"} Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.073534 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz" event={"ID":"abfd180c-c7bf-416e-9e0d-c0d8d1834f25","Type":"ContainerDied","Data":"364c311b352c96fe0a9bb3f7324e92e768a9694b5d1d79873b203f7dd5d5566f"} Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.073595 5030 scope.go:117] "RemoveContainer" containerID="79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.109633 5030 scope.go:117] "RemoveContainer" containerID="a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.112851 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.115428 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.115456 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.115465 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.115475 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs8w9\" (UniqueName: \"kubernetes.io/projected/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-kube-api-access-fs8w9\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.115487 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/abfd180c-c7bf-416e-9e0d-c0d8d1834f25-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.118728 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6f6766d59b-kb4fz"] Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.145137 5030 scope.go:117] "RemoveContainer" containerID="79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677" Mar 16 13:24:32 crc kubenswrapper[5030]: E0316 13:24:32.145691 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677\": container with ID starting with 79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677 not found: ID does not exist" containerID="79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.145743 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677"} err="failed to get container status \"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677\": rpc error: code = NotFound desc = could not find container \"79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677\": container with ID starting with 79009c6c6a59ffec28c6e117944ff203c8ca40d8bf31a78bdbc2d3e54b440677 not found: ID does not exist" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.145778 5030 scope.go:117] "RemoveContainer" containerID="a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe" Mar 16 13:24:32 crc kubenswrapper[5030]: E0316 13:24:32.146427 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe\": container with ID starting with a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe not found: ID does not exist" containerID="a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.146563 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe"} err="failed to get container status \"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe\": rpc error: code = NotFound desc = could not find container \"a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe\": container with ID starting with a79878b562c5d5943097e2fd18609270727e7bf23ccb3653e92614715570ccbe not found: ID does not exist" Mar 16 13:24:32 crc kubenswrapper[5030]: I0316 13:24:32.184057 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:24:32 crc kubenswrapper[5030]: W0316 13:24:32.186963 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39bbebf_a149_44b0_9982_5740bc7e9aed.slice/crio-2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3 WatchSource:0}: Error finding container 2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3: Status 404 returned error can't find the container with id 2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3 Mar 16 13:24:33 crc kubenswrapper[5030]: I0316 13:24:33.104850 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerStarted","Data":"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0"} Mar 16 13:24:33 crc kubenswrapper[5030]: I0316 13:24:33.112834 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerStarted","Data":"c2cd43506a91a5e11cfa5e16233edd85796456e9f6d9e96f25e8c54765c60a49"} Mar 16 13:24:33 crc kubenswrapper[5030]: I0316 13:24:33.112861 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerStarted","Data":"2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3"} Mar 16 13:24:33 crc kubenswrapper[5030]: I0316 13:24:33.559655 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:24:33 crc kubenswrapper[5030]: I0316 13:24:33.973326 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" path="/var/lib/kubelet/pods/abfd180c-c7bf-416e-9e0d-c0d8d1834f25/volumes" Mar 16 13:24:34 crc kubenswrapper[5030]: I0316 13:24:34.126934 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerStarted","Data":"081371a1bc630f0222de645b48a9ead168f8f5b9467629eb604488759f57432a"} Mar 16 13:24:34 crc kubenswrapper[5030]: I0316 13:24:34.130839 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerStarted","Data":"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b"} Mar 16 13:24:34 crc kubenswrapper[5030]: I0316 13:24:34.148640 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.148625872 podStartE2EDuration="3.148625872s" podCreationTimestamp="2026-03-16 13:24:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:34.141386111 +0000 UTC m=+1118.540698657" watchObservedRunningTime="2026-03-16 13:24:34.148625872 +0000 UTC m=+1118.547938420" Mar 16 13:24:35 crc kubenswrapper[5030]: I0316 13:24:35.147616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerStarted","Data":"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34"} Mar 16 13:24:35 crc kubenswrapper[5030]: I0316 13:24:35.147733 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:35 crc kubenswrapper[5030]: I0316 13:24:35.175422 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.467188492 podStartE2EDuration="5.175401524s" podCreationTimestamp="2026-03-16 13:24:30 +0000 UTC" firstStartedPulling="2026-03-16 13:24:31.168465223 +0000 UTC m=+1115.567777770" lastFinishedPulling="2026-03-16 13:24:34.876678255 +0000 UTC m=+1119.275990802" observedRunningTime="2026-03-16 13:24:35.168188182 +0000 UTC m=+1119.567500729" watchObservedRunningTime="2026-03-16 13:24:35.175401524 +0000 UTC m=+1119.574714071" Mar 16 13:24:36 crc kubenswrapper[5030]: I0316 13:24:36.741616 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.315467 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.316732 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.418762 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.610235 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.611659 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.611784 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.611851 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.611908 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.615056 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.615628 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="abfd180c-c7bf-416e-9e0d-c0d8d1834f25" containerName="barbican-api-log" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.622030 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.633194 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.677829 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndkr8\" (UniqueName: \"kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.678274 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.678432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.678570 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.678823 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.678946 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.679162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782047 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782377 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndkr8\" (UniqueName: \"kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782404 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782479 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.782618 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.787827 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.787906 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.788437 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.788536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.788877 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.793512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.796844 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndkr8\" (UniqueName: \"kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8\") pod \"neutron-67fb697f74-rtq89\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:38 crc kubenswrapper[5030]: I0316 13:24:38.943326 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:39 crc kubenswrapper[5030]: I0316 13:24:39.189861 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-api" containerID="cri-o://7cb026f33377be0a61f743f7620d8e600836a6c8c5a72279227ef694955be0c5" gracePeriod=30 Mar 16 13:24:39 crc kubenswrapper[5030]: I0316 13:24:39.190331 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-httpd" containerID="cri-o://bf80b8cf468fd33fa53393ea23b03f7d5efa9196a220b7bb218d18f1006bf3cc" gracePeriod=30 Mar 16 13:24:39 crc kubenswrapper[5030]: I0316 13:24:39.350534 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:24:39 crc kubenswrapper[5030]: W0316 13:24:39.353446 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b653b63_2051_4924_905d_94b6a7dac92a.slice/crio-47dff6d4b47af137d1efe767f0a6477435ec7e0490da504383d65be2fc055a1b WatchSource:0}: Error finding container 47dff6d4b47af137d1efe767f0a6477435ec7e0490da504383d65be2fc055a1b: Status 404 returned error can't find the container with id 47dff6d4b47af137d1efe767f0a6477435ec7e0490da504383d65be2fc055a1b Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.201263 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerStarted","Data":"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5"} Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.201802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerStarted","Data":"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785"} Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.201856 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.201869 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerStarted","Data":"47dff6d4b47af137d1efe767f0a6477435ec7e0490da504383d65be2fc055a1b"} Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.202983 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerID="bf80b8cf468fd33fa53393ea23b03f7d5efa9196a220b7bb218d18f1006bf3cc" exitCode=0 Mar 16 13:24:40 crc kubenswrapper[5030]: I0316 13:24:40.203278 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerDied","Data":"bf80b8cf468fd33fa53393ea23b03f7d5efa9196a220b7bb218d18f1006bf3cc"} Mar 16 13:24:41 crc kubenswrapper[5030]: I0316 13:24:41.955638 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:24:41 crc kubenswrapper[5030]: I0316 13:24:41.976126 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" podStartSLOduration=3.976108177 podStartE2EDuration="3.976108177s" podCreationTimestamp="2026-03-16 13:24:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:40.223171327 +0000 UTC m=+1124.622483874" watchObservedRunningTime="2026-03-16 13:24:41.976108177 +0000 UTC m=+1126.375420724" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.226954 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerID="7cb026f33377be0a61f743f7620d8e600836a6c8c5a72279227ef694955be0c5" exitCode=0 Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.227634 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerDied","Data":"7cb026f33377be0a61f743f7620d8e600836a6c8c5a72279227ef694955be0c5"} Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.342156 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.456754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs\") pod \"4ce50906-f53e-4fca-86d0-207cc3a1a590\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.457019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config\") pod \"4ce50906-f53e-4fca-86d0-207cc3a1a590\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.457124 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config\") pod \"4ce50906-f53e-4fca-86d0-207cc3a1a590\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.457295 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw4pr\" (UniqueName: \"kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr\") pod \"4ce50906-f53e-4fca-86d0-207cc3a1a590\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.457346 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle\") pod \"4ce50906-f53e-4fca-86d0-207cc3a1a590\" (UID: \"4ce50906-f53e-4fca-86d0-207cc3a1a590\") " Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.464690 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr" (OuterVolumeSpecName: "kube-api-access-nw4pr") pod "4ce50906-f53e-4fca-86d0-207cc3a1a590" (UID: "4ce50906-f53e-4fca-86d0-207cc3a1a590"). InnerVolumeSpecName "kube-api-access-nw4pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.478454 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "4ce50906-f53e-4fca-86d0-207cc3a1a590" (UID: "4ce50906-f53e-4fca-86d0-207cc3a1a590"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.506584 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config" (OuterVolumeSpecName: "config") pod "4ce50906-f53e-4fca-86d0-207cc3a1a590" (UID: "4ce50906-f53e-4fca-86d0-207cc3a1a590"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.515508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4ce50906-f53e-4fca-86d0-207cc3a1a590" (UID: "4ce50906-f53e-4fca-86d0-207cc3a1a590"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.515938 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "4ce50906-f53e-4fca-86d0-207cc3a1a590" (UID: "4ce50906-f53e-4fca-86d0-207cc3a1a590"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.562624 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.562658 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw4pr\" (UniqueName: \"kubernetes.io/projected/4ce50906-f53e-4fca-86d0-207cc3a1a590-kube-api-access-nw4pr\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.562671 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.562710 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:42 crc kubenswrapper[5030]: I0316 13:24:42.562720 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/4ce50906-f53e-4fca-86d0-207cc3a1a590-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.243433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" event={"ID":"4ce50906-f53e-4fca-86d0-207cc3a1a590","Type":"ContainerDied","Data":"6681b9372c7cc62c3ada5af0c556eb420de48e50682cac1862cb7b33cd843597"} Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.243488 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf" Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.243530 5030 scope.go:117] "RemoveContainer" containerID="bf80b8cf468fd33fa53393ea23b03f7d5efa9196a220b7bb218d18f1006bf3cc" Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.280335 5030 scope.go:117] "RemoveContainer" containerID="7cb026f33377be0a61f743f7620d8e600836a6c8c5a72279227ef694955be0c5" Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.284317 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.292652 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-5dddb55dfc-qk6lf"] Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.523007 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:43 crc kubenswrapper[5030]: I0316 13:24:43.956877 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" path="/var/lib/kubelet/pods/4ce50906-f53e-4fca-86d0-207cc3a1a590/volumes" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.332099 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.565774 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567055 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-api" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567206 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-api" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567282 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-httpd" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567333 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-httpd" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567622 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-httpd" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.567704 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ce50906-f53e-4fca-86d0-207cc3a1a590" containerName="neutron-api" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.573318 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.582978 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.701475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rnq9\" (UniqueName: \"kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.701530 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.701688 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.701749 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.701800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.702517 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.702686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.805260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.805331 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.805454 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rnq9\" (UniqueName: \"kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.805478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.806287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.805544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.806486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.806537 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.813396 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.813665 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.813700 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.814021 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.814694 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.825460 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rnq9\" (UniqueName: \"kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9\") pod \"placement-55cdc976c4-98djv\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:44 crc kubenswrapper[5030]: I0316 13:24:44.889224 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:45 crc kubenswrapper[5030]: I0316 13:24:45.301381 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:24:45 crc kubenswrapper[5030]: W0316 13:24:45.305444 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a23a1a1_8e33_4bed_a738_d044523febe8.slice/crio-9f5e0d9ef0f5db83e9d085ae638212dbbd801c94ad7ac7cee7918489752d23ef WatchSource:0}: Error finding container 9f5e0d9ef0f5db83e9d085ae638212dbbd801c94ad7ac7cee7918489752d23ef: Status 404 returned error can't find the container with id 9f5e0d9ef0f5db83e9d085ae638212dbbd801c94ad7ac7cee7918489752d23ef Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.277280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerStarted","Data":"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b"} Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.277632 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.277649 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerStarted","Data":"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267"} Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.277661 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.277671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerStarted","Data":"9f5e0d9ef0f5db83e9d085ae638212dbbd801c94ad7ac7cee7918489752d23ef"} Mar 16 13:24:46 crc kubenswrapper[5030]: I0316 13:24:46.307257 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" podStartSLOduration=2.307242342 podStartE2EDuration="2.307242342s" podCreationTimestamp="2026-03-16 13:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:46.295615312 +0000 UTC m=+1130.694927859" watchObservedRunningTime="2026-03-16 13:24:46.307242342 +0000 UTC m=+1130.706554888" Mar 16 13:24:51 crc kubenswrapper[5030]: I0316 13:24:51.052064 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.408427 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.422095 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.427885 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-rwvjq\"" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.428114 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.429064 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.437113 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.474408 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.474459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcgkc\" (UniqueName: \"kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.474631 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.474720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.582279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.582332 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcgkc\" (UniqueName: \"kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.582563 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.582716 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.586599 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.595043 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.597412 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.600728 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcgkc\" (UniqueName: \"kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc\") pod \"openstackclient\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.746934 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.794739 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.802236 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.853820 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.860203 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.870424 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:52 crc kubenswrapper[5030]: E0316 13:24:52.898934 5030 log.go:32] "RunPodSandbox from runtime service failed" err=< Mar 16 13:24:52 crc kubenswrapper[5030]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_2362f4a9-ba0b-4423-b5b7-026486ef0bc4_0(80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad" Netns:"/var/run/netns/5655cccc-08a8-41c2-9c0f-c5dd9fefcf5a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad;K8S_POD_UID=2362f4a9-ba0b-4423-b5b7-026486ef0bc4" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: Multus: [openstack-kuttl-tests/openstackclient/2362f4a9-ba0b-4423-b5b7-026486ef0bc4]: expected pod UID "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" but got "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" from Kube API Mar 16 13:24:52 crc kubenswrapper[5030]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 13:24:52 crc kubenswrapper[5030]: > Mar 16 13:24:52 crc kubenswrapper[5030]: E0316 13:24:52.899023 5030 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err=< Mar 16 13:24:52 crc kubenswrapper[5030]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_2362f4a9-ba0b-4423-b5b7-026486ef0bc4_0(80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad" Netns:"/var/run/netns/5655cccc-08a8-41c2-9c0f-c5dd9fefcf5a" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=80a39d61b4a129c341d44b264a50009b894007e39244dc3a19878e4a3ae00fad;K8S_POD_UID=2362f4a9-ba0b-4423-b5b7-026486ef0bc4" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: Multus: [openstack-kuttl-tests/openstackclient/2362f4a9-ba0b-4423-b5b7-026486ef0bc4]: expected pod UID "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" but got "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" from Kube API Mar 16 13:24:52 crc kubenswrapper[5030]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 13:24:52 crc kubenswrapper[5030]: > pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:52 crc kubenswrapper[5030]: I0316 13:24:52.999596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.000391 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.000607 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8cr\" (UniqueName: \"kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.000710 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.102309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.102428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.102534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8cr\" (UniqueName: \"kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.102602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.103583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.108821 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.109982 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.118404 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8cr\" (UniqueName: \"kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr\") pod \"openstackclient\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.182105 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.355605 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.359579 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="2362f4a9-ba0b-4423-b5b7-026486ef0bc4" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.367631 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.512277 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcgkc\" (UniqueName: \"kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc\") pod \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.512330 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config\") pod \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.512624 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret\") pod \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.512955 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle\") pod \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\" (UID: \"2362f4a9-ba0b-4423-b5b7-026486ef0bc4\") " Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.514314 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" (UID: "2362f4a9-ba0b-4423-b5b7-026486ef0bc4"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.519231 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" (UID: "2362f4a9-ba0b-4423-b5b7-026486ef0bc4"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.519255 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" (UID: "2362f4a9-ba0b-4423-b5b7-026486ef0bc4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.520056 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc" (OuterVolumeSpecName: "kube-api-access-hcgkc") pod "2362f4a9-ba0b-4423-b5b7-026486ef0bc4" (UID: "2362f4a9-ba0b-4423-b5b7-026486ef0bc4"). InnerVolumeSpecName "kube-api-access-hcgkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.618036 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.618079 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.618093 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcgkc\" (UniqueName: \"kubernetes.io/projected/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-kube-api-access-hcgkc\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.618104 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/2362f4a9-ba0b-4423-b5b7-026486ef0bc4-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.623004 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:24:53 crc kubenswrapper[5030]: I0316 13:24:53.958230 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2362f4a9-ba0b-4423-b5b7-026486ef0bc4" path="/var/lib/kubelet/pods/2362f4a9-ba0b-4423-b5b7-026486ef0bc4/volumes" Mar 16 13:24:54 crc kubenswrapper[5030]: E0316 13:24:54.223875 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1604571 actualBytes=10240 Mar 16 13:24:54 crc kubenswrapper[5030]: I0316 13:24:54.369694 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:24:54 crc kubenswrapper[5030]: I0316 13:24:54.370821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"10bc4a31-e3b9-4205-9e63-c7e92bffbf10","Type":"ContainerStarted","Data":"e8908e847bb2dabc673218764da0ce46415bfd85c00cd72e7b9b2e9c7cdd1e2b"} Mar 16 13:24:54 crc kubenswrapper[5030]: I0316 13:24:54.378042 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="2362f4a9-ba0b-4423-b5b7-026486ef0bc4" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.204370 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.204959 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-central-agent" containerID="cri-o://abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" gracePeriod=30 Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.205746 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="proxy-httpd" containerID="cri-o://54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" gracePeriod=30 Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.205824 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="sg-core" containerID="cri-o://d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" gracePeriod=30 Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.205866 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-notification-agent" containerID="cri-o://38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" gracePeriod=30 Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.222272 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.388697 5030 generic.go:358] "Generic (PLEG): container finished" podID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" exitCode=2 Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.388986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerDied","Data":"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b"} Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.754378 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.766021 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.769760 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.770417 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.770677 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.778403 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870238 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870288 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870410 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4td4v\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870537 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870605 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.870932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.972704 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.972949 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973048 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973142 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973235 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973330 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.973478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4td4v\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.975561 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.976138 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.978213 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.979416 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:24:55 crc kubenswrapper[5030]: I0316 13:24:55.979817 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.001483 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.003696 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.012908 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.016531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.022940 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.023502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.032257 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4td4v\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v\") pod \"swift-proxy-9d7784f86-5p7k4\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.097295 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.142533 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.143052 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-log" containerID="cri-o://f7b6c723825e64c4f191cc08a5c95b024c6be5bc5b535819d35df87d34cac345" gracePeriod=30 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.143571 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-httpd" containerID="cri-o://7c864b50f5b76910dd637af7b286a957e7268814f6ea45edf4c9d3b029e0dd3e" gracePeriod=30 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.179394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180179 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180292 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180315 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180333 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180541 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.180803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcmrb\" (UniqueName: \"kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb\") pod \"e1fdd221-6e5b-4328-875d-96b588cbdd46\" (UID: \"e1fdd221-6e5b-4328-875d-96b588cbdd46\") " Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.183966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.184254 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.190642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts" (OuterVolumeSpecName: "scripts") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.190767 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb" (OuterVolumeSpecName: "kube-api-access-mcmrb") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "kube-api-access-mcmrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.218021 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.292805 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.292841 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/e1fdd221-6e5b-4328-875d-96b588cbdd46-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.292853 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.292864 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcmrb\" (UniqueName: \"kubernetes.io/projected/e1fdd221-6e5b-4328-875d-96b588cbdd46-kube-api-access-mcmrb\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.292873 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.321806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data" (OuterVolumeSpecName: "config-data") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.331112 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e1fdd221-6e5b-4328-875d-96b588cbdd46" (UID: "e1fdd221-6e5b-4328-875d-96b588cbdd46"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.395957 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.395989 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e1fdd221-6e5b-4328-875d-96b588cbdd46-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.411478 5030 generic.go:358] "Generic (PLEG): container finished" podID="89d87382-e395-460d-b200-da5fc695112e" containerID="f7b6c723825e64c4f191cc08a5c95b024c6be5bc5b535819d35df87d34cac345" exitCode=143 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.411617 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerDied","Data":"f7b6c723825e64c4f191cc08a5c95b024c6be5bc5b535819d35df87d34cac345"} Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419769 5030 generic.go:358] "Generic (PLEG): container finished" podID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" exitCode=0 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419797 5030 generic.go:358] "Generic (PLEG): container finished" podID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" exitCode=0 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419805 5030 generic.go:358] "Generic (PLEG): container finished" podID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" exitCode=0 Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerDied","Data":"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34"} Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419948 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerDied","Data":"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0"} Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerDied","Data":"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2"} Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"e1fdd221-6e5b-4328-875d-96b588cbdd46","Type":"ContainerDied","Data":"ac41fece9af68b5c24e9b1413324274269a26736aa711f210e4af6e6034f8d4e"} Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.419986 5030 scope.go:117] "RemoveContainer" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.420123 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.465238 5030 scope.go:117] "RemoveContainer" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.471970 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.478869 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.484676 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485742 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="proxy-httpd" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485760 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="proxy-httpd" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485789 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-central-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485795 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-central-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485814 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="sg-core" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485820 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="sg-core" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485832 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-notification-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.485839 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-notification-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.486017 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-notification-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.486028 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="ceilometer-central-agent" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.486040 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="sg-core" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.486050 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" containerName="proxy-httpd" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.503251 5030 scope.go:117] "RemoveContainer" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.525408 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.525584 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.531109 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.532615 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.537194 5030 scope.go:117] "RemoveContainer" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.565852 5030 scope.go:117] "RemoveContainer" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" Mar 16 13:24:56 crc kubenswrapper[5030]: E0316 13:24:56.571848 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": container with ID starting with 54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34 not found: ID does not exist" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.571900 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34"} err="failed to get container status \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": rpc error: code = NotFound desc = could not find container \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": container with ID starting with 54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.571939 5030 scope.go:117] "RemoveContainer" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" Mar 16 13:24:56 crc kubenswrapper[5030]: E0316 13:24:56.572297 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": container with ID starting with d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b not found: ID does not exist" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.572340 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b"} err="failed to get container status \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": rpc error: code = NotFound desc = could not find container \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": container with ID starting with d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.572371 5030 scope.go:117] "RemoveContainer" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" Mar 16 13:24:56 crc kubenswrapper[5030]: E0316 13:24:56.572823 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": container with ID starting with 38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0 not found: ID does not exist" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.572850 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0"} err="failed to get container status \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": rpc error: code = NotFound desc = could not find container \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": container with ID starting with 38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.572865 5030 scope.go:117] "RemoveContainer" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" Mar 16 13:24:56 crc kubenswrapper[5030]: E0316 13:24:56.576981 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": container with ID starting with abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2 not found: ID does not exist" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577014 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2"} err="failed to get container status \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": rpc error: code = NotFound desc = could not find container \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": container with ID starting with abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577040 5030 scope.go:117] "RemoveContainer" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577653 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34"} err="failed to get container status \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": rpc error: code = NotFound desc = could not find container \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": container with ID starting with 54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577675 5030 scope.go:117] "RemoveContainer" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577940 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b"} err="failed to get container status \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": rpc error: code = NotFound desc = could not find container \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": container with ID starting with d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.577957 5030 scope.go:117] "RemoveContainer" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.578246 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0"} err="failed to get container status \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": rpc error: code = NotFound desc = could not find container \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": container with ID starting with 38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.578262 5030 scope.go:117] "RemoveContainer" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.578598 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2"} err="failed to get container status \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": rpc error: code = NotFound desc = could not find container \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": container with ID starting with abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.578616 5030 scope.go:117] "RemoveContainer" containerID="54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.579065 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34"} err="failed to get container status \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": rpc error: code = NotFound desc = could not find container \"54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34\": container with ID starting with 54ef7de2337f29a417b1f35547d51780f467a27e3fbcb57cf71643244451cf34 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.579093 5030 scope.go:117] "RemoveContainer" containerID="d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.583756 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b"} err="failed to get container status \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": rpc error: code = NotFound desc = could not find container \"d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b\": container with ID starting with d165835e817c3961cfdd72f88fcba2faf548671546c6e4b8ddd555d0aa20d97b not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.583777 5030 scope.go:117] "RemoveContainer" containerID="38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.584382 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0"} err="failed to get container status \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": rpc error: code = NotFound desc = could not find container \"38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0\": container with ID starting with 38409a4e8465114c3d3baf104d2cf5999889b51baf856c78dd94d4ebd39c14d0 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.584431 5030 scope.go:117] "RemoveContainer" containerID="abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.584987 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2"} err="failed to get container status \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": rpc error: code = NotFound desc = could not find container \"abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2\": container with ID starting with abf687ac9340fff6af552818f54743963e2be59e534a481e0fdcdaae55a350c2 not found: ID does not exist" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.635780 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703333 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703474 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703511 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8qp\" (UniqueName: \"kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703578 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703600 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.703992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.806407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.806970 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.806984 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807055 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807145 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807189 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8qp\" (UniqueName: \"kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807240 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807266 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.807940 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.814196 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.814203 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.814914 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.817404 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.823974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8qp\" (UniqueName: \"kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp\") pod \"ceilometer-0\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:56 crc kubenswrapper[5030]: I0316 13:24:56.841529 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.280953 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:57 crc kubenswrapper[5030]: W0316 13:24:57.281972 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded20a7be_0454_481c_8c44_541f51298a27.slice/crio-0703b237c5c1a5fdf04a71c9e8ce10b8bea02922397794419b9c3c1c985d2be0 WatchSource:0}: Error finding container 0703b237c5c1a5fdf04a71c9e8ce10b8bea02922397794419b9c3c1c985d2be0: Status 404 returned error can't find the container with id 0703b237c5c1a5fdf04a71c9e8ce10b8bea02922397794419b9c3c1c985d2be0 Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.445150 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerStarted","Data":"03bec67835cdc8e8d65802af5d0b340b126b95f546733b446cc78e5cdeb431ae"} Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.445200 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerStarted","Data":"47e275d6b60aa76a49a572f37a65e31aa3f43d845288dab61d5e5b368e6d66ee"} Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.445212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerStarted","Data":"0eb5dc823df80c08d7cbc1db7ae239d02572f9d48b61be005ea17f0ad7a6414f"} Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.446061 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.446101 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.447673 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerStarted","Data":"0703b237c5c1a5fdf04a71c9e8ce10b8bea02922397794419b9c3c1c985d2be0"} Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.465925 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" podStartSLOduration=2.465905058 podStartE2EDuration="2.465905058s" podCreationTimestamp="2026-03-16 13:24:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:24:57.459709249 +0000 UTC m=+1141.859021797" watchObservedRunningTime="2026-03-16 13:24:57.465905058 +0000 UTC m=+1141.865217605" Mar 16 13:24:57 crc kubenswrapper[5030]: I0316 13:24:57.960520 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1fdd221-6e5b-4328-875d-96b588cbdd46" path="/var/lib/kubelet/pods/e1fdd221-6e5b-4328-875d-96b588cbdd46/volumes" Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.460463 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerStarted","Data":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.931396 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z4pfn"] Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.935686 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.943187 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z4pfn"] Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.961633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lblqc\" (UniqueName: \"kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:58 crc kubenswrapper[5030]: I0316 13:24:58.961798 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.041578 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-94zql"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.062653 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.063565 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lblqc\" (UniqueName: \"kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.064002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.063671 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.065010 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.071353 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.074302 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.080456 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-94zql"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.081182 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lblqc\" (UniqueName: \"kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc\") pod \"nova-api-db-create-z4pfn\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.093609 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.140498 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2jzx2"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.146909 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.153050 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2jzx2"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7m4x\" (UniqueName: \"kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165327 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165455 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9jrn\" (UniqueName: \"kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165600 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgq5m\" (UniqueName: \"kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165739 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.165923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.251526 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.255980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.258133 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.265542 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.266900 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9jrn\" (UniqueName: \"kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgq5m\" (UniqueName: \"kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269312 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tr47\" (UniqueName: \"kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269564 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269727 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7m4x\" (UniqueName: \"kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.269812 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.270570 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.268420 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.271234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.294716 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.313008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgq5m\" (UniqueName: \"kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m\") pod \"nova-cell1-db-create-2jzx2\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.331392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9jrn\" (UniqueName: \"kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn\") pod \"nova-cell0-db-create-94zql\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.334612 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.335098 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-log" containerID="cri-o://b8fb4f8fa4e38f0365461f3d55fa251a66c71a6da73229cd605c8cd9cbf8b28a" gracePeriod=30 Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.339271 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-httpd" containerID="cri-o://e52b42ff212eadd8d8f3817e8be04e31e89df58e5ad9fda1dd4278d8c0b7dffc" gracePeriod=30 Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.346897 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7m4x\" (UniqueName: \"kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x\") pod \"nova-api-e1f5-account-create-update-gmzxn\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.373796 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.376130 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tr47\" (UniqueName: \"kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.374435 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.395363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tr47\" (UniqueName: \"kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47\") pod \"nova-cell0-2bb0-account-create-update-xwq6z\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.445424 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.450383 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.453323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.466741 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.471276 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.484831 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.486329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7blz\" (UniqueName: \"kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.486493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.497813 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.501216 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerStarted","Data":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.503132 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerID="b8fb4f8fa4e38f0365461f3d55fa251a66c71a6da73229cd605c8cd9cbf8b28a" exitCode=143 Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.503285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerDied","Data":"b8fb4f8fa4e38f0365461f3d55fa251a66c71a6da73229cd605c8cd9cbf8b28a"} Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.509799 5030 generic.go:358] "Generic (PLEG): container finished" podID="89d87382-e395-460d-b200-da5fc695112e" containerID="7c864b50f5b76910dd637af7b286a957e7268814f6ea45edf4c9d3b029e0dd3e" exitCode=0 Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.510140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerDied","Data":"7c864b50f5b76910dd637af7b286a957e7268814f6ea45edf4c9d3b029e0dd3e"} Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.592763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7blz\" (UniqueName: \"kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.592907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.593725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.599097 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.627025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7blz\" (UniqueName: \"kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz\") pod \"nova-cell1-c844-account-create-update-fwxmw\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.688730 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.755021 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z4pfn"] Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.800023 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:24:59 crc kubenswrapper[5030]: W0316 13:24:59.806504 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod046e6707_eca4_490a_accc_17495f250c9f.slice/crio-8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882 WatchSource:0}: Error finding container 8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882: Status 404 returned error can't find the container with id 8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882 Mar 16 13:24:59 crc kubenswrapper[5030]: I0316 13:24:59.902253 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.013827 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.013890 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.013919 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.014025 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85qqx\" (UniqueName: \"kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.014182 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.014275 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.014332 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.014417 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.015006 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.022393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs" (OuterVolumeSpecName: "logs") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.026416 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.028639 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts" (OuterVolumeSpecName: "scripts") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.032580 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx" (OuterVolumeSpecName: "kube-api-access-85qqx") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "kube-api-access-85qqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.065204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.113058 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2jzx2"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.116952 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.120729 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") pod \"89d87382-e395-460d-b200-da5fc695112e\" (UID: \"89d87382-e395-460d-b200-da5fc695112e\") " Mar 16 13:25:00 crc kubenswrapper[5030]: W0316 13:25:00.121364 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/89d87382-e395-460d-b200-da5fc695112e/volumes/kubernetes.io~secret/public-tls-certs Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121394 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121520 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121716 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121811 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121870 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/89d87382-e395-460d-b200-da5fc695112e-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121926 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.121976 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.122028 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85qqx\" (UniqueName: \"kubernetes.io/projected/89d87382-e395-460d-b200-da5fc695112e-kube-api-access-85qqx\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.125411 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data" (OuterVolumeSpecName: "config-data") pod "89d87382-e395-460d-b200-da5fc695112e" (UID: "89d87382-e395-460d-b200-da5fc695112e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.141996 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.227299 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/89d87382-e395-460d-b200-da5fc695112e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.227324 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.320120 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-94zql"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.326969 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z"] Mar 16 13:25:00 crc kubenswrapper[5030]: W0316 13:25:00.333512 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ba69b8a_68f5_46c7_8ce1_16211fbbcadd.slice/crio-396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f WatchSource:0}: Error finding container 396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f: Status 404 returned error can't find the container with id 396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.464199 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.472828 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw"] Mar 16 13:25:00 crc kubenswrapper[5030]: W0316 13:25:00.515784 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4e7e639_1a5c_4019_9b45_e38374870950.slice/crio-001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f WatchSource:0}: Error finding container 001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f: Status 404 returned error can't find the container with id 001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f Mar 16 13:25:00 crc kubenswrapper[5030]: W0316 13:25:00.521910 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cc6d5c9_4c94_475e_a809_127e04cd851e.slice/crio-c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df WatchSource:0}: Error finding container c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df: Status 404 returned error can't find the container with id c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.528956 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c379f98-1567-4e79-a4ea-d8816f94f669" containerID="30330ec7a8f6f0b678c7a56ec3e39dc58a576efa085bf0d9df7d1c4580cded94" exitCode=0 Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.529455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" event={"ID":"3c379f98-1567-4e79-a4ea-d8816f94f669","Type":"ContainerDied","Data":"30330ec7a8f6f0b678c7a56ec3e39dc58a576efa085bf0d9df7d1c4580cded94"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.529489 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" event={"ID":"3c379f98-1567-4e79-a4ea-d8816f94f669","Type":"ContainerStarted","Data":"2a9c848cba0db2a3fbae7011ace91eb5e492f5ed7a3361b3498a9bc1aa20e833"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.531953 5030 generic.go:358] "Generic (PLEG): container finished" podID="046e6707-eca4-490a-accc-17495f250c9f" containerID="50cf0e50e87d9371c455b37ce50e82e2608e8746b3bc96b0840e2f0053fa3c42" exitCode=0 Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.532132 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" event={"ID":"046e6707-eca4-490a-accc-17495f250c9f","Type":"ContainerDied","Data":"50cf0e50e87d9371c455b37ce50e82e2608e8746b3bc96b0840e2f0053fa3c42"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.532167 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" event={"ID":"046e6707-eca4-490a-accc-17495f250c9f","Type":"ContainerStarted","Data":"8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.535054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"89d87382-e395-460d-b200-da5fc695112e","Type":"ContainerDied","Data":"81fc11c7a225befc1b7ed152f24d59eb7c61a97f525a5fe6006f58c84daedd04"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.535102 5030 scope.go:117] "RemoveContainer" containerID="7c864b50f5b76910dd637af7b286a957e7268814f6ea45edf4c9d3b029e0dd3e" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.535240 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.559534 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerStarted","Data":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.561784 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" event={"ID":"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd","Type":"ContainerStarted","Data":"28d2b6c1154c4e2e7c02f38efdf02ffa92f341c9078e51b32ff06ade08369284"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.561833 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" event={"ID":"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd","Type":"ContainerStarted","Data":"396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.568012 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" event={"ID":"ab39e66a-2848-49fc-bb7a-ecba1c853708","Type":"ContainerStarted","Data":"fce3378e22a01aa92e5104d394ec2686065dd7062dba935766b7ac1e47397dec"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.568047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" event={"ID":"ab39e66a-2848-49fc-bb7a-ecba1c853708","Type":"ContainerStarted","Data":"283db4623c2f5b18ffff6d664fe7ca6e9f62f5d43de906715b1588938079483a"} Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.591741 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" podStartSLOduration=1.5917226119999999 podStartE2EDuration="1.591722612s" podCreationTimestamp="2026-03-16 13:24:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:00.577216078 +0000 UTC m=+1144.976528625" watchObservedRunningTime="2026-03-16 13:25:00.591722612 +0000 UTC m=+1144.991035159" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.600466 5030 scope.go:117] "RemoveContainer" containerID="f7b6c723825e64c4f191cc08a5c95b024c6be5bc5b535819d35df87d34cac345" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.606600 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.616647 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.618495 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" podStartSLOduration=1.618480771 podStartE2EDuration="1.618480771s" podCreationTimestamp="2026-03-16 13:24:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:00.603902852 +0000 UTC m=+1145.003215399" watchObservedRunningTime="2026-03-16 13:25:00.618480771 +0000 UTC m=+1145.017793318" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.637404 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638508 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-httpd" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638525 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-httpd" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638590 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-log" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638598 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-log" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638818 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-httpd" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.638833 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="89d87382-e395-460d-b200-da5fc695112e" containerName="glance-log" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.647201 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.647316 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.660442 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.661295 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.750368 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.750437 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.750466 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5cq\" (UniqueName: \"kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.750578 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.750629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.751097 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.751274 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.751347 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853196 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853245 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853341 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853377 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853422 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853440 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.853458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5cq\" (UniqueName: \"kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.854639 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.854830 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.855705 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.862104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.862178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.876512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.876948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.889286 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5cq\" (UniqueName: \"kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.896437 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:00 crc kubenswrapper[5030]: I0316 13:25:00.977743 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.432007 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:25:01 crc kubenswrapper[5030]: W0316 13:25:01.438925 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb8c60c8_da8e_4757_914f_e13df20a39a0.slice/crio-188885166fdef9fb47b6f427e761f0018187322c9fc7094a5f9351b1238897e7 WatchSource:0}: Error finding container 188885166fdef9fb47b6f427e761f0018187322c9fc7094a5f9351b1238897e7: Status 404 returned error can't find the container with id 188885166fdef9fb47b6f427e761f0018187322c9fc7094a5f9351b1238897e7 Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.600498 5030 generic.go:358] "Generic (PLEG): container finished" podID="8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" containerID="28d2b6c1154c4e2e7c02f38efdf02ffa92f341c9078e51b32ff06ade08369284" exitCode=0 Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.600707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" event={"ID":"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd","Type":"ContainerDied","Data":"28d2b6c1154c4e2e7c02f38efdf02ffa92f341c9078e51b32ff06ade08369284"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.604036 5030 generic.go:358] "Generic (PLEG): container finished" podID="ab39e66a-2848-49fc-bb7a-ecba1c853708" containerID="fce3378e22a01aa92e5104d394ec2686065dd7062dba935766b7ac1e47397dec" exitCode=0 Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.604199 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" event={"ID":"ab39e66a-2848-49fc-bb7a-ecba1c853708","Type":"ContainerDied","Data":"fce3378e22a01aa92e5104d394ec2686065dd7062dba935766b7ac1e47397dec"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.614082 5030 generic.go:358] "Generic (PLEG): container finished" podID="6cc6d5c9-4c94-475e-a809-127e04cd851e" containerID="06af05c99ec5dc0b030b1a9666ac11d65c83c426c39ebf3c2c06f91ef3795e46" exitCode=0 Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.614400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" event={"ID":"6cc6d5c9-4c94-475e-a809-127e04cd851e","Type":"ContainerDied","Data":"06af05c99ec5dc0b030b1a9666ac11d65c83c426c39ebf3c2c06f91ef3795e46"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.614415 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" event={"ID":"6cc6d5c9-4c94-475e-a809-127e04cd851e","Type":"ContainerStarted","Data":"c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.701749 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerStarted","Data":"188885166fdef9fb47b6f427e761f0018187322c9fc7094a5f9351b1238897e7"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.728022 5030 generic.go:358] "Generic (PLEG): container finished" podID="f4e7e639-1a5c-4019-9b45-e38374870950" containerID="7ab99802850440fa4b0c123a57a6dbc7fd5f9c7895c271504c56a39e49ed24fc" exitCode=0 Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.728676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" event={"ID":"f4e7e639-1a5c-4019-9b45-e38374870950","Type":"ContainerDied","Data":"7ab99802850440fa4b0c123a57a6dbc7fd5f9c7895c271504c56a39e49ed24fc"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.728708 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" event={"ID":"f4e7e639-1a5c-4019-9b45-e38374870950","Type":"ContainerStarted","Data":"001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f"} Mar 16 13:25:01 crc kubenswrapper[5030]: I0316 13:25:01.967782 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d87382-e395-460d-b200-da5fc695112e" path="/var/lib/kubelet/pods/89d87382-e395-460d-b200-da5fc695112e/volumes" Mar 16 13:25:02 crc kubenswrapper[5030]: I0316 13:25:02.742307 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerStarted","Data":"85c67cb0f67642c9dfd7d8c3562a7699102914abdea6c168b7a9983160c9ce2d"} Mar 16 13:25:02 crc kubenswrapper[5030]: I0316 13:25:02.751106 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerID="e52b42ff212eadd8d8f3817e8be04e31e89df58e5ad9fda1dd4278d8c0b7dffc" exitCode=0 Mar 16 13:25:02 crc kubenswrapper[5030]: I0316 13:25:02.751136 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerDied","Data":"e52b42ff212eadd8d8f3817e8be04e31e89df58e5ad9fda1dd4278d8c0b7dffc"} Mar 16 13:25:04 crc kubenswrapper[5030]: I0316 13:25:04.353311 5030 scope.go:117] "RemoveContainer" containerID="f13588f69f2615b045aaa48ca4b680d5e08b9e015c6abd1fa3f28fa0351f8080" Mar 16 13:25:04 crc kubenswrapper[5030]: I0316 13:25:04.515399 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:25:04 crc kubenswrapper[5030]: I0316 13:25:04.526138 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.300805 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.331926 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts\") pod \"3c379f98-1567-4e79-a4ea-d8816f94f669\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.332140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgq5m\" (UniqueName: \"kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m\") pod \"3c379f98-1567-4e79-a4ea-d8816f94f669\" (UID: \"3c379f98-1567-4e79-a4ea-d8816f94f669\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.335737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3c379f98-1567-4e79-a4ea-d8816f94f669" (UID: "3c379f98-1567-4e79-a4ea-d8816f94f669"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.351687 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m" (OuterVolumeSpecName: "kube-api-access-sgq5m") pod "3c379f98-1567-4e79-a4ea-d8816f94f669" (UID: "3c379f98-1567-4e79-a4ea-d8816f94f669"). InnerVolumeSpecName "kube-api-access-sgq5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.390831 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.392890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.394953 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.408406 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.416949 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.436486 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts\") pod \"f4e7e639-1a5c-4019-9b45-e38374870950\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.437059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7m4x\" (UniqueName: \"kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x\") pod \"f4e7e639-1a5c-4019-9b45-e38374870950\" (UID: \"f4e7e639-1a5c-4019-9b45-e38374870950\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.437169 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tr47\" (UniqueName: \"kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47\") pod \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.437297 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts\") pod \"046e6707-eca4-490a-accc-17495f250c9f\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.437694 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts\") pod \"ab39e66a-2848-49fc-bb7a-ecba1c853708\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.436958 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f4e7e639-1a5c-4019-9b45-e38374870950" (UID: "f4e7e639-1a5c-4019-9b45-e38374870950"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.439743 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "046e6707-eca4-490a-accc-17495f250c9f" (UID: "046e6707-eca4-490a-accc-17495f250c9f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.439839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9jrn\" (UniqueName: \"kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn\") pod \"ab39e66a-2848-49fc-bb7a-ecba1c853708\" (UID: \"ab39e66a-2848-49fc-bb7a-ecba1c853708\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.442470 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ab39e66a-2848-49fc-bb7a-ecba1c853708" (UID: "ab39e66a-2848-49fc-bb7a-ecba1c853708"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.442990 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts\") pod \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\" (UID: \"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.443111 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lblqc\" (UniqueName: \"kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc\") pod \"046e6707-eca4-490a-accc-17495f250c9f\" (UID: \"046e6707-eca4-490a-accc-17495f250c9f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444369 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f4e7e639-1a5c-4019-9b45-e38374870950-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444390 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/046e6707-eca4-490a-accc-17495f250c9f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444401 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ab39e66a-2848-49fc-bb7a-ecba1c853708-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444410 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3c379f98-1567-4e79-a4ea-d8816f94f669-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444419 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgq5m\" (UniqueName: \"kubernetes.io/projected/3c379f98-1567-4e79-a4ea-d8816f94f669-kube-api-access-sgq5m\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.444418 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" (UID: "8ba69b8a-68f5-46c7-8ce1-16211fbbcadd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.445651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47" (OuterVolumeSpecName: "kube-api-access-5tr47") pod "8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" (UID: "8ba69b8a-68f5-46c7-8ce1-16211fbbcadd"). InnerVolumeSpecName "kube-api-access-5tr47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.455823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc" (OuterVolumeSpecName: "kube-api-access-lblqc") pod "046e6707-eca4-490a-accc-17495f250c9f" (UID: "046e6707-eca4-490a-accc-17495f250c9f"). InnerVolumeSpecName "kube-api-access-lblqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.455907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn" (OuterVolumeSpecName: "kube-api-access-s9jrn") pod "ab39e66a-2848-49fc-bb7a-ecba1c853708" (UID: "ab39e66a-2848-49fc-bb7a-ecba1c853708"). InnerVolumeSpecName "kube-api-access-s9jrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.465419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x" (OuterVolumeSpecName: "kube-api-access-l7m4x") pod "f4e7e639-1a5c-4019-9b45-e38374870950" (UID: "f4e7e639-1a5c-4019-9b45-e38374870950"). InnerVolumeSpecName "kube-api-access-l7m4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.545408 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7blz\" (UniqueName: \"kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz\") pod \"6cc6d5c9-4c94-475e-a809-127e04cd851e\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.545667 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts\") pod \"6cc6d5c9-4c94-475e-a809-127e04cd851e\" (UID: \"6cc6d5c9-4c94-475e-a809-127e04cd851e\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.546197 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9jrn\" (UniqueName: \"kubernetes.io/projected/ab39e66a-2848-49fc-bb7a-ecba1c853708-kube-api-access-s9jrn\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.546216 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.546225 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lblqc\" (UniqueName: \"kubernetes.io/projected/046e6707-eca4-490a-accc-17495f250c9f-kube-api-access-lblqc\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.546233 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7m4x\" (UniqueName: \"kubernetes.io/projected/f4e7e639-1a5c-4019-9b45-e38374870950-kube-api-access-l7m4x\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.546242 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tr47\" (UniqueName: \"kubernetes.io/projected/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd-kube-api-access-5tr47\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.547235 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6cc6d5c9-4c94-475e-a809-127e04cd851e" (UID: "6cc6d5c9-4c94-475e-a809-127e04cd851e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.549986 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz" (OuterVolumeSpecName: "kube-api-access-s7blz") pod "6cc6d5c9-4c94-475e-a809-127e04cd851e" (UID: "6cc6d5c9-4c94-475e-a809-127e04cd851e"). InnerVolumeSpecName "kube-api-access-s7blz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.615277 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.652053 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7blz\" (UniqueName: \"kubernetes.io/projected/6cc6d5c9-4c94-475e-a809-127e04cd851e-kube-api-access-s7blz\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.652088 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6cc6d5c9-4c94-475e-a809-127e04cd851e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.752864 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753269 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753296 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753498 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf2xk\" (UniqueName: \"kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753598 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753715 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753813 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.753907 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run\") pod \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\" (UID: \"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f\") " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.754943 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs" (OuterVolumeSpecName: "logs") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.755574 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.756912 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.758658 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk" (OuterVolumeSpecName: "kube-api-access-mf2xk") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "kube-api-access-mf2xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.760144 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts" (OuterVolumeSpecName: "scripts") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.761147 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.783628 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.797274 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.801080 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data" (OuterVolumeSpecName: "config-data") pod "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" (UID: "b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerStarted","Data":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835527 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-central-agent" containerID="cri-o://0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" gracePeriod=30 Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835601 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835650 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="proxy-httpd" containerID="cri-o://d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" gracePeriod=30 Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835700 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-notification-agent" containerID="cri-o://382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" gracePeriod=30 Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.835779 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="sg-core" containerID="cri-o://7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" gracePeriod=30 Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.841341 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" event={"ID":"f4e7e639-1a5c-4019-9b45-e38374870950","Type":"ContainerDied","Data":"001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.841389 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="001cda5a36e727d433d2cdf741e1c7955c23b43334b13af884c91d4401ab9e3f" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.841356 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.845725 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.845773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z" event={"ID":"8ba69b8a-68f5-46c7-8ce1-16211fbbcadd","Type":"ContainerDied","Data":"396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.845829 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="396a0d4589de77e529777b183fb524883efbdbb5b6e94852dcea169217289b2f" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.850294 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" event={"ID":"ab39e66a-2848-49fc-bb7a-ecba1c853708","Type":"ContainerDied","Data":"283db4623c2f5b18ffff6d664fe7ca6e9f62f5d43de906715b1588938079483a"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.850339 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="283db4623c2f5b18ffff6d664fe7ca6e9f62f5d43de906715b1588938079483a" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.850390 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-94zql" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.856876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"10bc4a31-e3b9-4205-9e63-c7e92bffbf10","Type":"ContainerStarted","Data":"9a2861f8073235d0f35323d92513aefaa091c997b7a922a80a8d36caff545b80"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858402 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf2xk\" (UniqueName: \"kubernetes.io/projected/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-kube-api-access-mf2xk\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858501 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858601 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858658 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858718 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858776 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.858835 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.861508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" event={"ID":"6cc6d5c9-4c94-475e-a809-127e04cd851e","Type":"ContainerDied","Data":"c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.862028 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.862272 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c114a722d5e31f182566626e90fee299bf0fc3f0ed36eed6ff0f638476d608df" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.873804 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.826484635 podStartE2EDuration="11.873778944s" podCreationTimestamp="2026-03-16 13:24:56 +0000 UTC" firstStartedPulling="2026-03-16 13:24:57.296716562 +0000 UTC m=+1141.696029109" lastFinishedPulling="2026-03-16 13:25:07.344010871 +0000 UTC m=+1151.743323418" observedRunningTime="2026-03-16 13:25:07.855160899 +0000 UTC m=+1152.254473447" watchObservedRunningTime="2026-03-16 13:25:07.873778944 +0000 UTC m=+1152.273091491" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.876648 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.878584 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" event={"ID":"3c379f98-1567-4e79-a4ea-d8816f94f669","Type":"ContainerDied","Data":"2a9c848cba0db2a3fbae7011ace91eb5e492f5ed7a3361b3498a9bc1aa20e833"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.878624 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a9c848cba0db2a3fbae7011ace91eb5e492f5ed7a3361b3498a9bc1aa20e833" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.878635 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.124329562 podStartE2EDuration="15.878617451s" podCreationTimestamp="2026-03-16 13:24:52 +0000 UTC" firstStartedPulling="2026-03-16 13:24:53.633486564 +0000 UTC m=+1138.032799111" lastFinishedPulling="2026-03-16 13:25:07.387774453 +0000 UTC m=+1151.787087000" observedRunningTime="2026-03-16 13:25:07.870101731 +0000 UTC m=+1152.269414278" watchObservedRunningTime="2026-03-16 13:25:07.878617451 +0000 UTC m=+1152.277929998" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.878908 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-2jzx2" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.882711 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.882709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f","Type":"ContainerDied","Data":"339c7be51b45286adf12565ee0400dd34114e2618afd1209c9a935f17cfdd8d1"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.883393 5030 scope.go:117] "RemoveContainer" containerID="e52b42ff212eadd8d8f3817e8be04e31e89df58e5ad9fda1dd4278d8c0b7dffc" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.886586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" event={"ID":"046e6707-eca4-490a-accc-17495f250c9f","Type":"ContainerDied","Data":"8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882"} Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.886614 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-z4pfn" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.886621 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8714b117cb2f1b0d25be136afbbe0fcd65ebfe10b428d5ca337b395526dde882" Mar 16 13:25:07 crc kubenswrapper[5030]: I0316 13:25:07.921525 5030 scope.go:117] "RemoveContainer" containerID="b8fb4f8fa4e38f0365461f3d55fa251a66c71a6da73229cd605c8cd9cbf8b28a" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.009331 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.016739 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.020284 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.057931 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060126 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e7e639-1a5c-4019-9b45-e38374870950" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060410 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e7e639-1a5c-4019-9b45-e38374870950" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060473 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab39e66a-2848-49fc-bb7a-ecba1c853708" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060529 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab39e66a-2848-49fc-bb7a-ecba1c853708" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060631 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-log" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060678 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-log" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060729 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c379f98-1567-4e79-a4ea-d8816f94f669" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060785 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c379f98-1567-4e79-a4ea-d8816f94f669" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060850 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-httpd" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060902 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-httpd" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.060973 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc6d5c9-4c94-475e-a809-127e04cd851e" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061018 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc6d5c9-4c94-475e-a809-127e04cd851e" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061090 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046e6707-eca4-490a-accc-17495f250c9f" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061142 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="046e6707-eca4-490a-accc-17495f250c9f" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061192 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061253 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061440 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4e7e639-1a5c-4019-9b45-e38374870950" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061508 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cc6d5c9-4c94-475e-a809-127e04cd851e" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061579 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c379f98-1567-4e79-a4ea-d8816f94f669" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061719 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab39e66a-2848-49fc-bb7a-ecba1c853708" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061776 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="046e6707-eca4-490a-accc-17495f250c9f" containerName="mariadb-database-create" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061833 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-httpd" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061890 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" containerName="glance-log" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.061936 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" containerName="mariadb-account-create-update" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.065428 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.066952 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.067508 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.067693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlj5g\" (UniqueName: \"kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214451 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214467 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.214620 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.317220 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.318420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.318568 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.318745 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.318937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.319041 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.318963 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.319168 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.319295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.319149 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.319720 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlj5g\" (UniqueName: \"kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.331734 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.335333 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.339627 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.340269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.350918 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlj5g\" (UniqueName: \"kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.358894 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.380031 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.790845 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.819985 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:25:08 crc kubenswrapper[5030]: W0316 13:25:08.825991 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80d0d6c4_ceb2_400a_9ea2_ab01ded230bd.slice/crio-a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8 WatchSource:0}: Error finding container a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8: Status 404 returned error can't find the container with id a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8 Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.904820 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerStarted","Data":"a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.913206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerStarted","Data":"28e08b9d272c0ef18d06dc1de9d1deb4eb5a6bb831a9acdebf364ae571c3be49"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.917841 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed20a7be-0454-481c-8c44-541f51298a27" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" exitCode=0 Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.917872 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed20a7be-0454-481c-8c44-541f51298a27" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" exitCode=2 Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.917885 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed20a7be-0454-481c-8c44-541f51298a27" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" exitCode=0 Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.917894 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed20a7be-0454-481c-8c44-541f51298a27" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" exitCode=0 Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.917944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerDied","Data":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918000 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918032 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerDied","Data":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918061 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerDied","Data":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerDied","Data":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918099 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed20a7be-0454-481c-8c44-541f51298a27","Type":"ContainerDied","Data":"0703b237c5c1a5fdf04a71c9e8ce10b8bea02922397794419b9c3c1c985d2be0"} Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.918121 5030 scope.go:117] "RemoveContainer" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.949449 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.949571 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.951480 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj8qp\" (UniqueName: \"kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.952604 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.952723 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.952813 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.953106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.955598 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.957482 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.961108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts" (OuterVolumeSpecName: "scripts") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.961848 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp" (OuterVolumeSpecName: "kube-api-access-lj8qp") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "kube-api-access-lj8qp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:08 crc kubenswrapper[5030]: I0316 13:25:08.971341 5030 scope.go:117] "RemoveContainer" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.000043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.002695 5030 scope.go:117] "RemoveContainer" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.027714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.030305 5030 scope.go:117] "RemoveContainer" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.055941 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data" (OuterVolumeSpecName: "config-data") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.056612 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") pod \"ed20a7be-0454-481c-8c44-541f51298a27\" (UID: \"ed20a7be-0454-481c-8c44-541f51298a27\") " Mar 16 13:25:09 crc kubenswrapper[5030]: W0316 13:25:09.056776 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ed20a7be-0454-481c-8c44-541f51298a27/volumes/kubernetes.io~secret/config-data Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.056792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data" (OuterVolumeSpecName: "config-data") pod "ed20a7be-0454-481c-8c44-541f51298a27" (UID: "ed20a7be-0454-481c-8c44-541f51298a27"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057584 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057603 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057612 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057621 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed20a7be-0454-481c-8c44-541f51298a27-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057629 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj8qp\" (UniqueName: \"kubernetes.io/projected/ed20a7be-0454-481c-8c44-541f51298a27-kube-api-access-lj8qp\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057641 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.057651 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed20a7be-0454-481c-8c44-541f51298a27-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.084444 5030 scope.go:117] "RemoveContainer" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:09 crc kubenswrapper[5030]: E0316 13:25:09.085081 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": container with ID starting with d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb not found: ID does not exist" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.085112 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} err="failed to get container status \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": rpc error: code = NotFound desc = could not find container \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": container with ID starting with d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.085132 5030 scope.go:117] "RemoveContainer" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: E0316 13:25:09.086309 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": container with ID starting with 7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7 not found: ID does not exist" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.086330 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} err="failed to get container status \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": rpc error: code = NotFound desc = could not find container \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": container with ID starting with 7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.086344 5030 scope.go:117] "RemoveContainer" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: E0316 13:25:09.087503 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": container with ID starting with 382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce not found: ID does not exist" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.087528 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} err="failed to get container status \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": rpc error: code = NotFound desc = could not find container \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": container with ID starting with 382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.087541 5030 scope.go:117] "RemoveContainer" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: E0316 13:25:09.088179 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": container with ID starting with 0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7 not found: ID does not exist" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088203 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} err="failed to get container status \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": rpc error: code = NotFound desc = could not find container \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": container with ID starting with 0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088218 5030 scope.go:117] "RemoveContainer" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088451 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} err="failed to get container status \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": rpc error: code = NotFound desc = could not find container \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": container with ID starting with d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088491 5030 scope.go:117] "RemoveContainer" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088799 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} err="failed to get container status \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": rpc error: code = NotFound desc = could not find container \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": container with ID starting with 7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.088818 5030 scope.go:117] "RemoveContainer" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.089114 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} err="failed to get container status \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": rpc error: code = NotFound desc = could not find container \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": container with ID starting with 382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.089130 5030 scope.go:117] "RemoveContainer" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.089719 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} err="failed to get container status \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": rpc error: code = NotFound desc = could not find container \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": container with ID starting with 0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.089740 5030 scope.go:117] "RemoveContainer" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.090163 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} err="failed to get container status \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": rpc error: code = NotFound desc = could not find container \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": container with ID starting with d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.090181 5030 scope.go:117] "RemoveContainer" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.090459 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} err="failed to get container status \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": rpc error: code = NotFound desc = could not find container \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": container with ID starting with 7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.090481 5030 scope.go:117] "RemoveContainer" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.091288 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} err="failed to get container status \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": rpc error: code = NotFound desc = could not find container \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": container with ID starting with 382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.091311 5030 scope.go:117] "RemoveContainer" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.091975 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} err="failed to get container status \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": rpc error: code = NotFound desc = could not find container \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": container with ID starting with 0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.092029 5030 scope.go:117] "RemoveContainer" containerID="d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.092583 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb"} err="failed to get container status \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": rpc error: code = NotFound desc = could not find container \"d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb\": container with ID starting with d43a95b52f72263b8437d62a09baa4616a4c7abb34ac2eca88fa7d7ce1825adb not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.092607 5030 scope.go:117] "RemoveContainer" containerID="7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.093174 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7"} err="failed to get container status \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": rpc error: code = NotFound desc = could not find container \"7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7\": container with ID starting with 7696a38936bc8f8bece1135cbe3bd4a3ae26a2a49f7b5383e76424e102d6e8a7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.093191 5030 scope.go:117] "RemoveContainer" containerID="382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.093453 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce"} err="failed to get container status \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": rpc error: code = NotFound desc = could not find container \"382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce\": container with ID starting with 382f94ff23cae03fc651c3a5211646cf0ba0d816ab87074ff594e5ac0a87e6ce not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.093474 5030 scope.go:117] "RemoveContainer" containerID="0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.093806 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7"} err="failed to get container status \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": rpc error: code = NotFound desc = could not find container \"0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7\": container with ID starting with 0d1e4e78c867be5a83f2eed84b5a5c196ebbdce65f59c9ea7c8fb5b3ceaa81d7 not found: ID does not exist" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.248100 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=9.248084026 podStartE2EDuration="9.248084026s" podCreationTimestamp="2026-03-16 13:25:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:08.947751692 +0000 UTC m=+1153.347064249" watchObservedRunningTime="2026-03-16 13:25:09.248084026 +0000 UTC m=+1153.647396563" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.255004 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.267770 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.287605 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288533 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-central-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288565 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-central-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288575 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="proxy-httpd" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288580 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="proxy-httpd" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288606 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-notification-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288615 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-notification-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288636 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="sg-core" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288641 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="sg-core" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288816 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="proxy-httpd" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288827 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-central-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288839 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="ceilometer-notification-agent" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.288846 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed20a7be-0454-481c-8c44-541f51298a27" containerName="sg-core" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.295382 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.305310 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.305574 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.309615 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.483876 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.484580 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.484731 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.484812 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ntcw\" (UniqueName: \"kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.484899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.485179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.485295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587200 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587594 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587699 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ntcw\" (UniqueName: \"kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587732 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.587956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.590060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.590421 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.594283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.595111 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.595205 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.604701 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.617013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ntcw\" (UniqueName: \"kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw\") pod \"ceilometer-0\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.635138 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.646646 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.647870 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn"] Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.648837 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.648995 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-rsh69\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.651034 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.672565 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.793013 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.793583 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.793650 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.793800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p65dl\" (UniqueName: \"kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.896428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p65dl\" (UniqueName: \"kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.896490 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.896611 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.896639 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.904201 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.904812 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.905199 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.918492 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p65dl\" (UniqueName: \"kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl\") pod \"nova-cell0-conductor-db-sync-vspcn\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.933413 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerStarted","Data":"269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829"} Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.958194 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f" path="/var/lib/kubelet/pods/b9b7a91d-a3f6-47ca-b178-e8aa1f1fc85f/volumes" Mar 16 13:25:09 crc kubenswrapper[5030]: I0316 13:25:09.958927 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed20a7be-0454-481c-8c44-541f51298a27" path="/var/lib/kubelet/pods/ed20a7be-0454-481c-8c44-541f51298a27/volumes" Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.003956 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.172562 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.425245 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn"] Mar 16 13:25:10 crc kubenswrapper[5030]: W0316 13:25:10.428853 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d586557_5771_4f65_99bc_b6bd29f83dc9.slice/crio-66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e WatchSource:0}: Error finding container 66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e: Status 404 returned error can't find the container with id 66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.838876 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.963140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerStarted","Data":"7ba37912dff97635b19219822d83130b2684c85cd4b13a053456862a4f7eefed"} Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.965324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerStarted","Data":"ab553841a7a595be8e7fb603d582d96820d51d8a7702e62e808b9616500ae9e0"} Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.965385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerStarted","Data":"d9eb5b164498175b4efd606cfb7567cba9beedc9bd3f308513761ebdda6e83ca"} Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.967507 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" event={"ID":"9d586557-5771-4f65-99bc-b6bd29f83dc9","Type":"ContainerStarted","Data":"66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e"} Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.978727 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.978766 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:10 crc kubenswrapper[5030]: I0316 13:25:10.999802 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.999785373 podStartE2EDuration="3.999785373s" podCreationTimestamp="2026-03-16 13:25:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:10.987105253 +0000 UTC m=+1155.386417799" watchObservedRunningTime="2026-03-16 13:25:10.999785373 +0000 UTC m=+1155.399097920" Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.008728 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.016065 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.222623 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.280831 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.281047 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-api" containerID="cri-o://bdf9b90646e6aaef20c521364c6e15347f1f3c1b613cb62dfcbf449c33e10d62" gracePeriod=30 Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.281453 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-httpd" containerID="cri-o://9bfb94dfe0f13bbd6b69119c4383897a1a4a160d2604e1032da93835bac87b1a" gracePeriod=30 Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.992917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerStarted","Data":"d17eff28cbf0e0407026925350d2c94154c1e838c7cd2c56d7c44c7b584807db"} Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.995811 5030 generic.go:358] "Generic (PLEG): container finished" podID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerID="9bfb94dfe0f13bbd6b69119c4383897a1a4a160d2604e1032da93835bac87b1a" exitCode=0 Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.996825 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerDied","Data":"9bfb94dfe0f13bbd6b69119c4383897a1a4a160d2604e1032da93835bac87b1a"} Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.998397 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:11 crc kubenswrapper[5030]: I0316 13:25:11.998506 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:13 crc kubenswrapper[5030]: I0316 13:25:13.015634 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerStarted","Data":"f67a94f490cfd3d24fd24aa0593cca84cec6b6bd8e58f715453cdd64e6225940"} Mar 16 13:25:13 crc kubenswrapper[5030]: I0316 13:25:13.793106 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:14 crc kubenswrapper[5030]: I0316 13:25:14.788633 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.038709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerStarted","Data":"5e81a436aecb4b8aa4858d3191abf93d27d35e70f90c1a659d24ae254f2e442b"} Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.038796 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-central-agent" containerID="cri-o://ab553841a7a595be8e7fb603d582d96820d51d8a7702e62e808b9616500ae9e0" gracePeriod=30 Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.038893 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="sg-core" containerID="cri-o://f67a94f490cfd3d24fd24aa0593cca84cec6b6bd8e58f715453cdd64e6225940" gracePeriod=30 Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.038919 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-notification-agent" containerID="cri-o://d17eff28cbf0e0407026925350d2c94154c1e838c7cd2c56d7c44c7b584807db" gracePeriod=30 Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.038947 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="proxy-httpd" containerID="cri-o://5e81a436aecb4b8aa4858d3191abf93d27d35e70f90c1a659d24ae254f2e442b" gracePeriod=30 Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.039019 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:15 crc kubenswrapper[5030]: I0316 13:25:15.067597 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.901852275 podStartE2EDuration="6.067587158s" podCreationTimestamp="2026-03-16 13:25:09 +0000 UTC" firstStartedPulling="2026-03-16 13:25:10.200282834 +0000 UTC m=+1154.599595381" lastFinishedPulling="2026-03-16 13:25:14.366017716 +0000 UTC m=+1158.765330264" observedRunningTime="2026-03-16 13:25:15.064883225 +0000 UTC m=+1159.464195772" watchObservedRunningTime="2026-03-16 13:25:15.067587158 +0000 UTC m=+1159.466899705" Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.058962 5030 generic.go:358] "Generic (PLEG): container finished" podID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerID="bdf9b90646e6aaef20c521364c6e15347f1f3c1b613cb62dfcbf449c33e10d62" exitCode=0 Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.059369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerDied","Data":"bdf9b90646e6aaef20c521364c6e15347f1f3c1b613cb62dfcbf449c33e10d62"} Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064161 5030 generic.go:358] "Generic (PLEG): container finished" podID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerID="5e81a436aecb4b8aa4858d3191abf93d27d35e70f90c1a659d24ae254f2e442b" exitCode=0 Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064179 5030 generic.go:358] "Generic (PLEG): container finished" podID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerID="f67a94f490cfd3d24fd24aa0593cca84cec6b6bd8e58f715453cdd64e6225940" exitCode=2 Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064186 5030 generic.go:358] "Generic (PLEG): container finished" podID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerID="d17eff28cbf0e0407026925350d2c94154c1e838c7cd2c56d7c44c7b584807db" exitCode=0 Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064613 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerDied","Data":"5e81a436aecb4b8aa4858d3191abf93d27d35e70f90c1a659d24ae254f2e442b"} Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064686 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerDied","Data":"f67a94f490cfd3d24fd24aa0593cca84cec6b6bd8e58f715453cdd64e6225940"} Mar 16 13:25:16 crc kubenswrapper[5030]: I0316 13:25:16.064700 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerDied","Data":"d17eff28cbf0e0407026925350d2c94154c1e838c7cd2c56d7c44c7b584807db"} Mar 16 13:25:17 crc kubenswrapper[5030]: I0316 13:25:17.293887 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.127236 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.215371 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.215767 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-log" containerID="cri-o://20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd" gracePeriod=30 Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.216264 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-api" containerID="cri-o://9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306" gracePeriod=30 Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.380213 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.380588 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.416096 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:18 crc kubenswrapper[5030]: I0316 13:25:18.420041 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.096581 5030 generic.go:358] "Generic (PLEG): container finished" podID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerID="ab553841a7a595be8e7fb603d582d96820d51d8a7702e62e808b9616500ae9e0" exitCode=0 Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.096701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerDied","Data":"ab553841a7a595be8e7fb603d582d96820d51d8a7702e62e808b9616500ae9e0"} Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.100747 5030 generic.go:358] "Generic (PLEG): container finished" podID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerID="20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd" exitCode=143 Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.102043 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerDied","Data":"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd"} Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.102143 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:19 crc kubenswrapper[5030]: I0316 13:25:19.102165 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.641175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.750571 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758191 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cdh5\" (UniqueName: \"kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758285 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758307 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758332 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758375 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758393 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.758483 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config\") pod \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\" (UID: \"0869b9d9-5b75-473c-980a-2c2a7d735ba5\") " Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.766349 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5" (OuterVolumeSpecName: "kube-api-access-2cdh5") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "kube-api-access-2cdh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.788215 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.832719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.836083 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.845117 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.857826 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config" (OuterVolumeSpecName: "config") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860910 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860935 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cdh5\" (UniqueName: \"kubernetes.io/projected/0869b9d9-5b75-473c-980a-2c2a7d735ba5-kube-api-access-2cdh5\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860946 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860955 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860971 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.860979 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.866473 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "0869b9d9-5b75-473c-980a-2c2a7d735ba5" (UID: "0869b9d9-5b75-473c-980a-2c2a7d735ba5"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.872301 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:25:20 crc kubenswrapper[5030]: I0316 13:25:20.963596 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0869b9d9-5b75-473c-980a-2c2a7d735ba5-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.134213 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.135776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6897c78d86-vjc9l" event={"ID":"0869b9d9-5b75-473c-980a-2c2a7d735ba5","Type":"ContainerDied","Data":"9de493c7ae0aed88d25ce4e88f8c5a01ebe069463e371b3ddb9616243b79838a"} Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.136032 5030 scope.go:117] "RemoveContainer" containerID="9bfb94dfe0f13bbd6b69119c4383897a1a4a160d2604e1032da93835bac87b1a" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.170990 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.181636 5030 scope.go:117] "RemoveContainer" containerID="bdf9b90646e6aaef20c521364c6e15347f1f3c1b613cb62dfcbf449c33e10d62" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.182237 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.192056 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6897c78d86-vjc9l"] Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.274921 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.274986 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.275098 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.275265 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ntcw\" (UniqueName: \"kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.275477 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.275684 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.275727 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd\") pod \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\" (UID: \"0940c8e5-b29f-446f-ab5c-dcb7c9325928\") " Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.276771 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.278416 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.282099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts" (OuterVolumeSpecName: "scripts") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.282225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw" (OuterVolumeSpecName: "kube-api-access-4ntcw") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "kube-api-access-4ntcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.312249 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.352257 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.367719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data" (OuterVolumeSpecName: "config-data") pod "0940c8e5-b29f-446f-ab5c-dcb7c9325928" (UID: "0940c8e5-b29f-446f-ab5c-dcb7c9325928"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378654 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378699 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ntcw\" (UniqueName: \"kubernetes.io/projected/0940c8e5-b29f-446f-ab5c-dcb7c9325928-kube-api-access-4ntcw\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378712 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378720 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378729 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378736 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0940c8e5-b29f-446f-ab5c-dcb7c9325928-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.378744 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0940c8e5-b29f-446f-ab5c-dcb7c9325928-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.959148 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" path="/var/lib/kubelet/pods/0869b9d9-5b75-473c-980a-2c2a7d735ba5/volumes" Mar 16 13:25:21 crc kubenswrapper[5030]: I0316 13:25:21.988380 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.094620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.094888 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.094931 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.095014 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.095043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs" (OuterVolumeSpecName: "logs") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.095139 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.095306 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.095436 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzth5\" (UniqueName: \"kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5\") pod \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\" (UID: \"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a\") " Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.096474 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.104537 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5" (OuterVolumeSpecName: "kube-api-access-bzth5") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "kube-api-access-bzth5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.107694 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts" (OuterVolumeSpecName: "scripts") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.145796 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0940c8e5-b29f-446f-ab5c-dcb7c9325928","Type":"ContainerDied","Data":"d9eb5b164498175b4efd606cfb7567cba9beedc9bd3f308513761ebdda6e83ca"} Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.145868 5030 scope.go:117] "RemoveContainer" containerID="5e81a436aecb4b8aa4858d3191abf93d27d35e70f90c1a659d24ae254f2e442b" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.146095 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.151746 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.152203 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" event={"ID":"9d586557-5771-4f65-99bc-b6bd29f83dc9","Type":"ContainerStarted","Data":"ad53a5be399e7abb78da8e8f7af24615a9de7e9f77fa35133494130c04fe560c"} Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.154139 5030 generic.go:358] "Generic (PLEG): container finished" podID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerID="9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306" exitCode=0 Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.154301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerDied","Data":"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306"} Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.154403 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" event={"ID":"8e9b20df-8e0a-4b40-b0cc-d5152d368e1a","Type":"ContainerDied","Data":"41fff474c8159eb9484bfbd3d6ded2c55f6a77e6fc218fe126b0dd6f5fb979cd"} Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.154413 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8699bb6694-6td9g" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.154636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data" (OuterVolumeSpecName: "config-data") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.178173 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.186488 5030 scope.go:117] "RemoveContainer" containerID="f67a94f490cfd3d24fd24aa0593cca84cec6b6bd8e58f715453cdd64e6225940" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.190165 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.199944 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.199988 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzth5\" (UniqueName: \"kubernetes.io/projected/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-kube-api-access-bzth5\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.199999 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.200008 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.202385 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.203060 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" podStartSLOduration=2.4505065679999998 podStartE2EDuration="13.203039286s" podCreationTimestamp="2026-03-16 13:25:09 +0000 UTC" firstStartedPulling="2026-03-16 13:25:10.432272705 +0000 UTC m=+1154.831585253" lastFinishedPulling="2026-03-16 13:25:21.184805424 +0000 UTC m=+1165.584117971" observedRunningTime="2026-03-16 13:25:22.185867661 +0000 UTC m=+1166.585180207" watchObservedRunningTime="2026-03-16 13:25:22.203039286 +0000 UTC m=+1166.602351833" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.203798 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="sg-core" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.203868 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="sg-core" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.203945 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.203995 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204060 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-notification-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204118 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-notification-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204200 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-log" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204255 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-log" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204332 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204382 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204427 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="proxy-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204475 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="proxy-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204536 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-central-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204609 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-central-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204682 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204727 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.204962 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205022 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-api" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205087 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="proxy-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205143 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0869b9d9-5b75-473c-980a-2c2a7d735ba5" containerName="neutron-httpd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205197 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-notification-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205259 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="ceilometer-central-agent" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205312 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" containerName="sg-core" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.205360 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" containerName="placement-log" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.209239 5030 scope.go:117] "RemoveContainer" containerID="d17eff28cbf0e0407026925350d2c94154c1e838c7cd2c56d7c44c7b584807db" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.209659 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.215279 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.217790 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.218027 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.218349 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.227626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" (UID: "8e9b20df-8e0a-4b40-b0cc-d5152d368e1a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.255594 5030 scope.go:117] "RemoveContainer" containerID="ab553841a7a595be8e7fb603d582d96820d51d8a7702e62e808b9616500ae9e0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.273394 5030 scope.go:117] "RemoveContainer" containerID="9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.291765 5030 scope.go:117] "RemoveContainer" containerID="20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.301774 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.301930 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302036 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnwp\" (UniqueName: \"kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302176 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302347 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302436 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302511 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302656 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.302727 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.315454 5030 scope.go:117] "RemoveContainer" containerID="9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306" Mar 16 13:25:22 crc kubenswrapper[5030]: E0316 13:25:22.322278 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306\": container with ID starting with 9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306 not found: ID does not exist" containerID="9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.322490 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306"} err="failed to get container status \"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306\": rpc error: code = NotFound desc = could not find container \"9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306\": container with ID starting with 9076c997bb3f0dabff97cca89855b02e0230bfb8bcf137c5ec12b2985616b306 not found: ID does not exist" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.322515 5030 scope.go:117] "RemoveContainer" containerID="20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd" Mar 16 13:25:22 crc kubenswrapper[5030]: E0316 13:25:22.323512 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd\": container with ID starting with 20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd not found: ID does not exist" containerID="20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.323582 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd"} err="failed to get container status \"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd\": rpc error: code = NotFound desc = could not find container \"20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd\": container with ID starting with 20d33bd06dbf0a71f5cb59e47738e5148e6604b3c6177689cd0001ce848f22fd not found: ID does not exist" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.404266 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.404483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.404671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.404806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.404932 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llnwp\" (UniqueName: \"kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.405155 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.405381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.405925 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.406041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.409856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.410288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.411248 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.412761 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.427599 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnwp\" (UniqueName: \"kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp\") pod \"ceilometer-0\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.482096 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.496353 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-8699bb6694-6td9g"] Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.548025 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:22 crc kubenswrapper[5030]: I0316 13:25:22.967935 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:25:23 crc kubenswrapper[5030]: I0316 13:25:23.181052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerStarted","Data":"e0de0fc23ed8cb9a6ed81ccd8a3a7b76ef0183c34af2f1afbe5b30a5a72b7120"} Mar 16 13:25:23 crc kubenswrapper[5030]: I0316 13:25:23.959593 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0940c8e5-b29f-446f-ab5c-dcb7c9325928" path="/var/lib/kubelet/pods/0940c8e5-b29f-446f-ab5c-dcb7c9325928/volumes" Mar 16 13:25:23 crc kubenswrapper[5030]: I0316 13:25:23.960934 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9b20df-8e0a-4b40-b0cc-d5152d368e1a" path="/var/lib/kubelet/pods/8e9b20df-8e0a-4b40-b0cc-d5152d368e1a/volumes" Mar 16 13:25:24 crc kubenswrapper[5030]: I0316 13:25:24.199614 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerStarted","Data":"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11"} Mar 16 13:25:24 crc kubenswrapper[5030]: I0316 13:25:24.287465 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:25:24 crc kubenswrapper[5030]: I0316 13:25:24.287533 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:25:25 crc kubenswrapper[5030]: I0316 13:25:25.212108 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerStarted","Data":"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074"} Mar 16 13:25:26 crc kubenswrapper[5030]: I0316 13:25:26.229531 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerStarted","Data":"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684"} Mar 16 13:25:27 crc kubenswrapper[5030]: I0316 13:25:27.243221 5030 generic.go:358] "Generic (PLEG): container finished" podID="9d586557-5771-4f65-99bc-b6bd29f83dc9" containerID="ad53a5be399e7abb78da8e8f7af24615a9de7e9f77fa35133494130c04fe560c" exitCode=0 Mar 16 13:25:27 crc kubenswrapper[5030]: I0316 13:25:27.243616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" event={"ID":"9d586557-5771-4f65-99bc-b6bd29f83dc9","Type":"ContainerDied","Data":"ad53a5be399e7abb78da8e8f7af24615a9de7e9f77fa35133494130c04fe560c"} Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.261020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerStarted","Data":"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779"} Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.261343 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.290264 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.926303656 podStartE2EDuration="6.290254343s" podCreationTimestamp="2026-03-16 13:25:22 +0000 UTC" firstStartedPulling="2026-03-16 13:25:22.97182323 +0000 UTC m=+1167.371135777" lastFinishedPulling="2026-03-16 13:25:27.335773926 +0000 UTC m=+1171.735086464" observedRunningTime="2026-03-16 13:25:28.286125639 +0000 UTC m=+1172.685438186" watchObservedRunningTime="2026-03-16 13:25:28.290254343 +0000 UTC m=+1172.689566891" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.623407 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.767781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts\") pod \"9d586557-5771-4f65-99bc-b6bd29f83dc9\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.767870 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p65dl\" (UniqueName: \"kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl\") pod \"9d586557-5771-4f65-99bc-b6bd29f83dc9\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.768084 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data\") pod \"9d586557-5771-4f65-99bc-b6bd29f83dc9\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.768362 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle\") pod \"9d586557-5771-4f65-99bc-b6bd29f83dc9\" (UID: \"9d586557-5771-4f65-99bc-b6bd29f83dc9\") " Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.786896 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl" (OuterVolumeSpecName: "kube-api-access-p65dl") pod "9d586557-5771-4f65-99bc-b6bd29f83dc9" (UID: "9d586557-5771-4f65-99bc-b6bd29f83dc9"). InnerVolumeSpecName "kube-api-access-p65dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.789335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts" (OuterVolumeSpecName: "scripts") pod "9d586557-5771-4f65-99bc-b6bd29f83dc9" (UID: "9d586557-5771-4f65-99bc-b6bd29f83dc9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.793885 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9d586557-5771-4f65-99bc-b6bd29f83dc9" (UID: "9d586557-5771-4f65-99bc-b6bd29f83dc9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.795116 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data" (OuterVolumeSpecName: "config-data") pod "9d586557-5771-4f65-99bc-b6bd29f83dc9" (UID: "9d586557-5771-4f65-99bc-b6bd29f83dc9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.872097 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p65dl\" (UniqueName: \"kubernetes.io/projected/9d586557-5771-4f65-99bc-b6bd29f83dc9-kube-api-access-p65dl\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.872135 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.872149 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:28 crc kubenswrapper[5030]: I0316 13:25:28.872162 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9d586557-5771-4f65-99bc-b6bd29f83dc9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.292001 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.292344 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn" event={"ID":"9d586557-5771-4f65-99bc-b6bd29f83dc9","Type":"ContainerDied","Data":"66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e"} Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.292413 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66dd9554be35b1abcb54f3aaa4dae7a05659821449cced5f6b6ce30a5bfa4a9e" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.337751 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.338802 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d586557-5771-4f65-99bc-b6bd29f83dc9" containerName="nova-cell0-conductor-db-sync" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.338824 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d586557-5771-4f65-99bc-b6bd29f83dc9" containerName="nova-cell0-conductor-db-sync" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.339004 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d586557-5771-4f65-99bc-b6bd29f83dc9" containerName="nova-cell0-conductor-db-sync" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.391280 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.391482 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.394345 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-rsh69\"" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.394590 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.493917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.493965 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhdbj\" (UniqueName: \"kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.494188 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.596021 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.596087 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhdbj\" (UniqueName: \"kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.596181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.601777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.602274 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.624156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhdbj\" (UniqueName: \"kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj\") pod \"nova-cell0-conductor-0\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:29 crc kubenswrapper[5030]: I0316 13:25:29.717496 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:30 crc kubenswrapper[5030]: I0316 13:25:30.158492 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:25:30 crc kubenswrapper[5030]: W0316 13:25:30.164457 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd02d0f3_56a7_4181_aef1_17bf3effc3d7.slice/crio-d4eaf482bf67d5e39a825bc8e76e01105fe5e50107efe7d7da9ffcdec08f1f12 WatchSource:0}: Error finding container d4eaf482bf67d5e39a825bc8e76e01105fe5e50107efe7d7da9ffcdec08f1f12: Status 404 returned error can't find the container with id d4eaf482bf67d5e39a825bc8e76e01105fe5e50107efe7d7da9ffcdec08f1f12 Mar 16 13:25:30 crc kubenswrapper[5030]: I0316 13:25:30.302505 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fd02d0f3-56a7-4181-aef1-17bf3effc3d7","Type":"ContainerStarted","Data":"d4eaf482bf67d5e39a825bc8e76e01105fe5e50107efe7d7da9ffcdec08f1f12"} Mar 16 13:25:31 crc kubenswrapper[5030]: I0316 13:25:31.316414 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fd02d0f3-56a7-4181-aef1-17bf3effc3d7","Type":"ContainerStarted","Data":"f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0"} Mar 16 13:25:31 crc kubenswrapper[5030]: I0316 13:25:31.316903 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:31 crc kubenswrapper[5030]: I0316 13:25:31.337842 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.33782462 podStartE2EDuration="2.33782462s" podCreationTimestamp="2026-03-16 13:25:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:31.334316842 +0000 UTC m=+1175.733629389" watchObservedRunningTime="2026-03-16 13:25:31.33782462 +0000 UTC m=+1175.737137167" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.356302 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.790503 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx"] Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.800724 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.802714 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx"] Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.803749 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.804635 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.875899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.875947 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.875974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.876026 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szzc\" (UniqueName: \"kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.978309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7szzc\" (UniqueName: \"kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.978991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.979022 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.979076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:37 crc kubenswrapper[5030]: I0316 13:25:37.987840 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.009227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.010129 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.014936 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szzc\" (UniqueName: \"kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc\") pod \"nova-cell0-cell-mapping-g5jsx\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.033190 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.049276 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.049865 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.062365 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.064257 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.073820 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.080827 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.086742 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.105184 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.116894 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.119108 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.120443 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.148966 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.185107 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.185149 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68shc\" (UniqueName: \"kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.185185 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.185278 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.185992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9k6\" (UniqueName: \"kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186114 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186154 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186189 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5xwk\" (UniqueName: \"kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186313 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.186333 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.192281 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.197895 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.229095 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkgpd\" (UniqueName: \"kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290678 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9k6\" (UniqueName: \"kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290847 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290880 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290913 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5xwk\" (UniqueName: \"kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.290996 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291016 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68shc\" (UniqueName: \"kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291154 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.291583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.296096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.296602 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.298295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.302951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.303057 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.304316 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.305130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.312943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9k6\" (UniqueName: \"kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6\") pod \"nova-api-0\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.313420 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68shc\" (UniqueName: \"kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc\") pod \"nova-metadata-0\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.326436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5xwk\" (UniqueName: \"kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk\") pod \"nova-scheduler-0\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.374642 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.383804 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.394412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.394600 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.394674 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkgpd\" (UniqueName: \"kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.401710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.415787 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.420011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkgpd\" (UniqueName: \"kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd\") pod \"nova-cell1-novncproxy-0\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.433859 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.527072 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.625198 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx"] Mar 16 13:25:38 crc kubenswrapper[5030]: W0316 13:25:38.924976 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01a3faac_8a37_48a8_8c72_f38fdc495701.slice/crio-05c3ba5a2cc925cc78b93bfb21e14a0ef6780f531f45fcebf3f9b195f94e9eb7 WatchSource:0}: Error finding container 05c3ba5a2cc925cc78b93bfb21e14a0ef6780f531f45fcebf3f9b195f94e9eb7: Status 404 returned error can't find the container with id 05c3ba5a2cc925cc78b93bfb21e14a0ef6780f531f45fcebf3f9b195f94e9eb7 Mar 16 13:25:38 crc kubenswrapper[5030]: I0316 13:25:38.932059 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:39 crc kubenswrapper[5030]: W0316 13:25:39.004708 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98118a25_b7c3_4e6e_a1f4_8ac7696ef49a.slice/crio-e1779aa6d5fa2d98ed3fa3e4e97fc69467774145cbdc662929b7d5ab7e6f80e7 WatchSource:0}: Error finding container e1779aa6d5fa2d98ed3fa3e4e97fc69467774145cbdc662929b7d5ab7e6f80e7: Status 404 returned error can't find the container with id e1779aa6d5fa2d98ed3fa3e4e97fc69467774145cbdc662929b7d5ab7e6f80e7 Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.020639 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.032281 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.086346 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf"] Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.091987 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.093622 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.094074 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.095034 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf"] Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.130583 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.230964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x29bg\" (UniqueName: \"kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.231080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.231294 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.231435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.334314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.334396 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x29bg\" (UniqueName: \"kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.334444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.334519 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.342384 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.348512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.349842 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.353806 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x29bg\" (UniqueName: \"kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg\") pod \"nova-cell1-conductor-db-sync-pbsxf\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.410315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerStarted","Data":"e683916187e41ccad5a8a11b75a1f35443320d794276f963ab73b0bdb1fcea14"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.412716 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.414075 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a","Type":"ContainerStarted","Data":"e1779aa6d5fa2d98ed3fa3e4e97fc69467774145cbdc662929b7d5ab7e6f80e7"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.420186 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c1a4fe52-d216-4ff3-b3b1-de06a07c2316","Type":"ContainerStarted","Data":"94981516bafcf65dc9ea4a0a5cf75ec30f11928a6b99bffa036a53f66c168b22"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.423300 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerStarted","Data":"05c3ba5a2cc925cc78b93bfb21e14a0ef6780f531f45fcebf3f9b195f94e9eb7"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.425352 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" event={"ID":"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a","Type":"ContainerStarted","Data":"166669405acde68d22c4d2043fd75a235ee79a587bd884d22ab15c05177f67be"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.425379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" event={"ID":"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a","Type":"ContainerStarted","Data":"f493a7d2076b89e260ddcf0eb21d4c92a8171f004d735c8e055de26c71705214"} Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.447264 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" podStartSLOduration=2.447251852 podStartE2EDuration="2.447251852s" podCreationTimestamp="2026-03-16 13:25:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:39.437748922 +0000 UTC m=+1183.837061530" watchObservedRunningTime="2026-03-16 13:25:39.447251852 +0000 UTC m=+1183.846564400" Mar 16 13:25:39 crc kubenswrapper[5030]: I0316 13:25:39.641031 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf"] Mar 16 13:25:39 crc kubenswrapper[5030]: W0316 13:25:39.643351 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461a5b9f_7856_4bbe_907a_6c002b26263d.slice/crio-3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e WatchSource:0}: Error finding container 3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e: Status 404 returned error can't find the container with id 3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e Mar 16 13:25:40 crc kubenswrapper[5030]: I0316 13:25:40.445917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" event={"ID":"461a5b9f-7856-4bbe-907a-6c002b26263d","Type":"ContainerStarted","Data":"767b7552fbf5200db3f5f800a5f567717f8b76fbf35e0fc7d084705cff1eea09"} Mar 16 13:25:40 crc kubenswrapper[5030]: I0316 13:25:40.448106 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" event={"ID":"461a5b9f-7856-4bbe-907a-6c002b26263d","Type":"ContainerStarted","Data":"3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e"} Mar 16 13:25:40 crc kubenswrapper[5030]: I0316 13:25:40.469562 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" podStartSLOduration=1.469531589 podStartE2EDuration="1.469531589s" podCreationTimestamp="2026-03-16 13:25:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:40.463918486 +0000 UTC m=+1184.863231033" watchObservedRunningTime="2026-03-16 13:25:40.469531589 +0000 UTC m=+1184.868844136" Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.458215 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a","Type":"ContainerStarted","Data":"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709"} Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.461487 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c1a4fe52-d216-4ff3-b3b1-de06a07c2316","Type":"ContainerStarted","Data":"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398"} Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.473443 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.483723 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.484528 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.362859487 podStartE2EDuration="3.4845145s" podCreationTimestamp="2026-03-16 13:25:38 +0000 UTC" firstStartedPulling="2026-03-16 13:25:39.009004335 +0000 UTC m=+1183.408316881" lastFinishedPulling="2026-03-16 13:25:41.130659347 +0000 UTC m=+1185.529971894" observedRunningTime="2026-03-16 13:25:41.482819155 +0000 UTC m=+1185.882131703" watchObservedRunningTime="2026-03-16 13:25:41.4845145 +0000 UTC m=+1185.883827048" Mar 16 13:25:41 crc kubenswrapper[5030]: I0316 13:25:41.500984 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.493116562 podStartE2EDuration="3.500967344s" podCreationTimestamp="2026-03-16 13:25:38 +0000 UTC" firstStartedPulling="2026-03-16 13:25:39.117778548 +0000 UTC m=+1183.517091085" lastFinishedPulling="2026-03-16 13:25:41.125629319 +0000 UTC m=+1185.524941867" observedRunningTime="2026-03-16 13:25:41.499782538 +0000 UTC m=+1185.899095086" watchObservedRunningTime="2026-03-16 13:25:41.500967344 +0000 UTC m=+1185.900279891" Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.435655 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.487475 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerStarted","Data":"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308"} Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.487533 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerStarted","Data":"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e"} Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.492106 5030 generic.go:358] "Generic (PLEG): container finished" podID="461a5b9f-7856-4bbe-907a-6c002b26263d" containerID="767b7552fbf5200db3f5f800a5f567717f8b76fbf35e0fc7d084705cff1eea09" exitCode=0 Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.492287 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" event={"ID":"461a5b9f-7856-4bbe-907a-6c002b26263d","Type":"ContainerDied","Data":"767b7552fbf5200db3f5f800a5f567717f8b76fbf35e0fc7d084705cff1eea09"} Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.496166 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398" gracePeriod=30 Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.496429 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-log" containerID="cri-o://3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" gracePeriod=30 Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.496508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerStarted","Data":"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc"} Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.496531 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerStarted","Data":"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902"} Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.497626 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-metadata" containerID="cri-o://5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" gracePeriod=30 Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.512345 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.7945401309999998 podStartE2EDuration="6.512324512s" podCreationTimestamp="2026-03-16 13:25:37 +0000 UTC" firstStartedPulling="2026-03-16 13:25:39.023924749 +0000 UTC m=+1183.423237297" lastFinishedPulling="2026-03-16 13:25:42.74170913 +0000 UTC m=+1187.141021678" observedRunningTime="2026-03-16 13:25:43.509147985 +0000 UTC m=+1187.908460532" watchObservedRunningTime="2026-03-16 13:25:43.512324512 +0000 UTC m=+1187.911637059" Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.528917 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:43 crc kubenswrapper[5030]: I0316 13:25:43.533458 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.713573177 podStartE2EDuration="6.533440243s" podCreationTimestamp="2026-03-16 13:25:37 +0000 UTC" firstStartedPulling="2026-03-16 13:25:38.928410794 +0000 UTC m=+1183.327723341" lastFinishedPulling="2026-03-16 13:25:42.748277859 +0000 UTC m=+1187.147590407" observedRunningTime="2026-03-16 13:25:43.527053317 +0000 UTC m=+1187.926365865" watchObservedRunningTime="2026-03-16 13:25:43.533440243 +0000 UTC m=+1187.932752790" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.069482 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.158564 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle\") pod \"01a3faac-8a37-48a8-8c72-f38fdc495701\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.158809 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs\") pod \"01a3faac-8a37-48a8-8c72-f38fdc495701\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.158968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68shc\" (UniqueName: \"kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc\") pod \"01a3faac-8a37-48a8-8c72-f38fdc495701\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.159194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data\") pod \"01a3faac-8a37-48a8-8c72-f38fdc495701\" (UID: \"01a3faac-8a37-48a8-8c72-f38fdc495701\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.159441 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs" (OuterVolumeSpecName: "logs") pod "01a3faac-8a37-48a8-8c72-f38fdc495701" (UID: "01a3faac-8a37-48a8-8c72-f38fdc495701"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.159910 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/01a3faac-8a37-48a8-8c72-f38fdc495701-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.170120 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc" (OuterVolumeSpecName: "kube-api-access-68shc") pod "01a3faac-8a37-48a8-8c72-f38fdc495701" (UID: "01a3faac-8a37-48a8-8c72-f38fdc495701"). InnerVolumeSpecName "kube-api-access-68shc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.196511 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data" (OuterVolumeSpecName: "config-data") pod "01a3faac-8a37-48a8-8c72-f38fdc495701" (UID: "01a3faac-8a37-48a8-8c72-f38fdc495701"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.215522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01a3faac-8a37-48a8-8c72-f38fdc495701" (UID: "01a3faac-8a37-48a8-8c72-f38fdc495701"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.262685 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68shc\" (UniqueName: \"kubernetes.io/projected/01a3faac-8a37-48a8-8c72-f38fdc495701-kube-api-access-68shc\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.262723 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.262739 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01a3faac-8a37-48a8-8c72-f38fdc495701-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.278647 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.364295 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data\") pod \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.364343 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkgpd\" (UniqueName: \"kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd\") pod \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.364781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle\") pod \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\" (UID: \"c1a4fe52-d216-4ff3-b3b1-de06a07c2316\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.367613 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd" (OuterVolumeSpecName: "kube-api-access-dkgpd") pod "c1a4fe52-d216-4ff3-b3b1-de06a07c2316" (UID: "c1a4fe52-d216-4ff3-b3b1-de06a07c2316"). InnerVolumeSpecName "kube-api-access-dkgpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.383707 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data" (OuterVolumeSpecName: "config-data") pod "c1a4fe52-d216-4ff3-b3b1-de06a07c2316" (UID: "c1a4fe52-d216-4ff3-b3b1-de06a07c2316"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.385020 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c1a4fe52-d216-4ff3-b3b1-de06a07c2316" (UID: "c1a4fe52-d216-4ff3-b3b1-de06a07c2316"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.468521 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.468848 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.468881 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkgpd\" (UniqueName: \"kubernetes.io/projected/c1a4fe52-d216-4ff3-b3b1-de06a07c2316-kube-api-access-dkgpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.509635 5030 generic.go:358] "Generic (PLEG): container finished" podID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" containerID="716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398" exitCode=0 Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.509764 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.509761 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c1a4fe52-d216-4ff3-b3b1-de06a07c2316","Type":"ContainerDied","Data":"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398"} Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.509999 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c1a4fe52-d216-4ff3-b3b1-de06a07c2316","Type":"ContainerDied","Data":"94981516bafcf65dc9ea4a0a5cf75ec30f11928a6b99bffa036a53f66c168b22"} Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.510035 5030 scope.go:117] "RemoveContainer" containerID="716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.515596 5030 generic.go:358] "Generic (PLEG): container finished" podID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerID="5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" exitCode=0 Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.515638 5030 generic.go:358] "Generic (PLEG): container finished" podID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerID="3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" exitCode=143 Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.516475 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.519114 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerDied","Data":"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc"} Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.519187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerDied","Data":"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902"} Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.519208 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"01a3faac-8a37-48a8-8c72-f38fdc495701","Type":"ContainerDied","Data":"05c3ba5a2cc925cc78b93bfb21e14a0ef6780f531f45fcebf3f9b195f94e9eb7"} Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.544219 5030 scope.go:117] "RemoveContainer" containerID="716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398" Mar 16 13:25:44 crc kubenswrapper[5030]: E0316 13:25:44.544698 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398\": container with ID starting with 716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398 not found: ID does not exist" containerID="716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.544826 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398"} err="failed to get container status \"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398\": rpc error: code = NotFound desc = could not find container \"716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398\": container with ID starting with 716332a9cb42a68477833b429ccc88d19e55948147cdc9f207e968e610e45398 not found: ID does not exist" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.544926 5030 scope.go:117] "RemoveContainer" containerID="5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.563076 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.572613 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.581528 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.582815 5030 scope.go:117] "RemoveContainer" containerID="3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.588609 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.594031 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595242 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595272 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595296 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-metadata" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595302 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-metadata" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595338 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-log" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595344 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-log" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595531 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595544 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-log" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.595578 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" containerName="nova-metadata-metadata" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.601213 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.605749 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.607328 5030 scope.go:117] "RemoveContainer" containerID="5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" Mar 16 13:25:44 crc kubenswrapper[5030]: E0316 13:25:44.608248 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc\": container with ID starting with 5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc not found: ID does not exist" containerID="5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608281 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc"} err="failed to get container status \"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc\": rpc error: code = NotFound desc = could not find container \"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc\": container with ID starting with 5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc not found: ID does not exist" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608299 5030 scope.go:117] "RemoveContainer" containerID="3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" Mar 16 13:25:44 crc kubenswrapper[5030]: E0316 13:25:44.608612 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902\": container with ID starting with 3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902 not found: ID does not exist" containerID="3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608656 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902"} err="failed to get container status \"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902\": rpc error: code = NotFound desc = could not find container \"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902\": container with ID starting with 3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902 not found: ID does not exist" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608682 5030 scope.go:117] "RemoveContainer" containerID="5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608899 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc"} err="failed to get container status \"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc\": rpc error: code = NotFound desc = could not find container \"5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc\": container with ID starting with 5a70a97891b70a95c1f71d39ec1da5814f88d35cb93e4ab67bf7a152ae2e59bc not found: ID does not exist" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.608922 5030 scope.go:117] "RemoveContainer" containerID="3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.609119 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902"} err="failed to get container status \"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902\": rpc error: code = NotFound desc = could not find container \"3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902\": container with ID starting with 3402af4103016bff42a6396f557ef4d53c0f69aa53841a6ed7a31a6002f05902 not found: ID does not exist" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.612339 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.612449 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.615494 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.615824 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.615902 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.615994 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.616167 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.616570 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.684851 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.684927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685200 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685609 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44x2c\" (UniqueName: \"kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685697 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxb4v\" (UniqueName: \"kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.685998 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.686199 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794283 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44x2c\" (UniqueName: \"kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794349 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxb4v\" (UniqueName: \"kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794389 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794411 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794427 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794453 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794511 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.794602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.795414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.798895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.799059 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.800311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.800867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.801496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.806170 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.811405 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxb4v\" (UniqueName: \"kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.814046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44x2c\" (UniqueName: \"kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c\") pod \"nova-cell1-novncproxy-0\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.814354 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.915744 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.924133 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.929275 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.997817 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x29bg\" (UniqueName: \"kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg\") pod \"461a5b9f-7856-4bbe-907a-6c002b26263d\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.998159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data\") pod \"461a5b9f-7856-4bbe-907a-6c002b26263d\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.998289 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts\") pod \"461a5b9f-7856-4bbe-907a-6c002b26263d\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " Mar 16 13:25:44 crc kubenswrapper[5030]: I0316 13:25:44.998750 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle\") pod \"461a5b9f-7856-4bbe-907a-6c002b26263d\" (UID: \"461a5b9f-7856-4bbe-907a-6c002b26263d\") " Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.002088 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts" (OuterVolumeSpecName: "scripts") pod "461a5b9f-7856-4bbe-907a-6c002b26263d" (UID: "461a5b9f-7856-4bbe-907a-6c002b26263d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.002131 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg" (OuterVolumeSpecName: "kube-api-access-x29bg") pod "461a5b9f-7856-4bbe-907a-6c002b26263d" (UID: "461a5b9f-7856-4bbe-907a-6c002b26263d"). InnerVolumeSpecName "kube-api-access-x29bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.020504 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "461a5b9f-7856-4bbe-907a-6c002b26263d" (UID: "461a5b9f-7856-4bbe-907a-6c002b26263d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.021097 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data" (OuterVolumeSpecName: "config-data") pod "461a5b9f-7856-4bbe-907a-6c002b26263d" (UID: "461a5b9f-7856-4bbe-907a-6c002b26263d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.101673 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.101709 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.101720 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x29bg\" (UniqueName: \"kubernetes.io/projected/461a5b9f-7856-4bbe-907a-6c002b26263d-kube-api-access-x29bg\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.101729 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/461a5b9f-7856-4bbe-907a-6c002b26263d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.391255 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:25:45 crc kubenswrapper[5030]: W0316 13:25:45.396733 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod541e36a8_c06c_46c6_a86b_2129cd5b99a6.slice/crio-9f273290854363f97bb4e615a5c018919ca701ff88a130ad71621ac283c521e8 WatchSource:0}: Error finding container 9f273290854363f97bb4e615a5c018919ca701ff88a130ad71621ac283c521e8: Status 404 returned error can't find the container with id 9f273290854363f97bb4e615a5c018919ca701ff88a130ad71621ac283c521e8 Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.439696 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.531948 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.531946 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf" event={"ID":"461a5b9f-7856-4bbe-907a-6c002b26263d","Type":"ContainerDied","Data":"3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e"} Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.532299 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b04d1fc0faba73f2cb26a4d10d60a32441852cfa649a2c8ef7675b12d41c71e" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.536848 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerStarted","Data":"b666bdf300fafa395adc98ab50144ace1b021aafe95c9b87e8f50ccc044235ed"} Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.539570 5030 generic.go:358] "Generic (PLEG): container finished" podID="532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" containerID="166669405acde68d22c4d2043fd75a235ee79a587bd884d22ab15c05177f67be" exitCode=0 Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.539934 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" event={"ID":"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a","Type":"ContainerDied","Data":"166669405acde68d22c4d2043fd75a235ee79a587bd884d22ab15c05177f67be"} Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.542572 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"541e36a8-c06c-46c6-a86b-2129cd5b99a6","Type":"ContainerStarted","Data":"9f273290854363f97bb4e615a5c018919ca701ff88a130ad71621ac283c521e8"} Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.635707 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.637282 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461a5b9f-7856-4bbe-907a-6c002b26263d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.637315 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="461a5b9f-7856-4bbe-907a-6c002b26263d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.637698 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="461a5b9f-7856-4bbe-907a-6c002b26263d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.642170 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.644882 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.659884 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.717027 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87fz2\" (UniqueName: \"kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.717423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.717851 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.819831 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.820072 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.820119 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87fz2\" (UniqueName: \"kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.824760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.825808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.840994 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87fz2\" (UniqueName: \"kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2\") pod \"nova-cell1-conductor-0\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.958271 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a3faac-8a37-48a8-8c72-f38fdc495701" path="/var/lib/kubelet/pods/01a3faac-8a37-48a8-8c72-f38fdc495701/volumes" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.959324 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1a4fe52-d216-4ff3-b3b1-de06a07c2316" path="/var/lib/kubelet/pods/c1a4fe52-d216-4ff3-b3b1-de06a07c2316/volumes" Mar 16 13:25:45 crc kubenswrapper[5030]: I0316 13:25:45.963515 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.373382 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:25:46 crc kubenswrapper[5030]: W0316 13:25:46.381753 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45f3f054_9c16_4e92_b203_0ace1d4ce50b.slice/crio-780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c WatchSource:0}: Error finding container 780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c: Status 404 returned error can't find the container with id 780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.569807 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"541e36a8-c06c-46c6-a86b-2129cd5b99a6","Type":"ContainerStarted","Data":"2759a16515c1d2dc86dc52c9771e769e8d7a7abb0313d20a489258f557464d42"} Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.572024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerStarted","Data":"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3"} Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.572088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerStarted","Data":"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4"} Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.573842 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"45f3f054-9c16-4e92-b203-0ace1d4ce50b","Type":"ContainerStarted","Data":"01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969"} Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.573881 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"45f3f054-9c16-4e92-b203-0ace1d4ce50b","Type":"ContainerStarted","Data":"780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c"} Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.573982 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.610750 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=1.61073953 podStartE2EDuration="1.61073953s" podCreationTimestamp="2026-03-16 13:25:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:46.609387672 +0000 UTC m=+1191.008700218" watchObservedRunningTime="2026-03-16 13:25:46.61073953 +0000 UTC m=+1191.010052067" Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.614791 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.614780871 podStartE2EDuration="2.614780871s" podCreationTimestamp="2026-03-16 13:25:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:46.592161675 +0000 UTC m=+1190.991474222" watchObservedRunningTime="2026-03-16 13:25:46.614780871 +0000 UTC m=+1191.014093418" Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.624640 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.624631624 podStartE2EDuration="2.624631624s" podCreationTimestamp="2026-03-16 13:25:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:46.62146143 +0000 UTC m=+1191.020773967" watchObservedRunningTime="2026-03-16 13:25:46.624631624 +0000 UTC m=+1191.023944171" Mar 16 13:25:46 crc kubenswrapper[5030]: I0316 13:25:46.890904 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.053437 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data\") pod \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.053497 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7szzc\" (UniqueName: \"kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc\") pod \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.053588 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle\") pod \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.053614 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts\") pod \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\" (UID: \"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a\") " Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.061541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts" (OuterVolumeSpecName: "scripts") pod "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" (UID: "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.061602 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc" (OuterVolumeSpecName: "kube-api-access-7szzc") pod "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" (UID: "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a"). InnerVolumeSpecName "kube-api-access-7szzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.080407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data" (OuterVolumeSpecName: "config-data") pod "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" (UID: "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.081757 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" (UID: "532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.155863 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.155897 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7szzc\" (UniqueName: \"kubernetes.io/projected/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-kube-api-access-7szzc\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.155909 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.155918 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.592765 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.593102 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx" event={"ID":"532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a","Type":"ContainerDied","Data":"f493a7d2076b89e260ddcf0eb21d4c92a8171f004d735c8e055de26c71705214"} Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.593170 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f493a7d2076b89e260ddcf0eb21d4c92a8171f004d735c8e055de26c71705214" Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.675209 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.675533 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-log" containerID="cri-o://c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" gracePeriod=30 Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.675654 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-api" containerID="cri-o://b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" gracePeriod=30 Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.694425 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.694796 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" containerName="nova-scheduler-scheduler" containerID="cri-o://e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709" gracePeriod=30 Mar 16 13:25:47 crc kubenswrapper[5030]: I0316 13:25:47.772810 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.247135 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.302250 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq9k6\" (UniqueName: \"kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6\") pod \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.302369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle\") pod \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.302424 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data\") pod \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.302502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs\") pod \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\" (UID: \"b144d4f1-142d-443f-bf74-a4d4a04ebb3e\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.303293 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs" (OuterVolumeSpecName: "logs") pod "b144d4f1-142d-443f-bf74-a4d4a04ebb3e" (UID: "b144d4f1-142d-443f-bf74-a4d4a04ebb3e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.310665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6" (OuterVolumeSpecName: "kube-api-access-xq9k6") pod "b144d4f1-142d-443f-bf74-a4d4a04ebb3e" (UID: "b144d4f1-142d-443f-bf74-a4d4a04ebb3e"). InnerVolumeSpecName "kube-api-access-xq9k6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.332499 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b144d4f1-142d-443f-bf74-a4d4a04ebb3e" (UID: "b144d4f1-142d-443f-bf74-a4d4a04ebb3e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.332755 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data" (OuterVolumeSpecName: "config-data") pod "b144d4f1-142d-443f-bf74-a4d4a04ebb3e" (UID: "b144d4f1-142d-443f-bf74-a4d4a04ebb3e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.382159 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.404441 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle\") pod \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.404675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5xwk\" (UniqueName: \"kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk\") pod \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.404744 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data\") pod \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\" (UID: \"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a\") " Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.405307 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq9k6\" (UniqueName: \"kubernetes.io/projected/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-kube-api-access-xq9k6\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.405326 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.405337 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.405346 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b144d4f1-142d-443f-bf74-a4d4a04ebb3e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.409774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk" (OuterVolumeSpecName: "kube-api-access-w5xwk") pod "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" (UID: "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a"). InnerVolumeSpecName "kube-api-access-w5xwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.427835 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data" (OuterVolumeSpecName: "config-data") pod "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" (UID: "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.434674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" (UID: "98118a25-b7c3-4e6e-a1f4-8ac7696ef49a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.511882 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.511918 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5xwk\" (UniqueName: \"kubernetes.io/projected/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-kube-api-access-w5xwk\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.511931 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.604603 5030 generic.go:358] "Generic (PLEG): container finished" podID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerID="b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" exitCode=0 Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.605464 5030 generic.go:358] "Generic (PLEG): container finished" podID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerID="c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" exitCode=143 Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.604782 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.604683 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerDied","Data":"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308"} Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.605824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerDied","Data":"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e"} Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.605855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"b144d4f1-142d-443f-bf74-a4d4a04ebb3e","Type":"ContainerDied","Data":"e683916187e41ccad5a8a11b75a1f35443320d794276f963ab73b0bdb1fcea14"} Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.605884 5030 scope.go:117] "RemoveContainer" containerID="b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.608630 5030 generic.go:358] "Generic (PLEG): container finished" podID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" containerID="e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709" exitCode=0 Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.608777 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.608861 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a","Type":"ContainerDied","Data":"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709"} Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.608894 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"98118a25-b7c3-4e6e-a1f4-8ac7696ef49a","Type":"ContainerDied","Data":"e1779aa6d5fa2d98ed3fa3e4e97fc69467774145cbdc662929b7d5ab7e6f80e7"} Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.609857 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-log" containerID="cri-o://4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" gracePeriod=30 Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.609900 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-metadata" containerID="cri-o://d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" gracePeriod=30 Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.637296 5030 scope.go:117] "RemoveContainer" containerID="c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.643038 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.649425 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.667602 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.671220 5030 scope.go:117] "RemoveContainer" containerID="b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" Mar 16 13:25:48 crc kubenswrapper[5030]: E0316 13:25:48.671748 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308\": container with ID starting with b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308 not found: ID does not exist" containerID="b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.671792 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308"} err="failed to get container status \"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308\": rpc error: code = NotFound desc = could not find container \"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308\": container with ID starting with b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308 not found: ID does not exist" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.671824 5030 scope.go:117] "RemoveContainer" containerID="c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" Mar 16 13:25:48 crc kubenswrapper[5030]: E0316 13:25:48.672165 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e\": container with ID starting with c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e not found: ID does not exist" containerID="c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.672260 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e"} err="failed to get container status \"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e\": rpc error: code = NotFound desc = could not find container \"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e\": container with ID starting with c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e not found: ID does not exist" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.672335 5030 scope.go:117] "RemoveContainer" containerID="b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.672293 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.673591 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308"} err="failed to get container status \"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308\": rpc error: code = NotFound desc = could not find container \"b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308\": container with ID starting with b262434c6167fb6716dab3cdc0fb3c089a86e34b44e394ad4b150384a56de308 not found: ID does not exist" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.673616 5030 scope.go:117] "RemoveContainer" containerID="c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.673873 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e"} err="failed to get container status \"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e\": rpc error: code = NotFound desc = could not find container \"c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e\": container with ID starting with c7d674ce9051434d235aecb7873c7dd5709b0aa70eb90dfcf5254d96111d625e not found: ID does not exist" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.673900 5030 scope.go:117] "RemoveContainer" containerID="e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674098 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-log" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674245 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-log" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674314 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" containerName="nova-manage" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674369 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" containerName="nova-manage" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674445 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" containerName="nova-scheduler-scheduler" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674498 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" containerName="nova-scheduler-scheduler" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674599 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-api" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674662 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-api" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674856 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-api" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674914 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" containerName="nova-manage" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.674969 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" containerName="nova-api-log" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.675101 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" containerName="nova-scheduler-scheduler" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.681908 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.682084 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.693725 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.701388 5030 scope.go:117] "RemoveContainer" containerID="e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709" Mar 16 13:25:48 crc kubenswrapper[5030]: E0316 13:25:48.702306 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709\": container with ID starting with e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709 not found: ID does not exist" containerID="e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.702342 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709"} err="failed to get container status \"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709\": rpc error: code = NotFound desc = could not find container \"e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709\": container with ID starting with e8dae04cceda15e551b25caa994563cfb592d91662ad85c324d53578ffc8d709 not found: ID does not exist" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.708141 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.713589 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.715705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.715811 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnrd4\" (UniqueName: \"kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.715855 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.718865 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.721321 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.731457 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.817317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.817384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.817409 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.817633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vvg\" (UniqueName: \"kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.818065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnrd4\" (UniqueName: \"kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.818192 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.818314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.823822 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.823965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.836200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnrd4\" (UniqueName: \"kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4\") pod \"nova-scheduler-0\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.921208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.921251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.921302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vvg\" (UniqueName: \"kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.921439 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.922127 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.926008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.926145 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:48 crc kubenswrapper[5030]: I0316 13:25:48.938947 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vvg\" (UniqueName: \"kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg\") pod \"nova-api-0\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.040876 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.041109 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.174967 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.246682 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs\") pod \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.246868 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxb4v\" (UniqueName: \"kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v\") pod \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.246915 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle\") pod \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.246944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs\") pod \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.246992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data\") pod \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\" (UID: \"eaf02789-32b0-4401-a489-fc5fe0c7e37d\") " Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.248829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs" (OuterVolumeSpecName: "logs") pod "eaf02789-32b0-4401-a489-fc5fe0c7e37d" (UID: "eaf02789-32b0-4401-a489-fc5fe0c7e37d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.253225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v" (OuterVolumeSpecName: "kube-api-access-sxb4v") pod "eaf02789-32b0-4401-a489-fc5fe0c7e37d" (UID: "eaf02789-32b0-4401-a489-fc5fe0c7e37d"). InnerVolumeSpecName "kube-api-access-sxb4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.283294 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eaf02789-32b0-4401-a489-fc5fe0c7e37d" (UID: "eaf02789-32b0-4401-a489-fc5fe0c7e37d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.290154 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data" (OuterVolumeSpecName: "config-data") pod "eaf02789-32b0-4401-a489-fc5fe0c7e37d" (UID: "eaf02789-32b0-4401-a489-fc5fe0c7e37d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.307722 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "eaf02789-32b0-4401-a489-fc5fe0c7e37d" (UID: "eaf02789-32b0-4401-a489-fc5fe0c7e37d"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.349823 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.349869 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxb4v\" (UniqueName: \"kubernetes.io/projected/eaf02789-32b0-4401-a489-fc5fe0c7e37d-kube-api-access-sxb4v\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.349882 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.349893 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eaf02789-32b0-4401-a489-fc5fe0c7e37d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.349904 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf02789-32b0-4401-a489-fc5fe0c7e37d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.602293 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: W0316 13:25:49.605748 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c767bf9_5821_4cad_9816_290f87bd2684.slice/crio-77c728a85bd337295340f44b87af58ffa590c2c76fab0ccd55e143c7660fb21e WatchSource:0}: Error finding container 77c728a85bd337295340f44b87af58ffa590c2c76fab0ccd55e143c7660fb21e: Status 404 returned error can't find the container with id 77c728a85bd337295340f44b87af58ffa590c2c76fab0ccd55e143c7660fb21e Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.633799 5030 generic.go:358] "Generic (PLEG): container finished" podID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerID="d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" exitCode=0 Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.633833 5030 generic.go:358] "Generic (PLEG): container finished" podID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerID="4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" exitCode=143 Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.634247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerDied","Data":"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3"} Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.634286 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerDied","Data":"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4"} Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.634298 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"eaf02789-32b0-4401-a489-fc5fe0c7e37d","Type":"ContainerDied","Data":"b666bdf300fafa395adc98ab50144ace1b021aafe95c9b87e8f50ccc044235ed"} Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.634316 5030 scope.go:117] "RemoveContainer" containerID="d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.634433 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.647111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerStarted","Data":"77c728a85bd337295340f44b87af58ffa590c2c76fab0ccd55e143c7660fb21e"} Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.653482 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.676655 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.685516 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.690880 5030 scope.go:117] "RemoveContainer" containerID="4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.704867 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706353 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-metadata" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706391 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-metadata" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706486 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-log" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706498 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-log" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706783 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-metadata" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.706816 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" containerName="nova-metadata-log" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.727711 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.727932 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.730813 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.730863 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.732749 5030 scope.go:117] "RemoveContainer" containerID="d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" Mar 16 13:25:49 crc kubenswrapper[5030]: E0316 13:25:49.735925 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3\": container with ID starting with d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3 not found: ID does not exist" containerID="d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.735967 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3"} err="failed to get container status \"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3\": rpc error: code = NotFound desc = could not find container \"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3\": container with ID starting with d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3 not found: ID does not exist" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.735993 5030 scope.go:117] "RemoveContainer" containerID="4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" Mar 16 13:25:49 crc kubenswrapper[5030]: E0316 13:25:49.736562 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4\": container with ID starting with 4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4 not found: ID does not exist" containerID="4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.736612 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4"} err="failed to get container status \"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4\": rpc error: code = NotFound desc = could not find container \"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4\": container with ID starting with 4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4 not found: ID does not exist" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.736647 5030 scope.go:117] "RemoveContainer" containerID="d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.738232 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3"} err="failed to get container status \"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3\": rpc error: code = NotFound desc = could not find container \"d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3\": container with ID starting with d7ff4ae9ecad3e7f9b4ce96fb2d39d5f16e82d5c61b787429c910386295249c3 not found: ID does not exist" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.738276 5030 scope.go:117] "RemoveContainer" containerID="4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.738684 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4"} err="failed to get container status \"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4\": rpc error: code = NotFound desc = could not find container \"4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4\": container with ID starting with 4b27eacad744e1a22bb6d4864d343550e76c0654f68b28d089ceb1e74816a8d4 not found: ID does not exist" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.758569 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.758892 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.758970 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79b7\" (UniqueName: \"kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.759150 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.759209 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.860919 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.861251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v79b7\" (UniqueName: \"kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.861325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.861400 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.861603 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.861863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.866298 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.866913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.868705 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.876264 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79b7\" (UniqueName: \"kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7\") pod \"nova-metadata-0\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.929535 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.959966 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98118a25-b7c3-4e6e-a1f4-8ac7696ef49a" path="/var/lib/kubelet/pods/98118a25-b7c3-4e6e-a1f4-8ac7696ef49a/volumes" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.960536 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b144d4f1-142d-443f-bf74-a4d4a04ebb3e" path="/var/lib/kubelet/pods/b144d4f1-142d-443f-bf74-a4d4a04ebb3e/volumes" Mar 16 13:25:49 crc kubenswrapper[5030]: I0316 13:25:49.961182 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf02789-32b0-4401-a489-fc5fe0c7e37d" path="/var/lib/kubelet/pods/eaf02789-32b0-4401-a489-fc5fe0c7e37d/volumes" Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.069982 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.500626 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.661332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerStarted","Data":"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.662679 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerStarted","Data":"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.666425 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"726e7fa7-428a-43d5-b6be-3abb59b5aba5","Type":"ContainerStarted","Data":"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.666517 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"726e7fa7-428a-43d5-b6be-3abb59b5aba5","Type":"ContainerStarted","Data":"70f3cc87b06bb6df30e8740af0a2b386d9b444ce0f9be9c8215e3a4d040cd689"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.669180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerStarted","Data":"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.669283 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerStarted","Data":"ed9cabf16bb73e6c5d327124d7930700234093668c5817dbb961992a6eef2628"} Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.691868 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.6918486010000002 podStartE2EDuration="2.691848601s" podCreationTimestamp="2026-03-16 13:25:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:50.685832571 +0000 UTC m=+1195.085145118" watchObservedRunningTime="2026-03-16 13:25:50.691848601 +0000 UTC m=+1195.091161148" Mar 16 13:25:50 crc kubenswrapper[5030]: I0316 13:25:50.714152 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.714126175 podStartE2EDuration="2.714126175s" podCreationTimestamp="2026-03-16 13:25:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:50.69916352 +0000 UTC m=+1195.098476068" watchObservedRunningTime="2026-03-16 13:25:50.714126175 +0000 UTC m=+1195.113438722" Mar 16 13:25:51 crc kubenswrapper[5030]: I0316 13:25:51.687587 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerStarted","Data":"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1"} Mar 16 13:25:51 crc kubenswrapper[5030]: I0316 13:25:51.717090 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.717072368 podStartE2EDuration="2.717072368s" podCreationTimestamp="2026-03-16 13:25:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:51.713006269 +0000 UTC m=+1196.112318806" watchObservedRunningTime="2026-03-16 13:25:51.717072368 +0000 UTC m=+1196.116384904" Mar 16 13:25:52 crc kubenswrapper[5030]: I0316 13:25:52.620715 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:25:53 crc kubenswrapper[5030]: E0316 13:25:53.931695 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763170 actualBytes=10240 Mar 16 13:25:54 crc kubenswrapper[5030]: I0316 13:25:54.041320 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:54 crc kubenswrapper[5030]: I0316 13:25:54.286746 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:25:54 crc kubenswrapper[5030]: I0316 13:25:54.286866 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:25:54 crc kubenswrapper[5030]: I0316 13:25:54.930203 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:54 crc kubenswrapper[5030]: I0316 13:25:54.958861 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.763093 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.892817 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8"] Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.898519 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.900882 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.901174 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.905433 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8"] Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.991996 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.992310 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.992468 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fzs\" (UniqueName: \"kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:55 crc kubenswrapper[5030]: I0316 13:25:55.992755 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.095158 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22fzs\" (UniqueName: \"kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.096034 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.096438 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.096605 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.098543 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.100231 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.106253 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.114264 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.117178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.120032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fzs\" (UniqueName: \"kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs\") pod \"nova-cell1-cell-mapping-ds5x8\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.217202 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.468723 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.477288 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.480338 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.497899 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.644413 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8"] Mar 16 13:25:56 crc kubenswrapper[5030]: W0316 13:25:56.645494 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a170bb_6dc5_4f4a_b1e5_35d16b3c3a16.slice/crio-9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb WatchSource:0}: Error finding container 9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb: Status 404 returned error can't find the container with id 9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb Mar 16 13:25:56 crc kubenswrapper[5030]: I0316 13:25:56.759759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" event={"ID":"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16","Type":"ContainerStarted","Data":"9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb"} Mar 16 13:25:57 crc kubenswrapper[5030]: I0316 13:25:57.774712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" event={"ID":"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16","Type":"ContainerStarted","Data":"a1e80273a1bc2579497f4574ab52b8a3cb9721d1193c102dba93b5fbeeb2296d"} Mar 16 13:25:57 crc kubenswrapper[5030]: I0316 13:25:57.796420 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" podStartSLOduration=2.796400568 podStartE2EDuration="2.796400568s" podCreationTimestamp="2026-03-16 13:25:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:25:57.792293524 +0000 UTC m=+1202.191606071" watchObservedRunningTime="2026-03-16 13:25:57.796400568 +0000 UTC m=+1202.195713115" Mar 16 13:25:59 crc kubenswrapper[5030]: I0316 13:25:59.041761 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:59 crc kubenswrapper[5030]: I0316 13:25:59.042221 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:25:59 crc kubenswrapper[5030]: I0316 13:25:59.042237 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:59 crc kubenswrapper[5030]: I0316 13:25:59.085010 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:25:59 crc kubenswrapper[5030]: I0316 13:25:59.820581 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.070485 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.070803 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.082698 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.187:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.082765 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.187:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.138050 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561126-xckbz"] Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.144339 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.146321 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.146755 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.147347 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.151745 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561126-xckbz"] Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.185673 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwhd\" (UniqueName: \"kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd\") pod \"auto-csr-approver-29561126-xckbz\" (UID: \"b020c3fb-8562-4b9b-86c6-2048b9ecabaf\") " pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.288957 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stwhd\" (UniqueName: \"kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd\") pod \"auto-csr-approver-29561126-xckbz\" (UID: \"b020c3fb-8562-4b9b-86c6-2048b9ecabaf\") " pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.307472 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwhd\" (UniqueName: \"kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd\") pod \"auto-csr-approver-29561126-xckbz\" (UID: \"b020c3fb-8562-4b9b-86c6-2048b9ecabaf\") " pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.324105 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.468303 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:00 crc kubenswrapper[5030]: E0316 13:26:00.753021 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a170bb_6dc5_4f4a_b1e5_35d16b3c3a16.slice/crio-conmon-a1e80273a1bc2579497f4574ab52b8a3cb9721d1193c102dba93b5fbeeb2296d.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.806470 5030 generic.go:358] "Generic (PLEG): container finished" podID="32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" containerID="a1e80273a1bc2579497f4574ab52b8a3cb9721d1193c102dba93b5fbeeb2296d" exitCode=0 Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.806588 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" event={"ID":"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16","Type":"ContainerDied","Data":"a1e80273a1bc2579497f4574ab52b8a3cb9721d1193c102dba93b5fbeeb2296d"} Mar 16 13:26:00 crc kubenswrapper[5030]: I0316 13:26:00.962766 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561126-xckbz"] Mar 16 13:26:01 crc kubenswrapper[5030]: I0316 13:26:01.078715 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:01 crc kubenswrapper[5030]: I0316 13:26:01.078771 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.188:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:01 crc kubenswrapper[5030]: I0316 13:26:01.819631 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561126-xckbz" event={"ID":"b020c3fb-8562-4b9b-86c6-2048b9ecabaf","Type":"ContainerStarted","Data":"e3258ba91334b4fc7d1c7d700a8add68b71774b457dea74630370e04d6494348"} Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.185537 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.233385 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts\") pod \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.233459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22fzs\" (UniqueName: \"kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs\") pod \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.233850 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle\") pod \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.233928 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data\") pod \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\" (UID: \"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16\") " Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.240349 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts" (OuterVolumeSpecName: "scripts") pod "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" (UID: "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.240407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs" (OuterVolumeSpecName: "kube-api-access-22fzs") pod "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" (UID: "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16"). InnerVolumeSpecName "kube-api-access-22fzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.260501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" (UID: "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.260921 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data" (OuterVolumeSpecName: "config-data") pod "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" (UID: "32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.339029 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.339065 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.339076 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.339086 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22fzs\" (UniqueName: \"kubernetes.io/projected/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16-kube-api-access-22fzs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.835721 5030 generic.go:358] "Generic (PLEG): container finished" podID="b020c3fb-8562-4b9b-86c6-2048b9ecabaf" containerID="2522493bd1bdf376d451159efa759914e33d5283ab8d458fdb4dff049ecc746b" exitCode=0 Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.836291 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561126-xckbz" event={"ID":"b020c3fb-8562-4b9b-86c6-2048b9ecabaf","Type":"ContainerDied","Data":"2522493bd1bdf376d451159efa759914e33d5283ab8d458fdb4dff049ecc746b"} Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.840200 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" event={"ID":"32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16","Type":"ContainerDied","Data":"9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb"} Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.840273 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ffcab1bee842322fbe4cf7b46df0d5cc05c58ad4236e3c1749f8dc8edd2a1fb" Mar 16 13:26:02 crc kubenswrapper[5030]: I0316 13:26:02.840400 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8" Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.006673 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.006932 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-log" containerID="cri-o://97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.007052 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-api" containerID="cri-o://cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.064381 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.064758 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerName="nova-scheduler-scheduler" containerID="cri-o://91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.074463 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.074723 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-log" containerID="cri-o://ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.074827 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-metadata" containerID="cri-o://3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.536972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.537211 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="89147732-39a0-43c6-9768-5d4fd41e8c30" containerName="kube-state-metrics" containerID="cri-o://c1786f32986942b62ab3bb537cd96b1139a4f62c3c2a914c50827e5df67466d9" gracePeriod=30 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.858496 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c767bf9-5821-4cad-9816-290f87bd2684" containerID="97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f" exitCode=143 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.858659 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerDied","Data":"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f"} Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.860990 5030 generic.go:358] "Generic (PLEG): container finished" podID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerID="ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235" exitCode=143 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.861140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerDied","Data":"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235"} Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.862282 5030 generic.go:358] "Generic (PLEG): container finished" podID="89147732-39a0-43c6-9768-5d4fd41e8c30" containerID="c1786f32986942b62ab3bb537cd96b1139a4f62c3c2a914c50827e5df67466d9" exitCode=2 Mar 16 13:26:03 crc kubenswrapper[5030]: I0316 13:26:03.862736 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"89147732-39a0-43c6-9768-5d4fd41e8c30","Type":"ContainerDied","Data":"c1786f32986942b62ab3bb537cd96b1139a4f62c3c2a914c50827e5df67466d9"} Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.029148 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.085496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dspfn\" (UniqueName: \"kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn\") pod \"89147732-39a0-43c6-9768-5d4fd41e8c30\" (UID: \"89147732-39a0-43c6-9768-5d4fd41e8c30\") " Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.094214 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn" (OuterVolumeSpecName: "kube-api-access-dspfn") pod "89147732-39a0-43c6-9768-5d4fd41e8c30" (UID: "89147732-39a0-43c6-9768-5d4fd41e8c30"). InnerVolumeSpecName "kube-api-access-dspfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.189431 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dspfn\" (UniqueName: \"kubernetes.io/projected/89147732-39a0-43c6-9768-5d4fd41e8c30-kube-api-access-dspfn\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.208377 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.290568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stwhd\" (UniqueName: \"kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd\") pod \"b020c3fb-8562-4b9b-86c6-2048b9ecabaf\" (UID: \"b020c3fb-8562-4b9b-86c6-2048b9ecabaf\") " Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.298790 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd" (OuterVolumeSpecName: "kube-api-access-stwhd") pod "b020c3fb-8562-4b9b-86c6-2048b9ecabaf" (UID: "b020c3fb-8562-4b9b-86c6-2048b9ecabaf"). InnerVolumeSpecName "kube-api-access-stwhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.393233 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stwhd\" (UniqueName: \"kubernetes.io/projected/b020c3fb-8562-4b9b-86c6-2048b9ecabaf-kube-api-access-stwhd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:04 crc kubenswrapper[5030]: E0316 13:26:04.796413 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:26:04 crc kubenswrapper[5030]: E0316 13:26:04.798360 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:26:04 crc kubenswrapper[5030]: E0316 13:26:04.800033 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:26:04 crc kubenswrapper[5030]: E0316 13:26:04.800090 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.908351 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.908349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"89147732-39a0-43c6-9768-5d4fd41e8c30","Type":"ContainerDied","Data":"3e893f243bd6883b45beb6ea53dd2dda242c66863059cc9568d5412bfb5894e0"} Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.908496 5030 scope.go:117] "RemoveContainer" containerID="c1786f32986942b62ab3bb537cd96b1139a4f62c3c2a914c50827e5df67466d9" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.924864 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561126-xckbz" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.924886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561126-xckbz" event={"ID":"b020c3fb-8562-4b9b-86c6-2048b9ecabaf","Type":"ContainerDied","Data":"e3258ba91334b4fc7d1c7d700a8add68b71774b457dea74630370e04d6494348"} Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.924921 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3258ba91334b4fc7d1c7d700a8add68b71774b457dea74630370e04d6494348" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.949647 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.967209 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.988594 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989702 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89147732-39a0-43c6-9768-5d4fd41e8c30" containerName="kube-state-metrics" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989724 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="89147732-39a0-43c6-9768-5d4fd41e8c30" containerName="kube-state-metrics" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989778 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" containerName="nova-manage" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989784 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" containerName="nova-manage" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989811 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b020c3fb-8562-4b9b-86c6-2048b9ecabaf" containerName="oc" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989816 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b020c3fb-8562-4b9b-86c6-2048b9ecabaf" containerName="oc" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989972 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" containerName="nova-manage" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.989988 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="89147732-39a0-43c6-9768-5d4fd41e8c30" containerName="kube-state-metrics" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.990011 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b020c3fb-8562-4b9b-86c6-2048b9ecabaf" containerName="oc" Mar 16 13:26:04 crc kubenswrapper[5030]: I0316 13:26:04.993648 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.001621 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.001806 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.004920 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.124693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdd4q\" (UniqueName: \"kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.124786 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.124934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.125019 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.226626 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.226773 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.226811 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.227252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdd4q\" (UniqueName: \"kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.231380 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.231406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.231568 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.242794 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdd4q\" (UniqueName: \"kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q\") pod \"kube-state-metrics-0\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.278802 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561120-kg66j"] Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.288669 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561120-kg66j"] Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.293726 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.294118 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-central-agent" containerID="cri-o://73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11" gracePeriod=30 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.294159 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="proxy-httpd" containerID="cri-o://d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779" gracePeriod=30 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.294277 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-notification-agent" containerID="cri-o://fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074" gracePeriod=30 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.294177 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="sg-core" containerID="cri-o://40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684" gracePeriod=30 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.344949 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.748207 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.831187 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.935254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"77627c76-1e68-4476-af56-081c481ae2dd","Type":"ContainerStarted","Data":"ba8faed0c9f48b2362e25ab8f37072944a14a519db62243fb404240cf9cea7c3"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939082 5030 generic.go:358] "Generic (PLEG): container finished" podID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerID="d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779" exitCode=0 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939110 5030 generic.go:358] "Generic (PLEG): container finished" podID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerID="40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684" exitCode=2 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939116 5030 generic.go:358] "Generic (PLEG): container finished" podID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerID="73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11" exitCode=0 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939164 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerDied","Data":"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerDied","Data":"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.939218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerDied","Data":"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.940562 5030 generic.go:358] "Generic (PLEG): container finished" podID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" exitCode=0 Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.940615 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"726e7fa7-428a-43d5-b6be-3abb59b5aba5","Type":"ContainerDied","Data":"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.940645 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"726e7fa7-428a-43d5-b6be-3abb59b5aba5","Type":"ContainerDied","Data":"70f3cc87b06bb6df30e8740af0a2b386d9b444ce0f9be9c8215e3a4d040cd689"} Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.940663 5030 scope.go:117] "RemoveContainer" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.940671 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.943625 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data\") pod \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.944024 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnrd4\" (UniqueName: \"kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4\") pod \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.944079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle\") pod \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\" (UID: \"726e7fa7-428a-43d5-b6be-3abb59b5aba5\") " Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.962085 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89147732-39a0-43c6-9768-5d4fd41e8c30" path="/var/lib/kubelet/pods/89147732-39a0-43c6-9768-5d4fd41e8c30/volumes" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.962140 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4" (OuterVolumeSpecName: "kube-api-access-wnrd4") pod "726e7fa7-428a-43d5-b6be-3abb59b5aba5" (UID: "726e7fa7-428a-43d5-b6be-3abb59b5aba5"). InnerVolumeSpecName "kube-api-access-wnrd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.963384 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42ea2a0-f6a3-4095-a842-1a7df5f742b1" path="/var/lib/kubelet/pods/e42ea2a0-f6a3-4095-a842-1a7df5f742b1/volumes" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.968765 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data" (OuterVolumeSpecName: "config-data") pod "726e7fa7-428a-43d5-b6be-3abb59b5aba5" (UID: "726e7fa7-428a-43d5-b6be-3abb59b5aba5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:05 crc kubenswrapper[5030]: I0316 13:26:05.973657 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "726e7fa7-428a-43d5-b6be-3abb59b5aba5" (UID: "726e7fa7-428a-43d5-b6be-3abb59b5aba5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.010128 5030 scope.go:117] "RemoveContainer" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" Mar 16 13:26:06 crc kubenswrapper[5030]: E0316 13:26:06.010815 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059\": container with ID starting with 91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059 not found: ID does not exist" containerID="91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.010848 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059"} err="failed to get container status \"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059\": rpc error: code = NotFound desc = could not find container \"91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059\": container with ID starting with 91bc5da8d3f07ef0b1f8e6de24d47a8905588d4d92e84e01413c4ea827890059 not found: ID does not exist" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.050728 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.050777 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnrd4\" (UniqueName: \"kubernetes.io/projected/726e7fa7-428a-43d5-b6be-3abb59b5aba5-kube-api-access-wnrd4\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.050794 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/726e7fa7-428a-43d5-b6be-3abb59b5aba5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.423163 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.433832 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.473685 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.488781 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.498078 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499332 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-log" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499383 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-log" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499407 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerName="nova-scheduler-scheduler" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499413 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerName="nova-scheduler-scheduler" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499433 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-notification-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499440 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-notification-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499458 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="sg-core" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499463 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="sg-core" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499479 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="proxy-httpd" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499485 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="proxy-httpd" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499496 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-central-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499502 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-central-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499510 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-api" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499515 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-api" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499874 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-central-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499888 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-api" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499902 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="proxy-httpd" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499912 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" containerName="nova-api-log" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499924 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="ceilometer-notification-agent" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499931 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" containerName="nova-scheduler-scheduler" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.499939 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerName="sg-core" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.503251 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.506177 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.507182 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.567927 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568101 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llnwp\" (UniqueName: \"kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568383 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568436 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8vvg\" (UniqueName: \"kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg\") pod \"3c767bf9-5821-4cad-9816-290f87bd2684\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568520 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568701 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs\") pod \"3c767bf9-5821-4cad-9816-290f87bd2684\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568846 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd\") pod \"541b6790-a25c-4f1b-9453-5140dc6c8df6\" (UID: \"541b6790-a25c-4f1b-9453-5140dc6c8df6\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568876 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle\") pod \"3c767bf9-5821-4cad-9816-290f87bd2684\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.568949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data\") pod \"3c767bf9-5821-4cad-9816-290f87bd2684\" (UID: \"3c767bf9-5821-4cad-9816-290f87bd2684\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.569192 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.569809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs" (OuterVolumeSpecName: "logs") pod "3c767bf9-5821-4cad-9816-290f87bd2684" (UID: "3c767bf9-5821-4cad-9816-290f87bd2684"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.570114 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c767bf9-5821-4cad-9816-290f87bd2684-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.570131 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.572289 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.574477 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts" (OuterVolumeSpecName: "scripts") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.576484 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg" (OuterVolumeSpecName: "kube-api-access-v8vvg") pod "3c767bf9-5821-4cad-9816-290f87bd2684" (UID: "3c767bf9-5821-4cad-9816-290f87bd2684"). InnerVolumeSpecName "kube-api-access-v8vvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.578072 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp" (OuterVolumeSpecName: "kube-api-access-llnwp") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "kube-api-access-llnwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.609146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.618528 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data" (OuterVolumeSpecName: "config-data") pod "3c767bf9-5821-4cad-9816-290f87bd2684" (UID: "3c767bf9-5821-4cad-9816-290f87bd2684"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.620191 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c767bf9-5821-4cad-9816-290f87bd2684" (UID: "3c767bf9-5821-4cad-9816-290f87bd2684"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.636047 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.645537 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673137 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tldk\" (UniqueName: \"kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673451 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673772 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673813 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llnwp\" (UniqueName: \"kubernetes.io/projected/541b6790-a25c-4f1b-9453-5140dc6c8df6-kube-api-access-llnwp\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673825 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673835 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673846 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8vvg\" (UniqueName: \"kubernetes.io/projected/3c767bf9-5821-4cad-9816-290f87bd2684-kube-api-access-v8vvg\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673855 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/541b6790-a25c-4f1b-9453-5140dc6c8df6-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.673863 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.674538 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c767bf9-5821-4cad-9816-290f87bd2684-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.680732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data" (OuterVolumeSpecName: "config-data") pod "541b6790-a25c-4f1b-9453-5140dc6c8df6" (UID: "541b6790-a25c-4f1b-9453-5140dc6c8df6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.776661 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs\") pod \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.776749 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data\") pod \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.776787 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs\") pod \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.776985 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle\") pod \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.777203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs" (OuterVolumeSpecName: "logs") pod "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" (UID: "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.777235 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v79b7\" (UniqueName: \"kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7\") pod \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\" (UID: \"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd\") " Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.778189 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tldk\" (UniqueName: \"kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.778668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.778960 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.779165 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.779183 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541b6790-a25c-4f1b-9453-5140dc6c8df6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.782352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7" (OuterVolumeSpecName: "kube-api-access-v79b7") pod "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" (UID: "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd"). InnerVolumeSpecName "kube-api-access-v79b7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.782408 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.783570 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.794061 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tldk\" (UniqueName: \"kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk\") pod \"nova-scheduler-0\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.799176 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data" (OuterVolumeSpecName: "config-data") pod "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" (UID: "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.802952 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" (UID: "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.818275 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" (UID: "e60d6f6e-e1b5-4547-a273-7d3e22e1fabd"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.831542 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.881440 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.881471 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.881485 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.881495 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v79b7\" (UniqueName: \"kubernetes.io/projected/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd-kube-api-access-v79b7\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.957720 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"77627c76-1e68-4476-af56-081c481ae2dd","Type":"ContainerStarted","Data":"a1b33e99b6f52bbfd563d806270eaf84b0378e849edd84075641183edd498541"} Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.958135 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.960205 5030 generic.go:358] "Generic (PLEG): container finished" podID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerID="3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1" exitCode=0 Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.960859 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.960867 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerDied","Data":"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1"} Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.960915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e60d6f6e-e1b5-4547-a273-7d3e22e1fabd","Type":"ContainerDied","Data":"ed9cabf16bb73e6c5d327124d7930700234093668c5817dbb961992a6eef2628"} Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.960938 5030 scope.go:117] "RemoveContainer" containerID="3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.969602 5030 generic.go:358] "Generic (PLEG): container finished" podID="541b6790-a25c-4f1b-9453-5140dc6c8df6" containerID="fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074" exitCode=0 Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.969689 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerDied","Data":"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074"} Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.969716 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"541b6790-a25c-4f1b-9453-5140dc6c8df6","Type":"ContainerDied","Data":"e0de0fc23ed8cb9a6ed81ccd8a3a7b76ef0183c34af2f1afbe5b30a5a72b7120"} Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.969834 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:06 crc kubenswrapper[5030]: I0316 13:26:06.992202 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.7064565160000003 podStartE2EDuration="2.992183091s" podCreationTimestamp="2026-03-16 13:26:04 +0000 UTC" firstStartedPulling="2026-03-16 13:26:05.754527872 +0000 UTC m=+1210.153840419" lastFinishedPulling="2026-03-16 13:26:06.040254446 +0000 UTC m=+1210.439566994" observedRunningTime="2026-03-16 13:26:06.982143934 +0000 UTC m=+1211.381456482" watchObservedRunningTime="2026-03-16 13:26:06.992183091 +0000 UTC m=+1211.391495638" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.016249 5030 scope.go:117] "RemoveContainer" containerID="ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.016568 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c767bf9-5821-4cad-9816-290f87bd2684" containerID="cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346" exitCode=0 Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.016663 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerDied","Data":"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346"} Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.016695 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c767bf9-5821-4cad-9816-290f87bd2684","Type":"ContainerDied","Data":"77c728a85bd337295340f44b87af58ffa590c2c76fab0ccd55e143c7660fb21e"} Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.021658 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.029415 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.062161 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.068874 5030 scope.go:117] "RemoveContainer" containerID="3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.070630 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1\": container with ID starting with 3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1 not found: ID does not exist" containerID="3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.070661 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1"} err="failed to get container status \"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1\": rpc error: code = NotFound desc = could not find container \"3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1\": container with ID starting with 3584612ed2704857271d1880fdd521c126be794ac797cf69bd43129fd9113fe1 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.070680 5030 scope.go:117] "RemoveContainer" containerID="ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.071028 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235\": container with ID starting with ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235 not found: ID does not exist" containerID="ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.071052 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235"} err="failed to get container status \"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235\": rpc error: code = NotFound desc = could not find container \"ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235\": container with ID starting with ae3e8bf7b79e20f8a9a16d7585664360b117e22b1d58bbd6a61b564fea627235 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.071067 5030 scope.go:117] "RemoveContainer" containerID="d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.072307 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.086080 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.098279 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.099903 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-log" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.099924 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-log" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.099987 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-metadata" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.099993 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-metadata" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.100192 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-metadata" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.100204 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" containerName="nova-metadata-log" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.107875 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.111097 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.114519 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.114789 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.115756 5030 scope.go:117] "RemoveContainer" containerID="40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.116074 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.116104 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.116205 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.118348 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.118501 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.118364 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.119741 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.127224 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.139124 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.143915 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.145433 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.147803 5030 scope.go:117] "RemoveContainer" containerID="fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.152218 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.183704 5030 scope.go:117] "RemoveContainer" containerID="73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.192901 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193183 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqhw\" (UniqueName: \"kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193233 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shc2z\" (UniqueName: \"kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193533 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193760 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.193839 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscqg\" (UniqueName: \"kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194152 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194225 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194364 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194504 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194712 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.194830 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.207043 5030 scope.go:117] "RemoveContainer" containerID="d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.207504 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779\": container with ID starting with d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779 not found: ID does not exist" containerID="d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.207642 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779"} err="failed to get container status \"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779\": rpc error: code = NotFound desc = could not find container \"d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779\": container with ID starting with d6bb5a69095081a67b9bb1050447d85fe6490eb574ba3e4e6ec5994085806779 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.207734 5030 scope.go:117] "RemoveContainer" containerID="40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.208187 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684\": container with ID starting with 40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684 not found: ID does not exist" containerID="40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.208243 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684"} err="failed to get container status \"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684\": rpc error: code = NotFound desc = could not find container \"40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684\": container with ID starting with 40b79e64801bd33ab2da664421038b6a686fdb06794a033cd17542361d19d684 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.208293 5030 scope.go:117] "RemoveContainer" containerID="fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.208797 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074\": container with ID starting with fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074 not found: ID does not exist" containerID="fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.208886 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074"} err="failed to get container status \"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074\": rpc error: code = NotFound desc = could not find container \"fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074\": container with ID starting with fe5833be98c1d82393c927ad21aa848c9fbf8b980ef6ae42e3a291bb7ce97074 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.208956 5030 scope.go:117] "RemoveContainer" containerID="73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.209452 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11\": container with ID starting with 73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11 not found: ID does not exist" containerID="73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.209535 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11"} err="failed to get container status \"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11\": rpc error: code = NotFound desc = could not find container \"73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11\": container with ID starting with 73c62a6bf9ba0ac288ce6d59e199fd2cb16f3a6dad1e29ad43d20d757feaec11 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.209632 5030 scope.go:117] "RemoveContainer" containerID="cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.230093 5030 scope.go:117] "RemoveContainer" containerID="97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.269485 5030 scope.go:117] "RemoveContainer" containerID="cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.270088 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346\": container with ID starting with cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346 not found: ID does not exist" containerID="cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.270229 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346"} err="failed to get container status \"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346\": rpc error: code = NotFound desc = could not find container \"cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346\": container with ID starting with cc06c2ebb7bdc1fcbcec39b09e6a95bf4d67a3f5f3af4b67e71f29af97233346 not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.270327 5030 scope.go:117] "RemoveContainer" containerID="97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f" Mar 16 13:26:07 crc kubenswrapper[5030]: E0316 13:26:07.271184 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f\": container with ID starting with 97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f not found: ID does not exist" containerID="97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.271237 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f"} err="failed to get container status \"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f\": rpc error: code = NotFound desc = could not find container \"97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f\": container with ID starting with 97cbd91844a4a55fee1fca4f619fe5cbedf2098380ac98eeb1b5e597986c314f not found: ID does not exist" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.285296 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.296643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.296827 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.296965 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297150 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297415 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqhw\" (UniqueName: \"kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297868 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shc2z\" (UniqueName: \"kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.297977 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298128 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298222 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298382 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298517 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298639 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298719 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lscqg\" (UniqueName: \"kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.298856 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.300260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.300597 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.305694 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.308220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.311796 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.315187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.316297 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.317219 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.317521 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.317624 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.318048 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.318348 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.318886 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.319465 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.321203 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shc2z\" (UniqueName: \"kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z\") pod \"ceilometer-0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.322873 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqhw\" (UniqueName: \"kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw\") pod \"nova-metadata-0\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.324894 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscqg\" (UniqueName: \"kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg\") pod \"nova-api-0\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.428299 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.440147 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.466411 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.839661 5030 scope.go:117] "RemoveContainer" containerID="dee53f2f2a54132c92fba268f9a6b133d41436ae47ef187180ddbac514faad68" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.933951 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:07 crc kubenswrapper[5030]: W0316 13:26:07.951235 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff55db0a_a85a_44a0_8915_e935c40fe6a0.slice/crio-842cb42d4c4b502046298234978dd6bcdffad6125d6a5199ee06ab071e1c9d07 WatchSource:0}: Error finding container 842cb42d4c4b502046298234978dd6bcdffad6125d6a5199ee06ab071e1c9d07: Status 404 returned error can't find the container with id 842cb42d4c4b502046298234978dd6bcdffad6125d6a5199ee06ab071e1c9d07 Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.955253 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c767bf9-5821-4cad-9816-290f87bd2684" path="/var/lib/kubelet/pods/3c767bf9-5821-4cad-9816-290f87bd2684/volumes" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.956045 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541b6790-a25c-4f1b-9453-5140dc6c8df6" path="/var/lib/kubelet/pods/541b6790-a25c-4f1b-9453-5140dc6c8df6/volumes" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.956787 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="726e7fa7-428a-43d5-b6be-3abb59b5aba5" path="/var/lib/kubelet/pods/726e7fa7-428a-43d5-b6be-3abb59b5aba5/volumes" Mar 16 13:26:07 crc kubenswrapper[5030]: W0316 13:26:07.956977 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea781a55_9f91_4acb_b039_fbf8b016ea8f.slice/crio-12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd WatchSource:0}: Error finding container 12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd: Status 404 returned error can't find the container with id 12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.958097 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60d6f6e-e1b5-4547-a273-7d3e22e1fabd" path="/var/lib/kubelet/pods/e60d6f6e-e1b5-4547-a273-7d3e22e1fabd/volumes" Mar 16 13:26:07 crc kubenswrapper[5030]: I0316 13:26:07.958807 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.041498 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.050666 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerStarted","Data":"12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd"} Mar 16 13:26:08 crc kubenswrapper[5030]: W0316 13:26:08.053425 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a945754_a2c7_4dac_9d7b_23baaefc141f.slice/crio-e702028b2afbdece3fa68a4efe032c4d5bf11cb846b827e6ed82596b26cc2dc6 WatchSource:0}: Error finding container e702028b2afbdece3fa68a4efe032c4d5bf11cb846b827e6ed82596b26cc2dc6: Status 404 returned error can't find the container with id e702028b2afbdece3fa68a4efe032c4d5bf11cb846b827e6ed82596b26cc2dc6 Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.057345 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8e0c48df-8cc5-4a86-81bd-22e68eb4627d","Type":"ContainerStarted","Data":"48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f"} Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.057376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8e0c48df-8cc5-4a86-81bd-22e68eb4627d","Type":"ContainerStarted","Data":"474ea5c3310af18110a615645a4f58b9998634ca34109ec9a9d970e1477983bb"} Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.061938 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerStarted","Data":"842cb42d4c4b502046298234978dd6bcdffad6125d6a5199ee06ab071e1c9d07"} Mar 16 13:26:08 crc kubenswrapper[5030]: I0316 13:26:08.081620 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.081596908 podStartE2EDuration="2.081596908s" podCreationTimestamp="2026-03-16 13:26:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:26:08.072023154 +0000 UTC m=+1212.471335692" watchObservedRunningTime="2026-03-16 13:26:08.081596908 +0000 UTC m=+1212.480909454" Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.082086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerStarted","Data":"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.084811 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerStarted","Data":"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.084860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerStarted","Data":"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.084871 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerStarted","Data":"e702028b2afbdece3fa68a4efe032c4d5bf11cb846b827e6ed82596b26cc2dc6"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.088184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerStarted","Data":"47fa1e3a947e0e203651b727fa0ef8d9a70d09b909653ef1ccc9a12133a12fe7"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.088251 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerStarted","Data":"163415f418b956470547945a7ccb5a958e13f4da64b713bc0053c88f171d2360"} Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.111581 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.111565174 podStartE2EDuration="2.111565174s" podCreationTimestamp="2026-03-16 13:26:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:26:09.108894579 +0000 UTC m=+1213.508207126" watchObservedRunningTime="2026-03-16 13:26:09.111565174 +0000 UTC m=+1213.510877722" Mar 16 13:26:09 crc kubenswrapper[5030]: I0316 13:26:09.132488 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.132467526 podStartE2EDuration="2.132467526s" podCreationTimestamp="2026-03-16 13:26:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:26:09.126510949 +0000 UTC m=+1213.525823495" watchObservedRunningTime="2026-03-16 13:26:09.132467526 +0000 UTC m=+1213.531780073" Mar 16 13:26:10 crc kubenswrapper[5030]: I0316 13:26:10.103684 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerStarted","Data":"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137"} Mar 16 13:26:11 crc kubenswrapper[5030]: I0316 13:26:11.113285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerStarted","Data":"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df"} Mar 16 13:26:11 crc kubenswrapper[5030]: I0316 13:26:11.831840 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:13 crc kubenswrapper[5030]: I0316 13:26:13.132524 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerStarted","Data":"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d"} Mar 16 13:26:13 crc kubenswrapper[5030]: I0316 13:26:13.132946 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:13 crc kubenswrapper[5030]: I0316 13:26:13.158605 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.331978495 podStartE2EDuration="6.158590015s" podCreationTimestamp="2026-03-16 13:26:07 +0000 UTC" firstStartedPulling="2026-03-16 13:26:07.957516514 +0000 UTC m=+1212.356829062" lastFinishedPulling="2026-03-16 13:26:12.784128036 +0000 UTC m=+1217.183440582" observedRunningTime="2026-03-16 13:26:13.149443895 +0000 UTC m=+1217.548756442" watchObservedRunningTime="2026-03-16 13:26:13.158590015 +0000 UTC m=+1217.557902562" Mar 16 13:26:16 crc kubenswrapper[5030]: I0316 13:26:16.832593 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:16 crc kubenswrapper[5030]: I0316 13:26:16.860321 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:17 crc kubenswrapper[5030]: I0316 13:26:17.201831 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:26:17 crc kubenswrapper[5030]: I0316 13:26:17.429452 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:17 crc kubenswrapper[5030]: I0316 13:26:17.429789 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:17 crc kubenswrapper[5030]: I0316 13:26:17.467463 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:17 crc kubenswrapper[5030]: I0316 13:26:17.469991 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:18 crc kubenswrapper[5030]: I0316 13:26:18.067216 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:26:18 crc kubenswrapper[5030]: I0316 13:26:18.436716 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.193:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:18 crc kubenswrapper[5030]: I0316 13:26:18.437687 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.193:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:18 crc kubenswrapper[5030]: I0316 13:26:18.509727 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.195:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:18 crc kubenswrapper[5030]: I0316 13:26:18.510175 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.195:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:24 crc kubenswrapper[5030]: I0316 13:26:24.287408 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:26:24 crc kubenswrapper[5030]: I0316 13:26:24.288106 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:26:24 crc kubenswrapper[5030]: I0316 13:26:24.288164 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:26:24 crc kubenswrapper[5030]: I0316 13:26:24.288847 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:26:24 crc kubenswrapper[5030]: I0316 13:26:24.288940 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61" gracePeriod=600 Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.265612 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61" exitCode=0 Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.265696 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61"} Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.266280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5"} Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.266305 5030 scope.go:117] "RemoveContainer" containerID="8a6fcf3b33f7a2d6ce49b5dcec2a2f66f528ba0117a8ba27b60a8153aa5f8325" Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.429308 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.429370 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.471803 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:25 crc kubenswrapper[5030]: I0316 13:26:25.472073 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.435598 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.436090 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.441095 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.441952 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.470120 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.471042 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:27 crc kubenswrapper[5030]: I0316 13:26:27.473857 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:28 crc kubenswrapper[5030]: I0316 13:26:28.318240 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.164101 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.164713 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-central-agent" containerID="cri-o://e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" gracePeriod=30 Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.164793 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="proxy-httpd" containerID="cri-o://7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" gracePeriod=30 Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.164856 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-notification-agent" containerID="cri-o://1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" gracePeriod=30 Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.164844 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="sg-core" containerID="cri-o://880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" gracePeriod=30 Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.174226 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.194:3000/\": EOF" Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.337872 5030 generic.go:358] "Generic (PLEG): container finished" podID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" exitCode=2 Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.338091 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerDied","Data":"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df"} Mar 16 13:26:30 crc kubenswrapper[5030]: I0316 13:26:30.982752 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.047874 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048014 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048050 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048209 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shc2z\" (UniqueName: \"kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048263 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048324 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048438 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048457 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle\") pod \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\" (UID: \"ff55db0a-a85a-44a0-8915-e935c40fe6a0\") " Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.048806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.049947 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.054948 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z" (OuterVolumeSpecName: "kube-api-access-shc2z") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "kube-api-access-shc2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.055014 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts" (OuterVolumeSpecName: "scripts") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.084973 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.103854 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.114102 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.117296 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.150530 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data" (OuterVolumeSpecName: "config-data") pod "ff55db0a-a85a-44a0-8915-e935c40fe6a0" (UID: "ff55db0a-a85a-44a0-8915-e935c40fe6a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.150912 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shc2z\" (UniqueName: \"kubernetes.io/projected/ff55db0a-a85a-44a0-8915-e935c40fe6a0-kube-api-access-shc2z\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.150996 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151100 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ff55db0a-a85a-44a0-8915-e935c40fe6a0-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151149 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151200 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151253 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151299 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.151348 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ff55db0a-a85a-44a0-8915-e935c40fe6a0-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.356771 5030 generic.go:358] "Generic (PLEG): container finished" podID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" exitCode=0 Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.356813 5030 generic.go:358] "Generic (PLEG): container finished" podID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" exitCode=0 Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.356820 5030 generic.go:358] "Generic (PLEG): container finished" podID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" exitCode=0 Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357469 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-log" containerID="cri-o://d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63" gracePeriod=30 Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357716 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357858 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerDied","Data":"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d"} Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357902 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerDied","Data":"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137"} Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357916 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerDied","Data":"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1"} Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357926 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ff55db0a-a85a-44a0-8915-e935c40fe6a0","Type":"ContainerDied","Data":"842cb42d4c4b502046298234978dd6bcdffad6125d6a5199ee06ab071e1c9d07"} Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.357950 5030 scope.go:117] "RemoveContainer" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.359015 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-api" containerID="cri-o://f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b" gracePeriod=30 Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.385428 5030 scope.go:117] "RemoveContainer" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" Mar 16 13:26:31 crc kubenswrapper[5030]: E0316 13:26:31.406398 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a945754_a2c7_4dac_9d7b_23baaefc141f.slice/crio-d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.414031 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.417256 5030 scope.go:117] "RemoveContainer" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.429684 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.439491 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440527 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="sg-core" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440563 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="sg-core" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440609 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-central-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440616 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-central-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440639 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-notification-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440646 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-notification-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440660 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="proxy-httpd" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440667 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="proxy-httpd" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440825 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="proxy-httpd" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440845 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-central-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440855 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="sg-core" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.440864 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" containerName="ceilometer-notification-agent" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.442707 5030 scope.go:117] "RemoveContainer" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.448306 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.448453 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.450748 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.451248 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.451706 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.476887 5030 scope.go:117] "RemoveContainer" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" Mar 16 13:26:31 crc kubenswrapper[5030]: E0316 13:26:31.478209 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": container with ID starting with 7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d not found: ID does not exist" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.478350 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d"} err="failed to get container status \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": rpc error: code = NotFound desc = could not find container \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": container with ID starting with 7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.478461 5030 scope.go:117] "RemoveContainer" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" Mar 16 13:26:31 crc kubenswrapper[5030]: E0316 13:26:31.486764 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": container with ID starting with 880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df not found: ID does not exist" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.486860 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df"} err="failed to get container status \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": rpc error: code = NotFound desc = could not find container \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": container with ID starting with 880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.486907 5030 scope.go:117] "RemoveContainer" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" Mar 16 13:26:31 crc kubenswrapper[5030]: E0316 13:26:31.487446 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": container with ID starting with 1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137 not found: ID does not exist" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.487508 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137"} err="failed to get container status \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": rpc error: code = NotFound desc = could not find container \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": container with ID starting with 1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.487577 5030 scope.go:117] "RemoveContainer" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" Mar 16 13:26:31 crc kubenswrapper[5030]: E0316 13:26:31.488037 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": container with ID starting with e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1 not found: ID does not exist" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.488102 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1"} err="failed to get container status \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": rpc error: code = NotFound desc = could not find container \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": container with ID starting with e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.488164 5030 scope.go:117] "RemoveContainer" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.488632 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d"} err="failed to get container status \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": rpc error: code = NotFound desc = could not find container \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": container with ID starting with 7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.488663 5030 scope.go:117] "RemoveContainer" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.488984 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df"} err="failed to get container status \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": rpc error: code = NotFound desc = could not find container \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": container with ID starting with 880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.489009 5030 scope.go:117] "RemoveContainer" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.489407 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137"} err="failed to get container status \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": rpc error: code = NotFound desc = could not find container \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": container with ID starting with 1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.489471 5030 scope.go:117] "RemoveContainer" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.489823 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1"} err="failed to get container status \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": rpc error: code = NotFound desc = could not find container \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": container with ID starting with e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.489847 5030 scope.go:117] "RemoveContainer" containerID="7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.491722 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d"} err="failed to get container status \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": rpc error: code = NotFound desc = could not find container \"7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d\": container with ID starting with 7774d4d1e7b63bafeb76314ae0f6037afa5882d9517dedb8d6cfd0ee89c4431d not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.491746 5030 scope.go:117] "RemoveContainer" containerID="880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.492163 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df"} err="failed to get container status \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": rpc error: code = NotFound desc = could not find container \"880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df\": container with ID starting with 880861778e823757600ec66f1c92f5f6cf49ad7c21644fb0ace185cccfe212df not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.492197 5030 scope.go:117] "RemoveContainer" containerID="1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.492681 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137"} err="failed to get container status \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": rpc error: code = NotFound desc = could not find container \"1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137\": container with ID starting with 1a0bd994d9dad99873059c865a42b2d8b28f6b4f1e49d8af66f740327b235137 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.492744 5030 scope.go:117] "RemoveContainer" containerID="e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.493072 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1"} err="failed to get container status \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": rpc error: code = NotFound desc = could not find container \"e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1\": container with ID starting with e74594fe8c502228de47ecab9929ce5a52fdec095ae3ce48ed8bc0af27a748b1 not found: ID does not exist" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.594473 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.594673 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.594758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.594834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.594934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.595126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.595219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkgvj\" (UniqueName: \"kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.595407 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.697279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.697469 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.697616 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkgvj\" (UniqueName: \"kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.697794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.698729 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.699283 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.699666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.700080 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.699211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.699620 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.704942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.705435 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.708805 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.709077 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.709371 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.715774 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkgvj\" (UniqueName: \"kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj\") pod \"ceilometer-0\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.764535 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:31 crc kubenswrapper[5030]: I0316 13:26:31.969455 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff55db0a-a85a-44a0-8915-e935c40fe6a0" path="/var/lib/kubelet/pods/ff55db0a-a85a-44a0-8915-e935c40fe6a0/volumes" Mar 16 13:26:32 crc kubenswrapper[5030]: I0316 13:26:32.241174 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:32 crc kubenswrapper[5030]: W0316 13:26:32.242947 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1dff35d_c130_4626_82f2_0f972ad22cf3.slice/crio-00ccfd73620abd41df0934ce7d786a7f7e3eb5260fbdc929371108df5c426ab0 WatchSource:0}: Error finding container 00ccfd73620abd41df0934ce7d786a7f7e3eb5260fbdc929371108df5c426ab0: Status 404 returned error can't find the container with id 00ccfd73620abd41df0934ce7d786a7f7e3eb5260fbdc929371108df5c426ab0 Mar 16 13:26:32 crc kubenswrapper[5030]: I0316 13:26:32.376303 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerID="d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63" exitCode=143 Mar 16 13:26:32 crc kubenswrapper[5030]: I0316 13:26:32.376393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerDied","Data":"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63"} Mar 16 13:26:32 crc kubenswrapper[5030]: I0316 13:26:32.379975 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerStarted","Data":"00ccfd73620abd41df0934ce7d786a7f7e3eb5260fbdc929371108df5c426ab0"} Mar 16 13:26:33 crc kubenswrapper[5030]: I0316 13:26:33.393274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerStarted","Data":"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88"} Mar 16 13:26:33 crc kubenswrapper[5030]: I0316 13:26:33.545304 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.407986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerStarted","Data":"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861"} Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.955563 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.994897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data\") pod \"7a945754-a2c7-4dac-9d7b-23baaefc141f\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.994943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lscqg\" (UniqueName: \"kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg\") pod \"7a945754-a2c7-4dac-9d7b-23baaefc141f\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.995051 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle\") pod \"7a945754-a2c7-4dac-9d7b-23baaefc141f\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.995211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs\") pod \"7a945754-a2c7-4dac-9d7b-23baaefc141f\" (UID: \"7a945754-a2c7-4dac-9d7b-23baaefc141f\") " Mar 16 13:26:34 crc kubenswrapper[5030]: I0316 13:26:34.996300 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs" (OuterVolumeSpecName: "logs") pod "7a945754-a2c7-4dac-9d7b-23baaefc141f" (UID: "7a945754-a2c7-4dac-9d7b-23baaefc141f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.008730 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg" (OuterVolumeSpecName: "kube-api-access-lscqg") pod "7a945754-a2c7-4dac-9d7b-23baaefc141f" (UID: "7a945754-a2c7-4dac-9d7b-23baaefc141f"). InnerVolumeSpecName "kube-api-access-lscqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.020610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a945754-a2c7-4dac-9d7b-23baaefc141f" (UID: "7a945754-a2c7-4dac-9d7b-23baaefc141f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.021896 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data" (OuterVolumeSpecName: "config-data") pod "7a945754-a2c7-4dac-9d7b-23baaefc141f" (UID: "7a945754-a2c7-4dac-9d7b-23baaefc141f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.097725 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.097763 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lscqg\" (UniqueName: \"kubernetes.io/projected/7a945754-a2c7-4dac-9d7b-23baaefc141f-kube-api-access-lscqg\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.097776 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a945754-a2c7-4dac-9d7b-23baaefc141f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.097785 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a945754-a2c7-4dac-9d7b-23baaefc141f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.417517 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerID="f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b" exitCode=0 Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.417591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerDied","Data":"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b"} Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.418292 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.418486 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"7a945754-a2c7-4dac-9d7b-23baaefc141f","Type":"ContainerDied","Data":"e702028b2afbdece3fa68a4efe032c4d5bf11cb846b827e6ed82596b26cc2dc6"} Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.418526 5030 scope.go:117] "RemoveContainer" containerID="f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.420440 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerStarted","Data":"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a"} Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.441626 5030 scope.go:117] "RemoveContainer" containerID="d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.458626 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.461711 5030 scope.go:117] "RemoveContainer" containerID="f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b" Mar 16 13:26:35 crc kubenswrapper[5030]: E0316 13:26:35.462159 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b\": container with ID starting with f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b not found: ID does not exist" containerID="f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.462227 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b"} err="failed to get container status \"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b\": rpc error: code = NotFound desc = could not find container \"f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b\": container with ID starting with f4de5624b2408138cca502f891a8e817ec8d5286e8bdb11fc172e28ffae3f39b not found: ID does not exist" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.462255 5030 scope.go:117] "RemoveContainer" containerID="d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.465202 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:35 crc kubenswrapper[5030]: E0316 13:26:35.465471 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63\": container with ID starting with d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63 not found: ID does not exist" containerID="d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.465501 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63"} err="failed to get container status \"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63\": rpc error: code = NotFound desc = could not find container \"d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63\": container with ID starting with d47e64da3541daebad5d2b3212b0d84d7bf1484c1fa8b764b31cab7e74b55a63 not found: ID does not exist" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.479983 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481100 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-api" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481123 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-api" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481154 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-log" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481160 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-log" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481317 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-log" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.481332 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" containerName="nova-api-api" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.487382 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.490016 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.490299 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.490531 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.499276 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.610936 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.611222 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.611246 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.611275 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqxql\" (UniqueName: \"kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.611432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.611535 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.713843 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.714002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.714500 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.714759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.714791 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.715196 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.715235 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqxql\" (UniqueName: \"kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.719063 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.719719 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.720172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.732079 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.750219 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqxql\" (UniqueName: \"kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql\") pod \"nova-api-0\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.803004 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:35 crc kubenswrapper[5030]: I0316 13:26:35.966317 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a945754-a2c7-4dac-9d7b-23baaefc141f" path="/var/lib/kubelet/pods/7a945754-a2c7-4dac-9d7b-23baaefc141f/volumes" Mar 16 13:26:36 crc kubenswrapper[5030]: W0316 13:26:36.239743 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod406c1608_a210_4e95_9e30_0e7c15f51f67.slice/crio-530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b WatchSource:0}: Error finding container 530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b: Status 404 returned error can't find the container with id 530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b Mar 16 13:26:36 crc kubenswrapper[5030]: I0316 13:26:36.241122 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:26:36 crc kubenswrapper[5030]: I0316 13:26:36.432671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerStarted","Data":"91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd"} Mar 16 13:26:36 crc kubenswrapper[5030]: I0316 13:26:36.432744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerStarted","Data":"530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b"} Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.448016 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerStarted","Data":"1654ea9fb2ca753ee24b020c3fce08cd54c83140b9de3b532d2776ed18c83032"} Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.451455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerStarted","Data":"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022"} Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.451687 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-central-agent" containerID="cri-o://47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88" gracePeriod=30 Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.451804 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.451869 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="proxy-httpd" containerID="cri-o://3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022" gracePeriod=30 Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.452004 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-notification-agent" containerID="cri-o://5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861" gracePeriod=30 Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.452138 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="sg-core" containerID="cri-o://a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a" gracePeriod=30 Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.484180 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.484160324 podStartE2EDuration="2.484160324s" podCreationTimestamp="2026-03-16 13:26:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:26:37.477064329 +0000 UTC m=+1241.876376877" watchObservedRunningTime="2026-03-16 13:26:37.484160324 +0000 UTC m=+1241.883472871" Mar 16 13:26:37 crc kubenswrapper[5030]: I0316 13:26:37.496863 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.188234948 podStartE2EDuration="6.49685177s" podCreationTimestamp="2026-03-16 13:26:31 +0000 UTC" firstStartedPulling="2026-03-16 13:26:32.244963545 +0000 UTC m=+1236.644276091" lastFinishedPulling="2026-03-16 13:26:36.553580366 +0000 UTC m=+1240.952892913" observedRunningTime="2026-03-16 13:26:37.495455845 +0000 UTC m=+1241.894768392" watchObservedRunningTime="2026-03-16 13:26:37.49685177 +0000 UTC m=+1241.896164306" Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.465803 5030 generic.go:358] "Generic (PLEG): container finished" podID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerID="3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022" exitCode=0 Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.466912 5030 generic.go:358] "Generic (PLEG): container finished" podID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerID="a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a" exitCode=2 Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.466995 5030 generic.go:358] "Generic (PLEG): container finished" podID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerID="5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861" exitCode=0 Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.465898 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerDied","Data":"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022"} Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.467199 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerDied","Data":"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a"} Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.467228 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerDied","Data":"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861"} Mar 16 13:26:38 crc kubenswrapper[5030]: I0316 13:26:38.918236 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.004858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkgvj\" (UniqueName: \"kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.004930 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.004997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.005095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.005300 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.005405 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.005474 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.005540 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml\") pod \"b1dff35d-c130-4626-82f2-0f972ad22cf3\" (UID: \"b1dff35d-c130-4626-82f2-0f972ad22cf3\") " Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.006119 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.006175 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.007339 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.007371 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b1dff35d-c130-4626-82f2-0f972ad22cf3-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.012821 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj" (OuterVolumeSpecName: "kube-api-access-bkgvj") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "kube-api-access-bkgvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.014171 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts" (OuterVolumeSpecName: "scripts") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.034458 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.052748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.073300 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.098886 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data" (OuterVolumeSpecName: "config-data") pod "b1dff35d-c130-4626-82f2-0f972ad22cf3" (UID: "b1dff35d-c130-4626-82f2-0f972ad22cf3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111376 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111406 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111418 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111429 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkgvj\" (UniqueName: \"kubernetes.io/projected/b1dff35d-c130-4626-82f2-0f972ad22cf3-kube-api-access-bkgvj\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111438 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.111447 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1dff35d-c130-4626-82f2-0f972ad22cf3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.484228 5030 generic.go:358] "Generic (PLEG): container finished" podID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerID="47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88" exitCode=0 Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.484321 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.484330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerDied","Data":"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88"} Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.484927 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b1dff35d-c130-4626-82f2-0f972ad22cf3","Type":"ContainerDied","Data":"00ccfd73620abd41df0934ce7d786a7f7e3eb5260fbdc929371108df5c426ab0"} Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.484995 5030 scope.go:117] "RemoveContainer" containerID="3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.513639 5030 scope.go:117] "RemoveContainer" containerID="a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.519972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.526910 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.537290 5030 scope.go:117] "RemoveContainer" containerID="5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.550468 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.551993 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-central-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552020 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-central-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552066 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-notification-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552073 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-notification-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552095 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="sg-core" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552100 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="sg-core" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552113 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="proxy-httpd" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552118 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="proxy-httpd" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552304 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-central-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552319 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="proxy-httpd" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552332 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="ceilometer-notification-agent" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.552348 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" containerName="sg-core" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.561265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.561385 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.564875 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.564997 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.565142 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.571629 5030 scope.go:117] "RemoveContainer" containerID="47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.603327 5030 scope.go:117] "RemoveContainer" containerID="3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022" Mar 16 13:26:39 crc kubenswrapper[5030]: E0316 13:26:39.603598 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022\": container with ID starting with 3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022 not found: ID does not exist" containerID="3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.603622 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022"} err="failed to get container status \"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022\": rpc error: code = NotFound desc = could not find container \"3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022\": container with ID starting with 3247643bd5d40a53ae8bcb25998d7bc203e3688635d970cd7e51013eea386022 not found: ID does not exist" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.603641 5030 scope.go:117] "RemoveContainer" containerID="a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a" Mar 16 13:26:39 crc kubenswrapper[5030]: E0316 13:26:39.603913 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a\": container with ID starting with a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a not found: ID does not exist" containerID="a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.603932 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a"} err="failed to get container status \"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a\": rpc error: code = NotFound desc = could not find container \"a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a\": container with ID starting with a4459622d2789a476f9ac554aa4a13c29421dda72a378ee8e27d5d2ac277e74a not found: ID does not exist" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.603946 5030 scope.go:117] "RemoveContainer" containerID="5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861" Mar 16 13:26:39 crc kubenswrapper[5030]: E0316 13:26:39.604164 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861\": container with ID starting with 5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861 not found: ID does not exist" containerID="5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.604181 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861"} err="failed to get container status \"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861\": rpc error: code = NotFound desc = could not find container \"5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861\": container with ID starting with 5abe2934374c22d0db0a6d13e8da612b82af1adb7a9fe2a7bd4c1d03e23dd861 not found: ID does not exist" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.604194 5030 scope.go:117] "RemoveContainer" containerID="47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88" Mar 16 13:26:39 crc kubenswrapper[5030]: E0316 13:26:39.604423 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88\": container with ID starting with 47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88 not found: ID does not exist" containerID="47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.604445 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88"} err="failed to get container status \"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88\": rpc error: code = NotFound desc = could not find container \"47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88\": container with ID starting with 47bcd5c485bea570c258d8976c324df27f43979b08ddeb5ef3f54c33f75f0d88 not found: ID does not exist" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.724814 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.724869 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725014 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725151 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdv9l\" (UniqueName: \"kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.725721 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.826922 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827037 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827109 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827169 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827206 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.827269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv9l\" (UniqueName: \"kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.828718 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.828831 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.832108 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.832161 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.832358 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.832739 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.833012 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.841199 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdv9l\" (UniqueName: \"kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l\") pod \"ceilometer-0\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.879835 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:39 crc kubenswrapper[5030]: I0316 13:26:39.962847 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1dff35d-c130-4626-82f2-0f972ad22cf3" path="/var/lib/kubelet/pods/b1dff35d-c130-4626-82f2-0f972ad22cf3/volumes" Mar 16 13:26:40 crc kubenswrapper[5030]: W0316 13:26:40.312010 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48d90717_dbfc_40c0_a7ff_8abb1882e436.slice/crio-e28a9982d7b7ead35609be3db81f0f0a1661252577baaf9bbff41857f3fca570 WatchSource:0}: Error finding container e28a9982d7b7ead35609be3db81f0f0a1661252577baaf9bbff41857f3fca570: Status 404 returned error can't find the container with id e28a9982d7b7ead35609be3db81f0f0a1661252577baaf9bbff41857f3fca570 Mar 16 13:26:40 crc kubenswrapper[5030]: I0316 13:26:40.313449 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:26:40 crc kubenswrapper[5030]: I0316 13:26:40.501590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerStarted","Data":"e28a9982d7b7ead35609be3db81f0f0a1661252577baaf9bbff41857f3fca570"} Mar 16 13:26:41 crc kubenswrapper[5030]: I0316 13:26:41.514903 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerStarted","Data":"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2"} Mar 16 13:26:42 crc kubenswrapper[5030]: I0316 13:26:42.526322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerStarted","Data":"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012"} Mar 16 13:26:42 crc kubenswrapper[5030]: I0316 13:26:42.527037 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerStarted","Data":"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036"} Mar 16 13:26:44 crc kubenswrapper[5030]: I0316 13:26:44.547082 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerStarted","Data":"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445"} Mar 16 13:26:44 crc kubenswrapper[5030]: I0316 13:26:44.547524 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:26:44 crc kubenswrapper[5030]: I0316 13:26:44.569310 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.9137199470000001 podStartE2EDuration="5.569293018s" podCreationTimestamp="2026-03-16 13:26:39 +0000 UTC" firstStartedPulling="2026-03-16 13:26:40.314012576 +0000 UTC m=+1244.713325124" lastFinishedPulling="2026-03-16 13:26:43.969585648 +0000 UTC m=+1248.368898195" observedRunningTime="2026-03-16 13:26:44.566018972 +0000 UTC m=+1248.965331519" watchObservedRunningTime="2026-03-16 13:26:44.569293018 +0000 UTC m=+1248.968605565" Mar 16 13:26:45 crc kubenswrapper[5030]: I0316 13:26:45.804493 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:45 crc kubenswrapper[5030]: I0316 13:26:45.804576 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:46 crc kubenswrapper[5030]: I0316 13:26:46.811744 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.197:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:46 crc kubenswrapper[5030]: I0316 13:26:46.812501 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.197:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:26:53 crc kubenswrapper[5030]: I0316 13:26:53.803756 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:53 crc kubenswrapper[5030]: I0316 13:26:53.804380 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:53 crc kubenswrapper[5030]: E0316 13:26:53.932326 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763176 actualBytes=10240 Mar 16 13:26:55 crc kubenswrapper[5030]: I0316 13:26:55.817504 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:55 crc kubenswrapper[5030]: I0316 13:26:55.818302 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:55 crc kubenswrapper[5030]: I0316 13:26:55.835067 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:26:56 crc kubenswrapper[5030]: I0316 13:26:56.691589 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:27:15 crc kubenswrapper[5030]: I0316 13:27:15.564777 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.562864 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.563645 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" containerName="openstackclient" containerID="cri-o://9a2861f8073235d0f35323d92513aefaa091c997b7a922a80a8d36caff545b80" gracePeriod=2 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.576172 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.600640 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.600960 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="ovn-northd" containerID="cri-o://a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.601154 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="openstack-network-exporter" containerID="cri-o://79fcb8675447df9cfb7d0cebb9d431b613ebca60bc5200d6fa466d198199ac42" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.610769 5030 status_manager.go:895] "Failed to get status for pod" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.624585 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.625625 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" containerName="openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.625644 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" containerName="openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.625835 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" containerName="openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.629906 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.632843 5030 status_manager.go:895] "Failed to get status for pod" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.653640 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.660829 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.661194 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.661435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.661471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7252t\" (UniqueName: \"kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.661742 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.677711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.686858 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.687114 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" containerID="cri-o://48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.710443 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.710842 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="0d649e48-1a25-431c-a334-ed9bd902ee85" containerName="memcached" containerID="cri-o://4010f2c336c993f9f63a15808e83f0ac33d271d977a61410da43b7ecc626788b" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.730800 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.731627 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.731949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="openstack-network-exporter" containerID="cri-o://c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b" gracePeriod=300 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.744590 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.744770 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://2759a16515c1d2dc86dc52c9771e769e8d7a7abb0313d20a489258f557464d42" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764314 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764369 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764404 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764449 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7252t\" (UniqueName: \"kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764484 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764563 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764638 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsr2\" (UniqueName: \"kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.764784 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.765197 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.772087 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.793336 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.801539 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.817748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.821471 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.833822 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.845964 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7252t\" (UniqueName: \"kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t\") pod \"barbican-keystone-listener-9b95958fd-8sj56\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.862796 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.863132 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-log" containerID="cri-o://163415f418b956470547945a7ccb5a958e13f4da64b713bc0053c88f171d2360" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.863365 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.864130 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-metadata" containerID="cri-o://47fa1e3a947e0e203651b727fa0ef8d9a70d09b909653ef1ccc9a12133a12fe7" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.869124 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.869219 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.869278 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.869315 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.869438 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znsr2\" (UniqueName: \"kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.877894 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.910268 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.912227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.918290 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.927646 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.933495 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.933764 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="cinder-scheduler" containerID="cri-o://c2cd43506a91a5e11cfa5e16233edd85796456e9f6d9e96f25e8c54765c60a49" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.933915 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="probe" containerID="cri-o://081371a1bc630f0222de645b48a9ead168f8f5b9467629eb604488759f57432a" gracePeriod=30 Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.952168 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsr2\" (UniqueName: \"kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2\") pod \"barbican-worker-78fcf5cd85-cgcxb\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.974568 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.984374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.984435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.984500 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:21 crc kubenswrapper[5030]: I0316 13:27:21.984671 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx244\" (UniqueName: \"kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.050077 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.092502 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx244\" (UniqueName: \"kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.114638 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.125216 5030 generic.go:358] "Generic (PLEG): container finished" podID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerID="79fcb8675447df9cfb7d0cebb9d431b613ebca60bc5200d6fa466d198199ac42" exitCode=2 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.165527 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.165646 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.165822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.188362 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerDied","Data":"79fcb8675447df9cfb7d0cebb9d431b613ebca60bc5200d6fa466d198199ac42"} Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.188523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.188540 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.217089 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.217233 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.217392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.226621 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.227011 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-log" containerID="cri-o://85c67cb0f67642c9dfd7d8c3562a7699102914abdea6c168b7a9983160c9ce2d" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.227263 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-httpd" containerID="cri-o://28e08b9d272c0ef18d06dc1de9d1deb4eb5a6bb831a9acdebf364ae571c3be49" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.257002 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.258253 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.258358 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.264491 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx244\" (UniqueName: \"kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244\") pod \"openstackclient\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268663 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268704 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268751 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7n4s\" (UniqueName: \"kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268863 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.268906 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.314042 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.314474 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" containerID="cri-o://f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.327590 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.364057 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.372931 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7n4s\" (UniqueName: \"kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.373530 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.373705 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.373713 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.373970 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.374404 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.374439 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.374739 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.378625 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.395099 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.395149 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.400067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.402112 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.402460 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.402506 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.407112 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.408252 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.417028 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.417267 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" containerID="cri-o://01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.424397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7n4s\" (UniqueName: \"kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s\") pod \"barbican-api-58d698879d-2cxcf\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.453690 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.459848 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-log" containerID="cri-o://91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.460297 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-api" containerID="cri-o://1654ea9fb2ca753ee24b020c3fce08cd54c83140b9de3b532d2776ed18c83032" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.473951 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="ovsdbserver-nb" containerID="cri-o://c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" gracePeriod=300 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.516074 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.533672 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.533713 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.536400 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.536818 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api-log" containerID="cri-o://5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.537002 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api" containerID="cri-o://a3da06a2dce939d5a51ed26dadadc2c389616533e46cc1ea2b029b2bcb00cdb0" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.552746 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.553337 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-server" containerID="cri-o://59e52a58cff306c5b3794d240bea25619b6c04674c92596e8d1b304639b5367e" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.553473 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="swift-recon-cron" containerID="cri-o://59f2a7582ee7f1278fdf022a8d7af1323dc67f0a66fc35069516a2cfcafee453" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.553529 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="rsync" containerID="cri-o://1704842157f40733908dd4ed5867072e53a2bbe14d7f0e8ae69852982791aceb" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.553587 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-expirer" containerID="cri-o://fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.553625 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-updater" containerID="cri-o://72bc4662c978aa84acde832f34da75c1468516be07838a280b075621c30f6913" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554466 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-server" containerID="cri-o://27689210a9f998283768d42cc2924bb48afccb7a8d050492cbb021aaed5cd87c" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554490 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-auditor" containerID="cri-o://73801e700d8011bc159c00aaa6593343e45ac149660f216ba6e9790c295dbcb3" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554612 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-replicator" containerID="cri-o://dac4f687851ec775f6ceee6b03795d0d3a5d69ecffcecd2474ba573ade326558" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554663 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-server" containerID="cri-o://0cb5f47a58a27d974724912b597af41894fc9e1c24f5bf3b16e9d27f09518a1a" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554705 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-updater" containerID="cri-o://febf3f401efcc4f0a20b014dfd019f996fa60d2011460fbcaf9fd5210f3ba917" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554764 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-auditor" containerID="cri-o://9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.555498 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-auditor" containerID="cri-o://b82396b234410667a2b6ffa231b6520a5b7a6d7f1757babf3ecda8d988b304cb" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.556088 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-reaper" containerID="cri-o://19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.556150 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-replicator" containerID="cri-o://7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.554463 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-replicator" containerID="cri-o://ff495157508b1452e3738b26774988eacc4476672774db1d76cca80f03b7f4bd" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.558794 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.559006 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-log" containerID="cri-o://269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.559104 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-httpd" containerID="cri-o://7ba37912dff97635b19219822d83130b2684c85cd4b13a053456862a4f7eefed" gracePeriod=30 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.563934 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.566226 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.568455 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.569274 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.573741 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587747 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587818 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rcwz\" (UniqueName: \"kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.587898 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.617055 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.626381 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.632014 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.637217 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.640644 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="openstack-network-exporter" containerID="cri-o://2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a" gracePeriod=300 Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.641106 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.645690 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.678019 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.690967 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691175 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691195 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691223 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691357 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691440 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691503 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691585 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691603 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691661 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rcwz\" (UniqueName: \"kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnx5s\" (UniqueName: \"kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.691787 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.700807 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.716666 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.716732 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.717105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.717730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.721060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.726136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.726725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.736019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rcwz\" (UniqueName: \"kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz\") pod \"placement-65b5b9678-md66w\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794473 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794635 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794695 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794717 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794742 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnx5s\" (UniqueName: \"kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.794930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.795032 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.795076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.795097 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.795126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.795173 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.807286 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.822197 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.824168 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.824643 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.827061 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="ovsdbserver-sb" containerID="cri-o://ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" gracePeriod=300 Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.835297 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.835786 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.837094 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.838110 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.846928 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847240 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnx5s\" (UniqueName: \"kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847268 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847345 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys\") pod \"keystone-58d554f777-pvd8j\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.847600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle\") pod \"neutron-6665547686-fvn8g\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:22 crc kubenswrapper[5030]: I0316 13:27:22.959478 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:22 crc kubenswrapper[5030]: E0316 13:27:22.986784 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44d22e09_d69d_438f_b5aa_61b0f3842481.slice/crio-conmon-5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-conmon-19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod163ad89a_4fe7_4852_acab_8fb297698207.slice/crio-conmon-2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod406c1608_a210_4e95_9e30_0e7c15f51f67.slice/crio-conmon-91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode889c65d_38bf_4f76_8131_5d780dc0cbb6.slice/crio-conmon-c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-conmon-7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode889c65d_38bf_4f76_8131_5d780dc0cbb6.slice/crio-c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80d0d6c4_ceb2_400a_9ea2_ab01ded230bd.slice/crio-conmon-269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode889c65d_38bf_4f76_8131_5d780dc0cbb6.slice/crio-c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-conmon-9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f209a2b_0fda_47aa_8be7_d116be97132c.slice/crio-conmon-fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod406c1608_a210_4e95_9e30_0e7c15f51f67.slice/crio-91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:22.999626 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="galera" containerID="cri-o://c1ef8cc5b33acd6f7307c8cd325cd643f2fc1aaf0d76ddc2d0a9409a05d096a6" gracePeriod=30 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.024199 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="galera" containerID="cri-o://cd97a7de341dba228f0fbe410785bc2e337f24936cdccd8de3e7d129c046bc70" gracePeriod=30 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.079438 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.127468 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.133114 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:23 crc kubenswrapper[5030]: E0316 13:27:23.168067 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9 is running failed: container process not found" containerID="ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.168782 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:23 crc kubenswrapper[5030]: E0316 13:27:23.169157 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9 is running failed: container process not found" containerID="ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:23 crc kubenswrapper[5030]: E0316 13:27:23.171536 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9 is running failed: container process not found" containerID="ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:23 crc kubenswrapper[5030]: E0316 13:27:23.171597 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.211750 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerID="85c67cb0f67642c9dfd7d8c3562a7699102914abdea6c168b7a9983160c9ce2d" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.211797 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerDied","Data":"85c67cb0f67642c9dfd7d8c3562a7699102914abdea6c168b7a9983160c9ce2d"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.341459 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444400 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444519 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="72bc4662c978aa84acde832f34da75c1468516be07838a280b075621c30f6913" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444626 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="73801e700d8011bc159c00aaa6593343e45ac149660f216ba6e9790c295dbcb3" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444686 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="dac4f687851ec775f6ceee6b03795d0d3a5d69ecffcecd2474ba573ade326558" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444738 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="0cb5f47a58a27d974724912b597af41894fc9e1c24f5bf3b16e9d27f09518a1a" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444794 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="febf3f401efcc4f0a20b014dfd019f996fa60d2011460fbcaf9fd5210f3ba917" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444844 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444887 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="ff495157508b1452e3738b26774988eacc4476672774db1d76cca80f03b7f4bd" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.444992 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="27689210a9f998283768d42cc2924bb48afccb7a8d050492cbb021aaed5cd87c" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445039 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445083 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="b82396b234410667a2b6ffa231b6520a5b7a6d7f1757babf3ecda8d988b304cb" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445132 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445246 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="59e52a58cff306c5b3794d240bea25619b6c04674c92596e8d1b304639b5367e" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445396 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445528 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"72bc4662c978aa84acde832f34da75c1468516be07838a280b075621c30f6913"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445610 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"73801e700d8011bc159c00aaa6593343e45ac149660f216ba6e9790c295dbcb3"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445663 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"dac4f687851ec775f6ceee6b03795d0d3a5d69ecffcecd2474ba573ade326558"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445730 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"0cb5f47a58a27d974724912b597af41894fc9e1c24f5bf3b16e9d27f09518a1a"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445790 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"febf3f401efcc4f0a20b014dfd019f996fa60d2011460fbcaf9fd5210f3ba917"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445843 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445900 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"ff495157508b1452e3738b26774988eacc4476672774db1d76cca80f03b7f4bd"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.445960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"27689210a9f998283768d42cc2924bb48afccb7a8d050492cbb021aaed5cd87c"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.446024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.446088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"b82396b234410667a2b6ffa231b6520a5b7a6d7f1757babf3ecda8d988b304cb"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.446140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.446203 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"59e52a58cff306c5b3794d240bea25619b6c04674c92596e8d1b304639b5367e"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.485367 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.504252 5030 generic.go:358] "Generic (PLEG): container finished" podID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerID="91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.518393 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.518500 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerDied","Data":"91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.518679 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.543691 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.555794 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_163ad89a-4fe7-4852-acab-8fb297698207/ovsdbserver-sb/0.log" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.555846 5030 generic.go:358] "Generic (PLEG): container finished" podID="163ad89a-4fe7-4852-acab-8fb297698207" containerID="2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a" exitCode=2 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.555862 5030 generic.go:358] "Generic (PLEG): container finished" podID="163ad89a-4fe7-4852-acab-8fb297698207" containerID="ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.555987 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerDied","Data":"2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.556020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerDied","Data":"ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.580883 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.581016 5030 generic.go:358] "Generic (PLEG): container finished" podID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerID="5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.609087 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.622071 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.640672 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.640727 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q56vk\" (UniqueName: \"kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.665923 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e889c65d-38bf-4f76-8131-5d780dc0cbb6/ovsdbserver-nb/0.log" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.665990 5030 generic.go:358] "Generic (PLEG): container finished" podID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerID="c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b" exitCode=2 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.666007 5030 generic.go:358] "Generic (PLEG): container finished" podID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerID="c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.681701 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.681779 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerDied","Data":"5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.681811 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerDied","Data":"c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.681829 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerDied","Data":"c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.681951 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.700538 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.710662 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-sjm45"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.756337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.756408 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.756464 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.756716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.756740 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44x2c\" (UniqueName: \"kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.757836 5030 generic.go:358] "Generic (PLEG): container finished" podID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerID="081371a1bc630f0222de645b48a9ead168f8f5b9467629eb604488759f57432a" exitCode=0 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.757922 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerDied","Data":"081371a1bc630f0222de645b48a9ead168f8f5b9467629eb604488759f57432a"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.791636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c" (OuterVolumeSpecName: "kube-api-access-44x2c") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "kube-api-access-44x2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.792597 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.792644 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q56vk\" (UniqueName: \"kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.792687 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnhq\" (UniqueName: \"kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.793056 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.793264 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44x2c\" (UniqueName: \"kubernetes.io/projected/541e36a8-c06c-46c6-a86b-2129cd5b99a6-kube-api-access-44x2c\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.797669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.810908 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-dwb88"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.832882 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.858741 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.871800 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q56vk\" (UniqueName: \"kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk\") pod \"root-account-create-update-p6d78\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.873710 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-sjm45"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.873749 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerDied","Data":"269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829"} Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.873655 5030 generic.go:358] "Generic (PLEG): container finished" podID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerID="269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.893933 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-dwb88"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.895670 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.895869 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htnhq\" (UniqueName: \"kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.897842 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.926604 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.927584 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.927598 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.939904 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.944802 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.976652 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.979353 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnhq\" (UniqueName: \"kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq\") pod \"barbican-449a-account-create-update-n2qzv\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.985850 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.993443 5030 generic.go:358] "Generic (PLEG): container finished" podID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerID="163415f418b956470547945a7ccb5a958e13f4da64b713bc0053c88f171d2360" exitCode=143 Mar 16 13:27:23 crc kubenswrapper[5030]: I0316 13:27:23.997609 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.016713 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fb310c-855c-4095-ae8d-ec43a57fbdc7" path="/var/lib/kubelet/pods/37fb310c-855c-4095-ae8d-ec43a57fbdc7/volumes" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.017625 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54bef24-5038-4823-bb3d-c11b5554c6d0" path="/var/lib/kubelet/pods/a54bef24-5038-4823-bb3d-c11b5554c6d0/volumes" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.029403 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059251 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerDied","Data":"163415f418b956470547945a7ccb5a958e13f4da64b713bc0053c88f171d2360"} Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059279 5030 generic.go:358] "Generic (PLEG): container finished" podID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" containerID="2759a16515c1d2dc86dc52c9771e769e8d7a7abb0313d20a489258f557464d42" exitCode=0 Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059291 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059312 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"541e36a8-c06c-46c6-a86b-2129cd5b99a6","Type":"ContainerDied","Data":"2759a16515c1d2dc86dc52c9771e769e8d7a7abb0313d20a489258f557464d42"} Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059326 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-t7p9d"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059354 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-t7p9d"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059372 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059382 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059411 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.059468 5030 scope.go:117] "RemoveContainer" containerID="2759a16515c1d2dc86dc52c9771e769e8d7a7abb0313d20a489258f557464d42" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.120387 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.122507 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.125744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data" (OuterVolumeSpecName: "config-data") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.143952 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.144002 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.145465 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.171829 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.183221 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5 is running failed: container process not found" containerID="c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.185089 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5 is running failed: container process not found" containerID="c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.189723 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5 is running failed: container process not found" containerID="c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.189882 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.264900 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.264936 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.264950 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-hxlcj"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.264970 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-42ck9"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.265002 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-42ck9"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.265022 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.271786 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.283848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.283962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") pod \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\" (UID: \"541e36a8-c06c-46c6-a86b-2129cd5b99a6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: W0316 13:27:24.284316 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/541e36a8-c06c-46c6-a86b-2129cd5b99a6/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.284343 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: W0316 13:27:24.284460 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/541e36a8-c06c-46c6-a86b-2129cd5b99a6/volumes/kubernetes.io~secret/config-data Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.284480 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data" (OuterVolumeSpecName: "config-data") pod "541e36a8-c06c-46c6-a86b-2129cd5b99a6" (UID: "541e36a8-c06c-46c6-a86b-2129cd5b99a6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.291272 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.291448 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx94s\" (UniqueName: \"kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.302921 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.320401 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.327335 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.327366 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-s72j8"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.327379 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-s72j8"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.327400 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.342794 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.820479267 +0000 UTC m=+1289.219791814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.357037 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.357153 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.857128457 +0000 UTC m=+1289.256441004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.390209 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvcsr"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.390369 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.390912 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.424758 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.427200 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.428023 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.428057 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.428087 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.430225 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.457388 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e889c65d-38bf-4f76-8131-5d780dc0cbb6/ovsdbserver-nb/0.log" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.457470 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.457564 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-nqn29"] Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.462488 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.962462648 +0000 UTC m=+1289.361775195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.464848 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data podName:53313e64-d1c5-4aab-adb8-b1480d03bf0a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.964825881 +0000 UTC m=+1289.364138428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data") pod "rabbitmq-server-0" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a") : configmap "rabbitmq-config-data" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.464891 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.964884832 +0000 UTC m=+1289.364197380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.464915 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.96490973 +0000 UTC m=+1289.364222276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.465121 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.465176 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:24.965162895 +0000 UTC m=+1289.364475442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.466961 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.466991 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.467001 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/541e36a8-c06c-46c6-a86b-2129cd5b99a6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.488972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.534277 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-nqn29"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.569097 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.576575 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.576654 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.576745 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.577103 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.577173 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mth6q\" (UniqueName: \"kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.577250 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.577353 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs\") pod \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\" (UID: \"e889c65d-38bf-4f76-8131-5d780dc0cbb6\") " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587063 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw5nd\" (UniqueName: \"kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587181 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587230 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587252 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6jq\" (UniqueName: \"kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzph\" (UniqueName: \"kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587618 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587706 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx94s\" (UniqueName: \"kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587753 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.587834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2crjf\" (UniqueName: \"kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.592512 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config" (OuterVolumeSpecName: "config") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.594174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.594311 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-gmzxn"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.596153 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.596355 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.597048 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts" (OuterVolumeSpecName: "scripts") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.633919 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q" (OuterVolumeSpecName: "kube-api-access-mth6q") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "kube-api-access-mth6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.689242 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx94s\" (UniqueName: \"kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s\") pod \"glance-8247-account-create-update-h2td7\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.696806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.696871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.696894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6jq\" (UniqueName: \"kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.696934 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzph\" (UniqueName: \"kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.696955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697255 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2crjf\" (UniqueName: \"kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697359 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw5nd\" (UniqueName: \"kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697465 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697477 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697501 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697512 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mth6q\" (UniqueName: \"kubernetes.io/projected/e889c65d-38bf-4f76-8131-5d780dc0cbb6-kube-api-access-mth6q\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697524 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e889c65d-38bf-4f76-8131-5d780dc0cbb6-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.697659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.704907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.706089 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.713308 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.714841 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.729333 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.742361 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2crjf\" (UniqueName: \"kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf\") pod \"cinder-fdd0-account-create-update-mb6q5\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.747564 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-fvcsr"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.751211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzph\" (UniqueName: \"kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph\") pod \"placement-2079-account-create-update-fl62j\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.754120 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw5nd\" (UniqueName: \"kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd\") pod \"neutron-3924-account-create-update-n4h6t\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.754575 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6jq\" (UniqueName: \"kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq\") pod \"nova-api-e1f5-account-create-update-l68c4\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.777596 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.779280 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2csq4"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.792305 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2csq4"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.813179 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.813486 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-central-agent" containerID="cri-o://1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2" gracePeriod=30 Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.813970 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="proxy-httpd" containerID="cri-o://c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445" gracePeriod=30 Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.814033 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="sg-core" containerID="cri-o://ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012" gracePeriod=30 Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.814066 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-notification-agent" containerID="cri-o://53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036" gracePeriod=30 Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.844050 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.866762 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-2bb0-account-create-update-xwq6z"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.869144 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.916399 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.916426 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.916431 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.916483 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:25.916462986 +0000 UTC m=+1290.315775533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:24 crc kubenswrapper[5030]: E0316 13:27:24.916526 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:25.916506087 +0000 UTC m=+1290.315818634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.937272 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.958441 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.992363 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw"] Mar 16 13:27:24 crc kubenswrapper[5030]: I0316 13:27:24.992718 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.013784 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-c844-account-create-update-fwxmw"] Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.020230 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.020293 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.020275805 +0000 UTC m=+1290.419588353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.032924 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033012 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.03299253 +0000 UTC m=+1290.432305076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033067 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033095 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data podName:53313e64-d1c5-4aab-adb8-b1480d03bf0a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.033088 +0000 UTC m=+1290.432400547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data") pod "rabbitmq-server-0" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a") : configmap "rabbitmq-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033139 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033163 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.033155566 +0000 UTC m=+1290.432468114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033215 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033235 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.033230096 +0000 UTC m=+1290.432542643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033622 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.033699 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data podName:89282d6e-ff10-4092-b709-a2466e578fd4 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:25.533676325 +0000 UTC m=+1289.932988873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data") pod "rabbitmq-cell1-server-0" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.065221 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-s4c6l"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.091706 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-s4c6l"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.124168 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-hc75v"] Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.154135 5030 log.go:32] "RunPodSandbox from runtime service failed" err=< Mar 16 13:27:25 crc kubenswrapper[5030]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_875cb6c5-c50d-4bc0-a717-b04d59d82610_0(6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642" Netns:"/var/run/netns/ba94fc21-c4b3-483e-b46c-86b2d25c9e8e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642;K8S_POD_UID=875cb6c5-c50d-4bc0-a717-b04d59d82610" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: [openstack-kuttl-tests/openstackclient/875cb6c5-c50d-4bc0-a717-b04d59d82610:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[openstack-kuttl-tests/openstackclient 6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642 network default NAD default] [openstack-kuttl-tests/openstackclient 6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642 network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:d9:00:c9 [10.217.0.201/23] Mar 16 13:27:25 crc kubenswrapper[5030]: ' Mar 16 13:27:25 crc kubenswrapper[5030]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 13:27:25 crc kubenswrapper[5030]: > Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.154186 5030 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err=< Mar 16 13:27:25 crc kubenswrapper[5030]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_openstackclient_openstack-kuttl-tests_875cb6c5-c50d-4bc0-a717-b04d59d82610_0(6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642): error adding pod openstack-kuttl-tests_openstackclient to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642" Netns:"/var/run/netns/ba94fc21-c4b3-483e-b46c-86b2d25c9e8e" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=openstack-kuttl-tests;K8S_POD_NAME=openstackclient;K8S_POD_INFRA_CONTAINER_ID=6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642;K8S_POD_UID=875cb6c5-c50d-4bc0-a717-b04d59d82610" Path:"" ERRORED: error configuring pod [openstack-kuttl-tests/openstackclient] networking: [openstack-kuttl-tests/openstackclient/875cb6c5-c50d-4bc0-a717-b04d59d82610:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[openstack-kuttl-tests/openstackclient 6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642 network default NAD default] [openstack-kuttl-tests/openstackclient 6771ba94a582f54538e12207ab919c415e695cef16db8b4938fabbcfaf6bb642 network default NAD default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:d9:00:c9 [10.217.0.201/23] Mar 16 13:27:25 crc kubenswrapper[5030]: ' Mar 16 13:27:25 crc kubenswrapper[5030]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Mar 16 13:27:25 crc kubenswrapper[5030]: > pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.192645 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-hc75v"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.214568 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="1704842157f40733908dd4ed5867072e53a2bbe14d7f0e8ae69852982791aceb" exitCode=0 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.214680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"1704842157f40733908dd4ed5867072e53a2bbe14d7f0e8ae69852982791aceb"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.220669 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.230864 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.234938 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerStarted","Data":"590e2dc63d991e26b5924760c83b6b715b370163a76fa0608c181d14ec5babf7"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.261451 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btf9p"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.265530 5030 generic.go:358] "Generic (PLEG): container finished" podID="0d649e48-1a25-431c-a334-ed9bd902ee85" containerID="4010f2c336c993f9f63a15808e83f0ac33d271d977a61410da43b7ecc626788b" exitCode=0 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.300112 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"0d649e48-1a25-431c-a334-ed9bd902ee85","Type":"ContainerDied","Data":"4010f2c336c993f9f63a15808e83f0ac33d271d977a61410da43b7ecc626788b"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.325927 5030 generic.go:358] "Generic (PLEG): container finished" podID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerID="c1ef8cc5b33acd6f7307c8cd325cd643f2fc1aaf0d76ddc2d0a9409a05d096a6" exitCode=0 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.326454 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btf9p"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.326496 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerDied","Data":"c1ef8cc5b33acd6f7307c8cd325cd643f2fc1aaf0d76ddc2d0a9409a05d096a6"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.329004 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.348581 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.404381 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.413908 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerStarted","Data":"14281e55a79ae06c261feb23df407e90d9c8908453b3c98415d85fb606c89f06"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.452248 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_163ad89a-4fe7-4852-acab-8fb297698207/ovsdbserver-sb/0.log" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.452400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"163ad89a-4fe7-4852-acab-8fb297698207","Type":"ContainerDied","Data":"9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.452428 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b8a2504c11ec8b4a9c3c1251e62569b50961310d9abdfbdf7ef4a2fa51fadf8" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.486249 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="77627c76-1e68-4476-af56-081c481ae2dd" containerName="kube-state-metrics" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.527838 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.550507 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_e889c65d-38bf-4f76-8131-5d780dc0cbb6/ovsdbserver-nb/0.log" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.551750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"e889c65d-38bf-4f76-8131-5d780dc0cbb6","Type":"ContainerDied","Data":"a6a5290472a16e365d50c2da8b2a455ce53d8ecfb443f3fed946e04524e2faf8"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.551916 5030 scope.go:117] "RemoveContainer" containerID="c667a1a88b3ee2da8bc9efe3b840ca8a2176f5874a8f3583a57865b45646664b" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.552428 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.596277 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.605750 5030 generic.go:358] "Generic (PLEG): container finished" podID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerID="ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012" exitCode=2 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.605877 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerDied","Data":"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.606571 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-g5jsx"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.612238 5030 generic.go:358] "Generic (PLEG): container finished" podID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" containerID="9a2861f8073235d0f35323d92513aefaa091c997b7a922a80a8d36caff545b80" exitCode=137 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.617231 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.625778 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-ds5x8"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.631390 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.631527 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: E0316 13:27:25.631609 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data podName:89282d6e-ff10-4092-b709-a2466e578fd4 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:26.631594933 +0000 UTC m=+1291.030907480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data") pod "rabbitmq-cell1-server-0" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.635030 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerStarted","Data":"37d6bb65f7c1f8e993e876e0f93164117dd4840dfa1bedccfe22fa6b44056d0b"} Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.643263 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_163ad89a-4fe7-4852-acab-8fb297698207/ovsdbserver-sb/0.log" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.643408 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.644867 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.645849 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "e889c65d-38bf-4f76-8131-5d780dc0cbb6" (UID: "e889c65d-38bf-4f76-8131-5d780dc0cbb6"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646066 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646087 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646125 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="ovsdbserver-sb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646131 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="ovsdbserver-sb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646148 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646154 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646183 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="ovsdbserver-nb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646189 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="ovsdbserver-nb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646408 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646427 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="openstack-network-exporter" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646445 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" containerName="ovsdbserver-nb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.646471 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="163ad89a-4fe7-4852-acab-8fb297698207" containerName="ovsdbserver-sb" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.651770 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.673813 5030 scope.go:117] "RemoveContainer" containerID="c78bc06494127945c07d6e7c13ab36d9636be9f8def6b14b5b6a76c0dec133e5" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.679678 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.696810 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.697539 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.724143 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.724200 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-fffzm"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.724427 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-fffzm"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.724451 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="77627c76-1e68-4476-af56-081c481ae2dd" containerName="kube-state-metrics" containerID="cri-o://a1b33e99b6f52bbfd563d806270eaf84b0378e849edd84075641183edd498541" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.735232 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.739741 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.739995 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-log" containerID="cri-o://72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.740485 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-api" containerID="cri-o://080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.741823 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e889c65d-38bf-4f76-8131-5d780dc0cbb6-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.752137 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.761986 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.762220 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-api" containerID="cri-o://b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.762577 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-httpd" containerID="cri-o://cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.765629 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.789669 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.789627 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.793294 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d649e48-1a25-431c-a334-ed9bd902ee85" containerName="memcached" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.793314 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d649e48-1a25-431c-a334-ed9bd902ee85" containerName="memcached" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.793671 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="galera" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.793687 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d649e48-1a25-431c-a334-ed9bd902ee85" containerName="memcached" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.805561 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-tcwvn"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.805603 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.805615 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-tcwvn"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.805724 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.810487 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.810834 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.814478 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.820320 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.820583 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener-log" containerID="cri-o://f4e98c92cdbe24b70cac2d6f5073c2dff6eb434f2a726c5c09fa269d5aa2c6dc" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.820727 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener" containerID="cri-o://702f7b29fbd473ea5b18b1d283206cddf84ab25b8ce8f2d3fc07e9a31dac1c6b" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.822842 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5frv7"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.827009 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-5frv7"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.831223 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.835342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.839490 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.839752 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker-log" containerID="cri-o://fd603db9017ea18e32e104394c13a6249a68273e9c7dfd4b3469595d93092066" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.839892 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker" containerID="cri-o://bc20eaaadeb3ad1b260d080bfced970205680d1af449e78b8968357099595a03" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.866881 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873450 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config\") pod \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873509 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5vqw\" (UniqueName: \"kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw\") pod \"0d649e48-1a25-431c-a334-ed9bd902ee85\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret\") pod \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873604 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873751 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs\") pod \"0d649e48-1a25-431c-a334-ed9bd902ee85\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873777 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873814 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle\") pod \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873891 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873911 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.873928 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874110 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data\") pod \"0d649e48-1a25-431c-a334-ed9bd902ee85\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874139 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn8cr\" (UniqueName: \"kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr\") pod \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\" (UID: \"10bc4a31-e3b9-4205-9e63-c7e92bffbf10\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874168 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config\") pod \"0d649e48-1a25-431c-a334-ed9bd902ee85\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874213 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874258 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle\") pod \"0d649e48-1a25-431c-a334-ed9bd902ee85\" (UID: \"0d649e48-1a25-431c-a334-ed9bd902ee85\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874361 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfrtd\" (UniqueName: \"kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd\") pod \"163ad89a-4fe7-4852-acab-8fb297698207\" (UID: \"163ad89a-4fe7-4852-acab-8fb297698207\") " Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7lg5\" (UniqueName: \"kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.874960 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.875355 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.876379 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data" (OuterVolumeSpecName: "config-data") pod "0d649e48-1a25-431c-a334-ed9bd902ee85" (UID: "0d649e48-1a25-431c-a334-ed9bd902ee85"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.882634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts" (OuterVolumeSpecName: "scripts") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.882834 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config" (OuterVolumeSpecName: "config") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.884863 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-94zql"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.898738 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "0d649e48-1a25-431c-a334-ed9bd902ee85" (UID: "0d649e48-1a25-431c-a334-ed9bd902ee85"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.899293 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.899337 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-94zql"] Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.899411 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.899589 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api-log" containerID="cri-o://be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.900131 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api" containerID="cri-o://73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c" gracePeriod=30 Mar 16 13:27:25 crc kubenswrapper[5030]: I0316 13:27:25.926016 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-8ckn2"] Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.014627 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-8ckn2"] Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.026852 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.026889 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.026901 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/163ad89a-4fe7-4852-acab-8fb297698207-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.027858 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.027929 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.027910856 +0000 UTC m=+1292.427223403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.102670 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="153a0988-98b5-4ea1-b066-0b754566bfd3" path="/var/lib/kubelet/pods/153a0988-98b5-4ea1-b066-0b754566bfd3/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.104045 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb6fc47-7f95-4c05-96e0-02f0cde23fbb" path="/var/lib/kubelet/pods/2cb6fc47-7f95-4c05-96e0-02f0cde23fbb/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.104756 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d4caad-7cca-47fa-ac67-e805ac52a31e" path="/var/lib/kubelet/pods/31d4caad-7cca-47fa-ac67-e805ac52a31e/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.105397 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16" path="/var/lib/kubelet/pods/32a170bb-6dc5-4f4a-b1e5-35d16b3c3a16/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.106810 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a" path="/var/lib/kubelet/pods/532e96ee-97b4-41ac-b0bc-1ea62e6dfc7a/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.107526 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="541e36a8-c06c-46c6-a86b-2129cd5b99a6" path="/var/lib/kubelet/pods/541e36a8-c06c-46c6-a86b-2129cd5b99a6/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.108304 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59356801-aa08-452c-a9a2-d85d3ead51f1" path="/var/lib/kubelet/pods/59356801-aa08-452c-a9a2-d85d3ead51f1/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.109718 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc6d5c9-4c94-475e-a809-127e04cd851e" path="/var/lib/kubelet/pods/6cc6d5c9-4c94-475e-a809-127e04cd851e/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.110640 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="730d4b84-050c-4b47-944b-5e508001667d" path="/var/lib/kubelet/pods/730d4b84-050c-4b47-944b-5e508001667d/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.111274 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7730c44c-bbf1-4c58-b917-d1ce3efa6590" path="/var/lib/kubelet/pods/7730c44c-bbf1-4c58-b917-d1ce3efa6590/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.112890 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88e64fb3-edda-4ad3-af08-92198c11329d" path="/var/lib/kubelet/pods/88e64fb3-edda-4ad3-af08-92198c11329d/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.113598 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="899c0d58-6271-492f-b005-9776aa720374" path="/var/lib/kubelet/pods/899c0d58-6271-492f-b005-9776aa720374/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.114229 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba69b8a-68f5-46c7-8ce1-16211fbbcadd" path="/var/lib/kubelet/pods/8ba69b8a-68f5-46c7-8ce1-16211fbbcadd/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.115053 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99da41f4-ec63-4dcf-9a4b-406a7e2c74f8" path="/var/lib/kubelet/pods/99da41f4-ec63-4dcf-9a4b-406a7e2c74f8/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.116366 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab39e66a-2848-49fc-bb7a-ecba1c853708" path="/var/lib/kubelet/pods/ab39e66a-2848-49fc-bb7a-ecba1c853708/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133173 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw7gw\" (UniqueName: \"kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133318 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133368 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133707 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.133968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config\") pod \"6da8f44b-035c-4ab2-962b-5c44b123929e\" (UID: \"6da8f44b-035c-4ab2-962b-5c44b123929e\") " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.134597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.135402 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeec32ba-d979-49a9-8ad3-c8eb36978ae2" path="/var/lib/kubelet/pods/aeec32ba-d979-49a9-8ad3-c8eb36978ae2/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.143058 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af329639-82ba-4b13-8c6f-a20650cf518d" path="/var/lib/kubelet/pods/af329639-82ba-4b13-8c6f-a20650cf518d/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.143662 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c346155b-e36c-45a4-9396-499101acd0e7" path="/var/lib/kubelet/pods/c346155b-e36c-45a4-9396-499101acd0e7/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.144536 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfd05d91-655e-41ac-b719-17fdcd5a86e7" path="/var/lib/kubelet/pods/dfd05d91-655e-41ac-b719-17fdcd5a86e7/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.146585 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb91bd97-9fbb-4925-9af5-53310afb08ec" path="/var/lib/kubelet/pods/eb91bd97-9fbb-4925-9af5-53310afb08ec/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.151655 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7lg5\" (UniqueName: \"kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.151759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.151871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152111 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr7ms\" (UniqueName: \"kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152228 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152366 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/163ad89a-4fe7-4852-acab-8fb297698207-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152378 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/0d649e48-1a25-431c-a334-ed9bd902ee85-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152391 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.152849 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e7e639-1a5c-4019-9b45-e38374870950" path="/var/lib/kubelet/pods/f4e7e639-1a5c-4019-9b45-e38374870950/volumes" Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.153816 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.153884 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.153869351 +0000 UTC m=+1292.553181898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.154829 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.154893 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.154928 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data podName:53313e64-d1c5-4aab-adb8-b1480d03bf0a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.154918434 +0000 UTC m=+1292.554230980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data") pod "rabbitmq-server-0" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a") : configmap "rabbitmq-config-data" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155003 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155031 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.155018381 +0000 UTC m=+1292.554330928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.155565 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155629 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155659 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.155650891 +0000 UTC m=+1292.554963438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155722 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155746 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.15573574 +0000 UTC m=+1292.555048277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155791 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.155812 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.155803218 +0000 UTC m=+1292.555115764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.159023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.159685 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.161487 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.194025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7lg5\" (UniqueName: \"kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5\") pod \"dnsmasq-dnsmasq-79dcd846c5-2st7l\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.234634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw" (OuterVolumeSpecName: "kube-api-access-gw7gw") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "kube-api-access-gw7gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cr7ms\" (UniqueName: \"kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259852 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259865 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259875 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/6da8f44b-035c-4ab2-962b-5c44b123929e-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.259885 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw7gw\" (UniqueName: \"kubernetes.io/projected/6da8f44b-035c-4ab2-962b-5c44b123929e-kube-api-access-gw7gw\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.261096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.311513 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.311843 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd" (OuterVolumeSpecName: "kube-api-access-rfrtd") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "kube-api-access-rfrtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.312006 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr" (OuterVolumeSpecName: "kube-api-access-gn8cr") pod "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" (UID: "10bc4a31-e3b9-4205-9e63-c7e92bffbf10"). InnerVolumeSpecName "kube-api-access-gn8cr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.317090 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "mysql-db") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.320762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw" (OuterVolumeSpecName: "kube-api-access-j5vqw") pod "0d649e48-1a25-431c-a334-ed9bd902ee85" (UID: "0d649e48-1a25-431c-a334-ed9bd902ee85"). InnerVolumeSpecName "kube-api-access-j5vqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.325225 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr7ms\" (UniqueName: \"kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms\") pod \"keystone-fa3a-account-create-update-zb2ln\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.363163 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5vqw\" (UniqueName: \"kubernetes.io/projected/0d649e48-1a25-431c-a334-ed9bd902ee85-kube-api-access-j5vqw\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.363206 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.363219 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn8cr\" (UniqueName: \"kubernetes.io/projected/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-kube-api-access-gn8cr\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.363235 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.363245 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfrtd\" (UniqueName: \"kubernetes.io/projected/163ad89a-4fe7-4852-acab-8fb297698207-kube-api-access-rfrtd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.388413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.419742 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.432401 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.435357 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.438818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6da8f44b-035c-4ab2-962b-5c44b123929e" (UID: "6da8f44b-035c-4ab2-962b-5c44b123929e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.483127 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" (UID: "10bc4a31-e3b9-4205-9e63-c7e92bffbf10"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.484823 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.484844 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.484856 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.484866 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.484874 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6da8f44b-035c-4ab2-962b-5c44b123929e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.587988 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" (UID: "10bc4a31-e3b9-4205-9e63-c7e92bffbf10"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.687479 5030 generic.go:358] "Generic (PLEG): container finished" podID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.689847 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.693851 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:26 crc kubenswrapper[5030]: E0316 13:27:26.693950 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data podName:89282d6e-ff10-4092-b709-a2466e578fd4 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.693928724 +0000 UTC m=+1293.093241270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data") pod "rabbitmq-cell1-server-0" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.695417 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.695986 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:27:26 crc kubenswrapper[5030]: W0316 13:27:26.718705 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12da506b_6937_4461_b5db_540d347c943e.slice/crio-045f1601d825be30016305b6a0399ed5f628befaa7a91cf67bec27415ad57f11 WatchSource:0}: Error finding container 045f1601d825be30016305b6a0399ed5f628befaa7a91cf67bec27415ad57f11: Status 404 returned error can't find the container with id 045f1601d825be30016305b6a0399ed5f628befaa7a91cf67bec27415ad57f11 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.726269 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d649e48-1a25-431c-a334-ed9bd902ee85" (UID: "0d649e48-1a25-431c-a334-ed9bd902ee85"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.760888 5030 generic.go:358] "Generic (PLEG): container finished" podID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerID="72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267" exitCode=143 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.774686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.778028 5030 generic.go:358] "Generic (PLEG): container finished" podID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.782637 5030 generic.go:358] "Generic (PLEG): container finished" podID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerID="cd97a7de341dba228f0fbe410785bc2e337f24936cdccd8de3e7d129c046bc70" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.787715 5030 generic.go:358] "Generic (PLEG): container finished" podID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerID="a3da06a2dce939d5a51ed26dadadc2c389616533e46cc1ea2b029b2bcb00cdb0" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.790904 5030 generic.go:358] "Generic (PLEG): container finished" podID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerID="c2cd43506a91a5e11cfa5e16233edd85796456e9f6d9e96f25e8c54765c60a49" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.792040 5030 generic.go:358] "Generic (PLEG): container finished" podID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.807058 5030 generic.go:358] "Generic (PLEG): container finished" podID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerID="7ba37912dff97635b19219822d83130b2684c85cd4b13a053456862a4f7eefed" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.811681 5030 generic.go:358] "Generic (PLEG): container finished" podID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerID="c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.811829 5030 generic.go:358] "Generic (PLEG): container finished" podID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerID="1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.814207 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.817413 5030 generic.go:358] "Generic (PLEG): container finished" podID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerID="fd603db9017ea18e32e104394c13a6249a68273e9c7dfd4b3469595d93092066" exitCode=143 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.821114 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0167208-7974-4db5-89be-eafc7e5412f9" containerID="be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814" exitCode=143 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.823180 5030 generic.go:358] "Generic (PLEG): container finished" podID="77627c76-1e68-4476-af56-081c481ae2dd" containerID="a1b33e99b6f52bbfd563d806270eaf84b0378e849edd84075641183edd498541" exitCode=2 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.829637 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerID="28e08b9d272c0ef18d06dc1de9d1deb4eb5a6bb831a9acdebf364ae571c3be49" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.838075 5030 generic.go:358] "Generic (PLEG): container finished" podID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerID="f4e98c92cdbe24b70cac2d6f5073c2dff6eb434f2a726c5c09fa269d5aa2c6dc" exitCode=143 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.840029 5030 generic.go:358] "Generic (PLEG): container finished" podID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerID="1654ea9fb2ca753ee24b020c3fce08cd54c83140b9de3b532d2776ed18c83032" exitCode=0 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.849972 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.850085 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.851611 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.851952 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.858795 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.861392 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.921953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "0d649e48-1a25-431c-a334-ed9bd902ee85" (UID: "0d649e48-1a25-431c-a334-ed9bd902ee85"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.934449 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.936204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "10bc4a31-e3b9-4205-9e63-c7e92bffbf10" (UID: "10bc4a31-e3b9-4205-9e63-c7e92bffbf10"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:26 crc kubenswrapper[5030]: W0316 13:27:26.941115 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3529c2a2_d018_4c39_b2f0_6346a2b686cc.slice/crio-05f4c6dcb72481127b487e5c614fd8fa07c282aefe48772ceccb7b5b5ab4bec5 WatchSource:0}: Error finding container 05f4c6dcb72481127b487e5c614fd8fa07c282aefe48772ceccb7b5b5ab4bec5: Status 404 returned error can't find the container with id 05f4c6dcb72481127b487e5c614fd8fa07c282aefe48772ceccb7b5b5ab4bec5 Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.952746 5030 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d649e48-1a25-431c-a334-ed9bd902ee85-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.952781 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.952792 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/10bc4a31-e3b9-4205-9e63-c7e92bffbf10-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:26 crc kubenswrapper[5030]: I0316 13:27:26.960431 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "163ad89a-4fe7-4852-acab-8fb297698207" (UID: "163ad89a-4fe7-4852-acab-8fb297698207"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.063432 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/163ad89a-4fe7-4852-acab-8fb297698207-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.175232 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f is running failed: container process not found" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.178221 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f is running failed: container process not found" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.178510 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f is running failed: container process not found" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.178537 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.217394 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.219260 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-p6d78" podUID="46b4fd3c-70f8-46a4-a4bf-8a1e23f40135" Mar 16 13:27:27 crc kubenswrapper[5030]: W0316 13:27:27.265041 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64589292_9080_4285_b64d_14cf1da1c4be.slice/crio-ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2 WatchSource:0}: Error finding container ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2: Status 404 returned error can't find the container with id ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2 Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.336133 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0 is running failed: container process not found" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.336616 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0 is running failed: container process not found" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.341397 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0 is running failed: container process not found" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.341447 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.367700 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "cinder" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="cinder" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.368067 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "barbican" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="barbican" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.368358 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "glance" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="glance" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.369001 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"cinder-db-secret\\\" not found\"" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" podUID="64589292-9080-4285-b64d-14cf1da1c4be" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.370058 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" podUID="d73bbf1c-7745-4164-a49b-59e42235835f" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.371500 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" podUID="9f3064ee-07ca-4eb2-a044-aa49025a5c55" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.581433 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "nova_api" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="nova_api" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.582613 5030 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.568s" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583595 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583626 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"45f3f054-9c16-4e92-b203-0ace1d4ce50b","Type":"ContainerDied","Data":"01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583766 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2jzx2"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583800 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"0d649e48-1a25-431c-a334-ed9bd902ee85","Type":"ContainerDied","Data":"2504ea4a23ceb634ca5c5574130d68f358f23a92c8d88b8737953973dc4501be"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"6da8f44b-035c-4ab2-962b-5c44b123929e","Type":"ContainerDied","Data":"a9f86cbc5247f9c0f78cd6402885e6194907e56ab42c00c7dbb96d9ceddb6b1e"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583827 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-2jzx2"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583848 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerStarted","Data":"27807b24204415c8edd0371c056be4ef733a0acf6836c2d6671ca47c8483add1"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583882 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583895 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerDied","Data":"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583969 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mj7nk"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.583994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8e0c48df-8cc5-4a86-81bd-22e68eb4627d","Type":"ContainerDied","Data":"48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584007 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerDied","Data":"cd97a7de341dba228f0fbe410785bc2e337f24936cdccd8de3e7d129c046bc70"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584019 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerDied","Data":"a3da06a2dce939d5a51ed26dadadc2c389616533e46cc1ea2b029b2bcb00cdb0"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584032 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-mj7nk"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584066 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z4pfn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584101 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-z4pfn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584156 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584168 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerDied","Data":"c2cd43506a91a5e11cfa5e16233edd85796456e9f6d9e96f25e8c54765c60a49"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584182 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584215 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-kh9sb"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584226 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584238 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fd02d0f3-56a7-4181-aef1-17bf3effc3d7","Type":"ContainerDied","Data":"f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584249 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584258 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerDied","Data":"7ba37912dff97635b19219822d83130b2684c85cd4b13a053456862a4f7eefed"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584270 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-vspcn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584306 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerDied","Data":"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584318 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584329 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-pbsxf"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerDied","Data":"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584430 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerDied","Data":"fd603db9017ea18e32e104394c13a6249a68273e9c7dfd4b3469595d93092066"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584462 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerStarted","Data":"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584473 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zn5v7"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584483 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584493 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-zn5v7"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584508 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-tdwtn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584533 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerDied","Data":"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584545 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-tdwtn"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584665 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584678 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584733 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"77627c76-1e68-4476-af56-081c481ae2dd","Type":"ContainerDied","Data":"a1b33e99b6f52bbfd563d806270eaf84b0378e849edd84075641183edd498541"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584753 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerStarted","Data":"8b70b960b45f6ff8692961058963fc821184d79fcd80aacfb3ab3b668be2ec82"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerDied","Data":"28e08b9d272c0ef18d06dc1de9d1deb4eb5a6bb831a9acdebf364ae571c3be49"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584934 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584945 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584954 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dpwqs"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584963 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-dpwqs"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584974 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.584992 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerDied","Data":"f4e98c92cdbe24b70cac2d6f5073c2dff6eb434f2a726c5c09fa269d5aa2c6dc"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585001 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585012 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585021 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerDied","Data":"1654ea9fb2ca753ee24b020c3fce08cd54c83140b9de3b532d2776ed18c83032"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585031 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerStarted","Data":"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585076 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585100 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585109 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.585120 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.583463 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" podUID="8464be26-4571-474e-bc27-99bbb6c19f3d" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.587299 5030 scope.go:117] "RemoveContainer" containerID="4010f2c336c993f9f63a15808e83f0ac33d271d977a61410da43b7ecc626788b" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.588856 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-httpd" containerID="cri-o://47e275d6b60aa76a49a572f37a65e31aa3f43d845288dab61d5e5b368e6d66ee" gracePeriod=30 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.590265 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" podUID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" containerName="keystone-api" containerID="cri-o://cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9" gracePeriod=30 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.590272 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-server" containerID="cri-o://03bec67835cdc8e8d65802af5d0b340b126b95f546733b446cc78e5cdeb431ae" gracePeriod=30 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.591747 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.597583 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.599031 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969 is running failed: container process not found" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.599351 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969 is running failed: container process not found" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.599607 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969 is running failed: container process not found" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.599680 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.638150 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:27 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: if [ -n "neutron" ]; then Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="neutron" Mar 16 13:27:27 crc kubenswrapper[5030]: else Mar 16 13:27:27 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:27 crc kubenswrapper[5030]: fi Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:27 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:27 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:27 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:27 crc kubenswrapper[5030]: # support updates Mar 16 13:27:27 crc kubenswrapper[5030]: Mar 16 13:27:27 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.639300 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" podUID="dc11b156-a80f-4e89-93c4-89443d86dc6b" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.667787 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="rabbitmq" containerID="cri-o://230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429" gracePeriod=604800 Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.701123 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.701341 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0 podName:b065a85f-f473-459d-bd68-74d1b57ce27b nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.20132311 +0000 UTC m=+1292.600635657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0") pod "dnsmasq-dnsmasq-76f67dbd4f-xsfzq" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b") : configmap "dns-swift-storage-0" not found Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.701737 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.705565 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.718416 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="rabbitmq" containerID="cri-o://29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e" gracePeriod=604800 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.725324 5030 scope.go:117] "RemoveContainer" containerID="c1ef8cc5b33acd6f7307c8cd325cd643f2fc1aaf0d76ddc2d0a9409a05d096a6" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.729014 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.752597 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.757320 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.758917 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.765711 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.766994 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.768722 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.769518 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.775156 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.801287 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data\") pod \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.801414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhdbj\" (UniqueName: \"kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj\") pod \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.801525 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle\") pod \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\" (UID: \"fd02d0f3-56a7-4181-aef1-17bf3effc3d7\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.815286 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" secret="" err="secret \"galera-openstack-dockercfg-mlcpv\" not found" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.815340 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.838240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj" (OuterVolumeSpecName: "kube-api-access-nhdbj") pod "fd02d0f3-56a7-4181-aef1-17bf3effc3d7" (UID: "fd02d0f3-56a7-4181-aef1-17bf3effc3d7"). InnerVolumeSpecName "kube-api-access-nhdbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.838393 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.846931 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.853038 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.871829 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.880404 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.880672 5030 scope.go:117] "RemoveContainer" containerID="b09d1b62b39403e4863fb1147266980607d9262cb749205a77a0c7a7168986a7" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.885005 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.886198 5030 generic.go:358] "Generic (PLEG): container finished" podID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerID="702f7b29fbd473ea5b18b1d283206cddf84ab25b8ce8f2d3fc07e9a31dac1c6b" exitCode=0 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.886275 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerDied","Data":"702f7b29fbd473ea5b18b1d283206cddf84ab25b8ce8f2d3fc07e9a31dac1c6b"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.886304 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" event={"ID":"f1ee5b58-8044-4e80-a667-663f2f57f6e5","Type":"ContainerDied","Data":"833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.886318 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="833cdd3261924ab163e732aa66c77a3e77c897a19ab4afee7e729e08a93091ca" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.888517 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.889434 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"406c1608-a210-4e95-9e30-0e7c15f51f67","Type":"ContainerDied","Data":"530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.889458 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="530e0618d818439ea64328520ee25d8d944cd71a7ea5ba275661ef6b3cca867b" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.893271 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.893322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerStarted","Data":"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.901188 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.903404 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker-log" containerID="cri-o://2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438" gracePeriod=30 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.903510 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker" containerID="cri-o://84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107" gracePeriod=30 Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.904389 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config\") pod \"875cb6c5-c50d-4bc0-a717-b04d59d82610\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.904534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret\") pod \"875cb6c5-c50d-4bc0-a717-b04d59d82610\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.904712 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx244\" (UniqueName: \"kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244\") pod \"875cb6c5-c50d-4bc0-a717-b04d59d82610\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.904930 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle\") pod \"875cb6c5-c50d-4bc0-a717-b04d59d82610\" (UID: \"875cb6c5-c50d-4bc0-a717-b04d59d82610\") " Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.905800 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data" (OuterVolumeSpecName: "config-data") pod "fd02d0f3-56a7-4181-aef1-17bf3effc3d7" (UID: "fd02d0f3-56a7-4181-aef1-17bf3effc3d7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.906183 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:27:27 crc kubenswrapper[5030]: E0316 13:27:27.906510 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts podName:e27eb44f-510b-464d-82e7-017cf7806c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:28.406489676 +0000 UTC m=+1292.805802224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts") pod "keystone-fa3a-account-create-update-zb2ln" (UID: "e27eb44f-510b-464d-82e7-017cf7806c04") : configmap "openstack-scripts" not found Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.906132 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhdbj\" (UniqueName: \"kubernetes.io/projected/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-kube-api-access-nhdbj\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.906769 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"45f3f054-9c16-4e92-b203-0ace1d4ce50b","Type":"ContainerDied","Data":"780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.906793 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="780956f68d048d0496e5c2a0fc8a8d8f6c9bb71ed696c58dae3150eee4d3f14c" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.906891 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.915011 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "875cb6c5-c50d-4bc0-a717-b04d59d82610" (UID: "875cb6c5-c50d-4bc0-a717-b04d59d82610"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.933036 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"8e0c48df-8cc5-4a86-81bd-22e68eb4627d","Type":"ContainerDied","Data":"474ea5c3310af18110a615645a4f58b9998634ca34109ec9a9d970e1477983bb"} Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.933082 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="474ea5c3310af18110a615645a4f58b9998634ca34109ec9a9d970e1477983bb" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.941177 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244" (OuterVolumeSpecName: "kube-api-access-mx244") pod "875cb6c5-c50d-4bc0-a717-b04d59d82610" (UID: "875cb6c5-c50d-4bc0-a717-b04d59d82610"). InnerVolumeSpecName "kube-api-access-mx244". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.941536 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "875cb6c5-c50d-4bc0-a717-b04d59d82610" (UID: "875cb6c5-c50d-4bc0-a717-b04d59d82610"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.946640 5030 scope.go:117] "RemoveContainer" containerID="9a2861f8073235d0f35323d92513aefaa091c997b7a922a80a8d36caff545b80" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.952865 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.966089 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="046e6707-eca4-490a-accc-17495f250c9f" path="/var/lib/kubelet/pods/046e6707-eca4-490a-accc-17495f250c9f/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.966639 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c34cfb1-6d06-4a48-8de2-b21285e69853" path="/var/lib/kubelet/pods/0c34cfb1-6d06-4a48-8de2-b21285e69853/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.967168 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d649e48-1a25-431c-a334-ed9bd902ee85" path="/var/lib/kubelet/pods/0d649e48-1a25-431c-a334-ed9bd902ee85/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.967863 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.970104 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10bc4a31-e3b9-4205-9e63-c7e92bffbf10" path="/var/lib/kubelet/pods/10bc4a31-e3b9-4205-9e63-c7e92bffbf10/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.970636 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1170a347-14fc-4744-91aa-f0e3aef55814" path="/var/lib/kubelet/pods/1170a347-14fc-4744-91aa-f0e3aef55814/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.971218 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163ad89a-4fe7-4852-acab-8fb297698207" path="/var/lib/kubelet/pods/163ad89a-4fe7-4852-acab-8fb297698207/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.974303 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "875cb6c5-c50d-4bc0-a717-b04d59d82610" (UID: "875cb6c5-c50d-4bc0-a717-b04d59d82610"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.976575 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18699fe7-3c02-4efb-bf17-2ed7e45b3656" path="/var/lib/kubelet/pods/18699fe7-3c02-4efb-bf17-2ed7e45b3656/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.977093 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c379f98-1567-4e79-a4ea-d8816f94f669" path="/var/lib/kubelet/pods/3c379f98-1567-4e79-a4ea-d8816f94f669/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.977639 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461a5b9f-7856-4bbe-907a-6c002b26263d" path="/var/lib/kubelet/pods/461a5b9f-7856-4bbe-907a-6c002b26263d/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.978727 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" path="/var/lib/kubelet/pods/6da8f44b-035c-4ab2-962b-5c44b123929e/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.979348 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" path="/var/lib/kubelet/pods/875cb6c5-c50d-4bc0-a717-b04d59d82610/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.979742 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d586557-5771-4f65-99bc-b6bd29f83dc9" path="/var/lib/kubelet/pods/9d586557-5771-4f65-99bc-b6bd29f83dc9/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.980241 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd02f5c-7b03-47c9-9bed-d837b6d1b66f" path="/var/lib/kubelet/pods/abd02f5c-7b03-47c9-9bed-d837b6d1b66f/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.981202 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc8e2b24-c627-4b5f-bad9-a5b38399f8c7" path="/var/lib/kubelet/pods/bc8e2b24-c627-4b5f-bad9-a5b38399f8c7/volumes" Mar 16 13:27:27 crc kubenswrapper[5030]: I0316 13:27:27.983966 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" podStartSLOduration=6.983946704 podStartE2EDuration="6.983946704s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:27.948845306 +0000 UTC m=+1292.348157873" watchObservedRunningTime="2026-03-16 13:27:27.983946704 +0000 UTC m=+1292.383259251" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:27.999050 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011003 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011826 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011895 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp5cq\" (UniqueName: \"kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle\") pod \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.011946 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.012080 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.012814 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.013754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.013806 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.013854 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs\") pod \"77627c76-1e68-4476-af56-081c481ae2dd\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.013877 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.013905 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.014001 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.014033 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.014754 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.014944 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015073 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data\") pod \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015108 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015175 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8lcl\" (UniqueName: \"kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015243 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015265 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015405 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015432 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle\") pod \"77627c76-1e68-4476-af56-081c481ae2dd\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015470 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87fz2\" (UniqueName: \"kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2\") pod \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\" (UID: \"45f3f054-9c16-4e92-b203-0ace1d4ce50b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015506 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015561 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdd4q\" (UniqueName: \"kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q\") pod \"77627c76-1e68-4476-af56-081c481ae2dd\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqpfz\" (UniqueName: \"kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015643 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs\") pod \"eb8c60c8-da8e-4757-914f-e13df20a39a0\" (UID: \"eb8c60c8-da8e-4757-914f-e13df20a39a0\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015667 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015706 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config\") pod \"77627c76-1e68-4476-af56-081c481ae2dd\" (UID: \"77627c76-1e68-4476-af56-081c481ae2dd\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle\") pod \"44d22e09-d69d-438f-b5aa-61b0f3842481\" (UID: \"44d22e09-d69d-438f-b5aa-61b0f3842481\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.015759 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default\") pod \"b397af5f-d66b-45c1-a5a3-225084b4c13b\" (UID: \"b397af5f-d66b-45c1-a5a3-225084b4c13b\") " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017771 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017795 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017806 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/44d22e09-d69d-438f-b5aa-61b0f3842481-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017816 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017824 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017833 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx244\" (UniqueName: \"kubernetes.io/projected/875cb6c5-c50d-4bc0-a717-b04d59d82610-kube-api-access-mx244\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017842 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/875cb6c5-c50d-4bc0-a717-b04d59d82610-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.017851 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.018281 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.019926 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.025369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.025736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs" (OuterVolumeSpecName: "logs") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.027375 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs" (OuterVolumeSpecName: "logs") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.084974 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq" (OuterVolumeSpecName: "kube-api-access-kp5cq") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "kube-api-access-kp5cq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.085849 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.087959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q" (OuterVolumeSpecName: "kube-api-access-pdd4q") pod "77627c76-1e68-4476-af56-081c481ae2dd" (UID: "77627c76-1e68-4476-af56-081c481ae2dd"). InnerVolumeSpecName "kube-api-access-pdd4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.088782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl" (OuterVolumeSpecName: "kube-api-access-r8lcl") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "kube-api-access-r8lcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.090510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz" (OuterVolumeSpecName: "kube-api-access-lqpfz") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "kube-api-access-lqpfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.114808 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2" (OuterVolumeSpecName: "kube-api-access-87fz2") pod "45f3f054-9c16-4e92-b203-0ace1d4ce50b" (UID: "45f3f054-9c16-4e92-b203-0ace1d4ce50b"). InnerVolumeSpecName "kube-api-access-87fz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.126259 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126296 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126319 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.126354 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.126324375 +0000 UTC m=+1296.525636922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126385 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/b397af5f-d66b-45c1-a5a3-225084b4c13b-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126405 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp5cq\" (UniqueName: \"kubernetes.io/projected/eb8c60c8-da8e-4757-914f-e13df20a39a0-kube-api-access-kp5cq\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126423 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/eb8c60c8-da8e-4757-914f-e13df20a39a0-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126432 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8lcl\" (UniqueName: \"kubernetes.io/projected/44d22e09-d69d-438f-b5aa-61b0f3842481-kube-api-access-r8lcl\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126441 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/44d22e09-d69d-438f-b5aa-61b0f3842481-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126458 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87fz2\" (UniqueName: \"kubernetes.io/projected/45f3f054-9c16-4e92-b203-0ace1d4ce50b-kube-api-access-87fz2\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126469 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdd4q\" (UniqueName: \"kubernetes.io/projected/77627c76-1e68-4476-af56-081c481ae2dd-kube-api-access-pdd4q\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.126478 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqpfz\" (UniqueName: \"kubernetes.io/projected/b397af5f-d66b-45c1-a5a3-225084b4c13b-kube-api-access-lqpfz\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.131778 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.133653 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts" (OuterVolumeSpecName: "scripts") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.134731 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.135787 5030 generic.go:358] "Generic (PLEG): container finished" podID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerID="47fa1e3a947e0e203651b727fa0ef8d9a70d09b909653ef1ccc9a12133a12fe7" exitCode=0 Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.136694 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts" (OuterVolumeSpecName: "scripts") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.147039 5030 generic.go:358] "Generic (PLEG): container finished" podID="0b653b63-2051-4924-905d-94b6a7dac92a" containerID="cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5" exitCode=0 Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.155805 5030 generic.go:358] "Generic (PLEG): container finished" podID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerID="bc20eaaadeb3ad1b260d080bfced970205680d1af449e78b8968357099595a03" exitCode=0 Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.158252 5030 generic.go:358] "Generic (PLEG): container finished" podID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerID="47e275d6b60aa76a49a572f37a65e31aa3f43d845288dab61d5e5b368e6d66ee" exitCode=0 Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.163379 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.167163 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.170722 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.192113 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.228258 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.231464 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.231494 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.231506 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.231520 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.231529 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232262 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232331 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232309351 +0000 UTC m=+1296.631621898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232381 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232411 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0 podName:b065a85f-f473-459d-bd68-74d1b57ce27b nodeName:}" failed. No retries permitted until 2026-03-16 13:27:29.232403978 +0000 UTC m=+1293.631716525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0") pod "dnsmasq-dnsmasq-76f67dbd4f-xsfzq" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b") : configmap "dns-swift-storage-0" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232453 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232472 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232466256 +0000 UTC m=+1296.631778803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232506 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232523 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232517172 +0000 UTC m=+1296.631829719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232568 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232590 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232583446 +0000 UTC m=+1296.631895993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232619 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232637 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data podName:53313e64-d1c5-4aab-adb8-b1480d03bf0a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232630865 +0000 UTC m=+1296.631943412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data") pod "rabbitmq-server-0" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a") : configmap "rabbitmq-config-data" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232668 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.232689 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.232681781 +0000 UTC m=+1296.631994328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.279640 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:28 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: if [ -n "placement" ]; then Mar 16 13:27:28 crc kubenswrapper[5030]: GRANT_DATABASE="placement" Mar 16 13:27:28 crc kubenswrapper[5030]: else Mar 16 13:27:28 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:28 crc kubenswrapper[5030]: fi Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:28 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:28 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:28 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:28 crc kubenswrapper[5030]: # support updates Mar 16 13:27:28 crc kubenswrapper[5030]: Mar 16 13:27:28 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.281204 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" podUID="a36387b3-9ec8-46be-b5c1-984c715f0187" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.321234 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.322739 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.324199 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.324233 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="ovn-northd" probeResult="unknown" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.327569 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.334498 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.472198 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.472669 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts podName:e27eb44f-510b-464d-82e7-017cf7806c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:29.472637839 +0000 UTC m=+1293.871950376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts") pod "keystone-fa3a-account-create-update-zb2ln" (UID: "e27eb44f-510b-464d-82e7-017cf7806c04") : configmap "openstack-scripts" not found Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.548127 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "45f3f054-9c16-4e92-b203-0ace1d4ce50b" (UID: "45f3f054-9c16-4e92-b203-0ace1d4ce50b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.562371 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.574096 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.574121 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.746904 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.782911 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.783023 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:28 crc kubenswrapper[5030]: E0316 13:27:28.783096 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data podName:89282d6e-ff10-4092-b709-a2466e578fd4 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:32.783076299 +0000 UTC m=+1297.182388846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data") pod "rabbitmq-cell1-server-0" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.835925 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.886713 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.899517 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "77627c76-1e68-4476-af56-081c481ae2dd" (UID: "77627c76-1e68-4476-af56-081c481ae2dd"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.916972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.924802 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "77627c76-1e68-4476-af56-081c481ae2dd" (UID: "77627c76-1e68-4476-af56-081c481ae2dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.945793 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd02d0f3-56a7-4181-aef1-17bf3effc3d7" (UID: "fd02d0f3-56a7-4181-aef1-17bf3effc3d7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.950272 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.954753 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.958964 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data" (OuterVolumeSpecName: "config-data") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.964157 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "b397af5f-d66b-45c1-a5a3-225084b4c13b" (UID: "b397af5f-d66b-45c1-a5a3-225084b4c13b"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.965145 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data" (OuterVolumeSpecName: "config-data") pod "44d22e09-d69d-438f-b5aa-61b0f3842481" (UID: "44d22e09-d69d-438f-b5aa-61b0f3842481"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.983226 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data" (OuterVolumeSpecName: "config-data") pod "45f3f054-9c16-4e92-b203-0ace1d4ce50b" (UID: "45f3f054-9c16-4e92-b203-0ace1d4ce50b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: W0316 13:27:28.984022 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a619a5a_bdae_49d7_8418_df6059986198.slice/crio-5156a3f1add02743927311c8cc70b2dbe2c4d709d788c0cfd6fd967cae4a1bac WatchSource:0}: Error finding container 5156a3f1add02743927311c8cc70b2dbe2c4d709d788c0cfd6fd967cae4a1bac: Status 404 returned error can't find the container with id 5156a3f1add02743927311c8cc70b2dbe2c4d709d788c0cfd6fd967cae4a1bac Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.987636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "77627c76-1e68-4476-af56-081c481ae2dd" (UID: "77627c76-1e68-4476-af56-081c481ae2dd"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.990515 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991143 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991187 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991205 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd02d0f3-56a7-4181-aef1-17bf3effc3d7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991218 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/45f3f054-9c16-4e92-b203-0ace1d4ce50b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991231 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991243 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991254 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44d22e09-d69d-438f-b5aa-61b0f3842481-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991267 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991279 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/b397af5f-d66b-45c1-a5a3-225084b4c13b-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.991290 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/77627c76-1e68-4476-af56-081c481ae2dd-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:28 crc kubenswrapper[5030]: I0316 13:27:28.993522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "eb8c60c8-da8e-4757-914f-e13df20a39a0" (UID: "eb8c60c8-da8e-4757-914f-e13df20a39a0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.085948 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:27:29 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: if [ -n "keystone" ]; then Mar 16 13:27:29 crc kubenswrapper[5030]: GRANT_DATABASE="keystone" Mar 16 13:27:29 crc kubenswrapper[5030]: else Mar 16 13:27:29 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:27:29 crc kubenswrapper[5030]: fi Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:27:29 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:27:29 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:27:29 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:27:29 crc kubenswrapper[5030]: # support updates Mar 16 13:27:29 crc kubenswrapper[5030]: Mar 16 13:27:29 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.087618 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"keystone-db-secret\\\" not found\"" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" podUID="e27eb44f-510b-464d-82e7-017cf7806c04" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.094021 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/eb8c60c8-da8e-4757-914f-e13df20a39a0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.176820 5030 kubelet.go:2642] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.231s" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"b397af5f-d66b-45c1-a5a3-225084b4c13b","Type":"ContainerDied","Data":"5f352245f1059f9ac945ebf67ce60d04c6934b235d87469fa06aaf80ed67015e"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177446 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" event={"ID":"d73bbf1c-7745-4164-a49b-59e42235835f","Type":"ContainerStarted","Data":"87013fb5fdda508a63a5d5281bbffbda69660701272e9b336d7d2c3abfaa7d89"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177465 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177495 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" event={"ID":"dc11b156-a80f-4e89-93c4-89443d86dc6b","Type":"ContainerStarted","Data":"aa6dfdb04992a585988c215470783a5c8593098427aed101b58ab39b5b851095"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177510 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"44d22e09-d69d-438f-b5aa-61b0f3842481","Type":"ContainerDied","Data":"c9aea36fade84c7457a7d451931ce1bb5a81ab1eda1c385e3470e8410d27f089"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177529 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177542 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177579 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" event={"ID":"3529c2a2-d018-4c39-b2f0-6346a2b686cc","Type":"ContainerStarted","Data":"05f4c6dcb72481127b487e5c614fd8fa07c282aefe48772ceccb7b5b5ab4bec5"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"f39bbebf-a149-44b0-9982-5740bc7e9aed","Type":"ContainerDied","Data":"2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177624 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ad48437fbe6c70f64f96a818970f83008dd2de8f30757a3a221162ab792abe3" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177657 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fd02d0f3-56a7-4181-aef1-17bf3effc3d7","Type":"ContainerDied","Data":"d4eaf482bf67d5e39a825bc8e76e01105fe5e50107efe7d7da9ffcdec08f1f12"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd","Type":"ContainerDied","Data":"a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177688 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3a5e8988e0185cd2807a07dc5aecc337791e6f130a519d5aa10538a458eb9e8" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177696 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerDied","Data":"47fa1e3a947e0e203651b727fa0ef8d9a70d09b909653ef1ccc9a12133a12fe7"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea781a55-9f91-4acb-b039-fbf8b016ea8f","Type":"ContainerDied","Data":"12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177749 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12eeb6e481d4fa8042cef33db6b6d27c7966f9f56865d876c6d6989f63b40dcd" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177761 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerStarted","Data":"045f1601d825be30016305b6a0399ed5f628befaa7a91cf67bec27415ad57f11"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177775 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" event={"ID":"64589292-9080-4285-b64d-14cf1da1c4be","Type":"ContainerStarted","Data":"ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177793 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-p6d78" event={"ID":"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135","Type":"ContainerStarted","Data":"d49047a344e5a4c48303a23592d8c4ad1cf21cf656bfae8c91a8ff251346c215"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177807 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerDied","Data":"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerDied","Data":"bc20eaaadeb3ad1b260d080bfced970205680d1af449e78b8968357099595a03"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177854 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" event={"ID":"4a99b1a1-4c96-4d87-949f-085c755ecd82","Type":"ContainerDied","Data":"83080ddab2db7df5746de5c8c2fe419d2e8ed3909d84ccd83d0601fc4ee659f3"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177871 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83080ddab2db7df5746de5c8c2fe419d2e8ed3909d84ccd83d0601fc4ee659f3" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerDied","Data":"47e275d6b60aa76a49a572f37a65e31aa3f43d845288dab61d5e5b368e6d66ee"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177904 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"77627c76-1e68-4476-af56-081c481ae2dd","Type":"ContainerDied","Data":"ba8faed0c9f48b2362e25ab8f37072944a14a519db62243fb404240cf9cea7c3"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177923 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" event={"ID":"8464be26-4571-474e-bc27-99bbb6c19f3d","Type":"ContainerStarted","Data":"9e5c3efd38b83e5598f8d01899b9b3840ba1385bc666c3a12940ec9202f8b345"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177935 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"eb8c60c8-da8e-4757-914f-e13df20a39a0","Type":"ContainerDied","Data":"188885166fdef9fb47b6f427e761f0018187322c9fc7094a5f9351b1238897e7"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.177961 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" event={"ID":"9f3064ee-07ca-4eb2-a044-aa49025a5c55","Type":"ContainerStarted","Data":"492ed2f76eed8749f118af36eef742d3cf5020cea20f1ebd097c83073c410bef"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.190615 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.192575 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" event={"ID":"64589292-9080-4285-b64d-14cf1da1c4be","Type":"ContainerDied","Data":"ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.192629 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab3a8fcc34c9bec0adb542ef0d03e6756cdbb59100088d8ad4e0ea9aebcc66b2" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.195201 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-p6d78" event={"ID":"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135","Type":"ContainerDied","Data":"d49047a344e5a4c48303a23592d8c4ad1cf21cf656bfae8c91a8ff251346c215"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.195255 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d49047a344e5a4c48303a23592d8c4ad1cf21cf656bfae8c91a8ff251346c215" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.197805 5030 generic.go:358] "Generic (PLEG): container finished" podID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerID="03bec67835cdc8e8d65802af5d0b340b126b95f546733b446cc78e5cdeb431ae" exitCode=0 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.197887 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerDied","Data":"03bec67835cdc8e8d65802af5d0b340b126b95f546733b446cc78e5cdeb431ae"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.197922 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" event={"ID":"95d93974-fe4c-4f9a-9cde-81a68ad7542b","Type":"ContainerDied","Data":"0eb5dc823df80c08d7cbc1db7ae239d02572f9d48b61be005ea17f0ad7a6414f"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.197936 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eb5dc823df80c08d7cbc1db7ae239d02572f9d48b61be005ea17f0ad7a6414f" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.203803 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerStarted","Data":"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.204126 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener-log" containerID="cri-o://2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18" gracePeriod=30 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.204244 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener" containerID="cri-o://de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1" gracePeriod=30 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.211716 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.214628 5030 scope.go:117] "RemoveContainer" containerID="cd97a7de341dba228f0fbe410785bc2e337f24936cdccd8de3e7d129c046bc70" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.214635 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.226289 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerStarted","Data":"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.236827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" event={"ID":"8464be26-4571-474e-bc27-99bbb6c19f3d","Type":"ContainerDied","Data":"9e5c3efd38b83e5598f8d01899b9b3840ba1385bc666c3a12940ec9202f8b345"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.236866 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e5c3efd38b83e5598f8d01899b9b3840ba1385bc666c3a12940ec9202f8b345" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.238098 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" event={"ID":"e27eb44f-510b-464d-82e7-017cf7806c04","Type":"ContainerStarted","Data":"03648628b9484d991296e8d8824643229ff4433bb34caf7117b973e99c17713f"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.239266 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.251087 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" event={"ID":"9f3064ee-07ca-4eb2-a044-aa49025a5c55","Type":"ContainerDied","Data":"492ed2f76eed8749f118af36eef742d3cf5020cea20f1ebd097c83073c410bef"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.251132 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="492ed2f76eed8749f118af36eef742d3cf5020cea20f1ebd097c83073c410bef" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.252246 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" podStartSLOduration=8.252227228 podStartE2EDuration="8.252227228s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:29.237155926 +0000 UTC m=+1293.636468474" watchObservedRunningTime="2026-03-16 13:27:29.252227228 +0000 UTC m=+1293.651539926" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.271637 5030 generic.go:358] "Generic (PLEG): container finished" podID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerID="2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438" exitCode=143 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.271762 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerDied","Data":"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.274529 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerStarted","Data":"2407f944af51167292d77fc022cd49c4dee65d1006160a4d1fb5a556772f0318"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.274707 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api-log" containerID="cri-o://27807b24204415c8edd0371c056be4ef733a0acf6836c2d6671ca47c8483add1" gracePeriod=30 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.275008 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.275039 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.275353 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api" containerID="cri-o://2407f944af51167292d77fc022cd49c4dee65d1006160a4d1fb5a556772f0318" gracePeriod=30 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.283726 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" event={"ID":"d73bbf1c-7745-4164-a49b-59e42235835f","Type":"ContainerDied","Data":"87013fb5fdda508a63a5d5281bbffbda69660701272e9b336d7d2c3abfaa7d89"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.283762 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87013fb5fdda508a63a5d5281bbffbda69660701272e9b336d7d2c3abfaa7d89" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.300421 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data\") pod \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.300693 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tldk\" (UniqueName: \"kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk\") pod \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.300994 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle\") pod \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\" (UID: \"8e0c48df-8cc5-4a86-81bd-22e68eb4627d\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.307146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" event={"ID":"5a619a5a-bdae-49d7-8418-df6059986198","Type":"ContainerStarted","Data":"5156a3f1add02743927311c8cc70b2dbe2c4d709d788c0cfd6fd967cae4a1bac"} Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.307499 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.307570 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0 podName:b065a85f-f473-459d-bd68-74d1b57ce27b nodeName:}" failed. No retries permitted until 2026-03-16 13:27:31.307536046 +0000 UTC m=+1295.706848594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0") pod "dnsmasq-dnsmasq-76f67dbd4f-xsfzq" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b") : configmap "dns-swift-storage-0" not found Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.315697 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk" (OuterVolumeSpecName: "kube-api-access-7tldk") pod "8e0c48df-8cc5-4a86-81bd-22e68eb4627d" (UID: "8e0c48df-8cc5-4a86-81bd-22e68eb4627d"). InnerVolumeSpecName "kube-api-access-7tldk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.321332 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.326104 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" event={"ID":"dc11b156-a80f-4e89-93c4-89443d86dc6b","Type":"ContainerDied","Data":"aa6dfdb04992a585988c215470783a5c8593098427aed101b58ab39b5b851095"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.326142 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa6dfdb04992a585988c215470783a5c8593098427aed101b58ab39b5b851095" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.326872 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" podStartSLOduration=8.326860766 podStartE2EDuration="8.326860766s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:29.318435874 +0000 UTC m=+1293.717748421" watchObservedRunningTime="2026-03-16 13:27:29.326860766 +0000 UTC m=+1293.726173314" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.340257 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" podUID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" containerName="keystone-api" containerID="cri-o://30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658" gracePeriod=30 Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.340261 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" event={"ID":"3529c2a2-d018-4c39-b2f0-6346a2b686cc","Type":"ContainerStarted","Data":"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.340646 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.342412 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.345666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data" (OuterVolumeSpecName: "config-data") pod "8e0c48df-8cc5-4a86-81bd-22e68eb4627d" (UID: "8e0c48df-8cc5-4a86-81bd-22e68eb4627d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.354836 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e0c48df-8cc5-4a86-81bd-22e68eb4627d" (UID: "8e0c48df-8cc5-4a86-81bd-22e68eb4627d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.354991 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" event={"ID":"a36387b3-9ec8-46be-b5c1-984c715f0187","Type":"ContainerStarted","Data":"4040535737b5dfcd342d08e770438d875fb0776e304d0967f746979044195cfa"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.365934 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerStarted","Data":"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09"} Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.366035 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.366142 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.388507 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" podStartSLOduration=8.388488137 podStartE2EDuration="8.388488137s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:29.355723363 +0000 UTC m=+1293.755035930" watchObservedRunningTime="2026-03-16 13:27:29.388488137 +0000 UTC m=+1293.787800685" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.391750 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.403489 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.403516 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tldk\" (UniqueName: \"kubernetes.io/projected/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-kube-api-access-7tldk\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.403527 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e0c48df-8cc5-4a86-81bd-22e68eb4627d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.486009 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.103:5671: connect: connection refused" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.495710 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.104:5671: connect: connection refused" Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.506867 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:27:29 crc kubenswrapper[5030]: E0316 13:27:29.506962 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts podName:e27eb44f-510b-464d-82e7-017cf7806c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:31.506941308 +0000 UTC m=+1295.906253856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts") pod "keystone-fa3a-account-create-update-zb2ln" (UID: "e27eb44f-510b-464d-82e7-017cf7806c04") : configmap "openstack-scripts" not found Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.796928 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.822406 5030 scope.go:117] "RemoveContainer" containerID="1eb7f50851a52bf196d1bb6b656c048204345016f1aef337ec9decad06717063" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.829685 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.838896 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.846887 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.848996 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.866525 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.878248 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.882480 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.885433 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.902498 5030 status_manager.go:895] "Failed to get status for pod" podUID="875cb6c5-c50d-4bc0-a717-b04d59d82610" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.909375 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.917604 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.919498 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.924179 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928388 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs\") pod \"4a99b1a1-4c96-4d87-949f-085c755ecd82\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928593 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928757 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle\") pod \"4a99b1a1-4c96-4d87-949f-085c755ecd82\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.928953 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle\") pod \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929314 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom\") pod \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929356 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929460 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlj5g\" (UniqueName: \"kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929504 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs\") pod \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929524 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929569 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data\") pod \"4a99b1a1-4c96-4d87-949f-085c755ecd82\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929654 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom\") pod \"4a99b1a1-4c96-4d87-949f-085c755ecd82\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929682 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bqhw\" (UniqueName: \"kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw\") pod \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929710 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5kg5\" (UniqueName: \"kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5\") pod \"4a99b1a1-4c96-4d87-949f-085c755ecd82\" (UID: \"4a99b1a1-4c96-4d87-949f-085c755ecd82\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929745 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs\") pod \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs" (OuterVolumeSpecName: "logs") pod "4a99b1a1-4c96-4d87-949f-085c755ecd82" (UID: "4a99b1a1-4c96-4d87-949f-085c755ecd82"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929783 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle\") pod \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929852 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs6zj\" (UniqueName: \"kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj\") pod \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929883 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data\") pod \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\" (UID: \"f1ee5b58-8044-4e80-a667-663f2f57f6e5\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929922 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929948 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.929996 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.930030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.930084 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqxql\" (UniqueName: \"kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql\") pod \"406c1608-a210-4e95-9e30-0e7c15f51f67\" (UID: \"406c1608-a210-4e95-9e30-0e7c15f51f67\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.930124 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs\") pod \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.930159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data\") pod \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\" (UID: \"ea781a55-9f91-4acb-b039-fbf8b016ea8f\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.930210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts\") pod \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\" (UID: \"80d0d6c4-ceb2-400a-9ea2-ab01ded230bd\") " Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.940700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs" (OuterVolumeSpecName: "logs") pod "f1ee5b58-8044-4e80-a667-663f2f57f6e5" (UID: "f1ee5b58-8044-4e80-a667-663f2f57f6e5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.941251 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ee5b58-8044-4e80-a667-663f2f57f6e5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.941269 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4a99b1a1-4c96-4d87-949f-085c755ecd82-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.942890 5030 scope.go:117] "RemoveContainer" containerID="a3da06a2dce939d5a51ed26dadadc2c389616533e46cc1ea2b029b2bcb00cdb0" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.954306 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.958666 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.961063 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f1ee5b58-8044-4e80-a667-663f2f57f6e5" (UID: "f1ee5b58-8044-4e80-a667-663f2f57f6e5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.961236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5" (OuterVolumeSpecName: "kube-api-access-v5kg5") pod "4a99b1a1-4c96-4d87-949f-085c755ecd82" (UID: "4a99b1a1-4c96-4d87-949f-085c755ecd82"). InnerVolumeSpecName "kube-api-access-v5kg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.961780 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.962168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs" (OuterVolumeSpecName: "logs") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.962496 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.967303 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs" (OuterVolumeSpecName: "logs") pod "ea781a55-9f91-4acb-b039-fbf8b016ea8f" (UID: "ea781a55-9f91-4acb-b039-fbf8b016ea8f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.972693 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.974621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs" (OuterVolumeSpecName: "logs") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.987274 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g" (OuterVolumeSpecName: "kube-api-access-xlj5g") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "kube-api-access-xlj5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.987313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj" (OuterVolumeSpecName: "kube-api-access-xs6zj") pod "f1ee5b58-8044-4e80-a667-663f2f57f6e5" (UID: "f1ee5b58-8044-4e80-a667-663f2f57f6e5"). InnerVolumeSpecName "kube-api-access-xs6zj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.991412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4a99b1a1-4c96-4d87-949f-085c755ecd82" (UID: "4a99b1a1-4c96-4d87-949f-085c755ecd82"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.991458 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql" (OuterVolumeSpecName: "kube-api-access-sqxql") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "kube-api-access-sqxql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.992238 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts" (OuterVolumeSpecName: "scripts") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.992277 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw" (OuterVolumeSpecName: "kube-api-access-4bqhw") pod "ea781a55-9f91-4acb-b039-fbf8b016ea8f" (UID: "ea781a55-9f91-4acb-b039-fbf8b016ea8f"). InnerVolumeSpecName "kube-api-access-4bqhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.994834 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77627c76-1e68-4476-af56-081c481ae2dd" path="/var/lib/kubelet/pods/77627c76-1e68-4476-af56-081c481ae2dd/volumes" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.995628 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" path="/var/lib/kubelet/pods/eb8c60c8-da8e-4757-914f-e13df20a39a0/volumes" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.995622 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea781a55-9f91-4acb-b039-fbf8b016ea8f" (UID: "ea781a55-9f91-4acb-b039-fbf8b016ea8f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:29 crc kubenswrapper[5030]: I0316 13:27:29.999864 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" path="/var/lib/kubelet/pods/fd02d0f3-56a7-4181-aef1-17bf3effc3d7/volumes" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.042403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htnhq\" (UniqueName: \"kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq\") pod \"d73bbf1c-7745-4164-a49b-59e42235835f\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.042527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.042615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.042715 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.042936 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts\") pod \"d73bbf1c-7745-4164-a49b-59e42235835f\" (UID: \"d73bbf1c-7745-4164-a49b-59e42235835f\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.043226 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzd95\" (UniqueName: \"kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.043247 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.043378 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts\") pod \"f39bbebf-a149-44b0-9982-5740bc7e9aed\" (UID: \"f39bbebf-a149-44b0-9982-5740bc7e9aed\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.043644 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044840 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044866 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/f39bbebf-a149-44b0-9982-5740bc7e9aed-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044877 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044888 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlj5g\" (UniqueName: \"kubernetes.io/projected/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-kube-api-access-xlj5g\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044906 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044915 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bqhw\" (UniqueName: \"kubernetes.io/projected/ea781a55-9f91-4acb-b039-fbf8b016ea8f-kube-api-access-4bqhw\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044925 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5kg5\" (UniqueName: \"kubernetes.io/projected/4a99b1a1-4c96-4d87-949f-085c755ecd82-kube-api-access-v5kg5\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044935 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs6zj\" (UniqueName: \"kubernetes.io/projected/f1ee5b58-8044-4e80-a667-663f2f57f6e5-kube-api-access-xs6zj\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044944 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044957 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044968 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/406c1608-a210-4e95-9e30-0e7c15f51f67-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.044991 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqxql\" (UniqueName: \"kubernetes.io/projected/406c1608-a210-4e95-9e30-0e7c15f51f67-kube-api-access-sqxql\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.045002 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea781a55-9f91-4acb-b039-fbf8b016ea8f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.045010 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.045035 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.045582 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d73bbf1c-7745-4164-a49b-59e42235835f" (UID: "d73bbf1c-7745-4164-a49b-59e42235835f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.086764 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts" (OuterVolumeSpecName: "scripts") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.086881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.087220 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95" (OuterVolumeSpecName: "kube-api-access-lzd95") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "kube-api-access-lzd95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.088190 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1ee5b58-8044-4e80-a667-663f2f57f6e5" (UID: "f1ee5b58-8044-4e80-a667-663f2f57f6e5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.107386 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq" (OuterVolumeSpecName: "kube-api-access-htnhq") pod "d73bbf1c-7745-4164-a49b-59e42235835f" (UID: "d73bbf1c-7745-4164-a49b-59e42235835f"). InnerVolumeSpecName "kube-api-access-htnhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.124335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4a99b1a1-4c96-4d87-949f-085c755ecd82" (UID: "4a99b1a1-4c96-4d87-949f-085c755ecd82"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.124503 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data" (OuterVolumeSpecName: "config-data") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.124645 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.139489 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.146923 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htnhq\" (UniqueName: \"kubernetes.io/projected/d73bbf1c-7745-4164-a49b-59e42235835f-kube-api-access-htnhq\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147050 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147114 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147230 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147328 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d73bbf1c-7745-4164-a49b-59e42235835f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147459 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147694 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzd95\" (UniqueName: \"kubernetes.io/projected/f39bbebf-a149-44b0-9982-5740bc7e9aed-kube-api-access-lzd95\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147787 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.147873 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.148046 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.164853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.171576 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data" (OuterVolumeSpecName: "config-data") pod "ea781a55-9f91-4acb-b039-fbf8b016ea8f" (UID: "ea781a55-9f91-4acb-b039-fbf8b016ea8f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.184823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data" (OuterVolumeSpecName: "config-data") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.194103 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.195119 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ea781a55-9f91-4acb-b039-fbf8b016ea8f" (UID: "ea781a55-9f91-4acb-b039-fbf8b016ea8f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.201529 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.208888 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data" (OuterVolumeSpecName: "config-data") pod "f1ee5b58-8044-4e80-a667-663f2f57f6e5" (UID: "f1ee5b58-8044-4e80-a667-663f2f57f6e5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.214493 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data" (OuterVolumeSpecName: "config-data") pod "4a99b1a1-4c96-4d87-949f-085c755ecd82" (UID: "4a99b1a1-4c96-4d87-949f-085c755ecd82"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.217585 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "406c1608-a210-4e95-9e30-0e7c15f51f67" (UID: "406c1608-a210-4e95-9e30-0e7c15f51f67"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.227720 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" (UID: "80d0d6c4-ceb2-400a-9ea2-ab01ded230bd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.255894 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ee5b58-8044-4e80-a667-663f2f57f6e5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256274 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256291 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256303 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256313 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/406c1608-a210-4e95-9e30-0e7c15f51f67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256323 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256333 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea781a55-9f91-4acb-b039-fbf8b016ea8f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256345 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256356 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.256366 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4a99b1a1-4c96-4d87-949f-085c755ecd82-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.276696 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data" (OuterVolumeSpecName: "config-data") pod "f39bbebf-a149-44b0-9982-5740bc7e9aed" (UID: "f39bbebf-a149-44b0-9982-5740bc7e9aed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.291611 5030 scope.go:117] "RemoveContainer" containerID="5ac27604c2e51644815d03e8d6cdcfd3938690978d2539a75884767e78c7786d" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300572 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300608 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300640 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300650 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300666 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.300677 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.322217 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.326329 5030 scope.go:117] "RemoveContainer" containerID="f989cda818e9985e67d995f2703d5c9831fce206c6a631cc50ecc510e0dd43c0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.326421 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.345702 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.359294 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f39bbebf-a149-44b0-9982-5740bc7e9aed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.365243 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.368687 5030 scope.go:117] "RemoveContainer" containerID="a1b33e99b6f52bbfd563d806270eaf84b0378e849edd84075641183edd498541" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.373693 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.378061 5030 generic.go:358] "Generic (PLEG): container finished" podID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerID="2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18" exitCode=143 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.378297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerDied","Data":"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.383724 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.384280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerStarted","Data":"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.384411 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-log" containerID="cri-o://0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" gracePeriod=30 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.384528 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.384576 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.384614 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-api" containerID="cri-o://38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" gracePeriod=30 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.387985 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.398425 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_ee66b746-fdc9-4765-93cd-21aa27cf84f0/ovn-northd/0.log" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.398477 5030 generic.go:358] "Generic (PLEG): container finished" podID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerID="a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" exitCode=139 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.398661 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerDied","Data":"a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.398693 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"ee66b746-fdc9-4765-93cd-21aa27cf84f0","Type":"ContainerDied","Data":"d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.398709 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d19f7d83a5f2dc7ed8ef63b21e77fef310e6a470e8682b71ea2d5429dd66a560" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.400894 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.402687 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" event={"ID":"e27eb44f-510b-464d-82e7-017cf7806c04","Type":"ContainerDied","Data":"03648628b9484d991296e8d8824643229ff4433bb34caf7117b973e99c17713f"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.402782 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406311 5030 generic.go:358] "Generic (PLEG): container finished" podID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerID="2407f944af51167292d77fc022cd49c4dee65d1006160a4d1fb5a556772f0318" exitCode=0 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406335 5030 generic.go:358] "Generic (PLEG): container finished" podID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerID="27807b24204415c8edd0371c056be4ef733a0acf6836c2d6671ca47c8483add1" exitCode=143 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerDied","Data":"2407f944af51167292d77fc022cd49c4dee65d1006160a4d1fb5a556772f0318"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerDied","Data":"27807b24204415c8edd0371c056be4ef733a0acf6836c2d6671ca47c8483add1"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406454 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" event={"ID":"2ab462d1-b867-48bf-aa79-7e1a45859a40","Type":"ContainerDied","Data":"14281e55a79ae06c261feb23df407e90d9c8908453b3c98415d85fb606c89f06"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406474 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14281e55a79ae06c261feb23df407e90d9c8908453b3c98415d85fb606c89f06" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.406616 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.413688 5030 generic.go:358] "Generic (PLEG): container finished" podID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerID="080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b" exitCode=0 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.413763 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerDied","Data":"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.413786 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" event={"ID":"8a23a1a1-8e33-4bed-a738-d044523febe8","Type":"ContainerDied","Data":"9f5e0d9ef0f5db83e9d085ae638212dbbd801c94ad7ac7cee7918489752d23ef"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.415376 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.415465 5030 scope.go:117] "RemoveContainer" containerID="28e08b9d272c0ef18d06dc1de9d1deb4eb5a6bb831a9acdebf364ae571c3be49" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.419384 5030 generic.go:358] "Generic (PLEG): container finished" podID="5a619a5a-bdae-49d7-8418-df6059986198" containerID="47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2" exitCode=0 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.419467 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" event={"ID":"5a619a5a-bdae-49d7-8418-df6059986198","Type":"ContainerDied","Data":"47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.420146 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.423060 5030 generic.go:358] "Generic (PLEG): container finished" podID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" containerID="30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658" exitCode=0 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.423174 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" event={"ID":"3529c2a2-d018-4c39-b2f0-6346a2b686cc","Type":"ContainerDied","Data":"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.423196 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" event={"ID":"3529c2a2-d018-4c39-b2f0-6346a2b686cc","Type":"ContainerDied","Data":"05f4c6dcb72481127b487e5c614fd8fa07c282aefe48772ceccb7b5b5ab4bec5"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.423249 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-58d554f777-pvd8j" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.425037 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_ee66b746-fdc9-4765-93cd-21aa27cf84f0/ovn-northd/0.log" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.425102 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.425796 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" event={"ID":"a36387b3-9ec8-46be-b5c1-984c715f0187","Type":"ContainerDied","Data":"4040535737b5dfcd342d08e770438d875fb0776e304d0967f746979044195cfa"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.425884 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-2079-account-create-update-fl62j" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.432686 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerStarted","Data":"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6"} Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.432820 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-api" containerID="cri-o://9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09" gracePeriod=30 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.433035 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.433083 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-httpd" containerID="cri-o://be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6" gracePeriod=30 Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.433892 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" podStartSLOduration=9.433880469 podStartE2EDuration="9.433880469s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:30.43097164 +0000 UTC m=+1294.830284186" watchObservedRunningTime="2026-03-16 13:27:30.433880469 +0000 UTC m=+1294.833193015" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.441794 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.442617 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.442785 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.443304 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.443890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.444014 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.444739 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.444832 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.445175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8247-account-create-update-h2td7" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.445358 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.445459 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.447134 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.460590 5030 scope.go:117] "RemoveContainer" containerID="85c67cb0f67642c9dfd7d8c3562a7699102914abdea6c168b7a9983160c9ce2d" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461346 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts\") pod \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461493 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q56vk\" (UniqueName: \"kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk\") pod \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461655 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts\") pod \"64589292-9080-4285-b64d-14cf1da1c4be\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.461826 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462126 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts\") pod \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\" (UID: \"46b4fd3c-70f8-46a4-a4bf-8a1e23f40135\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462178 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts\") pod \"e27eb44f-510b-464d-82e7-017cf7806c04\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts\") pod \"dc11b156-a80f-4e89-93c4-89443d86dc6b\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462311 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts\") pod \"8464be26-4571-474e-bc27-99bbb6c19f3d\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462361 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462380 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2crjf\" (UniqueName: \"kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf\") pod \"64589292-9080-4285-b64d-14cf1da1c4be\" (UID: \"64589292-9080-4285-b64d-14cf1da1c4be\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462408 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr6jq\" (UniqueName: \"kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq\") pod \"8464be26-4571-474e-bc27-99bbb6c19f3d\" (UID: \"8464be26-4571-474e-bc27-99bbb6c19f3d\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462430 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462587 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.462675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr7ms\" (UniqueName: \"kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms\") pod \"e27eb44f-510b-464d-82e7-017cf7806c04\" (UID: \"e27eb44f-510b-464d-82e7-017cf7806c04\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.463334 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.463711 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "64589292-9080-4285-b64d-14cf1da1c4be" (UID: "64589292-9080-4285-b64d-14cf1da1c4be"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.464111 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e27eb44f-510b-464d-82e7-017cf7806c04" (UID: "e27eb44f-510b-464d-82e7-017cf7806c04"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.464613 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "46b4fd3c-70f8-46a4-a4bf-8a1e23f40135" (UID: "46b4fd3c-70f8-46a4-a4bf-8a1e23f40135"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.464653 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw5nd\" (UniqueName: \"kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd\") pod \"dc11b156-a80f-4e89-93c4-89443d86dc6b\" (UID: \"dc11b156-a80f-4e89-93c4-89443d86dc6b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.464731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4td4v\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.465223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx94s\" (UniqueName: \"kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s\") pod \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\" (UID: \"9f3064ee-07ca-4eb2-a044-aa49025a5c55\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.465313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs\") pod \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\" (UID: \"95d93974-fe4c-4f9a-9cde-81a68ad7542b\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9f3064ee-07ca-4eb2-a044-aa49025a5c55" (UID: "9f3064ee-07ca-4eb2-a044-aa49025a5c55"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468914 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9f3064ee-07ca-4eb2-a044-aa49025a5c55-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468940 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/64589292-9080-4285-b64d-14cf1da1c4be-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468949 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468983 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.468993 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e27eb44f-510b-464d-82e7-017cf7806c04-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.469057 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dc11b156-a80f-4e89-93c4-89443d86dc6b" (UID: "dc11b156-a80f-4e89-93c4-89443d86dc6b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.472472 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.472585 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf" (OuterVolumeSpecName: "kube-api-access-2crjf") pod "64589292-9080-4285-b64d-14cf1da1c4be" (UID: "64589292-9080-4285-b64d-14cf1da1c4be"). InnerVolumeSpecName "kube-api-access-2crjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.473057 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8464be26-4571-474e-bc27-99bbb6c19f3d" (UID: "8464be26-4571-474e-bc27-99bbb6c19f3d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.475756 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms" (OuterVolumeSpecName: "kube-api-access-cr7ms") pod "e27eb44f-510b-464d-82e7-017cf7806c04" (UID: "e27eb44f-510b-464d-82e7-017cf7806c04"). InnerVolumeSpecName "kube-api-access-cr7ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.476015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk" (OuterVolumeSpecName: "kube-api-access-q56vk") pod "46b4fd3c-70f8-46a4-a4bf-8a1e23f40135" (UID: "46b4fd3c-70f8-46a4-a4bf-8a1e23f40135"). InnerVolumeSpecName "kube-api-access-q56vk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.478538 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq" (OuterVolumeSpecName: "kube-api-access-lr6jq") pod "8464be26-4571-474e-bc27-99bbb6c19f3d" (UID: "8464be26-4571-474e-bc27-99bbb6c19f3d"). InnerVolumeSpecName "kube-api-access-lr6jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.482963 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd" (OuterVolumeSpecName: "kube-api-access-cw5nd") pod "dc11b156-a80f-4e89-93c4-89443d86dc6b" (UID: "dc11b156-a80f-4e89-93c4-89443d86dc6b"). InnerVolumeSpecName "kube-api-access-cw5nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.483106 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.483217 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v" (OuterVolumeSpecName: "kube-api-access-4td4v") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "kube-api-access-4td4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.484377 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s" (OuterVolumeSpecName: "kube-api-access-gx94s") pod "9f3064ee-07ca-4eb2-a044-aa49025a5c55" (UID: "9f3064ee-07ca-4eb2-a044-aa49025a5c55"). InnerVolumeSpecName "kube-api-access-gx94s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.523995 5030 scope.go:117] "RemoveContainer" containerID="080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.551434 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": read tcp 10.217.0.2:57732->10.217.0.155:9311: read: connection reset by peer" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.552562 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.558848 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.560034 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" podStartSLOduration=9.559607649 podStartE2EDuration="9.559607649s" podCreationTimestamp="2026-03-16 13:27:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:30.541680608 +0000 UTC m=+1294.940993155" watchObservedRunningTime="2026-03-16 13:27:30.559607649 +0000 UTC m=+1294.958920197" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.560795 5030 scope.go:117] "RemoveContainer" containerID="72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.574523 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxzph\" (UniqueName: \"kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph\") pod \"a36387b3-9ec8-46be-b5c1-984c715f0187\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.574600 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tpn9\" (UniqueName: \"kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.574846 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.574897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575028 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575073 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnx5s\" (UniqueName: \"kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575163 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575240 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575257 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575362 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575395 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575413 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575446 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575674 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575713 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.575780 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576054 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576093 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576131 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs\") pod \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\" (UID: \"ee66b746-fdc9-4765-93cd-21aa27cf84f0\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576379 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts\") pod \"a36387b3-9ec8-46be-b5c1-984c715f0187\" (UID: \"a36387b3-9ec8-46be-b5c1-984c715f0187\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576484 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576526 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts" (OuterVolumeSpecName: "scripts") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.576544 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data\") pod \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\" (UID: \"3529c2a2-d018-4c39-b2f0-6346a2b686cc\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577517 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577537 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7n4s\" (UniqueName: \"kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577630 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577678 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom\") pod \"2ab462d1-b867-48bf-aa79-7e1a45859a40\" (UID: \"2ab462d1-b867-48bf-aa79-7e1a45859a40\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.577702 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rnq9\" (UniqueName: \"kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9\") pod \"8a23a1a1-8e33-4bed-a738-d044523febe8\" (UID: \"8a23a1a1-8e33-4bed-a738-d044523febe8\") " Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578490 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578510 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q56vk\" (UniqueName: \"kubernetes.io/projected/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135-kube-api-access-q56vk\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578520 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578529 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578538 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc11b156-a80f-4e89-93c4-89443d86dc6b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578721 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8464be26-4571-474e-bc27-99bbb6c19f3d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578740 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578751 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2crjf\" (UniqueName: \"kubernetes.io/projected/64589292-9080-4285-b64d-14cf1da1c4be-kube-api-access-2crjf\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578760 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr6jq\" (UniqueName: \"kubernetes.io/projected/8464be26-4571-474e-bc27-99bbb6c19f3d-kube-api-access-lr6jq\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578770 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/95d93974-fe4c-4f9a-9cde-81a68ad7542b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578779 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr7ms\" (UniqueName: \"kubernetes.io/projected/e27eb44f-510b-464d-82e7-017cf7806c04-kube-api-access-cr7ms\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578789 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw5nd\" (UniqueName: \"kubernetes.io/projected/dc11b156-a80f-4e89-93c4-89443d86dc6b-kube-api-access-cw5nd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578798 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4td4v\" (UniqueName: \"kubernetes.io/projected/95d93974-fe4c-4f9a-9cde-81a68ad7542b-kube-api-access-4td4v\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.578808 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx94s\" (UniqueName: \"kubernetes.io/projected/9f3064ee-07ca-4eb2-a044-aa49025a5c55-kube-api-access-gx94s\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.579306 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a36387b3-9ec8-46be-b5c1-984c715f0187" (UID: "a36387b3-9ec8-46be-b5c1-984c715f0187"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.592843 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.592887 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data" (OuterVolumeSpecName: "config-data") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.598188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "95d93974-fe4c-4f9a-9cde-81a68ad7542b" (UID: "95d93974-fe4c-4f9a-9cde-81a68ad7542b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.598398 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9" (OuterVolumeSpecName: "kube-api-access-7tpn9") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "kube-api-access-7tpn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.598959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs" (OuterVolumeSpecName: "logs") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.600892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs" (OuterVolumeSpecName: "logs") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.601097 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts" (OuterVolumeSpecName: "scripts") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.605074 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config" (OuterVolumeSpecName: "config") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.605167 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s" (OuterVolumeSpecName: "kube-api-access-fnx5s") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "kube-api-access-fnx5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.622284 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.622405 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph" (OuterVolumeSpecName: "kube-api-access-sxzph") pod "a36387b3-9ec8-46be-b5c1-984c715f0187" (UID: "a36387b3-9ec8-46be-b5c1-984c715f0187"). InnerVolumeSpecName "kube-api-access-sxzph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.631894 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.631962 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.632039 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9" (OuterVolumeSpecName: "kube-api-access-8rnq9") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "kube-api-access-8rnq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.633312 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts" (OuterVolumeSpecName: "scripts") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.665769 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s" (OuterVolumeSpecName: "kube-api-access-t7n4s") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "kube-api-access-t7n4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.684790 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxzph\" (UniqueName: \"kubernetes.io/projected/a36387b3-9ec8-46be-b5c1-984c715f0187-kube-api-access-sxzph\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685127 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tpn9\" (UniqueName: \"kubernetes.io/projected/ee66b746-fdc9-4765-93cd-21aa27cf84f0-kube-api-access-7tpn9\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685140 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685153 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685167 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685176 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnx5s\" (UniqueName: \"kubernetes.io/projected/3529c2a2-d018-4c39-b2f0-6346a2b686cc-kube-api-access-fnx5s\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685186 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685196 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685205 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685214 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee66b746-fdc9-4765-93cd-21aa27cf84f0-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685224 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/95d93974-fe4c-4f9a-9cde-81a68ad7542b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685235 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a36387b3-9ec8-46be-b5c1-984c715f0187-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685243 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2ab462d1-b867-48bf-aa79-7e1a45859a40-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685252 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7n4s\" (UniqueName: \"kubernetes.io/projected/2ab462d1-b867-48bf-aa79-7e1a45859a40-kube-api-access-t7n4s\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685260 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8a23a1a1-8e33-4bed-a738-d044523febe8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685270 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.685280 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rnq9\" (UniqueName: \"kubernetes.io/projected/8a23a1a1-8e33-4bed-a738-d044523febe8-kube-api-access-8rnq9\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.697945 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.708417 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.719626 5030 scope.go:117] "RemoveContainer" containerID="080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b" Mar 16 13:27:30 crc kubenswrapper[5030]: E0316 13:27:30.720245 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b\": container with ID starting with 080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b not found: ID does not exist" containerID="080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.720315 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b"} err="failed to get container status \"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b\": rpc error: code = NotFound desc = could not find container \"080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b\": container with ID starting with 080b2fcc56da975d150573e2b1d11e1bcd2c5eb0d296bc0fdc7a1b5fbbb03f7b not found: ID does not exist" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.720333 5030 scope.go:117] "RemoveContainer" containerID="72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267" Mar 16 13:27:30 crc kubenswrapper[5030]: E0316 13:27:30.722062 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267\": container with ID starting with 72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267 not found: ID does not exist" containerID="72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.722102 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267"} err="failed to get container status \"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267\": rpc error: code = NotFound desc = could not find container \"72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267\": container with ID starting with 72a9d7faf296344f3435983bdc0f44cf03658d2a0db4e109401829850e487267 not found: ID does not exist" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.722127 5030 scope.go:117] "RemoveContainer" containerID="30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.724404 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.725297 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.753361 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.781062 5030 scope.go:117] "RemoveContainer" containerID="30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658" Mar 16 13:27:30 crc kubenswrapper[5030]: E0316 13:27:30.782308 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658\": container with ID starting with 30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658 not found: ID does not exist" containerID="30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.782341 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658"} err="failed to get container status \"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658\": rpc error: code = NotFound desc = could not find container \"30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658\": container with ID starting with 30a77d1fda79c3e5cb7959472dab2cdbd77fb4a80943ca2b714151320f5cc658 not found: ID does not exist" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.786675 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.786832 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.803635 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.812517 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.819520 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-84c74787d9-2vq7x"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.832706 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.839114 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-449a-account-create-update-n2qzv"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.844205 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.849504 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.850274 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.155:9311/healthcheck\": dial tcp 10.217.0.155:9311: connect: connection refused" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.855279 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.859295 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.863728 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.870467 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-76ff475c8b-zxw2w"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.875093 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.878948 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.889536 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.892773 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-fa3a-account-create-update-zb2ln"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.908436 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.908656 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-2079-account-create-update-fl62j"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.910762 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.912111 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.913511 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data" (OuterVolumeSpecName: "config-data") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.915994 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.924494 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.970850 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-fdd0-account-create-update-mb6q5"] Mar 16 13:27:30 crc kubenswrapper[5030]: I0316 13:27:30.999676 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.018921 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.018965 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.018990 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.034612 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.073577 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-3924-account-create-update-n4h6t"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.076306 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.083174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data" (OuterVolumeSpecName: "config-data") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.089636 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.095523 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-8247-account-create-update-h2td7"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.121339 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.121375 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.123646 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.124626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data" (OuterVolumeSpecName: "config-data") pod "2ab462d1-b867-48bf-aa79-7e1a45859a40" (UID: "2ab462d1-b867-48bf-aa79-7e1a45859a40"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.127942 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3529c2a2-d018-4c39-b2f0-6346a2b686cc" (UID: "3529c2a2-d018-4c39-b2f0-6346a2b686cc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.130866 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.139412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.165718 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.167522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "ee66b746-fdc9-4765-93cd-21aa27cf84f0" (UID: "ee66b746-fdc9-4765-93cd-21aa27cf84f0"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.180808 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "8a23a1a1-8e33-4bed-a738-d044523febe8" (UID: "8a23a1a1-8e33-4bed-a738-d044523febe8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.224520 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225006 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225024 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee66b746-fdc9-4765-93cd-21aa27cf84f0-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225057 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3529c2a2-d018-4c39-b2f0-6346a2b686cc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225068 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225078 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ab462d1-b867-48bf-aa79-7e1a45859a40-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225089 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.225100 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a23a1a1-8e33-4bed-a738-d044523febe8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.238673 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.244014 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.291393 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.326608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rcwz\" (UniqueName: \"kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328458 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328493 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328623 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328828 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.328902 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs\") pod \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\" (UID: \"11ee4617-94c0-4a7a-a51b-42a116d86dcc\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.329143 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs" (OuterVolumeSpecName: "logs") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.330605 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts" (OuterVolumeSpecName: "scripts") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.330749 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.330907 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/11ee4617-94c0-4a7a-a51b-42a116d86dcc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.331346 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0 podName:b065a85f-f473-459d-bd68-74d1b57ce27b nodeName:}" failed. No retries permitted until 2026-03-16 13:27:35.331289258 +0000 UTC m=+1299.730601805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0") pod "dnsmasq-dnsmasq-76f67dbd4f-xsfzq" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b") : configmap "dns-swift-storage-0" not found Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.331370 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.338133 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz" (OuterVolumeSpecName: "kube-api-access-9rcwz") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "kube-api-access-9rcwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.358846 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.365693 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-58d554f777-pvd8j"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.367320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.383041 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data" (OuterVolumeSpecName: "config-data") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.397222 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.397255 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "11ee4617-94c0-4a7a-a51b-42a116d86dcc" (UID: "11ee4617-94c0-4a7a-a51b-42a116d86dcc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432439 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432533 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432585 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432678 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432706 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432743 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nbdz\" (UniqueName: \"kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432791 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432868 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdfwp\" (UniqueName: \"kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys\") pod \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\" (UID: \"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432913 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.432943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs\") pod \"f0167208-7974-4db5-89be-eafc7e5412f9\" (UID: \"f0167208-7974-4db5-89be-eafc7e5412f9\") " Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433381 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433399 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433407 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433415 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/11ee4617-94c0-4a7a-a51b-42a116d86dcc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433424 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rcwz\" (UniqueName: \"kubernetes.io/projected/11ee4617-94c0-4a7a-a51b-42a116d86dcc-kube-api-access-9rcwz\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.433477 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs" (OuterVolumeSpecName: "logs") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.435648 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.436510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts" (OuterVolumeSpecName: "scripts") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.437940 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz" (OuterVolumeSpecName: "kube-api-access-6nbdz") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "kube-api-access-6nbdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.438108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.439949 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp" (OuterVolumeSpecName: "kube-api-access-hdfwp") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "kube-api-access-hdfwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.452187 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.461037 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0167208-7974-4db5-89be-eafc7e5412f9" containerID="73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c" exitCode=0 Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.461137 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerDied","Data":"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.461187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" event={"ID":"f0167208-7974-4db5-89be-eafc7e5412f9","Type":"ContainerDied","Data":"27bcff6ff1b7e1d16238eef527ca1e621a1683d1d3c6eab5764e0e7874d546af"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.461214 5030 scope.go:117] "RemoveContainer" containerID="73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.461350 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.467762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data" (OuterVolumeSpecName: "config-data") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468649 5030 generic.go:358] "Generic (PLEG): container finished" podID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerID="38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" exitCode=0 Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468674 5030 generic.go:358] "Generic (PLEG): container finished" podID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerID="0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" exitCode=143 Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468691 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerDied","Data":"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468723 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerDied","Data":"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468731 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.468748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-65b5b9678-md66w" event={"ID":"11ee4617-94c0-4a7a-a51b-42a116d86dcc","Type":"ContainerDied","Data":"8b70b960b45f6ff8692961058963fc821184d79fcd80aacfb3ab3b668be2ec82"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.470812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.471296 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-55cdc976c4-98djv" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.475074 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" event={"ID":"5a619a5a-bdae-49d7-8418-df6059986198","Type":"ContainerStarted","Data":"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.475432 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.479365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.479806 5030 generic.go:358] "Generic (PLEG): container finished" podID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" containerID="cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9" exitCode=0 Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.479960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" event={"ID":"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5","Type":"ContainerDied","Data":"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.480033 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" event={"ID":"bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5","Type":"ContainerDied","Data":"87eab5fffa838e309482555766d154205c30a858dbfeb59fa8acfc6bfdc27307"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.480138 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-5c648c5fc-4kfz8" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.483629 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.484765 5030 generic.go:358] "Generic (PLEG): container finished" podID="12da506b-6937-4461-b5db-540d347c943e" containerID="be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6" exitCode=0 Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.485053 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p6d78" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.485074 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-58d698879d-2cxcf" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.485106 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerDied","Data":"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6"} Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.485191 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.485196 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.490699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.491204 5030 scope.go:117] "RemoveContainer" containerID="be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.495228 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" podStartSLOduration=7.495208578 podStartE2EDuration="7.495208578s" podCreationTimestamp="2026-03-16 13:27:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:27:31.492262528 +0000 UTC m=+1295.891575075" watchObservedRunningTime="2026-03-16 13:27:31.495208578 +0000 UTC m=+1295.894521125" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.496988 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data" (OuterVolumeSpecName: "config-data") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.497015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f0167208-7974-4db5-89be-eafc7e5412f9" (UID: "f0167208-7974-4db5-89be-eafc7e5412f9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.519990 5030 scope.go:117] "RemoveContainer" containerID="73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.520265 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c\": container with ID starting with 73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c not found: ID does not exist" containerID="73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.520297 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c"} err="failed to get container status \"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c\": rpc error: code = NotFound desc = could not find container \"73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c\": container with ID starting with 73dc9833d6f1bc170e5b7ca290323a9387fdd6e7c04161e04362aa4f47e2af0c not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.520318 5030 scope.go:117] "RemoveContainer" containerID="be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.520521 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814\": container with ID starting with be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814 not found: ID does not exist" containerID="be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.520540 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814"} err="failed to get container status \"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814\": rpc error: code = NotFound desc = could not find container \"be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814\": container with ID starting with be30a865ee62529979d2cb580944cbcb69d96c2d715ff59609c96637fd963814 not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.520573 5030 scope.go:117] "RemoveContainer" containerID="38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.520915 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.531060 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" (UID: "bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.532193 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-65b5b9678-md66w"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535042 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdfwp\" (UniqueName: \"kubernetes.io/projected/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-kube-api-access-hdfwp\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535067 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535102 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535110 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535119 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535127 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0167208-7974-4db5-89be-eafc7e5412f9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535136 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535144 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535276 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535285 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535294 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535303 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0167208-7974-4db5-89be-eafc7e5412f9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535311 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nbdz\" (UniqueName: \"kubernetes.io/projected/f0167208-7974-4db5-89be-eafc7e5412f9-kube-api-access-6nbdz\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535345 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.535353 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.539230 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.543324 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-55cdc976c4-98djv"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.547374 5030 scope.go:117] "RemoveContainer" containerID="0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.547402 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.553877 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.568726 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.569200 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-e1f5-account-create-update-l68c4"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.586166 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.590345 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p6d78"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.592305 5030 scope.go:117] "RemoveContainer" containerID="38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.592803 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0\": container with ID starting with 38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0 not found: ID does not exist" containerID="38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.592841 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0"} err="failed to get container status \"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0\": rpc error: code = NotFound desc = could not find container \"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0\": container with ID starting with 38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0 not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.592869 5030 scope.go:117] "RemoveContainer" containerID="0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.593293 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d\": container with ID starting with 0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d not found: ID does not exist" containerID="0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593328 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d"} err="failed to get container status \"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d\": rpc error: code = NotFound desc = could not find container \"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d\": container with ID starting with 0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593350 5030 scope.go:117] "RemoveContainer" containerID="38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593460 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593636 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0"} err="failed to get container status \"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0\": rpc error: code = NotFound desc = could not find container \"38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0\": container with ID starting with 38ba184d50e513f88533488cea9ad7ff7c13c19739c30787ce6b7a1071a60fc0 not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593656 5030 scope.go:117] "RemoveContainer" containerID="0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593951 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d"} err="failed to get container status \"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d\": rpc error: code = NotFound desc = could not find container \"0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d\": container with ID starting with 0523da32cf2f18687c14af82418bbee681481bae33736abd5e3659356aa5dc8d not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.593971 5030 scope.go:117] "RemoveContainer" containerID="cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.597048 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-58d698879d-2cxcf"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.622082 5030 scope.go:117] "RemoveContainer" containerID="cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9" Mar 16 13:27:31 crc kubenswrapper[5030]: E0316 13:27:31.622502 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9\": container with ID starting with cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9 not found: ID does not exist" containerID="cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.622537 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9"} err="failed to get container status \"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9\": rpc error: code = NotFound desc = could not find container \"cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9\": container with ID starting with cccfdb39e9dc4abaffa4a04e7bb45ea9b5486b28996927466393aa87030296d9 not found: ID does not exist" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.790572 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.800476 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-c4ff8c868-5x9pd"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.810574 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.814636 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-5c648c5fc-4kfz8"] Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.973700 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" path="/var/lib/kubelet/pods/11ee4617-94c0-4a7a-a51b-42a116d86dcc/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.974389 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" path="/var/lib/kubelet/pods/2ab462d1-b867-48bf-aa79-7e1a45859a40/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.975038 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" path="/var/lib/kubelet/pods/3529c2a2-d018-4c39-b2f0-6346a2b686cc/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.976343 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" path="/var/lib/kubelet/pods/406c1608-a210-4e95-9e30-0e7c15f51f67/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.977015 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" path="/var/lib/kubelet/pods/44d22e09-d69d-438f-b5aa-61b0f3842481/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.977835 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" path="/var/lib/kubelet/pods/45f3f054-9c16-4e92-b203-0ace1d4ce50b/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.978787 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b4fd3c-70f8-46a4-a4bf-8a1e23f40135" path="/var/lib/kubelet/pods/46b4fd3c-70f8-46a4-a4bf-8a1e23f40135/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.979228 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" path="/var/lib/kubelet/pods/4a99b1a1-4c96-4d87-949f-085c755ecd82/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.979815 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64589292-9080-4285-b64d-14cf1da1c4be" path="/var/lib/kubelet/pods/64589292-9080-4285-b64d-14cf1da1c4be/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.980684 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" path="/var/lib/kubelet/pods/80d0d6c4-ceb2-400a-9ea2-ab01ded230bd/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.981378 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8464be26-4571-474e-bc27-99bbb6c19f3d" path="/var/lib/kubelet/pods/8464be26-4571-474e-bc27-99bbb6c19f3d/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.981934 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" path="/var/lib/kubelet/pods/8a23a1a1-8e33-4bed-a738-d044523febe8/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.984454 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" path="/var/lib/kubelet/pods/8e0c48df-8cc5-4a86-81bd-22e68eb4627d/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.985072 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" path="/var/lib/kubelet/pods/95d93974-fe4c-4f9a-9cde-81a68ad7542b/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.986392 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f3064ee-07ca-4eb2-a044-aa49025a5c55" path="/var/lib/kubelet/pods/9f3064ee-07ca-4eb2-a044-aa49025a5c55/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.986781 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36387b3-9ec8-46be-b5c1-984c715f0187" path="/var/lib/kubelet/pods/a36387b3-9ec8-46be-b5c1-984c715f0187/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.987301 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" path="/var/lib/kubelet/pods/b397af5f-d66b-45c1-a5a3-225084b4c13b/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.987956 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" path="/var/lib/kubelet/pods/bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.989042 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73bbf1c-7745-4164-a49b-59e42235835f" path="/var/lib/kubelet/pods/d73bbf1c-7745-4164-a49b-59e42235835f/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.989361 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc11b156-a80f-4e89-93c4-89443d86dc6b" path="/var/lib/kubelet/pods/dc11b156-a80f-4e89-93c4-89443d86dc6b/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.989695 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27eb44f-510b-464d-82e7-017cf7806c04" path="/var/lib/kubelet/pods/e27eb44f-510b-464d-82e7-017cf7806c04/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.990112 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" path="/var/lib/kubelet/pods/ea781a55-9f91-4acb-b039-fbf8b016ea8f/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.990647 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.156:8776/healthcheck\": context deadline exceeded" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.991105 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" path="/var/lib/kubelet/pods/ee66b746-fdc9-4765-93cd-21aa27cf84f0/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.991674 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" path="/var/lib/kubelet/pods/f0167208-7974-4db5-89be-eafc7e5412f9/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.992258 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" path="/var/lib/kubelet/pods/f1ee5b58-8044-4e80-a667-663f2f57f6e5/volumes" Mar 16 13:27:31 crc kubenswrapper[5030]: I0316 13:27:31.993255 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" path="/var/lib/kubelet/pods/f39bbebf-a149-44b0-9982-5740bc7e9aed/volumes" Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.147891 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.148018 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.147991568 +0000 UTC m=+1304.547304115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250039 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250119 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250147 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250123827 +0000 UTC m=+1304.649436374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250203 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250181697 +0000 UTC m=+1304.649494244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250246 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250266 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250346 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250317963 +0000 UTC m=+1304.649630509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250383 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250361956 +0000 UTC m=+1304.649674503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250431 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250478 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250469027 +0000 UTC m=+1304.649781824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250485 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.250653 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data podName:53313e64-d1c5-4aab-adb8-b1480d03bf0a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.250629538 +0000 UTC m=+1304.649942086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data") pod "rabbitmq-server-0" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a") : configmap "rabbitmq-config-data" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.866893 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:32 crc kubenswrapper[5030]: E0316 13:27:32.867400 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data podName:89282d6e-ff10-4092-b709-a2466e578fd4 nodeName:}" failed. No retries permitted until 2026-03-16 13:27:40.867369851 +0000 UTC m=+1305.266682708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data") pod "rabbitmq-cell1-server-0" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.245093 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.291830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.291896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.291931 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292038 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292085 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292104 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7jrw\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292213 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.292235 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\" (UID: \"53313e64-d1c5-4aab-adb8-b1480d03bf0a\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.297681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "persistence") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.297808 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.297889 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.300249 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.300569 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.300606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw" (OuterVolumeSpecName: "kube-api-access-n7jrw") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "kube-api-access-n7jrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.300654 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.302682 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info" (OuterVolumeSpecName: "pod-info") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.312163 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.315621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data" (OuterVolumeSpecName: "config-data") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.327637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf" (OuterVolumeSpecName: "server-conf") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.360345 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "53313e64-d1c5-4aab-adb8-b1480d03bf0a" (UID: "53313e64-d1c5-4aab-adb8-b1480d03bf0a"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w84g\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394515 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394847 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394928 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.394957 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395036 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395131 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395171 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins\") pod \"89282d6e-ff10-4092-b709-a2466e578fd4\" (UID: \"89282d6e-ff10-4092-b709-a2466e578fd4\") " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395890 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395910 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395919 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395929 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/53313e64-d1c5-4aab-adb8-b1480d03bf0a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395937 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395947 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/53313e64-d1c5-4aab-adb8-b1480d03bf0a-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395956 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7jrw\" (UniqueName: \"kubernetes.io/projected/53313e64-d1c5-4aab-adb8-b1480d03bf0a-kube-api-access-n7jrw\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395967 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395976 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/53313e64-d1c5-4aab-adb8-b1480d03bf0a-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.395995 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/53313e64-d1c5-4aab-adb8-b1480d03bf0a-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.396015 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.397360 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g" (OuterVolumeSpecName: "kube-api-access-7w84g") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "kube-api-access-7w84g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.398118 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.400050 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info" (OuterVolumeSpecName: "pod-info") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.400274 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.400412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.400505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.400878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "persistence") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.403695 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.410896 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.415333 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data" (OuterVolumeSpecName: "config-data") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.425932 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf" (OuterVolumeSpecName: "server-conf") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.454391 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "89282d6e-ff10-4092-b709-a2466e578fd4" (UID: "89282d6e-ff10-4092-b709-a2466e578fd4"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497751 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497779 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497790 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497823 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497834 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/89282d6e-ff10-4092-b709-a2466e578fd4-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497843 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/89282d6e-ff10-4092-b709-a2466e578fd4-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497853 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497863 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497872 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/89282d6e-ff10-4092-b709-a2466e578fd4-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497883 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497893 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w84g\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-kube-api-access-7w84g\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.497905 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/89282d6e-ff10-4092-b709-a2466e578fd4-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.509588 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.512901 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.163:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.530639 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-9d7784f86-5p7k4" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.163:8080/healthcheck\": context deadline exceeded" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.534708 5030 generic.go:358] "Generic (PLEG): container finished" podID="89282d6e-ff10-4092-b709-a2466e578fd4" containerID="29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e" exitCode=0 Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.534854 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.534859 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerDied","Data":"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e"} Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.534948 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"89282d6e-ff10-4092-b709-a2466e578fd4","Type":"ContainerDied","Data":"97a248d5cb0ff6353e92423cd840359a40c418409da2af9b3673b3d9225bd5d6"} Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.534990 5030 scope.go:117] "RemoveContainer" containerID="29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.537849 5030 generic.go:358] "Generic (PLEG): container finished" podID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerID="230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429" exitCode=0 Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.537922 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerDied","Data":"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429"} Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.537959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"53313e64-d1c5-4aab-adb8-b1480d03bf0a","Type":"ContainerDied","Data":"7e21c664785a4f979bd13ec212e58584510cf8d11fa22c589ad5382d415f960c"} Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.538062 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.559122 5030 scope.go:117] "RemoveContainer" containerID="243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.576507 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.584289 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.589015 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.592757 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.599402 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.613089 5030 scope.go:117] "RemoveContainer" containerID="29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e" Mar 16 13:27:34 crc kubenswrapper[5030]: E0316 13:27:34.613514 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e\": container with ID starting with 29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e not found: ID does not exist" containerID="29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.613574 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e"} err="failed to get container status \"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e\": rpc error: code = NotFound desc = could not find container \"29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e\": container with ID starting with 29f4408da8d74be6d55160252bcb7790190db7b891159a7ee6486b723ce65e8e not found: ID does not exist" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.613600 5030 scope.go:117] "RemoveContainer" containerID="243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda" Mar 16 13:27:34 crc kubenswrapper[5030]: E0316 13:27:34.613892 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda\": container with ID starting with 243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda not found: ID does not exist" containerID="243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.613929 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda"} err="failed to get container status \"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda\": rpc error: code = NotFound desc = could not find container \"243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda\": container with ID starting with 243cb62091c035baae96a50c6ab9816f1e736e656e6f37c89b774b1aed037fda not found: ID does not exist" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.613961 5030 scope.go:117] "RemoveContainer" containerID="230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.633291 5030 scope.go:117] "RemoveContainer" containerID="9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.648442 5030 scope.go:117] "RemoveContainer" containerID="230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429" Mar 16 13:27:34 crc kubenswrapper[5030]: E0316 13:27:34.649299 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429\": container with ID starting with 230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429 not found: ID does not exist" containerID="230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.649339 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429"} err="failed to get container status \"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429\": rpc error: code = NotFound desc = could not find container \"230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429\": container with ID starting with 230b68c6d0101d8f3a592cba5128832268c87402872164ec4b65e88be61cd429 not found: ID does not exist" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.649366 5030 scope.go:117] "RemoveContainer" containerID="9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8" Mar 16 13:27:34 crc kubenswrapper[5030]: E0316 13:27:34.649783 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8\": container with ID starting with 9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8 not found: ID does not exist" containerID="9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8" Mar 16 13:27:34 crc kubenswrapper[5030]: I0316 13:27:34.649819 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8"} err="failed to get container status \"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8\": rpc error: code = NotFound desc = could not find container \"9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8\": container with ID starting with 9323e7f11f86eb0eb3fcf648a4ee1bf4a222bd8bac73c3975f39bf4a7f5e9dd8 not found: ID does not exist" Mar 16 13:27:35 crc kubenswrapper[5030]: E0316 13:27:35.416902 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:27:35 crc kubenswrapper[5030]: E0316 13:27:35.417469 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0 podName:b065a85f-f473-459d-bd68-74d1b57ce27b nodeName:}" failed. No retries permitted until 2026-03-16 13:27:43.417437948 +0000 UTC m=+1307.816750495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0") pod "dnsmasq-dnsmasq-76f67dbd4f-xsfzq" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b") : configmap "dns-swift-storage-0" not found Mar 16 13:27:35 crc kubenswrapper[5030]: I0316 13:27:35.958826 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" path="/var/lib/kubelet/pods/53313e64-d1c5-4aab-adb8-b1480d03bf0a/volumes" Mar 16 13:27:35 crc kubenswrapper[5030]: I0316 13:27:35.960818 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" path="/var/lib/kubelet/pods/89282d6e-ff10-4092-b709-a2466e578fd4/volumes" Mar 16 13:27:37 crc kubenswrapper[5030]: I0316 13:27:37.510802 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:27:37 crc kubenswrapper[5030]: I0316 13:27:37.580233 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:27:37 crc kubenswrapper[5030]: I0316 13:27:37.580530 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="dnsmasq-dns" containerID="cri-o://e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554" gracePeriod=10 Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.001837 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.072204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjh76\" (UniqueName: \"kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76\") pod \"b065a85f-f473-459d-bd68-74d1b57ce27b\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.072462 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config\") pod \"b065a85f-f473-459d-bd68-74d1b57ce27b\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.072780 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0\") pod \"b065a85f-f473-459d-bd68-74d1b57ce27b\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.072884 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc\") pod \"b065a85f-f473-459d-bd68-74d1b57ce27b\" (UID: \"b065a85f-f473-459d-bd68-74d1b57ce27b\") " Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.079237 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76" (OuterVolumeSpecName: "kube-api-access-sjh76") pod "b065a85f-f473-459d-bd68-74d1b57ce27b" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b"). InnerVolumeSpecName "kube-api-access-sjh76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.103635 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config" (OuterVolumeSpecName: "config") pod "b065a85f-f473-459d-bd68-74d1b57ce27b" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.104933 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "b065a85f-f473-459d-bd68-74d1b57ce27b" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.113681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "b065a85f-f473-459d-bd68-74d1b57ce27b" (UID: "b065a85f-f473-459d-bd68-74d1b57ce27b"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.175698 5030 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.175739 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.175753 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjh76\" (UniqueName: \"kubernetes.io/projected/b065a85f-f473-459d-bd68-74d1b57ce27b-kube-api-access-sjh76\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.175768 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b065a85f-f473-459d-bd68-74d1b57ce27b-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.584656 5030 generic.go:358] "Generic (PLEG): container finished" podID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerID="e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554" exitCode=0 Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.584765 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.584766 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" event={"ID":"b065a85f-f473-459d-bd68-74d1b57ce27b","Type":"ContainerDied","Data":"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554"} Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.584847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq" event={"ID":"b065a85f-f473-459d-bd68-74d1b57ce27b","Type":"ContainerDied","Data":"54e666738a4dddcf2efe0a01dc9632f324a2ea484bf26cef508061e60a5293b1"} Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.584874 5030 scope.go:117] "RemoveContainer" containerID="e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.611736 5030 scope.go:117] "RemoveContainer" containerID="f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.615338 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.620665 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-76f67dbd4f-xsfzq"] Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.641853 5030 scope.go:117] "RemoveContainer" containerID="e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554" Mar 16 13:27:38 crc kubenswrapper[5030]: E0316 13:27:38.642248 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554\": container with ID starting with e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554 not found: ID does not exist" containerID="e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.642345 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554"} err="failed to get container status \"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554\": rpc error: code = NotFound desc = could not find container \"e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554\": container with ID starting with e1e719e767a0d24560e1f8ebfa9c9c652ccc08b8d12c418df4e12f0f33d9c554 not found: ID does not exist" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.642438 5030 scope.go:117] "RemoveContainer" containerID="f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae" Mar 16 13:27:38 crc kubenswrapper[5030]: E0316 13:27:38.642848 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae\": container with ID starting with f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae not found: ID does not exist" containerID="f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae" Mar 16 13:27:38 crc kubenswrapper[5030]: I0316 13:27:38.642902 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae"} err="failed to get container status \"f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae\": rpc error: code = NotFound desc = could not find container \"f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae\": container with ID starting with f83780e7ed324d6deb8babfad2e279a8555e02a586b5052c75b6eb66e8a59bae not found: ID does not exist" Mar 16 13:27:39 crc kubenswrapper[5030]: I0316 13:27:39.965302 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" path="/var/lib/kubelet/pods/b065a85f-f473-459d-bd68-74d1b57ce27b/volumes" Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.209405 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-httpd-config: secret "neutron-httpd-config" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.209510 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.209488851 +0000 UTC m=+1320.608801398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "httpd-config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-httpd-config" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310588 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-internal-svc: secret "cert-neutron-internal-svc" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310643 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.310632197 +0000 UTC m=+1320.709944745 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-internal-svc" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310655 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-public-svc: secret "cert-neutron-public-svc" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310659 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310768 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.310740251 +0000 UTC m=+1320.710052808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-public-svc" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310789 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.310780937 +0000 UTC m=+1320.710093494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "combined-ca-bundle" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310808 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-neutron-ovndbs: secret "cert-neutron-ovndbs" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.310977 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.310949585 +0000 UTC m=+1320.710262121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "ovndb-tls-certs" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "cert-neutron-ovndbs" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.311101 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/neutron-config: secret "neutron-config" not found Mar 16 13:27:40 crc kubenswrapper[5030]: E0316 13:27:40.311260 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config podName:0b653b63-2051-4924-905d-94b6a7dac92a nodeName:}" failed. No retries permitted until 2026-03-16 13:27:56.311247464 +0000 UTC m=+1320.710560011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config") pod "neutron-67fb697f74-rtq89" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a") : secret "neutron-config" not found Mar 16 13:27:41 crc kubenswrapper[5030]: I0316 13:27:41.225658 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.159:9696/\": dial tcp 10.217.0.159:9696: connect: connection refused" Mar 16 13:27:45 crc kubenswrapper[5030]: I0316 13:27:45.559210 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.198:3000/\": dial tcp 10.217.0.198:3000: connect: connection refused" Mar 16 13:27:52 crc kubenswrapper[5030]: I0316 13:27:52.768150 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerID="59f2a7582ee7f1278fdf022a8d7af1323dc67f0a66fc35069516a2cfcafee453" exitCode=137 Mar 16 13:27:52 crc kubenswrapper[5030]: I0316 13:27:52.768758 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"59f2a7582ee7f1278fdf022a8d7af1323dc67f0a66fc35069516a2cfcafee453"} Mar 16 13:27:52 crc kubenswrapper[5030]: I0316 13:27:52.948020 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.036072 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.037142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.037283 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.037350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.037435 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.037539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmzn7\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7\") pod \"9f209a2b-0fda-47aa-8be7-d116be97132c\" (UID: \"9f209a2b-0fda-47aa-8be7-d116be97132c\") " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.038108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock" (OuterVolumeSpecName: "lock") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.038159 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache" (OuterVolumeSpecName: "cache") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.038502 5030 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-cache\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.038523 5030 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/9f209a2b-0fda-47aa-8be7-d116be97132c-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.042656 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "swift") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.043120 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.043311 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7" (OuterVolumeSpecName: "kube-api-access-wmzn7") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "kube-api-access-wmzn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.140954 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.141017 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.141031 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmzn7\" (UniqueName: \"kubernetes.io/projected/9f209a2b-0fda-47aa-8be7-d116be97132c-kube-api-access-wmzn7\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.159490 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.242934 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.245827 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f209a2b-0fda-47aa-8be7-d116be97132c" (UID: "9f209a2b-0fda-47aa-8be7-d116be97132c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.346068 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f209a2b-0fda-47aa-8be7-d116be97132c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.786919 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"9f209a2b-0fda-47aa-8be7-d116be97132c","Type":"ContainerDied","Data":"5db588dc219248be9a8ea8e75de0e0fc8b2da94839d88d7fe1d3af1af2c2363a"} Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.787014 5030 scope.go:117] "RemoveContainer" containerID="59f2a7582ee7f1278fdf022a8d7af1323dc67f0a66fc35069516a2cfcafee453" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.787030 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.833116 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.834472 5030 scope.go:117] "RemoveContainer" containerID="1704842157f40733908dd4ed5867072e53a2bbe14d7f0e8ae69852982791aceb" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.837731 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.853183 5030 scope.go:117] "RemoveContainer" containerID="fa664220bf89e97cbccbb7734c36ffdf1e3614c7a5a2f963fc6d4324a1e73e44" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.874253 5030 scope.go:117] "RemoveContainer" containerID="72bc4662c978aa84acde832f34da75c1468516be07838a280b075621c30f6913" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.897449 5030 scope.go:117] "RemoveContainer" containerID="73801e700d8011bc159c00aaa6593343e45ac149660f216ba6e9790c295dbcb3" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.925688 5030 scope.go:117] "RemoveContainer" containerID="dac4f687851ec775f6ceee6b03795d0d3a5d69ecffcecd2474ba573ade326558" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.959088 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" path="/var/lib/kubelet/pods/9f209a2b-0fda-47aa-8be7-d116be97132c/volumes" Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.960265 5030 scope.go:117] "RemoveContainer" containerID="0cb5f47a58a27d974724912b597af41894fc9e1c24f5bf3b16e9d27f09518a1a" Mar 16 13:27:53 crc kubenswrapper[5030]: E0316 13:27:53.966603 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1309542 actualBytes=10240 Mar 16 13:27:53 crc kubenswrapper[5030]: I0316 13:27:53.985542 5030 scope.go:117] "RemoveContainer" containerID="febf3f401efcc4f0a20b014dfd019f996fa60d2011460fbcaf9fd5210f3ba917" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.008178 5030 scope.go:117] "RemoveContainer" containerID="9d3e71c354e75eb27c303adc432703502010fcd083c70fa768810564c16880e6" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.039267 5030 scope.go:117] "RemoveContainer" containerID="ff495157508b1452e3738b26774988eacc4476672774db1d76cca80f03b7f4bd" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.059839 5030 scope.go:117] "RemoveContainer" containerID="27689210a9f998283768d42cc2924bb48afccb7a8d050492cbb021aaed5cd87c" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.079478 5030 scope.go:117] "RemoveContainer" containerID="19faef358b4b1df25d2837ad7b886efa6e318029c186dc89f2e90dde0bee316e" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.095956 5030 scope.go:117] "RemoveContainer" containerID="b82396b234410667a2b6ffa231b6520a5b7a6d7f1757babf3ecda8d988b304cb" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.116645 5030 scope.go:117] "RemoveContainer" containerID="7cb2296fe046a1f0ccfc46cfd205bb8cdb1f10ad6f19249d7402bd16e70a54bd" Mar 16 13:27:54 crc kubenswrapper[5030]: I0316 13:27:54.133725 5030 scope.go:117] "RemoveContainer" containerID="59e52a58cff306c5b3794d240bea25619b6c04674c92596e8d1b304639b5367e" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.217606 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387291 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387380 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387434 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387495 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387523 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdv9l\" (UniqueName: \"kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.387727 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data\") pod \"48d90717-dbfc-40c0-a7ff-8abb1882e436\" (UID: \"48d90717-dbfc-40c0-a7ff-8abb1882e436\") " Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.388124 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.388876 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.396378 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts" (OuterVolumeSpecName: "scripts") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.396417 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l" (OuterVolumeSpecName: "kube-api-access-pdv9l") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "kube-api-access-pdv9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.410253 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.422236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.436471 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.444704 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data" (OuterVolumeSpecName: "config-data") pod "48d90717-dbfc-40c0-a7ff-8abb1882e436" (UID: "48d90717-dbfc-40c0-a7ff-8abb1882e436"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490206 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490254 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490265 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490274 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/48d90717-dbfc-40c0-a7ff-8abb1882e436-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490283 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490294 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490304 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/48d90717-dbfc-40c0-a7ff-8abb1882e436-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.490330 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdv9l\" (UniqueName: \"kubernetes.io/projected/48d90717-dbfc-40c0-a7ff-8abb1882e436-kube-api-access-pdv9l\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.815113 5030 generic.go:358] "Generic (PLEG): container finished" podID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerID="53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036" exitCode=137 Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.815195 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerDied","Data":"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036"} Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.815230 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"48d90717-dbfc-40c0-a7ff-8abb1882e436","Type":"ContainerDied","Data":"e28a9982d7b7ead35609be3db81f0f0a1661252577baaf9bbff41857f3fca570"} Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.815251 5030 scope.go:117] "RemoveContainer" containerID="c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.815437 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.842632 5030 scope.go:117] "RemoveContainer" containerID="ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.852162 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.858742 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.897593 5030 scope.go:117] "RemoveContainer" containerID="53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.942255 5030 scope.go:117] "RemoveContainer" containerID="1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.957930 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" path="/var/lib/kubelet/pods/48d90717-dbfc-40c0-a7ff-8abb1882e436/volumes" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.965256 5030 scope.go:117] "RemoveContainer" containerID="c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445" Mar 16 13:27:55 crc kubenswrapper[5030]: E0316 13:27:55.965672 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445\": container with ID starting with c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445 not found: ID does not exist" containerID="c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.965711 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445"} err="failed to get container status \"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445\": rpc error: code = NotFound desc = could not find container \"c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445\": container with ID starting with c7a0b7e2a1d52280289efdffd6abfdc02d6fddae6906ac5907af8363399b4445 not found: ID does not exist" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.965734 5030 scope.go:117] "RemoveContainer" containerID="ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012" Mar 16 13:27:55 crc kubenswrapper[5030]: E0316 13:27:55.966041 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012\": container with ID starting with ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012 not found: ID does not exist" containerID="ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.966070 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012"} err="failed to get container status \"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012\": rpc error: code = NotFound desc = could not find container \"ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012\": container with ID starting with ce2f986940251053cb4f18a0c5976a606d05a075adc25584dcd274701ebcb012 not found: ID does not exist" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.966085 5030 scope.go:117] "RemoveContainer" containerID="53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036" Mar 16 13:27:55 crc kubenswrapper[5030]: E0316 13:27:55.966592 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036\": container with ID starting with 53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036 not found: ID does not exist" containerID="53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.966617 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036"} err="failed to get container status \"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036\": rpc error: code = NotFound desc = could not find container \"53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036\": container with ID starting with 53c3397ef36178192667e205123bee58cc392f58c2fc14e24650c481001d6036 not found: ID does not exist" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.966630 5030 scope.go:117] "RemoveContainer" containerID="1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2" Mar 16 13:27:55 crc kubenswrapper[5030]: E0316 13:27:55.967107 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2\": container with ID starting with 1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2 not found: ID does not exist" containerID="1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2" Mar 16 13:27:55 crc kubenswrapper[5030]: I0316 13:27:55.967150 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2"} err="failed to get container status \"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2\": rpc error: code = NotFound desc = could not find container \"1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2\": container with ID starting with 1f30bb17b492f67fc2a4f3c62583354c193820defbaf554933c1f160ca437cc2 not found: ID does not exist" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.121694 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-67fb697f74-rtq89_0b653b63-2051-4924-905d-94b6a7dac92a/neutron-api/0.log" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.121779 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.307900 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308048 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndkr8\" (UniqueName: \"kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308160 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308220 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308256 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.308313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config\") pod \"0b653b63-2051-4924-905d-94b6a7dac92a\" (UID: \"0b653b63-2051-4924-905d-94b6a7dac92a\") " Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.315839 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.315941 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8" (OuterVolumeSpecName: "kube-api-access-ndkr8") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "kube-api-access-ndkr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.344787 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config" (OuterVolumeSpecName: "config") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.345250 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.346681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.347495 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.364432 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "0b653b63-2051-4924-905d-94b6a7dac92a" (UID: "0b653b63-2051-4924-905d-94b6a7dac92a"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410748 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410788 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndkr8\" (UniqueName: \"kubernetes.io/projected/0b653b63-2051-4924-905d-94b6a7dac92a-kube-api-access-ndkr8\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410802 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410813 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410825 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410835 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.410845 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/0b653b63-2051-4924-905d-94b6a7dac92a-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828165 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-67fb697f74-rtq89_0b653b63-2051-4924-905d-94b6a7dac92a/neutron-api/0.log" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828417 5030 generic.go:358] "Generic (PLEG): container finished" podID="0b653b63-2051-4924-905d-94b6a7dac92a" containerID="b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785" exitCode=137 Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828544 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerDied","Data":"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785"} Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828647 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67fb697f74-rtq89" event={"ID":"0b653b63-2051-4924-905d-94b6a7dac92a","Type":"ContainerDied","Data":"47dff6d4b47af137d1efe767f0a6477435ec7e0490da504383d65be2fc055a1b"} Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.828667 5030 scope.go:117] "RemoveContainer" containerID="cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.858201 5030 scope.go:117] "RemoveContainer" containerID="b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.860413 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.865106 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-67fb697f74-rtq89"] Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.878701 5030 scope.go:117] "RemoveContainer" containerID="cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5" Mar 16 13:27:56 crc kubenswrapper[5030]: E0316 13:27:56.881114 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5\": container with ID starting with cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5 not found: ID does not exist" containerID="cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.881169 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5"} err="failed to get container status \"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5\": rpc error: code = NotFound desc = could not find container \"cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5\": container with ID starting with cb42c83d08e41ba4818c3333d4e90516e4c9b44e63d81b63434292cd1e14dab5 not found: ID does not exist" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.881205 5030 scope.go:117] "RemoveContainer" containerID="b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785" Mar 16 13:27:56 crc kubenswrapper[5030]: E0316 13:27:56.881583 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785\": container with ID starting with b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785 not found: ID does not exist" containerID="b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785" Mar 16 13:27:56 crc kubenswrapper[5030]: I0316 13:27:56.881622 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785"} err="failed to get container status \"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785\": rpc error: code = NotFound desc = could not find container \"b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785\": container with ID starting with b4541dbe2c62dc1581f3176babf931ce77a963e4b86f7b14ebbfb9f831a77785 not found: ID does not exist" Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.580543 5030 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pode889c65d-38bf-4f76-8131-5d780dc0cbb6"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pode889c65d-38bf-4f76-8131-5d780dc0cbb6] : Timed out while waiting for systemd to remove kubepods-besteffort-pode889c65d_38bf_4f76_8131_5d780dc0cbb6.slice" Mar 16 13:27:57 crc kubenswrapper[5030]: E0316 13:27:57.580620 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pode889c65d-38bf-4f76-8131-5d780dc0cbb6] : unable to destroy cgroup paths for cgroup [kubepods besteffort pode889c65d-38bf-4f76-8131-5d780dc0cbb6] : Timed out while waiting for systemd to remove kubepods-besteffort-pode889c65d_38bf_4f76_8131_5d780dc0cbb6.slice" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.844185 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.865039 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.869679 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.959356 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" path="/var/lib/kubelet/pods/0b653b63-2051-4924-905d-94b6a7dac92a/volumes" Mar 16 13:27:57 crc kubenswrapper[5030]: I0316 13:27:57.960514 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e889c65d-38bf-4f76-8131-5d780dc0cbb6" path="/var/lib/kubelet/pods/e889c65d-38bf-4f76-8131-5d780dc0cbb6/volumes" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.229224 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.242106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom\") pod \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.242185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs\") pod \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.242296 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data\") pod \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.242429 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle\") pod \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.242494 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znsr2\" (UniqueName: \"kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2\") pod \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\" (UID: \"56601e65-1af2-44fc-9fe5-75f4a581d5aa\") " Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.243000 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs" (OuterVolumeSpecName: "logs") pod "56601e65-1af2-44fc-9fe5-75f4a581d5aa" (UID: "56601e65-1af2-44fc-9fe5-75f4a581d5aa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.243265 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/56601e65-1af2-44fc-9fe5-75f4a581d5aa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.249739 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2" (OuterVolumeSpecName: "kube-api-access-znsr2") pod "56601e65-1af2-44fc-9fe5-75f4a581d5aa" (UID: "56601e65-1af2-44fc-9fe5-75f4a581d5aa"). InnerVolumeSpecName "kube-api-access-znsr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.252666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "56601e65-1af2-44fc-9fe5-75f4a581d5aa" (UID: "56601e65-1af2-44fc-9fe5-75f4a581d5aa"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.262133 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56601e65-1af2-44fc-9fe5-75f4a581d5aa" (UID: "56601e65-1af2-44fc-9fe5-75f4a581d5aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.273700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data" (OuterVolumeSpecName: "config-data") pod "56601e65-1af2-44fc-9fe5-75f4a581d5aa" (UID: "56601e65-1af2-44fc-9fe5-75f4a581d5aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.345433 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.345468 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.345481 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znsr2\" (UniqueName: \"kubernetes.io/projected/56601e65-1af2-44fc-9fe5-75f4a581d5aa-kube-api-access-znsr2\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.345493 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56601e65-1af2-44fc-9fe5-75f4a581d5aa-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.856637 5030 generic.go:358] "Generic (PLEG): container finished" podID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerID="84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107" exitCode=137 Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.856690 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerDied","Data":"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107"} Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.857046 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" event={"ID":"56601e65-1af2-44fc-9fe5-75f4a581d5aa","Type":"ContainerDied","Data":"590e2dc63d991e26b5924760c83b6b715b370163a76fa0608c181d14ec5babf7"} Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.857073 5030 scope.go:117] "RemoveContainer" containerID="84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.856739 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.883864 5030 scope.go:117] "RemoveContainer" containerID="2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.889950 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.901166 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-78fcf5cd85-cgcxb"] Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.901952 5030 scope.go:117] "RemoveContainer" containerID="84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107" Mar 16 13:27:58 crc kubenswrapper[5030]: E0316 13:27:58.902317 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107\": container with ID starting with 84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107 not found: ID does not exist" containerID="84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.902362 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107"} err="failed to get container status \"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107\": rpc error: code = NotFound desc = could not find container \"84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107\": container with ID starting with 84d031f8f9d13247c680d14a330fd91e8cbe7d3cd977767ba004504a580e1107 not found: ID does not exist" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.902385 5030 scope.go:117] "RemoveContainer" containerID="2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438" Mar 16 13:27:58 crc kubenswrapper[5030]: E0316 13:27:58.902778 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438\": container with ID starting with 2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438 not found: ID does not exist" containerID="2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438" Mar 16 13:27:58 crc kubenswrapper[5030]: I0316 13:27:58.902819 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438"} err="failed to get container status \"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438\": rpc error: code = NotFound desc = could not find container \"2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438\": container with ID starting with 2081c73056ec601e11aea6fb4be0fb4eec89d62d685f79eb80018e5b2857b438 not found: ID does not exist" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.526970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.564615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle\") pod \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.564667 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs\") pod \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.564742 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom\") pod \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.564793 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7252t\" (UniqueName: \"kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t\") pod \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.564856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data\") pod \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\" (UID: \"4f670f0f-7d8a-44cc-988a-5f2f0ea28623\") " Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.565301 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs" (OuterVolumeSpecName: "logs") pod "4f670f0f-7d8a-44cc-988a-5f2f0ea28623" (UID: "4f670f0f-7d8a-44cc-988a-5f2f0ea28623"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.569522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4f670f0f-7d8a-44cc-988a-5f2f0ea28623" (UID: "4f670f0f-7d8a-44cc-988a-5f2f0ea28623"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.569522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t" (OuterVolumeSpecName: "kube-api-access-7252t") pod "4f670f0f-7d8a-44cc-988a-5f2f0ea28623" (UID: "4f670f0f-7d8a-44cc-988a-5f2f0ea28623"). InnerVolumeSpecName "kube-api-access-7252t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.590730 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4f670f0f-7d8a-44cc-988a-5f2f0ea28623" (UID: "4f670f0f-7d8a-44cc-988a-5f2f0ea28623"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.597538 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data" (OuterVolumeSpecName: "config-data") pod "4f670f0f-7d8a-44cc-988a-5f2f0ea28623" (UID: "4f670f0f-7d8a-44cc-988a-5f2f0ea28623"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.667173 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.667287 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.667348 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.667399 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7252t\" (UniqueName: \"kubernetes.io/projected/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-kube-api-access-7252t\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.667450 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f670f0f-7d8a-44cc-988a-5f2f0ea28623-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.840041 5030 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod45f3f054-9c16-4e92-b203-0ace1d4ce50b"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod45f3f054-9c16-4e92-b203-0ace1d4ce50b] : Timed out while waiting for systemd to remove kubepods-besteffort-pod45f3f054_9c16_4e92_b203_0ace1d4ce50b.slice" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.868659 5030 generic.go:358] "Generic (PLEG): container finished" podID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerID="de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1" exitCode=137 Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.868730 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerDied","Data":"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1"} Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.868773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" event={"ID":"4f670f0f-7d8a-44cc-988a-5f2f0ea28623","Type":"ContainerDied","Data":"37d6bb65f7c1f8e993e876e0f93164117dd4840dfa1bedccfe22fa6b44056d0b"} Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.868796 5030 scope.go:117] "RemoveContainer" containerID="de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.869511 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.898683 5030 scope.go:117] "RemoveContainer" containerID="2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.902498 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.907619 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-9b95958fd-8sj56"] Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.914902 5030 scope.go:117] "RemoveContainer" containerID="de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1" Mar 16 13:27:59 crc kubenswrapper[5030]: E0316 13:27:59.915351 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1\": container with ID starting with de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1 not found: ID does not exist" containerID="de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.915439 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1"} err="failed to get container status \"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1\": rpc error: code = NotFound desc = could not find container \"de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1\": container with ID starting with de98c6cc3f05c0525941e5efc4f8bd60fe9537036b0066c9706868c04f9c04f1 not found: ID does not exist" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.915512 5030 scope.go:117] "RemoveContainer" containerID="2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18" Mar 16 13:27:59 crc kubenswrapper[5030]: E0316 13:27:59.916069 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18\": container with ID starting with 2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18 not found: ID does not exist" containerID="2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.916108 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18"} err="failed to get container status \"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18\": rpc error: code = NotFound desc = could not find container \"2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18\": container with ID starting with 2d5a5799c2019b85bb9052bffc5a52fa9e3db40e43750b1e2c9261e037f14d18 not found: ID does not exist" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.953643 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" path="/var/lib/kubelet/pods/4f670f0f-7d8a-44cc-988a-5f2f0ea28623/volumes" Mar 16 13:27:59 crc kubenswrapper[5030]: I0316 13:27:59.954399 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" path="/var/lib/kubelet/pods/56601e65-1af2-44fc-9fe5-75f4a581d5aa/volumes" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.132830 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561128-bml8c"] Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133683 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133705 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133720 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133728 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133736 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133740 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133748 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133753 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133759 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77627c76-1e68-4476-af56-081c481ae2dd" containerName="kube-state-metrics" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133763 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="77627c76-1e68-4476-af56-081c481ae2dd" containerName="kube-state-metrics" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133773 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133777 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133782 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="dnsmasq-dns" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133786 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="dnsmasq-dns" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133793 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133799 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133805 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="cinder-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133809 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="cinder-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133818 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133822 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133830 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133835 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133842 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="probe" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133847 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="probe" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133855 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133861 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133870 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133874 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133881 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="swift-recon-cron" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133885 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="swift-recon-cron" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133895 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133900 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133908 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133912 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133920 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133925 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133930 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133934 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133942 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-central-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133947 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-central-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133955 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133960 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133966 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133971 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133978 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133982 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.133997 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="openstack-network-exporter" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134003 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="openstack-network-exporter" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134008 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134013 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134021 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134025 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134031 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134036 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134042 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134046 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134053 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134058 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134066 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="setup-container" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134071 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="setup-container" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134078 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="setup-container" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134082 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="setup-container" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134089 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="mysql-bootstrap" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134093 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="mysql-bootstrap" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134099 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134104 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134111 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="rsync" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134116 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="rsync" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134124 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134129 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134137 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134142 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134149 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134153 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134158 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134162 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134168 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-notification-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134173 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-notification-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134181 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="mysql-bootstrap" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134186 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="mysql-bootstrap" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134194 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-reaper" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134204 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-reaper" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134212 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134216 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134222 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134236 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="galera" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134240 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="galera" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134247 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134251 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134258 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134263 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134268 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134273 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134280 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134284 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134291 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-metadata" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134296 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-metadata" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134301 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134306 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134311 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="init" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134315 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="init" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134321 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134325 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134331 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134335 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134343 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134347 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134354 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="sg-core" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134358 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="sg-core" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134364 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134368 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134375 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134381 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134388 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="ovn-northd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134392 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="ovn-northd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134400 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134406 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134414 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134419 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134425 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="galera" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134431 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da8f44b-035c-4ab2-962b-5c44b123929e" containerName="galera" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134437 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134442 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134448 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134453 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134460 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134466 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134474 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134479 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134487 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134492 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134497 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-expirer" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134502 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-expirer" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134510 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134514 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134521 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134526 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134662 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="89282d6e-ff10-4092-b709-a2466e578fd4" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134674 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="45f3f054-9c16-4e92-b203-0ace1d4ce50b" containerName="nova-cell1-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134681 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134703 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134709 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134715 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134722 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134730 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a99b1a1-4c96-4d87-949f-085c755ecd82" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134737 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134744 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-central-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134750 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="56601e65-1af2-44fc-9fe5-75f4a581d5aa" containerName="barbican-worker" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134758 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-expirer" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134765 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd1a3eed-f1d9-455c-919d-ce19a0f8a6a5" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134774 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-reaper" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134779 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="rsync" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134786 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134793 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134798 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134806 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3529c2a2-d018-4c39-b2f0-6346a2b686cc" containerName="keystone-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134811 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a23a1a1-8e33-4bed-a738-d044523febe8" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134818 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134825 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b397af5f-d66b-45c1-a5a3-225084b4c13b" containerName="galera" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134831 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="openstack-network-exporter" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134836 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134843 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134850 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134859 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-updater" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134866 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee66b746-fdc9-4765-93cd-21aa27cf84f0" containerName="ovn-northd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134871 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134876 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="ceilometer-notification-agent" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134882 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="cinder-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134890 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e0c48df-8cc5-4a86-81bd-22e68eb4627d" containerName="nova-scheduler-scheduler" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134895 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134901 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd02d0f3-56a7-4181-aef1-17bf3effc3d7" containerName="nova-cell0-conductor-conductor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134909 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ee5b58-8044-4e80-a667-663f2f57f6e5" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134916 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0167208-7974-4db5-89be-eafc7e5412f9" containerName="barbican-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134921 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134926 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134932 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134936 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134943 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="object-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134949 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f39bbebf-a149-44b0-9982-5740bc7e9aed" containerName="probe" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134955 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="77627c76-1e68-4476-af56-081c481ae2dd" containerName="kube-state-metrics" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134960 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="406c1608-a210-4e95-9e30-0e7c15f51f67" containerName="nova-api-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134965 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134970 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea781a55-9f91-4acb-b039-fbf8b016ea8f" containerName="nova-metadata-metadata" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134977 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="container-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.134986 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-auditor" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135000 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="44d22e09-d69d-438f-b5aa-61b0f3842481" containerName="cinder-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135007 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb8c60c8-da8e-4757-914f-e13df20a39a0" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135011 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ab462d1-b867-48bf-aa79-7e1a45859a40" containerName="barbican-api-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135018 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b065a85f-f473-459d-bd68-74d1b57ce27b" containerName="dnsmasq-dns" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135024 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="95d93974-fe4c-4f9a-9cde-81a68ad7542b" containerName="proxy-server" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135028 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="sg-core" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135035 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f670f0f-7d8a-44cc-988a-5f2f0ea28623" containerName="barbican-keystone-listener" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135041 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="48d90717-dbfc-40c0-a7ff-8abb1882e436" containerName="proxy-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135047 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="53313e64-d1c5-4aab-adb8-b1480d03bf0a" containerName="rabbitmq" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135052 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="swift-recon-cron" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135059 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f209a2b-0fda-47aa-8be7-d116be97132c" containerName="account-replicator" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135063 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="11ee4617-94c0-4a7a-a51b-42a116d86dcc" containerName="placement-api" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135070 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b653b63-2051-4924-905d-94b6a7dac92a" containerName="neutron-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135076 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.135082 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="80d0d6c4-ceb2-400a-9ea2-ab01ded230bd" containerName="glance-httpd" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.138401 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.140503 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.140730 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.141290 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.147126 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561128-bml8c"] Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.175966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82smz\" (UniqueName: \"kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz\") pod \"auto-csr-approver-29561128-bml8c\" (UID: \"212c1a97-8a01-4ba7-94e7-46ba954a9385\") " pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.278541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82smz\" (UniqueName: \"kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz\") pod \"auto-csr-approver-29561128-bml8c\" (UID: \"212c1a97-8a01-4ba7-94e7-46ba954a9385\") " pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.295532 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82smz\" (UniqueName: \"kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz\") pod \"auto-csr-approver-29561128-bml8c\" (UID: \"212c1a97-8a01-4ba7-94e7-46ba954a9385\") " pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.437853 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.205:9696/\": dial tcp 10.217.0.205:9696: connect: connection refused" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.453433 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.745691 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6665547686-fvn8g_12da506b-6937-4461-b5db-540d347c943e/neutron-api/0.log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.745974 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.785971 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786187 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786244 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786384 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.786416 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9\") pod \"12da506b-6937-4461-b5db-540d347c943e\" (UID: \"12da506b-6937-4461-b5db-540d347c943e\") " Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.792143 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9" (OuterVolumeSpecName: "kube-api-access-fk2l9") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "kube-api-access-fk2l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.792215 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.825689 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.826259 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.826333 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.828619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config" (OuterVolumeSpecName: "config") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.831740 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561128-bml8c"] Mar 16 13:28:00 crc kubenswrapper[5030]: W0316 13:28:00.835084 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212c1a97_8a01_4ba7_94e7_46ba954a9385.slice/crio-87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897 WatchSource:0}: Error finding container 87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897: Status 404 returned error can't find the container with id 87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897 Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.839286 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "12da506b-6937-4461-b5db-540d347c943e" (UID: "12da506b-6937-4461-b5db-540d347c943e"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.883822 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561128-bml8c" event={"ID":"212c1a97-8a01-4ba7-94e7-46ba954a9385","Type":"ContainerStarted","Data":"87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897"} Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886491 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6665547686-fvn8g_12da506b-6937-4461-b5db-540d347c943e/neutron-api/0.log" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886523 5030 generic.go:358] "Generic (PLEG): container finished" podID="12da506b-6937-4461-b5db-540d347c943e" containerID="9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09" exitCode=137 Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerDied","Data":"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09"} Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886613 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" event={"ID":"12da506b-6937-4461-b5db-540d347c943e","Type":"ContainerDied","Data":"045f1601d825be30016305b6a0399ed5f628befaa7a91cf67bec27415ad57f11"} Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886632 5030 scope.go:117] "RemoveContainer" containerID="be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.886754 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6665547686-fvn8g" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888428 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888451 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888461 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888474 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888483 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888491 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk2l9\" (UniqueName: \"kubernetes.io/projected/12da506b-6937-4461-b5db-540d347c943e-kube-api-access-fk2l9\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.888499 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/12da506b-6937-4461-b5db-540d347c943e-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.923246 5030 scope.go:117] "RemoveContainer" containerID="9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.928026 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.934291 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6665547686-fvn8g"] Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.947867 5030 scope.go:117] "RemoveContainer" containerID="be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6" Mar 16 13:28:00 crc kubenswrapper[5030]: E0316 13:28:00.948336 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6\": container with ID starting with be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6 not found: ID does not exist" containerID="be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.948377 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6"} err="failed to get container status \"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6\": rpc error: code = NotFound desc = could not find container \"be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6\": container with ID starting with be9a15f5a2b934166838986591b063f3cd01e69830a66987ea47981221356af6 not found: ID does not exist" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.948407 5030 scope.go:117] "RemoveContainer" containerID="9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09" Mar 16 13:28:00 crc kubenswrapper[5030]: E0316 13:28:00.948743 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09\": container with ID starting with 9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09 not found: ID does not exist" containerID="9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09" Mar 16 13:28:00 crc kubenswrapper[5030]: I0316 13:28:00.948781 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09"} err="failed to get container status \"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09\": rpc error: code = NotFound desc = could not find container \"9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09\": container with ID starting with 9e9b58a403291f45339d0d08e17e32e0728243c130b3ab4ed515b528739fef09 not found: ID does not exist" Mar 16 13:28:01 crc kubenswrapper[5030]: I0316 13:28:01.958031 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12da506b-6937-4461-b5db-540d347c943e" path="/var/lib/kubelet/pods/12da506b-6937-4461-b5db-540d347c943e/volumes" Mar 16 13:28:02 crc kubenswrapper[5030]: I0316 13:28:02.913386 5030 generic.go:358] "Generic (PLEG): container finished" podID="212c1a97-8a01-4ba7-94e7-46ba954a9385" containerID="516b88bcb8c32c350cfdaa316e3b310ba08cd193f8921852de8fac9f21b33008" exitCode=0 Mar 16 13:28:02 crc kubenswrapper[5030]: I0316 13:28:02.913455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561128-bml8c" event={"ID":"212c1a97-8a01-4ba7-94e7-46ba954a9385","Type":"ContainerDied","Data":"516b88bcb8c32c350cfdaa316e3b310ba08cd193f8921852de8fac9f21b33008"} Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.181001 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.246144 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82smz\" (UniqueName: \"kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz\") pod \"212c1a97-8a01-4ba7-94e7-46ba954a9385\" (UID: \"212c1a97-8a01-4ba7-94e7-46ba954a9385\") " Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.254399 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz" (OuterVolumeSpecName: "kube-api-access-82smz") pod "212c1a97-8a01-4ba7-94e7-46ba954a9385" (UID: "212c1a97-8a01-4ba7-94e7-46ba954a9385"). InnerVolumeSpecName "kube-api-access-82smz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.348298 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82smz\" (UniqueName: \"kubernetes.io/projected/212c1a97-8a01-4ba7-94e7-46ba954a9385-kube-api-access-82smz\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.940776 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561128-bml8c" Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.940817 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561128-bml8c" event={"ID":"212c1a97-8a01-4ba7-94e7-46ba954a9385","Type":"ContainerDied","Data":"87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897"} Mar 16 13:28:04 crc kubenswrapper[5030]: I0316 13:28:04.941166 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87224f1bb9d62bdd467b5e725205ab5a570d2d0418097faf35aaae7a4165d897" Mar 16 13:28:05 crc kubenswrapper[5030]: I0316 13:28:05.237687 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561122-6kbjg"] Mar 16 13:28:05 crc kubenswrapper[5030]: I0316 13:28:05.240932 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561122-6kbjg"] Mar 16 13:28:05 crc kubenswrapper[5030]: I0316 13:28:05.957309 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d483d5-dd7e-49ea-8734-96d1a87c7f0f" path="/var/lib/kubelet/pods/86d483d5-dd7e-49ea-8734-96d1a87c7f0f/volumes" Mar 16 13:28:08 crc kubenswrapper[5030]: I0316 13:28:08.361268 5030 scope.go:117] "RemoveContainer" containerID="6abd6a5461e3cd0ce2e8c6b109682567d10d209e8d0139f66a0f262adfb40ac9" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.298150 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299192 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-httpd" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299207 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-httpd" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299218 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="212c1a97-8a01-4ba7-94e7-46ba954a9385" containerName="oc" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299224 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="212c1a97-8a01-4ba7-94e7-46ba954a9385" containerName="oc" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299243 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-api" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299249 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-api" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299375 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-api" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299386 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="212c1a97-8a01-4ba7-94e7-46ba954a9385" containerName="oc" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.299397 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="12da506b-6937-4461-b5db-540d347c943e" containerName="neutron-httpd" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.306662 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.308693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.312645 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.312949 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.313161 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.313475 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.314182 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.316114 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.317494 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-cl4gg\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460742 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460933 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxdd2\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.460987 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.461021 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.461039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.461061 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562493 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562516 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562538 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562856 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.562987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563068 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563161 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563215 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563242 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") device mount path \"/mnt/openstack/pv18\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563254 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxdd2\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563562 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.563937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.564289 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.564419 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.571250 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.571438 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.571511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.571895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.579727 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxdd2\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.581356 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"rabbitmq-server-0\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.603020 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.612534 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.615566 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.616400 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.617069 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.617345 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.618421 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.618491 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.618649 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-n4qz9\"" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.619175 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.635678 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.767976 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768098 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768136 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768215 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768258 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768347 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwqtj\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768488 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768526 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.768720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.870357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwqtj\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.870405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.870961 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871082 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871228 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871299 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871346 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871475 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871513 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871673 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.871807 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.872081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.872303 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.872692 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.873461 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.873626 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.876108 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.877115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.878818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.880263 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.885415 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwqtj\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.889965 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:11 crc kubenswrapper[5030]: I0316 13:28:11.951911 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.051470 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.222789 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.226724 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.228634 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-w8dtc\"" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.232636 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.232892 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.233139 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.233741 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.239109 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.368787 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:28:12 crc kubenswrapper[5030]: W0316 13:28:12.376726 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8553f68_b65a_4220_8445_7fb5e36ba36b.slice/crio-2c15cf6d3de37e6b1f423eeb64ba91287bbc9f17548b1a91ef5138853a44240c WatchSource:0}: Error finding container 2c15cf6d3de37e6b1f423eeb64ba91287bbc9f17548b1a91ef5138853a44240c: Status 404 returned error can't find the container with id 2c15cf6d3de37e6b1f423eeb64ba91287bbc9f17548b1a91ef5138853a44240c Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383695 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383734 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383755 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhmn\" (UniqueName: \"kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.383817 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.384099 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.384200 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.485844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.485929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.485982 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486033 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhmn\" (UniqueName: \"kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486073 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486112 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486167 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486580 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.486595 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.487726 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.488090 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.488616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.489658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.492274 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.492325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.502531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhmn\" (UniqueName: \"kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.504297 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:12 crc kubenswrapper[5030]: I0316 13:28:12.539785 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.008670 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:28:13 crc kubenswrapper[5030]: W0316 13:28:13.011304 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5e6f15_6858_49ff_9570_39f56bf0b83b.slice/crio-dbcb21a9cf924251c3640591187d39122e5aaa4593df6d0f057fda6a99d0d23c WatchSource:0}: Error finding container dbcb21a9cf924251c3640591187d39122e5aaa4593df6d0f057fda6a99d0d23c: Status 404 returned error can't find the container with id dbcb21a9cf924251c3640591187d39122e5aaa4593df6d0f057fda6a99d0d23c Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.032360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerStarted","Data":"f82c2e403d84fff0b90ea40d3e548e144aae168888c72897cefaab7fea4a0930"} Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.035017 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerStarted","Data":"2c15cf6d3de37e6b1f423eeb64ba91287bbc9f17548b1a91ef5138853a44240c"} Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.036694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerStarted","Data":"dbcb21a9cf924251c3640591187d39122e5aaa4593df6d0f057fda6a99d0d23c"} Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.596501 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.602073 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.607889 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.610881 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-cf2xs\"" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.610935 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.610881 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.611323 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710440 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710487 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710616 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710677 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710737 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc8s5\" (UniqueName: \"kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.710811 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.812503 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.812762 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.812886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.812987 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813088 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813467 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813099 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813622 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813704 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc8s5\" (UniqueName: \"kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813756 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.813907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.814100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.814350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.818450 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.818502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.828112 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.828645 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc8s5\" (UniqueName: \"kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5\") pod \"openstack-cell1-galera-0\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:13 crc kubenswrapper[5030]: I0316 13:28:13.915635 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.048809 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerStarted","Data":"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4"} Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.051969 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerStarted","Data":"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46"} Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.053591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerStarted","Data":"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c"} Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.310933 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.833170 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.836951 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.839762 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.839774 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.839844 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-52jbx\"" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.845930 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.931833 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.931940 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cklm\" (UniqueName: \"kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.931962 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.932098 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:14 crc kubenswrapper[5030]: I0316 13:28:14.932178 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.033863 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.034418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cklm\" (UniqueName: \"kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.034453 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.034637 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.034757 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.034841 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.035445 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.040513 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.041499 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.051208 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cklm\" (UniqueName: \"kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm\") pod \"memcached-0\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.065721 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerStarted","Data":"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b"} Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.065798 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerStarted","Data":"c5abf05c454a4f2bfd3e6954877f7b064bc8eb5313cd4c59524a1b86ea267205"} Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.153727 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:15 crc kubenswrapper[5030]: I0316 13:28:15.612823 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.081826 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a7890951-cd05-4236-a0db-e6f9063aacdb","Type":"ContainerStarted","Data":"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9"} Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.082139 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.082151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a7890951-cd05-4236-a0db-e6f9063aacdb","Type":"ContainerStarted","Data":"28a292647f74e78706c9254ceb9316a0ebe9e2b9b69a4cbdb98cdcb3ca921487"} Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.084515 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerID="1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c" exitCode=0 Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.084585 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerDied","Data":"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c"} Mar 16 13:28:16 crc kubenswrapper[5030]: I0316 13:28:16.106274 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.106255941 podStartE2EDuration="2.106255941s" podCreationTimestamp="2026-03-16 13:28:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:16.097645879 +0000 UTC m=+1340.496958426" watchObservedRunningTime="2026-03-16 13:28:16.106255941 +0000 UTC m=+1340.505568487" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.036327 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.040143 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.042036 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-c5g5g\"" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.052738 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.106374 5030 generic.go:358] "Generic (PLEG): container finished" podID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerID="2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b" exitCode=0 Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.106454 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerDied","Data":"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b"} Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.112478 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerStarted","Data":"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de"} Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.150473 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=5.150456252 podStartE2EDuration="5.150456252s" podCreationTimestamp="2026-03-16 13:28:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:17.148126241 +0000 UTC m=+1341.547438788" watchObservedRunningTime="2026-03-16 13:28:17.150456252 +0000 UTC m=+1341.549768800" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.180151 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlcq\" (UniqueName: \"kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq\") pod \"kube-state-metrics-0\" (UID: \"a7e47a34-3b99-4202-a013-fad458954964\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.281284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlcq\" (UniqueName: \"kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq\") pod \"kube-state-metrics-0\" (UID: \"a7e47a34-3b99-4202-a013-fad458954964\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.296944 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlcq\" (UniqueName: \"kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq\") pod \"kube-state-metrics-0\" (UID: \"a7e47a34-3b99-4202-a013-fad458954964\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.352530 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:17 crc kubenswrapper[5030]: I0316 13:28:17.767216 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:28:17 crc kubenswrapper[5030]: W0316 13:28:17.769936 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7e47a34_3b99_4202_a013_fad458954964.slice/crio-2a825dac0490e6b0d53cabae2c25b19524ba5b7b0422987686525756dce36d91 WatchSource:0}: Error finding container 2a825dac0490e6b0d53cabae2c25b19524ba5b7b0422987686525756dce36d91: Status 404 returned error can't find the container with id 2a825dac0490e6b0d53cabae2c25b19524ba5b7b0422987686525756dce36d91 Mar 16 13:28:18 crc kubenswrapper[5030]: I0316 13:28:18.139479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a7e47a34-3b99-4202-a013-fad458954964","Type":"ContainerStarted","Data":"2a825dac0490e6b0d53cabae2c25b19524ba5b7b0422987686525756dce36d91"} Mar 16 13:28:18 crc kubenswrapper[5030]: I0316 13:28:18.143761 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerStarted","Data":"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740"} Mar 16 13:28:18 crc kubenswrapper[5030]: I0316 13:28:18.161140 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=5.161126038 podStartE2EDuration="5.161126038s" podCreationTimestamp="2026-03-16 13:28:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:18.160798452 +0000 UTC m=+1342.560110999" watchObservedRunningTime="2026-03-16 13:28:18.161126038 +0000 UTC m=+1342.560438585" Mar 16 13:28:19 crc kubenswrapper[5030]: I0316 13:28:19.155824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a7e47a34-3b99-4202-a013-fad458954964","Type":"ContainerStarted","Data":"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074"} Mar 16 13:28:19 crc kubenswrapper[5030]: I0316 13:28:19.156238 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:19 crc kubenswrapper[5030]: I0316 13:28:19.170131 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.915534847 podStartE2EDuration="2.170110444s" podCreationTimestamp="2026-03-16 13:28:17 +0000 UTC" firstStartedPulling="2026-03-16 13:28:17.771415734 +0000 UTC m=+1342.170728280" lastFinishedPulling="2026-03-16 13:28:18.025991329 +0000 UTC m=+1342.425303877" observedRunningTime="2026-03-16 13:28:19.167684182 +0000 UTC m=+1343.566996739" watchObservedRunningTime="2026-03-16 13:28:19.170110444 +0000 UTC m=+1343.569422982" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.011166 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.019012 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.024132 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.025811 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.025866 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.026599 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-tckqj\"" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.026917 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.030191 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132161 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132210 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132398 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132454 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.132545 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzgb8\" (UniqueName: \"kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234080 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234173 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234247 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234267 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234294 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzgb8\" (UniqueName: \"kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234421 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234440 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234531 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.234856 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.235626 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.236574 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.243757 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.247196 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.249720 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.252488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzgb8\" (UniqueName: \"kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.260931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.338650 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:20 crc kubenswrapper[5030]: I0316 13:28:20.769609 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:28:20 crc kubenswrapper[5030]: W0316 13:28:20.770205 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod314a6460_082f_4fbb_a520_26438f689a6a.slice/crio-be22fda69ce8a0b6052728a0dd630efe61b75d2d359bb1dccb7a8da97cda7cb0 WatchSource:0}: Error finding container be22fda69ce8a0b6052728a0dd630efe61b75d2d359bb1dccb7a8da97cda7cb0: Status 404 returned error can't find the container with id be22fda69ce8a0b6052728a0dd630efe61b75d2d359bb1dccb7a8da97cda7cb0 Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.177664 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerStarted","Data":"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687"} Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.178367 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerStarted","Data":"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6"} Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.178381 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerStarted","Data":"be22fda69ce8a0b6052728a0dd630efe61b75d2d359bb1dccb7a8da97cda7cb0"} Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.207024 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.206994928 podStartE2EDuration="2.206994928s" podCreationTimestamp="2026-03-16 13:28:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:21.202123348 +0000 UTC m=+1345.601435894" watchObservedRunningTime="2026-03-16 13:28:21.206994928 +0000 UTC m=+1345.606307475" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.750998 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.754973 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.761820 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.762064 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-mrfqr\"" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.762268 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.762943 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.764730 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866389 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866573 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xz5\" (UniqueName: \"kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866724 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.866880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.867055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969661 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969692 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xz5\" (UniqueName: \"kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.969748 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.970037 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.970108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.970133 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.971334 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.971940 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.972046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.979289 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.979325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.980605 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.986148 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xz5\" (UniqueName: \"kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:21 crc kubenswrapper[5030]: I0316 13:28:21.992460 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.071300 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.114369 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.510220 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:28:22 crc kubenswrapper[5030]: W0316 13:28:22.513262 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf14a2769_6106_4965_bd88_9feb130a7485.slice/crio-464f956a987ec86e400a18343c87d7e076ad2a5deb9f1e317c39a8d2048b80ce WatchSource:0}: Error finding container 464f956a987ec86e400a18343c87d7e076ad2a5deb9f1e317c39a8d2048b80ce: Status 404 returned error can't find the container with id 464f956a987ec86e400a18343c87d7e076ad2a5deb9f1e317c39a8d2048b80ce Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.540141 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.540454 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:22 crc kubenswrapper[5030]: I0316 13:28:22.658022 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.225487 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerStarted","Data":"0fee0be6c904ce3c9dcaf670d16cd5b3d4fd713b77776a1d54bfac9adb32c910"} Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.227714 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerStarted","Data":"50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa"} Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.227773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerStarted","Data":"464f956a987ec86e400a18343c87d7e076ad2a5deb9f1e317c39a8d2048b80ce"} Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.248830 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.248807952 podStartE2EDuration="2.248807952s" podCreationTimestamp="2026-03-16 13:28:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:23.243288111 +0000 UTC m=+1347.642600658" watchObservedRunningTime="2026-03-16 13:28:23.248807952 +0000 UTC m=+1347.648120509" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.299313 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.339301 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.374609 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.916514 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.916580 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:23 crc kubenswrapper[5030]: I0316 13:28:23.982890 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:24 crc kubenswrapper[5030]: I0316 13:28:24.235123 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:24 crc kubenswrapper[5030]: I0316 13:28:24.287132 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:28:24 crc kubenswrapper[5030]: I0316 13:28:24.287220 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:28:24 crc kubenswrapper[5030]: I0316 13:28:24.298788 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:28:25 crc kubenswrapper[5030]: I0316 13:28:25.072097 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:25 crc kubenswrapper[5030]: I0316 13:28:25.104779 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:25 crc kubenswrapper[5030]: I0316 13:28:25.245254 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:25 crc kubenswrapper[5030]: I0316 13:28:25.273503 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.236857 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-vk7hb"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.241750 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.243582 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-vk7hb"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.349458 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.355739 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.358384 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.359564 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.368565 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.369273 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxftk\" (UniqueName: \"kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.469772 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkjnl"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.470847 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcbk\" (UniqueName: \"kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.471076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxftk\" (UniqueName: \"kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.471161 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.471241 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.471979 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.473698 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.476450 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkjnl"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.492827 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxftk\" (UniqueName: \"kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk\") pod \"keystone-db-create-vk7hb\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.546298 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.551323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.553014 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.556274 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq"] Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.570010 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.572773 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.572917 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcbk\" (UniqueName: \"kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.572983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hcg2\" (UniqueName: \"kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.573183 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.573588 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.589848 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcbk\" (UniqueName: \"kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk\") pod \"keystone-675a-account-create-update-wxt4f\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.673926 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.676089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.676164 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hcg2\" (UniqueName: \"kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.676221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphpw\" (UniqueName: \"kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.676272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.677262 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.692001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hcg2\" (UniqueName: \"kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2\") pod \"placement-db-create-qkjnl\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.778950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.779027 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pphpw\" (UniqueName: \"kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.779852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.792139 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.796204 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphpw\" (UniqueName: \"kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw\") pod \"placement-d6dd-account-create-update-7zhfq\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.874776 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:26 crc kubenswrapper[5030]: I0316 13:28:26.981965 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-vk7hb"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.071147 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f"] Mar 16 13:28:27 crc kubenswrapper[5030]: W0316 13:28:27.085097 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefee2114_7d16_44d3_ad75_7224b8ae4077.slice/crio-cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97 WatchSource:0}: Error finding container cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97: Status 404 returned error can't find the container with id cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97 Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.212784 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkjnl"] Mar 16 13:28:27 crc kubenswrapper[5030]: W0316 13:28:27.216782 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59d41150_83f5_40f5_bb52_2be58b73a852.slice/crio-f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7 WatchSource:0}: Error finding container f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7: Status 404 returned error can't find the container with id f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7 Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.261185 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkjnl" event={"ID":"59d41150-83f5-40f5-bb52-2be58b73a852","Type":"ContainerStarted","Data":"f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7"} Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.263707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" event={"ID":"efee2114-7d16-44d3-ad75-7224b8ae4077","Type":"ContainerStarted","Data":"f58d05d36952eea06086c2695cb65175a7d3b22ba74b69a94fa51ad36f38ffbf"} Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.263734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" event={"ID":"efee2114-7d16-44d3-ad75-7224b8ae4077","Type":"ContainerStarted","Data":"cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97"} Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.266611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" event={"ID":"114c5991-4a9a-484f-88a9-ba1a07b4c6ca","Type":"ContainerStarted","Data":"49dc2a14fd486dbaa0d4179dfda7484c141488f90359859fb50a04fba3f61259"} Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.266658 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" event={"ID":"114c5991-4a9a-484f-88a9-ba1a07b4c6ca","Type":"ContainerStarted","Data":"07381b5579c138a98189910ede84225736ae576334a6e97f4ba53c0667477659"} Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.287905 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.293979 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" podStartSLOduration=1.293962188 podStartE2EDuration="1.293962188s" podCreationTimestamp="2026-03-16 13:28:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:27.280028074 +0000 UTC m=+1351.679340622" watchObservedRunningTime="2026-03-16 13:28:27.293962188 +0000 UTC m=+1351.693274736" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.314999 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" podStartSLOduration=1.31498329 podStartE2EDuration="1.31498329s" podCreationTimestamp="2026-03-16 13:28:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:27.297747527 +0000 UTC m=+1351.697060074" watchObservedRunningTime="2026-03-16 13:28:27.31498329 +0000 UTC m=+1351.714295837" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.409047 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.420798 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.424031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.424186 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.424313 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-hmrsr\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.424449 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.436660 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.496934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.497201 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.497302 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gwl\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.497336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.497365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.497736 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.537982 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-vprnh"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.542599 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.546197 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.546197 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.546564 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.549175 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-vprnh"] Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.599680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.599852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.599886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8525\" (UniqueName: \"kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.599923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.599956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600222 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600498 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gwl\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: E0316 13:28:27.600578 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:28:27 crc kubenswrapper[5030]: E0316 13:28:27.600603 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:28:27 crc kubenswrapper[5030]: E0316 13:28:27.600664 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift podName:7a6edfca-35e3-4b2d-8b5d-2c8e8818360f nodeName:}" failed. No retries permitted until 2026-03-16 13:28:28.100644624 +0000 UTC m=+1352.499957171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift") pod "swift-storage-0" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f") : configmap "swift-ring-files" not found Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.600905 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.601062 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.601091 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.601295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.601317 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.606428 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.619657 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gwl\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.627617 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702356 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702400 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702830 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8525\" (UniqueName: \"kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.702881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.703287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.703731 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.703843 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.706350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.706590 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.707172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.716792 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8525\" (UniqueName: \"kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525\") pod \"swift-ring-rebalance-vprnh\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:27 crc kubenswrapper[5030]: I0316 13:28:27.878714 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.114205 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:28 crc kubenswrapper[5030]: E0316 13:28:28.114456 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:28:28 crc kubenswrapper[5030]: E0316 13:28:28.114494 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:28:28 crc kubenswrapper[5030]: E0316 13:28:28.114601 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift podName:7a6edfca-35e3-4b2d-8b5d-2c8e8818360f nodeName:}" failed. No retries permitted until 2026-03-16 13:28:29.114574169 +0000 UTC m=+1353.513886716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift") pod "swift-storage-0" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f") : configmap "swift-ring-files" not found Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.282780 5030 generic.go:358] "Generic (PLEG): container finished" podID="59d41150-83f5-40f5-bb52-2be58b73a852" containerID="41b92f197a4a60897b91bed6e99c000cf2bed6404c4032d095f1798d396ce51b" exitCode=0 Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.282890 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkjnl" event={"ID":"59d41150-83f5-40f5-bb52-2be58b73a852","Type":"ContainerDied","Data":"41b92f197a4a60897b91bed6e99c000cf2bed6404c4032d095f1798d396ce51b"} Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.287968 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-vprnh"] Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.288764 5030 generic.go:358] "Generic (PLEG): container finished" podID="efee2114-7d16-44d3-ad75-7224b8ae4077" containerID="f58d05d36952eea06086c2695cb65175a7d3b22ba74b69a94fa51ad36f38ffbf" exitCode=0 Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.288912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" event={"ID":"efee2114-7d16-44d3-ad75-7224b8ae4077","Type":"ContainerDied","Data":"f58d05d36952eea06086c2695cb65175a7d3b22ba74b69a94fa51ad36f38ffbf"} Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.295500 5030 generic.go:358] "Generic (PLEG): container finished" podID="114c5991-4a9a-484f-88a9-ba1a07b4c6ca" containerID="49dc2a14fd486dbaa0d4179dfda7484c141488f90359859fb50a04fba3f61259" exitCode=0 Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.295849 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" event={"ID":"114c5991-4a9a-484f-88a9-ba1a07b4c6ca","Type":"ContainerDied","Data":"49dc2a14fd486dbaa0d4179dfda7484c141488f90359859fb50a04fba3f61259"} Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.298221 5030 generic.go:358] "Generic (PLEG): container finished" podID="e9f2d89e-5413-416f-a84a-43a5cc05bbfa" containerID="f6b6022deab7358ce5a5b274c64507e2c96bd7604d0ffd460756da35132192e3" exitCode=0 Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.299057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" event={"ID":"e9f2d89e-5413-416f-a84a-43a5cc05bbfa","Type":"ContainerDied","Data":"f6b6022deab7358ce5a5b274c64507e2c96bd7604d0ffd460756da35132192e3"} Mar 16 13:28:28 crc kubenswrapper[5030]: I0316 13:28:28.299115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" event={"ID":"e9f2d89e-5413-416f-a84a-43a5cc05bbfa","Type":"ContainerStarted","Data":"afbfed3a9a6297ea61079e64d3775ac0ff0c73ca46c478775226980ee2026553"} Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.134758 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:29 crc kubenswrapper[5030]: E0316 13:28:29.134972 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:28:29 crc kubenswrapper[5030]: E0316 13:28:29.135151 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:28:29 crc kubenswrapper[5030]: E0316 13:28:29.135230 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift podName:7a6edfca-35e3-4b2d-8b5d-2c8e8818360f nodeName:}" failed. No retries permitted until 2026-03-16 13:28:31.135208263 +0000 UTC m=+1355.534520800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift") pod "swift-storage-0" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f") : configmap "swift-ring-files" not found Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.310789 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" event={"ID":"84f827ba-f56b-44db-bbe7-edee2f1dc11f","Type":"ContainerStarted","Data":"0597c268c505829fc3b9e804a1d5a9fd4f8e47ef5ca53026cc892559b2600716"} Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.311348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" event={"ID":"84f827ba-f56b-44db-bbe7-edee2f1dc11f","Type":"ContainerStarted","Data":"a822d43f87bc2eca8cf2aa2e558a7b82b42565e25470d3b27588db98e3b13e7d"} Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.341003 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" podStartSLOduration=2.340987313 podStartE2EDuration="2.340987313s" podCreationTimestamp="2026-03-16 13:28:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:29.338042876 +0000 UTC m=+1353.737355413" watchObservedRunningTime="2026-03-16 13:28:29.340987313 +0000 UTC m=+1353.740299860" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.801952 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.807460 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.811546 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.816358 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955052 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts\") pod \"59d41150-83f5-40f5-bb52-2be58b73a852\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955214 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts\") pod \"efee2114-7d16-44d3-ad75-7224b8ae4077\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955270 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts\") pod \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hcg2\" (UniqueName: \"kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2\") pod \"59d41150-83f5-40f5-bb52-2be58b73a852\" (UID: \"59d41150-83f5-40f5-bb52-2be58b73a852\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955416 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkcbk\" (UniqueName: \"kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk\") pod \"efee2114-7d16-44d3-ad75-7224b8ae4077\" (UID: \"efee2114-7d16-44d3-ad75-7224b8ae4077\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "59d41150-83f5-40f5-bb52-2be58b73a852" (UID: "59d41150-83f5-40f5-bb52-2be58b73a852"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955826 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "efee2114-7d16-44d3-ad75-7224b8ae4077" (UID: "efee2114-7d16-44d3-ad75-7224b8ae4077"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.956067 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e9f2d89e-5413-416f-a84a-43a5cc05bbfa" (UID: "e9f2d89e-5413-416f-a84a-43a5cc05bbfa"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.956316 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "114c5991-4a9a-484f-88a9-ba1a07b4c6ca" (UID: "114c5991-4a9a-484f-88a9-ba1a07b4c6ca"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.955479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts\") pod \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.956527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pphpw\" (UniqueName: \"kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw\") pod \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\" (UID: \"e9f2d89e-5413-416f-a84a-43a5cc05bbfa\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.956620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxftk\" (UniqueName: \"kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk\") pod \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\" (UID: \"114c5991-4a9a-484f-88a9-ba1a07b4c6ca\") " Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.957032 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59d41150-83f5-40f5-bb52-2be58b73a852-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.957044 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/efee2114-7d16-44d3-ad75-7224b8ae4077-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.957054 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.957062 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.963327 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk" (OuterVolumeSpecName: "kube-api-access-cxftk") pod "114c5991-4a9a-484f-88a9-ba1a07b4c6ca" (UID: "114c5991-4a9a-484f-88a9-ba1a07b4c6ca"). InnerVolumeSpecName "kube-api-access-cxftk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.963438 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2" (OuterVolumeSpecName: "kube-api-access-5hcg2") pod "59d41150-83f5-40f5-bb52-2be58b73a852" (UID: "59d41150-83f5-40f5-bb52-2be58b73a852"). InnerVolumeSpecName "kube-api-access-5hcg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.963463 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk" (OuterVolumeSpecName: "kube-api-access-wkcbk") pod "efee2114-7d16-44d3-ad75-7224b8ae4077" (UID: "efee2114-7d16-44d3-ad75-7224b8ae4077"). InnerVolumeSpecName "kube-api-access-wkcbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:29 crc kubenswrapper[5030]: I0316 13:28:29.963699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw" (OuterVolumeSpecName: "kube-api-access-pphpw") pod "e9f2d89e-5413-416f-a84a-43a5cc05bbfa" (UID: "e9f2d89e-5413-416f-a84a-43a5cc05bbfa"). InnerVolumeSpecName "kube-api-access-pphpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.058812 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hcg2\" (UniqueName: \"kubernetes.io/projected/59d41150-83f5-40f5-bb52-2be58b73a852-kube-api-access-5hcg2\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.058940 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkcbk\" (UniqueName: \"kubernetes.io/projected/efee2114-7d16-44d3-ad75-7224b8ae4077-kube-api-access-wkcbk\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.059021 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pphpw\" (UniqueName: \"kubernetes.io/projected/e9f2d89e-5413-416f-a84a-43a5cc05bbfa-kube-api-access-pphpw\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.059078 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxftk\" (UniqueName: \"kubernetes.io/projected/114c5991-4a9a-484f-88a9-ba1a07b4c6ca-kube-api-access-cxftk\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.167670 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.321640 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.321813 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq" event={"ID":"e9f2d89e-5413-416f-a84a-43a5cc05bbfa","Type":"ContainerDied","Data":"afbfed3a9a6297ea61079e64d3775ac0ff0c73ca46c478775226980ee2026553"} Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.321865 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afbfed3a9a6297ea61079e64d3775ac0ff0c73ca46c478775226980ee2026553" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.326692 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkjnl" event={"ID":"59d41150-83f5-40f5-bb52-2be58b73a852","Type":"ContainerDied","Data":"f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7"} Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.326731 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f646c4526f6f6d1dd61eac9e67574c771151ce69cec5b422c142ea3b7538b5a7" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.326832 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkjnl" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.331721 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" event={"ID":"efee2114-7d16-44d3-ad75-7224b8ae4077","Type":"ContainerDied","Data":"cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97"} Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.331780 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cab0d38d30d5883a0f7fa725764e9bc74e55600275943f13fbf784b4b7a57a97" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.331860 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.334573 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" event={"ID":"114c5991-4a9a-484f-88a9-ba1a07b4c6ca","Type":"ContainerDied","Data":"07381b5579c138a98189910ede84225736ae576334a6e97f4ba53c0667477659"} Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.334627 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07381b5579c138a98189910ede84225736ae576334a6e97f4ba53c0667477659" Mar 16 13:28:30 crc kubenswrapper[5030]: I0316 13:28:30.334694 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-vk7hb" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.177049 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:31 crc kubenswrapper[5030]: E0316 13:28:31.177316 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:28:31 crc kubenswrapper[5030]: E0316 13:28:31.177699 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:28:31 crc kubenswrapper[5030]: E0316 13:28:31.177791 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift podName:7a6edfca-35e3-4b2d-8b5d-2c8e8818360f nodeName:}" failed. No retries permitted until 2026-03-16 13:28:35.177765906 +0000 UTC m=+1359.577078453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift") pod "swift-storage-0" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f") : configmap "swift-ring-files" not found Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.291324 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.474174 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114c5991-4a9a-484f-88a9-ba1a07b4c6ca" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477687 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="114c5991-4a9a-484f-88a9-ba1a07b4c6ca" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477715 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9f2d89e-5413-416f-a84a-43a5cc05bbfa" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477723 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9f2d89e-5413-416f-a84a-43a5cc05bbfa" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477741 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efee2114-7d16-44d3-ad75-7224b8ae4077" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477747 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="efee2114-7d16-44d3-ad75-7224b8ae4077" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477802 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d41150-83f5-40f5-bb52-2be58b73a852" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.477809 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d41150-83f5-40f5-bb52-2be58b73a852" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.478215 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9f2d89e-5413-416f-a84a-43a5cc05bbfa" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.478235 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="114c5991-4a9a-484f-88a9-ba1a07b4c6ca" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.478252 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="59d41150-83f5-40f5-bb52-2be58b73a852" containerName="mariadb-database-create" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.478267 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="efee2114-7d16-44d3-ad75-7224b8ae4077" containerName="mariadb-account-create-update" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.504063 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.504208 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.508723 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-629pv\"" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.509024 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.509175 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.515141 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595189 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595265 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzhjg\" (UniqueName: \"kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595906 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.595980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.697883 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.697946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.697978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.698016 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzhjg\" (UniqueName: \"kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.698094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.698117 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.698154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.698936 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.699295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.699958 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.705546 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.712351 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.713592 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzhjg\" (UniqueName: \"kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.719019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:31 crc kubenswrapper[5030]: I0316 13:28:31.834759 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.214158 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p82l8"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.219239 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.220761 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p82l8"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.221292 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.243940 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.294934 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-zlgxh"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.299991 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-zlgxh"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.300122 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.307311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp8wl\" (UniqueName: \"kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.307515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.361603 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerStarted","Data":"06d5a3b84b9b8d691ed8a5eb595dcd5772d9008f25a74f03fd67b54278610f7e"} Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.396148 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-e762-account-create-update-7d5js"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.402936 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.404787 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-e762-account-create-update-7d5js"] Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.406851 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.409181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.409325 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.409362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp8wl\" (UniqueName: \"kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.409625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czn8p\" (UniqueName: \"kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.410344 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.427960 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp8wl\" (UniqueName: \"kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl\") pod \"root-account-create-update-p82l8\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.512256 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.512330 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czn8p\" (UniqueName: \"kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.512478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.512587 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55h4\" (UniqueName: \"kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.515072 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.527251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czn8p\" (UniqueName: \"kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p\") pod \"glance-db-create-zlgxh\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.536275 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.615154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d55h4\" (UniqueName: \"kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.615335 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.616098 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.616260 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.633492 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55h4\" (UniqueName: \"kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4\") pod \"glance-e762-account-create-update-7d5js\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.726988 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:32 crc kubenswrapper[5030]: I0316 13:28:32.943830 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p82l8"] Mar 16 13:28:33 crc kubenswrapper[5030]: W0316 13:28:33.056285 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f469802_ea7b_408f_8672_5daef83c9050.slice/crio-1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7 WatchSource:0}: Error finding container 1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7: Status 404 returned error can't find the container with id 1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7 Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.060366 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-zlgxh"] Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.124089 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-e762-account-create-update-7d5js"] Mar 16 13:28:33 crc kubenswrapper[5030]: W0316 13:28:33.133630 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d9438a4_2e25_4af1_bc80_3ce36b537d95.slice/crio-18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99 WatchSource:0}: Error finding container 18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99: Status 404 returned error can't find the container with id 18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99 Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.377328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerStarted","Data":"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.377398 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerStarted","Data":"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.377424 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.379358 5030 generic.go:358] "Generic (PLEG): container finished" podID="b4fa04f0-6db8-4c7c-9971-dd427b7f6716" containerID="7d9b8557c1cf6d6e55cb6d230982e95de1ba974ea529c3e0592b3b07ca95cc80" exitCode=0 Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.379432 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-p82l8" event={"ID":"b4fa04f0-6db8-4c7c-9971-dd427b7f6716","Type":"ContainerDied","Data":"7d9b8557c1cf6d6e55cb6d230982e95de1ba974ea529c3e0592b3b07ca95cc80"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.379505 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-p82l8" event={"ID":"b4fa04f0-6db8-4c7c-9971-dd427b7f6716","Type":"ContainerStarted","Data":"8b83d45629b95c1b5cfeeb85f6154ba3c5348369aa7a5913071334b2f9e839bf"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.381447 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" event={"ID":"5d9438a4-2e25-4af1-bc80-3ce36b537d95","Type":"ContainerStarted","Data":"bf826ed251cedfbbf2070a9a54a4adb54b938da2e06234e9fa2c1171b9ce54f9"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.381474 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" event={"ID":"5d9438a4-2e25-4af1-bc80-3ce36b537d95","Type":"ContainerStarted","Data":"18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.383164 5030 generic.go:358] "Generic (PLEG): container finished" podID="5f469802-ea7b-408f-8672-5daef83c9050" containerID="b48a5aded88db64f8f3afe32b970eca6e240e709467374559e974ae943372a67" exitCode=0 Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.383274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-zlgxh" event={"ID":"5f469802-ea7b-408f-8672-5daef83c9050","Type":"ContainerDied","Data":"b48a5aded88db64f8f3afe32b970eca6e240e709467374559e974ae943372a67"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.383336 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-zlgxh" event={"ID":"5f469802-ea7b-408f-8672-5daef83c9050","Type":"ContainerStarted","Data":"1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7"} Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.403068 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.403056008 podStartE2EDuration="2.403056008s" podCreationTimestamp="2026-03-16 13:28:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:33.39541486 +0000 UTC m=+1357.794727407" watchObservedRunningTime="2026-03-16 13:28:33.403056008 +0000 UTC m=+1357.802368556" Mar 16 13:28:33 crc kubenswrapper[5030]: I0316 13:28:33.417177 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" podStartSLOduration=1.417166585 podStartE2EDuration="1.417166585s" podCreationTimestamp="2026-03-16 13:28:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:33.415434908 +0000 UTC m=+1357.814747456" watchObservedRunningTime="2026-03-16 13:28:33.417166585 +0000 UTC m=+1357.816479132" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.394856 5030 generic.go:358] "Generic (PLEG): container finished" podID="5d9438a4-2e25-4af1-bc80-3ce36b537d95" containerID="bf826ed251cedfbbf2070a9a54a4adb54b938da2e06234e9fa2c1171b9ce54f9" exitCode=0 Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.395083 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" event={"ID":"5d9438a4-2e25-4af1-bc80-3ce36b537d95","Type":"ContainerDied","Data":"bf826ed251cedfbbf2070a9a54a4adb54b938da2e06234e9fa2c1171b9ce54f9"} Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.397458 5030 generic.go:358] "Generic (PLEG): container finished" podID="84f827ba-f56b-44db-bbe7-edee2f1dc11f" containerID="0597c268c505829fc3b9e804a1d5a9fd4f8e47ef5ca53026cc892559b2600716" exitCode=0 Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.398912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" event={"ID":"84f827ba-f56b-44db-bbe7-edee2f1dc11f","Type":"ContainerDied","Data":"0597c268c505829fc3b9e804a1d5a9fd4f8e47ef5ca53026cc892559b2600716"} Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.801955 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.807193 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.864286 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp8wl\" (UniqueName: \"kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl\") pod \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.864371 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czn8p\" (UniqueName: \"kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p\") pod \"5f469802-ea7b-408f-8672-5daef83c9050\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.864392 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts\") pod \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\" (UID: \"b4fa04f0-6db8-4c7c-9971-dd427b7f6716\") " Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.864436 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts\") pod \"5f469802-ea7b-408f-8672-5daef83c9050\" (UID: \"5f469802-ea7b-408f-8672-5daef83c9050\") " Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.865290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5f469802-ea7b-408f-8672-5daef83c9050" (UID: "5f469802-ea7b-408f-8672-5daef83c9050"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.865363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b4fa04f0-6db8-4c7c-9971-dd427b7f6716" (UID: "b4fa04f0-6db8-4c7c-9971-dd427b7f6716"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.869866 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl" (OuterVolumeSpecName: "kube-api-access-fp8wl") pod "b4fa04f0-6db8-4c7c-9971-dd427b7f6716" (UID: "b4fa04f0-6db8-4c7c-9971-dd427b7f6716"). InnerVolumeSpecName "kube-api-access-fp8wl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.869966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p" (OuterVolumeSpecName: "kube-api-access-czn8p") pod "5f469802-ea7b-408f-8672-5daef83c9050" (UID: "5f469802-ea7b-408f-8672-5daef83c9050"). InnerVolumeSpecName "kube-api-access-czn8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.967101 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5f469802-ea7b-408f-8672-5daef83c9050-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.967135 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp8wl\" (UniqueName: \"kubernetes.io/projected/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-kube-api-access-fp8wl\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.967149 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czn8p\" (UniqueName: \"kubernetes.io/projected/5f469802-ea7b-408f-8672-5daef83c9050-kube-api-access-czn8p\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:34 crc kubenswrapper[5030]: I0316 13:28:34.967160 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4fa04f0-6db8-4c7c-9971-dd427b7f6716-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.270622 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.275425 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"swift-storage-0\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.409160 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-zlgxh" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.409144 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-zlgxh" event={"ID":"5f469802-ea7b-408f-8672-5daef83c9050","Type":"ContainerDied","Data":"1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7"} Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.409217 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1124702b0efe47db1e6eea72e5d0c30b3092b7cec778426ef91ed318127adbf7" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.411107 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-p82l8" event={"ID":"b4fa04f0-6db8-4c7c-9971-dd427b7f6716","Type":"ContainerDied","Data":"8b83d45629b95c1b5cfeeb85f6154ba3c5348369aa7a5913071334b2f9e839bf"} Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.411179 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b83d45629b95c1b5cfeeb85f6154ba3c5348369aa7a5913071334b2f9e839bf" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.411182 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-p82l8" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.543703 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.782079 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.793949 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880170 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880289 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880343 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d55h4\" (UniqueName: \"kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4\") pod \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880441 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts\") pod \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\" (UID: \"5d9438a4-2e25-4af1-bc80-3ce36b537d95\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880643 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880707 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8525\" (UniqueName: \"kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525\") pod \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\" (UID: \"84f827ba-f56b-44db-bbe7-edee2f1dc11f\") " Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.880844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.881614 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5d9438a4-2e25-4af1-bc80-3ce36b537d95" (UID: "5d9438a4-2e25-4af1-bc80-3ce36b537d95"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.882057 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5d9438a4-2e25-4af1-bc80-3ce36b537d95-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.882070 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.882771 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.886061 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4" (OuterVolumeSpecName: "kube-api-access-d55h4") pod "5d9438a4-2e25-4af1-bc80-3ce36b537d95" (UID: "5d9438a4-2e25-4af1-bc80-3ce36b537d95"). InnerVolumeSpecName "kube-api-access-d55h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.886919 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525" (OuterVolumeSpecName: "kube-api-access-c8525") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "kube-api-access-c8525". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.888691 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.898875 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts" (OuterVolumeSpecName: "scripts") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.899479 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.900842 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84f827ba-f56b-44db-bbe7-edee2f1dc11f" (UID: "84f827ba-f56b-44db-bbe7-edee2f1dc11f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.967964 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984303 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/84f827ba-f56b-44db-bbe7-edee2f1dc11f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984325 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984335 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984345 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/84f827ba-f56b-44db-bbe7-edee2f1dc11f-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984356 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8525\" (UniqueName: \"kubernetes.io/projected/84f827ba-f56b-44db-bbe7-edee2f1dc11f-kube-api-access-c8525\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984366 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/84f827ba-f56b-44db-bbe7-edee2f1dc11f-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:35 crc kubenswrapper[5030]: I0316 13:28:35.984374 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d55h4\" (UniqueName: \"kubernetes.io/projected/5d9438a4-2e25-4af1-bc80-3ce36b537d95-kube-api-access-d55h4\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.424379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" event={"ID":"5d9438a4-2e25-4af1-bc80-3ce36b537d95","Type":"ContainerDied","Data":"18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.425637 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18f97e98aa9d71f7adddc1e716e381b5821dc30df8b8b823c6abeb839c9f3c99" Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.425826 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-e762-account-create-update-7d5js" Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.430915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.431004 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.431035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.431046 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"3ddc1346770bc82396349a4f9a2677f8bcdb36122c663d242a47f1a78bb4e8ca"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.434410 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" event={"ID":"84f827ba-f56b-44db-bbe7-edee2f1dc11f","Type":"ContainerDied","Data":"a822d43f87bc2eca8cf2aa2e558a7b82b42565e25470d3b27588db98e3b13e7d"} Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.434454 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a822d43f87bc2eca8cf2aa2e558a7b82b42565e25470d3b27588db98e3b13e7d" Mar 16 13:28:36 crc kubenswrapper[5030]: I0316 13:28:36.434569 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-vprnh" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.469803 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470284 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470309 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470333 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470341 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.470349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d"} Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.552171 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sfkfl"] Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554098 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f469802-ea7b-408f-8672-5daef83c9050" containerName="mariadb-database-create" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554235 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f469802-ea7b-408f-8672-5daef83c9050" containerName="mariadb-database-create" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554318 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9438a4-2e25-4af1-bc80-3ce36b537d95" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554386 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9438a4-2e25-4af1-bc80-3ce36b537d95" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554471 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4fa04f0-6db8-4c7c-9971-dd427b7f6716" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554614 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4fa04f0-6db8-4c7c-9971-dd427b7f6716" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554687 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f827ba-f56b-44db-bbe7-edee2f1dc11f" containerName="swift-ring-rebalance" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554741 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f827ba-f56b-44db-bbe7-edee2f1dc11f" containerName="swift-ring-rebalance" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.554977 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4fa04f0-6db8-4c7c-9971-dd427b7f6716" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.555055 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5d9438a4-2e25-4af1-bc80-3ce36b537d95" containerName="mariadb-account-create-update" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.555112 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="84f827ba-f56b-44db-bbe7-edee2f1dc11f" containerName="swift-ring-rebalance" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.555171 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f469802-ea7b-408f-8672-5daef83c9050" containerName="mariadb-database-create" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.559934 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.563382 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9hzdd\"" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.563502 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.567964 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sfkfl"] Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.623779 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72wfl\" (UniqueName: \"kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.623872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.623912 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.623995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.732058 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72wfl\" (UniqueName: \"kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.732136 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.732171 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.732192 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.737359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.737495 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.745152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.746669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72wfl\" (UniqueName: \"kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl\") pod \"glance-db-sync-sfkfl\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:37 crc kubenswrapper[5030]: I0316 13:28:37.889388 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.337110 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sfkfl"] Mar 16 13:28:38 crc kubenswrapper[5030]: W0316 13:28:38.341476 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb7c4513_747f_481f_ae6e_4a81eba22639.slice/crio-99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc WatchSource:0}: Error finding container 99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc: Status 404 returned error can't find the container with id 99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.483320 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" event={"ID":"cb7c4513-747f-481f-ae6e-4a81eba22639","Type":"ContainerStarted","Data":"99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.495924 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.495971 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.495984 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.495994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.496003 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerStarted","Data":"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba"} Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.533793 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=11.53377167 podStartE2EDuration="11.53377167s" podCreationTimestamp="2026-03-16 13:28:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:38.524389215 +0000 UTC m=+1362.923701753" watchObservedRunningTime="2026-03-16 13:28:38.53377167 +0000 UTC m=+1362.933084217" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.647192 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.664808 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.667324 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.675397 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.684349 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p82l8"] Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.690509 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-p82l8"] Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.753461 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.753723 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.753792 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.753972 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9l6\" (UniqueName: \"kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.856065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9l6\" (UniqueName: \"kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.856338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.856524 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.856606 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.857514 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.857533 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.857908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.879782 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9l6\" (UniqueName: \"kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6\") pod \"dnsmasq-dnsmasq-58df95f9c7-kbs5g\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:38 crc kubenswrapper[5030]: I0316 13:28:38.985402 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:39 crc kubenswrapper[5030]: I0316 13:28:39.418921 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:28:39 crc kubenswrapper[5030]: I0316 13:28:39.507632 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" event={"ID":"cb7c4513-747f-481f-ae6e-4a81eba22639","Type":"ContainerStarted","Data":"1d59f1bf99ee76482798762a86345163ac0835f828b811fef21b5e3fed01c0f7"} Mar 16 13:28:39 crc kubenswrapper[5030]: I0316 13:28:39.511041 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" event={"ID":"fc10a42d-e0a1-473e-9a6e-aad88b2d8502","Type":"ContainerStarted","Data":"3a348039a73bd1474791f577dd6e6601508e1c148a6dff29807300ef2f997b4b"} Mar 16 13:28:39 crc kubenswrapper[5030]: I0316 13:28:39.526797 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" podStartSLOduration=2.526788398 podStartE2EDuration="2.526788398s" podCreationTimestamp="2026-03-16 13:28:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:39.520598598 +0000 UTC m=+1363.919911146" watchObservedRunningTime="2026-03-16 13:28:39.526788398 +0000 UTC m=+1363.926100945" Mar 16 13:28:39 crc kubenswrapper[5030]: I0316 13:28:39.959471 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4fa04f0-6db8-4c7c-9971-dd427b7f6716" path="/var/lib/kubelet/pods/b4fa04f0-6db8-4c7c-9971-dd427b7f6716/volumes" Mar 16 13:28:40 crc kubenswrapper[5030]: I0316 13:28:40.520124 5030 generic.go:358] "Generic (PLEG): container finished" podID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerID="2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750" exitCode=0 Mar 16 13:28:40 crc kubenswrapper[5030]: I0316 13:28:40.521490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" event={"ID":"fc10a42d-e0a1-473e-9a6e-aad88b2d8502","Type":"ContainerDied","Data":"2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750"} Mar 16 13:28:41 crc kubenswrapper[5030]: I0316 13:28:41.534794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" event={"ID":"fc10a42d-e0a1-473e-9a6e-aad88b2d8502","Type":"ContainerStarted","Data":"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900"} Mar 16 13:28:41 crc kubenswrapper[5030]: I0316 13:28:41.537289 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb7c4513-747f-481f-ae6e-4a81eba22639" containerID="1d59f1bf99ee76482798762a86345163ac0835f828b811fef21b5e3fed01c0f7" exitCode=0 Mar 16 13:28:41 crc kubenswrapper[5030]: I0316 13:28:41.537537 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" event={"ID":"cb7c4513-747f-481f-ae6e-4a81eba22639","Type":"ContainerDied","Data":"1d59f1bf99ee76482798762a86345163ac0835f828b811fef21b5e3fed01c0f7"} Mar 16 13:28:41 crc kubenswrapper[5030]: I0316 13:28:41.559497 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" podStartSLOduration=3.559483976 podStartE2EDuration="3.559483976s" podCreationTimestamp="2026-03-16 13:28:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:41.553354843 +0000 UTC m=+1365.952667390" watchObservedRunningTime="2026-03-16 13:28:41.559483976 +0000 UTC m=+1365.958796524" Mar 16 13:28:42 crc kubenswrapper[5030]: I0316 13:28:42.546652 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:42 crc kubenswrapper[5030]: I0316 13:28:42.884991 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.040322 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data\") pod \"cb7c4513-747f-481f-ae6e-4a81eba22639\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.040381 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72wfl\" (UniqueName: \"kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl\") pod \"cb7c4513-747f-481f-ae6e-4a81eba22639\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.040420 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle\") pod \"cb7c4513-747f-481f-ae6e-4a81eba22639\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.040454 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data\") pod \"cb7c4513-747f-481f-ae6e-4a81eba22639\" (UID: \"cb7c4513-747f-481f-ae6e-4a81eba22639\") " Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.048049 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "cb7c4513-747f-481f-ae6e-4a81eba22639" (UID: "cb7c4513-747f-481f-ae6e-4a81eba22639"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.048441 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl" (OuterVolumeSpecName: "kube-api-access-72wfl") pod "cb7c4513-747f-481f-ae6e-4a81eba22639" (UID: "cb7c4513-747f-481f-ae6e-4a81eba22639"). InnerVolumeSpecName "kube-api-access-72wfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.068905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb7c4513-747f-481f-ae6e-4a81eba22639" (UID: "cb7c4513-747f-481f-ae6e-4a81eba22639"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.084224 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data" (OuterVolumeSpecName: "config-data") pod "cb7c4513-747f-481f-ae6e-4a81eba22639" (UID: "cb7c4513-747f-481f-ae6e-4a81eba22639"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.143207 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.143242 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.143254 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb7c4513-747f-481f-ae6e-4a81eba22639-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.143265 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72wfl\" (UniqueName: \"kubernetes.io/projected/cb7c4513-747f-481f-ae6e-4a81eba22639-kube-api-access-72wfl\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.559486 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.559495 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-sfkfl" event={"ID":"cb7c4513-747f-481f-ae6e-4a81eba22639","Type":"ContainerDied","Data":"99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc"} Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.559547 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99015758a7fe7a4d156569d175c65c9c349a00e895f6c42b83c8f9ca04fa32cc" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.740408 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-2kkdg"] Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.758954 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb7c4513-747f-481f-ae6e-4a81eba22639" containerName="glance-db-sync" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.758993 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb7c4513-747f-481f-ae6e-4a81eba22639" containerName="glance-db-sync" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.759322 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb7c4513-747f-481f-ae6e-4a81eba22639" containerName="glance-db-sync" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.765413 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-2kkdg"] Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.765569 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.772263 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.862801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.862866 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fwr8\" (UniqueName: \"kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.964908 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.964969 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fwr8\" (UniqueName: \"kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.965670 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:43 crc kubenswrapper[5030]: I0316 13:28:43.980352 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fwr8\" (UniqueName: \"kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8\") pod \"root-account-create-update-2kkdg\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.089930 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.454347 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:28:44 crc kubenswrapper[5030]: W0316 13:28:44.513870 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22e9cb31_8a02_4def_a045_e677b45035bb.slice/crio-ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287 WatchSource:0}: Error finding container ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287: Status 404 returned error can't find the container with id ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287 Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.521658 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-2kkdg"] Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.570238 5030 generic.go:358] "Generic (PLEG): container finished" podID="0058e628-e03b-4086-806e-da6878e1539f" containerID="dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4" exitCode=0 Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.570324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerDied","Data":"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4"} Mar 16 13:28:44 crc kubenswrapper[5030]: I0316 13:28:44.571893 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" event={"ID":"22e9cb31-8a02-4def-a045-e677b45035bb","Type":"ContainerStarted","Data":"ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287"} Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.583827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerStarted","Data":"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463"} Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.584416 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.585963 5030 generic.go:358] "Generic (PLEG): container finished" podID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerID="5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46" exitCode=0 Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.586029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerDied","Data":"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46"} Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.587989 5030 generic.go:358] "Generic (PLEG): container finished" podID="22e9cb31-8a02-4def-a045-e677b45035bb" containerID="a4420e6d592e293197b23276322e1cbb924faedc68f713ebc378f61736200726" exitCode=0 Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.588045 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" event={"ID":"22e9cb31-8a02-4def-a045-e677b45035bb","Type":"ContainerDied","Data":"a4420e6d592e293197b23276322e1cbb924faedc68f713ebc378f61736200726"} Mar 16 13:28:45 crc kubenswrapper[5030]: I0316 13:28:45.685371 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=35.685351216 podStartE2EDuration="35.685351216s" podCreationTimestamp="2026-03-16 13:28:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:45.647999896 +0000 UTC m=+1370.047312443" watchObservedRunningTime="2026-03-16 13:28:45.685351216 +0000 UTC m=+1370.084663753" Mar 16 13:28:46 crc kubenswrapper[5030]: I0316 13:28:46.601121 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerStarted","Data":"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737"} Mar 16 13:28:46 crc kubenswrapper[5030]: I0316 13:28:46.622289 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.62226483 podStartE2EDuration="36.62226483s" podCreationTimestamp="2026-03-16 13:28:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:46.620841855 +0000 UTC m=+1371.020154402" watchObservedRunningTime="2026-03-16 13:28:46.62226483 +0000 UTC m=+1371.021577377" Mar 16 13:28:46 crc kubenswrapper[5030]: I0316 13:28:46.937496 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.042387 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fwr8\" (UniqueName: \"kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8\") pod \"22e9cb31-8a02-4def-a045-e677b45035bb\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.042448 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts\") pod \"22e9cb31-8a02-4def-a045-e677b45035bb\" (UID: \"22e9cb31-8a02-4def-a045-e677b45035bb\") " Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.043246 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "22e9cb31-8a02-4def-a045-e677b45035bb" (UID: "22e9cb31-8a02-4def-a045-e677b45035bb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.044290 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22e9cb31-8a02-4def-a045-e677b45035bb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.053777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8" (OuterVolumeSpecName: "kube-api-access-5fwr8") pod "22e9cb31-8a02-4def-a045-e677b45035bb" (UID: "22e9cb31-8a02-4def-a045-e677b45035bb"). InnerVolumeSpecName "kube-api-access-5fwr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.146414 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fwr8\" (UniqueName: \"kubernetes.io/projected/22e9cb31-8a02-4def-a045-e677b45035bb-kube-api-access-5fwr8\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.616231 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.616244 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-2kkdg" event={"ID":"22e9cb31-8a02-4def-a045-e677b45035bb","Type":"ContainerDied","Data":"ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287"} Mar 16 13:28:47 crc kubenswrapper[5030]: I0316 13:28:47.616299 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff368d1ba8e17046a9f826cbb1974e61301823efd596ca14316ed741d5cff287" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.013796 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.015203 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9cb31-8a02-4def-a045-e677b45035bb" containerName="mariadb-account-create-update" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.015231 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9cb31-8a02-4def-a045-e677b45035bb" containerName="mariadb-account-create-update" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.015417 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="22e9cb31-8a02-4def-a045-e677b45035bb" containerName="mariadb-account-create-update" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.021999 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.036756 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.168430 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlcz\" (UniqueName: \"kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.168482 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.168535 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.271486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.271807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlcz\" (UniqueName: \"kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.271884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.272164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.272405 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.294313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlcz\" (UniqueName: \"kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz\") pod \"redhat-operators-v47bf\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.341659 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.564202 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.627600 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.627836 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="dnsmasq-dns" containerID="cri-o://44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821" gracePeriod=10 Mar 16 13:28:48 crc kubenswrapper[5030]: I0316 13:28:48.788454 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.057204 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.195248 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config\") pod \"5a619a5a-bdae-49d7-8418-df6059986198\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.195303 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7lg5\" (UniqueName: \"kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5\") pod \"5a619a5a-bdae-49d7-8418-df6059986198\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.195596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc\") pod \"5a619a5a-bdae-49d7-8418-df6059986198\" (UID: \"5a619a5a-bdae-49d7-8418-df6059986198\") " Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.204444 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5" (OuterVolumeSpecName: "kube-api-access-j7lg5") pod "5a619a5a-bdae-49d7-8418-df6059986198" (UID: "5a619a5a-bdae-49d7-8418-df6059986198"). InnerVolumeSpecName "kube-api-access-j7lg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.229174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config" (OuterVolumeSpecName: "config") pod "5a619a5a-bdae-49d7-8418-df6059986198" (UID: "5a619a5a-bdae-49d7-8418-df6059986198"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.229251 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "5a619a5a-bdae-49d7-8418-df6059986198" (UID: "5a619a5a-bdae-49d7-8418-df6059986198"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.299852 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.299889 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7lg5\" (UniqueName: \"kubernetes.io/projected/5a619a5a-bdae-49d7-8418-df6059986198-kube-api-access-j7lg5\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.299902 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/5a619a5a-bdae-49d7-8418-df6059986198-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.648622 5030 generic.go:358] "Generic (PLEG): container finished" podID="5a619a5a-bdae-49d7-8418-df6059986198" containerID="44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821" exitCode=0 Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.648732 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" event={"ID":"5a619a5a-bdae-49d7-8418-df6059986198","Type":"ContainerDied","Data":"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821"} Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.649226 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" event={"ID":"5a619a5a-bdae-49d7-8418-df6059986198","Type":"ContainerDied","Data":"5156a3f1add02743927311c8cc70b2dbe2c4d709d788c0cfd6fd967cae4a1bac"} Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.648757 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.649269 5030 scope.go:117] "RemoveContainer" containerID="44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.652367 5030 generic.go:358] "Generic (PLEG): container finished" podID="10be7381-68f9-4c79-a736-f9def759753e" containerID="f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610" exitCode=0 Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.652865 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerDied","Data":"f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610"} Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.652914 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerStarted","Data":"e6769397cad96903d0e4dce54c6989b0df5563b1a4a7f7bddca7bb3f5a5d783f"} Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.676318 5030 scope.go:117] "RemoveContainer" containerID="47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.697193 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.712309 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2st7l"] Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.722712 5030 scope.go:117] "RemoveContainer" containerID="44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821" Mar 16 13:28:49 crc kubenswrapper[5030]: E0316 13:28:49.723136 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821\": container with ID starting with 44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821 not found: ID does not exist" containerID="44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.723167 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821"} err="failed to get container status \"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821\": rpc error: code = NotFound desc = could not find container \"44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821\": container with ID starting with 44e6a8e4bc8b8209a91d96eac342743a4dd9549f7887c90da723ed2f67244821 not found: ID does not exist" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.723191 5030 scope.go:117] "RemoveContainer" containerID="47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2" Mar 16 13:28:49 crc kubenswrapper[5030]: E0316 13:28:49.723634 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2\": container with ID starting with 47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2 not found: ID does not exist" containerID="47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.723682 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2"} err="failed to get container status \"47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2\": rpc error: code = NotFound desc = could not find container \"47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2\": container with ID starting with 47d1f87c1d5020f82c5dff58d8dea44c0c4e7a4cdd3c8f71403e2b006f3d5db2 not found: ID does not exist" Mar 16 13:28:49 crc kubenswrapper[5030]: I0316 13:28:49.956463 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a619a5a-bdae-49d7-8418-df6059986198" path="/var/lib/kubelet/pods/5a619a5a-bdae-49d7-8418-df6059986198/volumes" Mar 16 13:28:51 crc kubenswrapper[5030]: I0316 13:28:51.678279 5030 generic.go:358] "Generic (PLEG): container finished" podID="10be7381-68f9-4c79-a736-f9def759753e" containerID="59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7" exitCode=0 Mar 16 13:28:51 crc kubenswrapper[5030]: I0316 13:28:51.678565 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerDied","Data":"59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7"} Mar 16 13:28:52 crc kubenswrapper[5030]: I0316 13:28:52.692452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerStarted","Data":"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9"} Mar 16 13:28:52 crc kubenswrapper[5030]: I0316 13:28:52.717383 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-v47bf" podStartSLOduration=4.818503099 podStartE2EDuration="5.717364325s" podCreationTimestamp="2026-03-16 13:28:47 +0000 UTC" firstStartedPulling="2026-03-16 13:28:49.653527384 +0000 UTC m=+1374.052839931" lastFinishedPulling="2026-03-16 13:28:50.55238861 +0000 UTC m=+1374.951701157" observedRunningTime="2026-03-16 13:28:52.715676662 +0000 UTC m=+1377.114989208" watchObservedRunningTime="2026-03-16 13:28:52.717364325 +0000 UTC m=+1377.116676872" Mar 16 13:28:53 crc kubenswrapper[5030]: E0316 13:28:53.626967 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1407693 actualBytes=10240 Mar 16 13:28:54 crc kubenswrapper[5030]: I0316 13:28:54.286972 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:28:54 crc kubenswrapper[5030]: I0316 13:28:54.287121 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.601598 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.605000 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.606913 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.851514 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tfzcb"] Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.852352 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="dnsmasq-dns" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.852373 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="dnsmasq-dns" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.852389 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="init" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.852394 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="init" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.852592 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a619a5a-bdae-49d7-8418-df6059986198" containerName="dnsmasq-dns" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.857470 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.875201 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tfzcb"] Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.953623 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25skh\" (UniqueName: \"kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.953716 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.958744 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-w28zr"] Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.963776 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.965382 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:28:56 crc kubenswrapper[5030]: I0316 13:28:56.971833 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-w28zr"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.044843 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-tzkn4"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.052164 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.052590 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.055846 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25skh\" (UniqueName: \"kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.055964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f585m\" (UniqueName: \"kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.056005 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.056108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.056815 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.056818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.059389 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-tzkn4"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.059476 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.077760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25skh\" (UniqueName: \"kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh\") pod \"cinder-db-create-tfzcb\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.078461 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.144048 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6n5jr"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.147882 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.151600 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157210 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157232 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjdw\" (UniqueName: \"kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157298 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157324 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djrb\" (UniqueName: \"kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f585m\" (UniqueName: \"kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.157440 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.158073 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.158912 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.159893 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6n5jr"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.177937 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.179768 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.246077 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f585m\" (UniqueName: \"kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m\") pod \"barbican-a165-account-create-update-w28zr\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259574 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjdw\" (UniqueName: \"kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259634 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgx7w\" (UniqueName: \"kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259793 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6djrb\" (UniqueName: \"kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.259989 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.260008 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65x85\" (UniqueName: \"kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.261021 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.261689 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.277234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djrb\" (UniqueName: \"kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb\") pod \"neutron-db-create-tzkn4\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.279290 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjdw\" (UniqueName: \"kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw\") pod \"neutron-cf3f-account-create-update-nfsvg\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.281007 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8pg2v"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.283137 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.287130 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.293840 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8pg2v"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.300973 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.301009 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.301300 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.301697 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-j667m\"" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mp5s\" (UniqueName: \"kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363504 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363536 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65x85\" (UniqueName: \"kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363584 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363626 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.363668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgx7w\" (UniqueName: \"kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.364799 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.365447 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.370880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.378672 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.380606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65x85\" (UniqueName: \"kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85\") pod \"cinder-f67f-account-create-update-t8l7b\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.382255 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgx7w\" (UniqueName: \"kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w\") pod \"barbican-db-create-6n5jr\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.466358 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.467085 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.467403 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mp5s\" (UniqueName: \"kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.467735 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.473102 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.477212 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.479943 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.483184 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mp5s\" (UniqueName: \"kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s\") pod \"keystone-db-sync-8pg2v\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.641339 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.649920 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tfzcb"] Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.703773 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-w28zr"] Mar 16 13:28:57 crc kubenswrapper[5030]: W0316 13:28:57.720520 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc90587f_7ae0_4ee8_836d_433aca0e7f65.slice/crio-33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345 WatchSource:0}: Error finding container 33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345: Status 404 returned error can't find the container with id 33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345 Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.755693 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" event={"ID":"cc90587f-7ae0-4ee8-836d-433aca0e7f65","Type":"ContainerStarted","Data":"33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345"} Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.763171 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" event={"ID":"e05c082d-aba5-46a8-aa3f-c411583939bc","Type":"ContainerStarted","Data":"c4a402d5515b1457ff930241a4e39811f00cdc7bdba80559ff09d10fcc82d7e1"} Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.827169 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-tzkn4"] Mar 16 13:28:57 crc kubenswrapper[5030]: W0316 13:28:57.917690 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb36a14c_9dff_4400_90b6_91f3089ea6bd.slice/crio-d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e WatchSource:0}: Error finding container d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e: Status 404 returned error can't find the container with id d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e Mar 16 13:28:57 crc kubenswrapper[5030]: I0316 13:28:57.918183 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg"] Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.004293 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6n5jr"] Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.011097 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b"] Mar 16 13:28:58 crc kubenswrapper[5030]: W0316 13:28:58.022295 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4eb3d6a_bc6a_4042_a238_0de6589f3da6.slice/crio-7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616 WatchSource:0}: Error finding container 7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616: Status 404 returned error can't find the container with id 7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.150753 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8pg2v"] Mar 16 13:28:58 crc kubenswrapper[5030]: W0316 13:28:58.152820 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c097fbf_7f83_43b0_a8c0_bb0e0399b2af.slice/crio-a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f WatchSource:0}: Error finding container a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f: Status 404 returned error can't find the container with id a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.342025 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.342344 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.385176 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.773384 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" event={"ID":"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af","Type":"ContainerStarted","Data":"ba77909881a2affc2b7fc8d2fe68ef686fa09ef811a6fbcb3ef5a1621b99757a"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.773441 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" event={"ID":"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af","Type":"ContainerStarted","Data":"a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.776257 5030 generic.go:358] "Generic (PLEG): container finished" podID="fc8a05b9-b460-45ec-9689-d0e34f761e9f" containerID="29fec4cc4a0f107fe6a63bab372f01d7bc5d94eef061b196724414ddd0428d71" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.776501 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" event={"ID":"fc8a05b9-b460-45ec-9689-d0e34f761e9f","Type":"ContainerDied","Data":"29fec4cc4a0f107fe6a63bab372f01d7bc5d94eef061b196724414ddd0428d71"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.776571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" event={"ID":"fc8a05b9-b460-45ec-9689-d0e34f761e9f","Type":"ContainerStarted","Data":"40eb7c65121b311868bbca07eda1458761d12165544e82519714cc1924cd7528"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.779199 5030 generic.go:358] "Generic (PLEG): container finished" podID="cc90587f-7ae0-4ee8-836d-433aca0e7f65" containerID="560f1c7534b3e927b727f758c05ed8d3154f10f75eb82188447d0163dd95be18" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.779287 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" event={"ID":"cc90587f-7ae0-4ee8-836d-433aca0e7f65","Type":"ContainerDied","Data":"560f1c7534b3e927b727f758c05ed8d3154f10f75eb82188447d0163dd95be18"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.780691 5030 generic.go:358] "Generic (PLEG): container finished" podID="d72dcff8-fe6d-44b2-8268-704269965202" containerID="4e838a0f76bffc3adf9872617ad9d3573fc04847c0ab0477d610c2558ee9c128" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.780772 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" event={"ID":"d72dcff8-fe6d-44b2-8268-704269965202","Type":"ContainerDied","Data":"4e838a0f76bffc3adf9872617ad9d3573fc04847c0ab0477d610c2558ee9c128"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.780795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" event={"ID":"d72dcff8-fe6d-44b2-8268-704269965202","Type":"ContainerStarted","Data":"50bad0f55b50642739c6e0baa862367cbedf21b0419587dddf22aeb1e78b7846"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.782306 5030 generic.go:358] "Generic (PLEG): container finished" podID="e05c082d-aba5-46a8-aa3f-c411583939bc" containerID="aafaab0234ba26854e3807e885f5ee1d8f39c9d254749932ea0bca5ce1850443" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.782433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" event={"ID":"e05c082d-aba5-46a8-aa3f-c411583939bc","Type":"ContainerDied","Data":"aafaab0234ba26854e3807e885f5ee1d8f39c9d254749932ea0bca5ce1850443"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.783648 5030 generic.go:358] "Generic (PLEG): container finished" podID="b4eb3d6a-bc6a-4042-a238-0de6589f3da6" containerID="5d79cb0f03f129542bf7e59637521e0f7fd02be5c586536a2b4a61f050223f43" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.783698 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" event={"ID":"b4eb3d6a-bc6a-4042-a238-0de6589f3da6","Type":"ContainerDied","Data":"5d79cb0f03f129542bf7e59637521e0f7fd02be5c586536a2b4a61f050223f43"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.783716 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" event={"ID":"b4eb3d6a-bc6a-4042-a238-0de6589f3da6","Type":"ContainerStarted","Data":"7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.784823 5030 generic.go:358] "Generic (PLEG): container finished" podID="fb36a14c-9dff-4400-90b6-91f3089ea6bd" containerID="8da5f76655a4d15504bca4555d4ab03c63f1e5902ddf415b149676c5f285aed5" exitCode=0 Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.785366 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" event={"ID":"fb36a14c-9dff-4400-90b6-91f3089ea6bd","Type":"ContainerDied","Data":"8da5f76655a4d15504bca4555d4ab03c63f1e5902ddf415b149676c5f285aed5"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.785393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" event={"ID":"fb36a14c-9dff-4400-90b6-91f3089ea6bd","Type":"ContainerStarted","Data":"d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e"} Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.796732 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" podStartSLOduration=1.79672085 podStartE2EDuration="1.79672085s" podCreationTimestamp="2026-03-16 13:28:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:28:58.78664279 +0000 UTC m=+1383.185955337" watchObservedRunningTime="2026-03-16 13:28:58.79672085 +0000 UTC m=+1383.196033397" Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.822435 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:28:58 crc kubenswrapper[5030]: I0316 13:28:58.946165 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.152299 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.232804 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts\") pod \"d72dcff8-fe6d-44b2-8268-704269965202\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.233211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgx7w\" (UniqueName: \"kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w\") pod \"d72dcff8-fe6d-44b2-8268-704269965202\" (UID: \"d72dcff8-fe6d-44b2-8268-704269965202\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.233295 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d72dcff8-fe6d-44b2-8268-704269965202" (UID: "d72dcff8-fe6d-44b2-8268-704269965202"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.234542 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d72dcff8-fe6d-44b2-8268-704269965202-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.248129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w" (OuterVolumeSpecName: "kube-api-access-lgx7w") pod "d72dcff8-fe6d-44b2-8268-704269965202" (UID: "d72dcff8-fe6d-44b2-8268-704269965202"). InnerVolumeSpecName "kube-api-access-lgx7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.315175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.320483 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.329002 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.337235 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgx7w\" (UniqueName: \"kubernetes.io/projected/d72dcff8-fe6d-44b2-8268-704269965202-kube-api-access-lgx7w\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.344286 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.360505 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.438483 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65x85\" (UniqueName: \"kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85\") pod \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.438714 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts\") pod \"e05c082d-aba5-46a8-aa3f-c411583939bc\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.438750 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpjdw\" (UniqueName: \"kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw\") pod \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.438988 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25skh\" (UniqueName: \"kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh\") pod \"e05c082d-aba5-46a8-aa3f-c411583939bc\" (UID: \"e05c082d-aba5-46a8-aa3f-c411583939bc\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439039 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts\") pod \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\" (UID: \"b4eb3d6a-bc6a-4042-a238-0de6589f3da6\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439115 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts\") pod \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439173 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6djrb\" (UniqueName: \"kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb\") pod \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\" (UID: \"fc8a05b9-b460-45ec-9689-d0e34f761e9f\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f585m\" (UniqueName: \"kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m\") pod \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439240 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts\") pod \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\" (UID: \"fb36a14c-9dff-4400-90b6-91f3089ea6bd\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439387 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts\") pod \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\" (UID: \"cc90587f-7ae0-4ee8-836d-433aca0e7f65\") " Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439526 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e05c082d-aba5-46a8-aa3f-c411583939bc" (UID: "e05c082d-aba5-46a8-aa3f-c411583939bc"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439808 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e05c082d-aba5-46a8-aa3f-c411583939bc-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.439948 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b4eb3d6a-bc6a-4042-a238-0de6589f3da6" (UID: "b4eb3d6a-bc6a-4042-a238-0de6589f3da6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.440486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fc8a05b9-b460-45ec-9689-d0e34f761e9f" (UID: "fc8a05b9-b460-45ec-9689-d0e34f761e9f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.440502 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cc90587f-7ae0-4ee8-836d-433aca0e7f65" (UID: "cc90587f-7ae0-4ee8-836d-433aca0e7f65"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.440638 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fb36a14c-9dff-4400-90b6-91f3089ea6bd" (UID: "fb36a14c-9dff-4400-90b6-91f3089ea6bd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.444840 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb" (OuterVolumeSpecName: "kube-api-access-6djrb") pod "fc8a05b9-b460-45ec-9689-d0e34f761e9f" (UID: "fc8a05b9-b460-45ec-9689-d0e34f761e9f"). InnerVolumeSpecName "kube-api-access-6djrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.444881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh" (OuterVolumeSpecName: "kube-api-access-25skh") pod "e05c082d-aba5-46a8-aa3f-c411583939bc" (UID: "e05c082d-aba5-46a8-aa3f-c411583939bc"). InnerVolumeSpecName "kube-api-access-25skh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.444966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw" (OuterVolumeSpecName: "kube-api-access-bpjdw") pod "fb36a14c-9dff-4400-90b6-91f3089ea6bd" (UID: "fb36a14c-9dff-4400-90b6-91f3089ea6bd"). InnerVolumeSpecName "kube-api-access-bpjdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.445144 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85" (OuterVolumeSpecName: "kube-api-access-65x85") pod "b4eb3d6a-bc6a-4042-a238-0de6589f3da6" (UID: "b4eb3d6a-bc6a-4042-a238-0de6589f3da6"). InnerVolumeSpecName "kube-api-access-65x85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.445341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m" (OuterVolumeSpecName: "kube-api-access-f585m") pod "cc90587f-7ae0-4ee8-836d-433aca0e7f65" (UID: "cc90587f-7ae0-4ee8-836d-433aca0e7f65"). InnerVolumeSpecName "kube-api-access-f585m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541737 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25skh\" (UniqueName: \"kubernetes.io/projected/e05c082d-aba5-46a8-aa3f-c411583939bc-kube-api-access-25skh\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541774 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541784 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fc8a05b9-b460-45ec-9689-d0e34f761e9f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541795 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6djrb\" (UniqueName: \"kubernetes.io/projected/fc8a05b9-b460-45ec-9689-d0e34f761e9f-kube-api-access-6djrb\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541805 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f585m\" (UniqueName: \"kubernetes.io/projected/cc90587f-7ae0-4ee8-836d-433aca0e7f65-kube-api-access-f585m\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541815 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fb36a14c-9dff-4400-90b6-91f3089ea6bd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541826 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cc90587f-7ae0-4ee8-836d-433aca0e7f65-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541836 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65x85\" (UniqueName: \"kubernetes.io/projected/b4eb3d6a-bc6a-4042-a238-0de6589f3da6-kube-api-access-65x85\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.541846 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpjdw\" (UniqueName: \"kubernetes.io/projected/fb36a14c-9dff-4400-90b6-91f3089ea6bd-kube-api-access-bpjdw\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.809093 5030 generic.go:358] "Generic (PLEG): container finished" podID="8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" containerID="ba77909881a2affc2b7fc8d2fe68ef686fa09ef811a6fbcb3ef5a1621b99757a" exitCode=0 Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.809376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" event={"ID":"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af","Type":"ContainerDied","Data":"ba77909881a2affc2b7fc8d2fe68ef686fa09ef811a6fbcb3ef5a1621b99757a"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.811540 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.811592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-tzkn4" event={"ID":"fc8a05b9-b460-45ec-9689-d0e34f761e9f","Type":"ContainerDied","Data":"40eb7c65121b311868bbca07eda1458761d12165544e82519714cc1924cd7528"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.811646 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40eb7c65121b311868bbca07eda1458761d12165544e82519714cc1924cd7528" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.814290 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" event={"ID":"cc90587f-7ae0-4ee8-836d-433aca0e7f65","Type":"ContainerDied","Data":"33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.814352 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33c1ef11fa89a074c810c7cf704f6e61019633996dad18e6c1aad3bb932ae345" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.814290 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-w28zr" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.816508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.816679 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-6n5jr" event={"ID":"d72dcff8-fe6d-44b2-8268-704269965202","Type":"ContainerDied","Data":"50bad0f55b50642739c6e0baa862367cbedf21b0419587dddf22aeb1e78b7846"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.816724 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50bad0f55b50642739c6e0baa862367cbedf21b0419587dddf22aeb1e78b7846" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.818509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" event={"ID":"e05c082d-aba5-46a8-aa3f-c411583939bc","Type":"ContainerDied","Data":"c4a402d5515b1457ff930241a4e39811f00cdc7bdba80559ff09d10fcc82d7e1"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.818642 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4a402d5515b1457ff930241a4e39811f00cdc7bdba80559ff09d10fcc82d7e1" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.818541 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-tfzcb" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.821249 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" event={"ID":"b4eb3d6a-bc6a-4042-a238-0de6589f3da6","Type":"ContainerDied","Data":"7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.821287 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7866bfa74978dc06200420097f162881a6072b4591766ed247d8190a2ea26616" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.821262 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.827255 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.827314 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg" event={"ID":"fb36a14c-9dff-4400-90b6-91f3089ea6bd","Type":"ContainerDied","Data":"d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e"} Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.827345 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d113ee3076762090e01f4118bfdda437a4f47ea455f3efd56a0a328053c6c61e" Mar 16 13:29:00 crc kubenswrapper[5030]: I0316 13:29:00.827769 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-v47bf" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="registry-server" containerID="cri-o://409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9" gracePeriod=2 Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.271027 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.357414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqlcz\" (UniqueName: \"kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz\") pod \"10be7381-68f9-4c79-a736-f9def759753e\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.358572 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content\") pod \"10be7381-68f9-4c79-a736-f9def759753e\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.358965 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities\") pod \"10be7381-68f9-4c79-a736-f9def759753e\" (UID: \"10be7381-68f9-4c79-a736-f9def759753e\") " Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.360316 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities" (OuterVolumeSpecName: "utilities") pod "10be7381-68f9-4c79-a736-f9def759753e" (UID: "10be7381-68f9-4c79-a736-f9def759753e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.364240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz" (OuterVolumeSpecName: "kube-api-access-qqlcz") pod "10be7381-68f9-4c79-a736-f9def759753e" (UID: "10be7381-68f9-4c79-a736-f9def759753e"). InnerVolumeSpecName "kube-api-access-qqlcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.462581 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.462623 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqlcz\" (UniqueName: \"kubernetes.io/projected/10be7381-68f9-4c79-a736-f9def759753e-kube-api-access-qqlcz\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.842215 5030 generic.go:358] "Generic (PLEG): container finished" podID="10be7381-68f9-4c79-a736-f9def759753e" containerID="409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9" exitCode=0 Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.842322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerDied","Data":"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9"} Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.842375 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-v47bf" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.842437 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-v47bf" event={"ID":"10be7381-68f9-4c79-a736-f9def759753e","Type":"ContainerDied","Data":"e6769397cad96903d0e4dce54c6989b0df5563b1a4a7f7bddca7bb3f5a5d783f"} Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.842481 5030 scope.go:117] "RemoveContainer" containerID="409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.873722 5030 scope.go:117] "RemoveContainer" containerID="59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.896913 5030 scope.go:117] "RemoveContainer" containerID="f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.922157 5030 scope.go:117] "RemoveContainer" containerID="409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9" Mar 16 13:29:01 crc kubenswrapper[5030]: E0316 13:29:01.923848 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9\": container with ID starting with 409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9 not found: ID does not exist" containerID="409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.923977 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9"} err="failed to get container status \"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9\": rpc error: code = NotFound desc = could not find container \"409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9\": container with ID starting with 409b14cc4d56ffd72f30f90828ecbc9e89eb2148099d1681f351513585d420e9 not found: ID does not exist" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.924073 5030 scope.go:117] "RemoveContainer" containerID="59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7" Mar 16 13:29:01 crc kubenswrapper[5030]: E0316 13:29:01.925589 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7\": container with ID starting with 59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7 not found: ID does not exist" containerID="59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.925712 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7"} err="failed to get container status \"59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7\": rpc error: code = NotFound desc = could not find container \"59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7\": container with ID starting with 59751d00743a2e35ab01cde5409ed1195615836afa670c215fd01f8537edacf7 not found: ID does not exist" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.925795 5030 scope.go:117] "RemoveContainer" containerID="f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610" Mar 16 13:29:01 crc kubenswrapper[5030]: E0316 13:29:01.927406 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610\": container with ID starting with f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610 not found: ID does not exist" containerID="f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610" Mar 16 13:29:01 crc kubenswrapper[5030]: I0316 13:29:01.927456 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610"} err="failed to get container status \"f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610\": rpc error: code = NotFound desc = could not find container \"f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610\": container with ID starting with f0ab0219cd9def3f6fcc7278da118df41f39b3f846b56cb22fbd17edad8c1610 not found: ID does not exist" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.142043 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.276940 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle\") pod \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.277088 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data\") pod \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.277380 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mp5s\" (UniqueName: \"kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s\") pod \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\" (UID: \"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af\") " Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.283611 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s" (OuterVolumeSpecName: "kube-api-access-6mp5s") pod "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" (UID: "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af"). InnerVolumeSpecName "kube-api-access-6mp5s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.296419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" (UID: "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.307731 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data" (OuterVolumeSpecName: "config-data") pod "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" (UID: "8c097fbf-7f83-43b0-a8c0-bb0e0399b2af"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.380332 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.380374 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mp5s\" (UniqueName: \"kubernetes.io/projected/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-kube-api-access-6mp5s\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.380387 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.395086 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "10be7381-68f9-4c79-a736-f9def759753e" (UID: "10be7381-68f9-4c79-a736-f9def759753e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.482213 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/10be7381-68f9-4c79-a736-f9def759753e-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.484316 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.490396 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-v47bf"] Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.857005 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.857056 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-8pg2v" event={"ID":"8c097fbf-7f83-43b0-a8c0-bb0e0399b2af","Type":"ContainerDied","Data":"a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f"} Mar 16 13:29:02 crc kubenswrapper[5030]: I0316 13:29:02.857102 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1cb63abefe50dcc963ee3dc3e220f015f3fe16545897bd7262bb98a508b446f" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.076756 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpb8"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079515 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4eb3d6a-bc6a-4042-a238-0de6589f3da6" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079564 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4eb3d6a-bc6a-4042-a238-0de6589f3da6" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079587 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb36a14c-9dff-4400-90b6-91f3089ea6bd" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079594 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb36a14c-9dff-4400-90b6-91f3089ea6bd" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079613 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="registry-server" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079618 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="registry-server" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079626 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="extract-utilities" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079633 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="extract-utilities" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079645 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" containerName="keystone-db-sync" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079651 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" containerName="keystone-db-sync" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc8a05b9-b460-45ec-9689-d0e34f761e9f" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079668 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc8a05b9-b460-45ec-9689-d0e34f761e9f" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079680 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="extract-content" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079684 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="extract-content" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079703 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc90587f-7ae0-4ee8-836d-433aca0e7f65" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079709 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc90587f-7ae0-4ee8-836d-433aca0e7f65" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079723 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d72dcff8-fe6d-44b2-8268-704269965202" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079728 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d72dcff8-fe6d-44b2-8268-704269965202" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079737 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05c082d-aba5-46a8-aa3f-c411583939bc" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079742 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05c082d-aba5-46a8-aa3f-c411583939bc" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079980 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d72dcff8-fe6d-44b2-8268-704269965202" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.079997 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc90587f-7ae0-4ee8-836d-433aca0e7f65" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080005 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="10be7381-68f9-4c79-a736-f9def759753e" containerName="registry-server" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080021 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" containerName="keystone-db-sync" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080029 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc8a05b9-b460-45ec-9689-d0e34f761e9f" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080040 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb36a14c-9dff-4400-90b6-91f3089ea6bd" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080048 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4eb3d6a-bc6a-4042-a238-0de6589f3da6" containerName="mariadb-account-create-update" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.080062 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e05c082d-aba5-46a8-aa3f-c411583939bc" containerName="mariadb-database-create" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.088636 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.099880 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.100153 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.100298 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.100363 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.102080 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpb8"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.102813 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-j667m\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.154811 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.166159 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.170984 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9hzdd\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.171281 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.171373 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.172259 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.182767 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195121 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195171 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxpg\" (UniqueName: \"kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195426 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.195748 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.238297 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.246537 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.254977 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.255614 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.256874 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298141 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjrcl\" (UniqueName: \"kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298187 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298220 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298255 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298273 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298298 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298335 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxpg\" (UniqueName: \"kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298490 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkmj\" (UniqueName: \"kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298513 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298585 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298610 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298628 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298706 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298740 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298821 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.298840 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.310777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.312806 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.322200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.326806 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.329955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.330024 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cn5tq"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.342608 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxpg\" (UniqueName: \"kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg\") pod \"keystone-bootstrap-tvpb8\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.358677 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-9r7r5"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.360299 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.364957 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.364975 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.365589 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.365729 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-x8bh4\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.378705 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.378972 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-t8vf4\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.379123 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.384623 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409507 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkmj\" (UniqueName: \"kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7sq7\" (UniqueName: \"kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409704 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409733 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409825 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409847 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409908 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.409994 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410102 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410151 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410187 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjrcl\" (UniqueName: \"kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410280 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410346 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410370 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410402 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410436 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.410453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfx5m\" (UniqueName: \"kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.412301 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cn5tq"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.412509 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.413156 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.415615 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.417170 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.421109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.421406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.421933 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.423639 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.424038 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.424275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.426673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.426829 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.430982 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-9r7r5"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.435107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.435531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.435911 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.441200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkmj\" (UniqueName: \"kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.443176 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.451184 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.451709 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.455117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjrcl\" (UniqueName: \"kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.463559 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.478627 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.482657 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.494497 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.511979 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512052 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512081 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512109 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512140 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512162 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfx5m\" (UniqueName: \"kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512203 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7sq7\" (UniqueName: \"kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512231 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512255 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512313 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcs56\" (UniqueName: \"kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512345 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.512450 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.516449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.517720 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.519708 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.520000 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.521896 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.525737 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.527489 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-9hhwz"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.530174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfx5m\" (UniqueName: \"kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m\") pod \"neutron-db-sync-cn5tq\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.530926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7sq7\" (UniqueName: \"kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7\") pod \"cinder-db-sync-9r7r5\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.532526 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.535473 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-9hhwz"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.543837 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.543903 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-hv6hw\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.544035 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.565969 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-27rfr"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.568486 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.569791 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.571898 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.576586 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-l6f5s\"" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.576757 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-27rfr"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615567 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615690 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbvdv\" (UniqueName: \"kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615780 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615824 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcs56\" (UniqueName: \"kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615897 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615922 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615957 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.615983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzznc\" (UniqueName: \"kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.616061 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.617026 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.617463 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.617520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.617634 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.617702 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.618214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.620411 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.621424 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.624054 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.627143 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.632200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcs56\" (UniqueName: \"kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.646004 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720084 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzznc\" (UniqueName: \"kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720175 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720385 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbvdv\" (UniqueName: \"kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720569 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.720940 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.725895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.725974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.733593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.735361 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.737612 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbvdv\" (UniqueName: \"kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.739456 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzznc\" (UniqueName: \"kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc\") pod \"barbican-db-sync-27rfr\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.742601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts\") pod \"placement-db-sync-9hhwz\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.804172 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.804186 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.811437 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.861689 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.881080 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpb8"] Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.893076 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:03 crc kubenswrapper[5030]: I0316 13:29:03.977817 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10be7381-68f9-4c79-a736-f9def759753e" path="/var/lib/kubelet/pods/10be7381-68f9-4c79-a736-f9def759753e/volumes" Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.002886 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.075063 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:04 crc kubenswrapper[5030]: W0316 13:29:04.086654 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a1c9526_e2d0_4f87_9e29_31a18b721d82.slice/crio-a9d27df08146ff0a361f0adaeee0dc8d9f2bffd276b68df5399816a903c2f4c8 WatchSource:0}: Error finding container a9d27df08146ff0a361f0adaeee0dc8d9f2bffd276b68df5399816a903c2f4c8: Status 404 returned error can't find the container with id a9d27df08146ff0a361f0adaeee0dc8d9f2bffd276b68df5399816a903c2f4c8 Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.314773 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cn5tq"] Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.323829 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-9r7r5"] Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.336611 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:04 crc kubenswrapper[5030]: W0316 13:29:04.402254 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80e6745e_dd11_4a34_af91_2dfb661017d0.slice/crio-6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c WatchSource:0}: Error finding container 6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c: Status 404 returned error can't find the container with id 6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.508060 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-27rfr"] Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.512398 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-9hhwz"] Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.920209 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerStarted","Data":"89431d521351e6296a55b81c105d3a24653d72d23a5dcd517e6023dad0e6c4ac"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.922155 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" event={"ID":"80e6745e-dd11-4a34-af91-2dfb661017d0","Type":"ContainerStarted","Data":"162b2e78bb5a73a4368c330f80da034167f3b961aea53158aea8c32fbb321142"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.922184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" event={"ID":"80e6745e-dd11-4a34-af91-2dfb661017d0","Type":"ContainerStarted","Data":"6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.927606 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" event={"ID":"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5","Type":"ContainerStarted","Data":"ac82ba7994f73619397bf75a66d64d6e409e3dd4bec43628c5871c16a96e4d26"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.927722 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" event={"ID":"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5","Type":"ContainerStarted","Data":"64e048912aeac5412d67fcd839f712f5041a5af1bdbcbf5d83e32224f5f2954f"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.933459 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" event={"ID":"69a9985f-641a-43ae-90fa-5770f0bf4b6b","Type":"ContainerStarted","Data":"9a75ce20f7cad765a5a074668abdbe9b1ad859b199547ff845eb05a62894c99f"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.933513 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" event={"ID":"69a9985f-641a-43ae-90fa-5770f0bf4b6b","Type":"ContainerStarted","Data":"183295fa2fd63dc22c194a5e93322566a3da363aea9c13372e5d79024b47dd85"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.947045 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerStarted","Data":"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.947088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerStarted","Data":"be30d482b4bb6f18831e7ae6bc0f0ac74e02e548df58863afb9a1e2ce5ed046e"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.947354 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" podStartSLOduration=1.947338324 podStartE2EDuration="1.947338324s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:04.945232705 +0000 UTC m=+1389.344545252" watchObservedRunningTime="2026-03-16 13:29:04.947338324 +0000 UTC m=+1389.346650871" Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.958003 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" event={"ID":"44990d1a-4e21-45fe-b82a-167db72971a0","Type":"ContainerStarted","Data":"a5ce7ba27007a0aaa93feadf5bba21d3859e2640111699bd074e2b5be168c157"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.958065 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" event={"ID":"44990d1a-4e21-45fe-b82a-167db72971a0","Type":"ContainerStarted","Data":"2543bd72e0290bf6e944896637fca6d653e09aa114e4bafd5128bf16646e069c"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.964308 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" podStartSLOduration=1.9642916499999998 podStartE2EDuration="1.96429165s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:04.957852754 +0000 UTC m=+1389.357165301" watchObservedRunningTime="2026-03-16 13:29:04.96429165 +0000 UTC m=+1389.363604207" Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.976525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" event={"ID":"1d7fd9a6-353d-4c18-ae50-bd967e4b7116","Type":"ContainerStarted","Data":"0872e0fedea37e16faf1903adfa83321a43313c269a30e43445af5883cafd45b"} Mar 16 13:29:04 crc kubenswrapper[5030]: I0316 13:29:04.988359 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" podStartSLOduration=1.988344927 podStartE2EDuration="1.988344927s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:04.976892343 +0000 UTC m=+1389.376204889" watchObservedRunningTime="2026-03-16 13:29:04.988344927 +0000 UTC m=+1389.387657475" Mar 16 13:29:05 crc kubenswrapper[5030]: I0316 13:29:05.000394 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerStarted","Data":"a9d27df08146ff0a361f0adaeee0dc8d9f2bffd276b68df5399816a903c2f4c8"} Mar 16 13:29:05 crc kubenswrapper[5030]: I0316 13:29:05.012691 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" podStartSLOduration=2.0126732 podStartE2EDuration="2.0126732s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:05.003306719 +0000 UTC m=+1389.402619266" watchObservedRunningTime="2026-03-16 13:29:05.0126732 +0000 UTC m=+1389.411985748" Mar 16 13:29:05 crc kubenswrapper[5030]: I0316 13:29:05.907237 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.019473 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.053396 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.074216 5030 generic.go:358] "Generic (PLEG): container finished" podID="69a9985f-641a-43ae-90fa-5770f0bf4b6b" containerID="9a75ce20f7cad765a5a074668abdbe9b1ad859b199547ff845eb05a62894c99f" exitCode=0 Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.074313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" event={"ID":"69a9985f-641a-43ae-90fa-5770f0bf4b6b","Type":"ContainerDied","Data":"9a75ce20f7cad765a5a074668abdbe9b1ad859b199547ff845eb05a62894c99f"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.103430 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerStarted","Data":"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.126181 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerStarted","Data":"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.126225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerStarted","Data":"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.129139 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerStarted","Data":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.146002 5030 generic.go:358] "Generic (PLEG): container finished" podID="1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" containerID="ac82ba7994f73619397bf75a66d64d6e409e3dd4bec43628c5871c16a96e4d26" exitCode=0 Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.147011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" event={"ID":"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5","Type":"ContainerDied","Data":"ac82ba7994f73619397bf75a66d64d6e409e3dd4bec43628c5871c16a96e4d26"} Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.154026 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.154003142 podStartE2EDuration="3.154003142s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:06.15058835 +0000 UTC m=+1390.549900898" watchObservedRunningTime="2026-03-16 13:29:06.154003142 +0000 UTC m=+1390.553315689" Mar 16 13:29:06 crc kubenswrapper[5030]: I0316 13:29:06.204864 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.204839157 podStartE2EDuration="3.204839157s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:06.186783739 +0000 UTC m=+1390.586096306" watchObservedRunningTime="2026-03-16 13:29:06.204839157 +0000 UTC m=+1390.604151724" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.156613 5030 generic.go:358] "Generic (PLEG): container finished" podID="44990d1a-4e21-45fe-b82a-167db72971a0" containerID="a5ce7ba27007a0aaa93feadf5bba21d3859e2640111699bd074e2b5be168c157" exitCode=0 Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.156765 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" event={"ID":"44990d1a-4e21-45fe-b82a-167db72971a0","Type":"ContainerDied","Data":"a5ce7ba27007a0aaa93feadf5bba21d3859e2640111699bd074e2b5be168c157"} Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.159377 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" event={"ID":"1d7fd9a6-353d-4c18-ae50-bd967e4b7116","Type":"ContainerStarted","Data":"f4ef1ea67f35b369bf6bc211bcfeb89dbb9b30ae98889d84f099a8d966b90302"} Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.162184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerStarted","Data":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.162448 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-log" containerID="cri-o://7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" gracePeriod=30 Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.162716 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-httpd" containerID="cri-o://0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" gracePeriod=30 Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.162977 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-log" containerID="cri-o://733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" gracePeriod=30 Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.163071 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-httpd" containerID="cri-o://03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" gracePeriod=30 Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.201242 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" podStartSLOduration=4.201224003 podStartE2EDuration="4.201224003s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:07.192618272 +0000 UTC m=+1391.591930819" watchObservedRunningTime="2026-03-16 13:29:07.201224003 +0000 UTC m=+1391.600536551" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.836842 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.844233 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.945788 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle\") pod \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946322 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data\") pod \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946408 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts\") pod \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946487 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle\") pod \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946586 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbvdv\" (UniqueName: \"kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv\") pod \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs\") pod \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\" (UID: \"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946745 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzznc\" (UniqueName: \"kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc\") pod \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.946879 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data\") pod \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\" (UID: \"69a9985f-641a-43ae-90fa-5770f0bf4b6b\") " Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.947842 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.953582 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs" (OuterVolumeSpecName: "logs") pod "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" (UID: "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.959675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv" (OuterVolumeSpecName: "kube-api-access-nbvdv") pod "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" (UID: "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5"). InnerVolumeSpecName "kube-api-access-nbvdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.959864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc" (OuterVolumeSpecName: "kube-api-access-gzznc") pod "69a9985f-641a-43ae-90fa-5770f0bf4b6b" (UID: "69a9985f-641a-43ae-90fa-5770f0bf4b6b"). InnerVolumeSpecName "kube-api-access-gzznc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.962751 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts" (OuterVolumeSpecName: "scripts") pod "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" (UID: "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.968721 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "69a9985f-641a-43ae-90fa-5770f0bf4b6b" (UID: "69a9985f-641a-43ae-90fa-5770f0bf4b6b"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:07 crc kubenswrapper[5030]: I0316 13:29:07.990957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" (UID: "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.009202 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69a9985f-641a-43ae-90fa-5770f0bf4b6b" (UID: "69a9985f-641a-43ae-90fa-5770f0bf4b6b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.010702 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data" (OuterVolumeSpecName: "config-data") pod "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" (UID: "1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053025 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053164 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjrcl\" (UniqueName: \"kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053292 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053463 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053589 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053653 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.053751 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts\") pod \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\" (UID: \"7a1c9526-e2d0-4f87-9e29-31a18b721d82\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054199 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054216 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzznc\" (UniqueName: \"kubernetes.io/projected/69a9985f-641a-43ae-90fa-5770f0bf4b6b-kube-api-access-gzznc\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054285 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054303 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054319 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054333 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054345 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a9985f-641a-43ae-90fa-5770f0bf4b6b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054360 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbvdv\" (UniqueName: \"kubernetes.io/projected/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-kube-api-access-nbvdv\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054375 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.054491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs" (OuterVolumeSpecName: "logs") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.072643 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts" (OuterVolumeSpecName: "scripts") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.072899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.076648 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl" (OuterVolumeSpecName: "kube-api-access-xjrcl") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "kube-api-access-xjrcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.103660 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.115131 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.124727 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data" (OuterVolumeSpecName: "config-data") pod "7a1c9526-e2d0-4f87-9e29-31a18b721d82" (UID: "7a1c9526-e2d0-4f87-9e29-31a18b721d82"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156144 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156172 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjrcl\" (UniqueName: \"kubernetes.io/projected/7a1c9526-e2d0-4f87-9e29-31a18b721d82-kube-api-access-xjrcl\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156185 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156194 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156202 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156210 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156218 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7a1c9526-e2d0-4f87-9e29-31a18b721d82-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.156225 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7a1c9526-e2d0-4f87-9e29-31a18b721d82-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.167428 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.184146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" event={"ID":"69a9985f-641a-43ae-90fa-5770f0bf4b6b","Type":"ContainerDied","Data":"183295fa2fd63dc22c194a5e93322566a3da363aea9c13372e5d79024b47dd85"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.184197 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="183295fa2fd63dc22c194a5e93322566a3da363aea9c13372e5d79024b47dd85" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.184166 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-27rfr" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187469 5030 generic.go:358] "Generic (PLEG): container finished" podID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerID="0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" exitCode=0 Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187501 5030 generic.go:358] "Generic (PLEG): container finished" podID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerID="7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" exitCode=143 Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187742 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerDied","Data":"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187783 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerDied","Data":"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"bc601dc5-733a-4ccc-bffd-3ffac131f6c2","Type":"ContainerDied","Data":"be30d482b4bb6f18831e7ae6bc0f0ac74e02e548df58863afb9a1e2ce5ed046e"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187811 5030 scope.go:117] "RemoveContainer" containerID="0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.187964 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.188027 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191332 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerID="03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" exitCode=0 Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191363 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerID="733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" exitCode=143 Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191390 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191435 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerDied","Data":"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191493 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerDied","Data":"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.191507 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7a1c9526-e2d0-4f87-9e29-31a18b721d82","Type":"ContainerDied","Data":"a9d27df08146ff0a361f0adaeee0dc8d9f2bffd276b68df5399816a903c2f4c8"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.204294 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerStarted","Data":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.210531 5030 generic.go:358] "Generic (PLEG): container finished" podID="80e6745e-dd11-4a34-af91-2dfb661017d0" containerID="162b2e78bb5a73a4368c330f80da034167f3b961aea53158aea8c32fbb321142" exitCode=0 Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.210836 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" event={"ID":"80e6745e-dd11-4a34-af91-2dfb661017d0","Type":"ContainerDied","Data":"162b2e78bb5a73a4368c330f80da034167f3b961aea53158aea8c32fbb321142"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.214812 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.214821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-9hhwz" event={"ID":"1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5","Type":"ContainerDied","Data":"64e048912aeac5412d67fcd839f712f5041a5af1bdbcbf5d83e32224f5f2954f"} Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.214877 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64e048912aeac5412d67fcd839f712f5041a5af1bdbcbf5d83e32224f5f2954f" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.239623 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.256489 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257236 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257276 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkkmj\" (UniqueName: \"kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257342 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257429 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257623 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.257646 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.258099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs" (OuterVolumeSpecName: "logs") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.258161 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.258229 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs\") pod \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\" (UID: \"bc601dc5-733a-4ccc-bffd-3ffac131f6c2\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.259184 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.259201 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.259214 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.260767 5030 scope.go:117] "RemoveContainer" containerID="7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.271749 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj" (OuterVolumeSpecName: "kube-api-access-lkkmj") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "kube-api-access-lkkmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.271893 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.279618 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.280921 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.280958 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.280970 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.280978 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.280999 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281005 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281056 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69a9985f-641a-43ae-90fa-5770f0bf4b6b" containerName="barbican-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281063 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="69a9985f-641a-43ae-90fa-5770f0bf4b6b" containerName="barbican-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281073 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281079 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281094 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" containerName="placement-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281100 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" containerName="placement-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281314 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" containerName="placement-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281325 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281334 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="69a9985f-641a-43ae-90fa-5770f0bf4b6b" containerName="barbican-db-sync" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281362 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-log" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281370 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.281377 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" containerName="glance-httpd" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.286859 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.289875 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.290008 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.291674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts" (OuterVolumeSpecName: "scripts") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.292135 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.294727 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.309151 5030 scope.go:117] "RemoveContainer" containerID="0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" Mar 16 13:29:08 crc kubenswrapper[5030]: E0316 13:29:08.310024 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5\": container with ID starting with 0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5 not found: ID does not exist" containerID="0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310076 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5"} err="failed to get container status \"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5\": rpc error: code = NotFound desc = could not find container \"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5\": container with ID starting with 0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5 not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310102 5030 scope.go:117] "RemoveContainer" containerID="7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" Mar 16 13:29:08 crc kubenswrapper[5030]: E0316 13:29:08.310308 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca\": container with ID starting with 7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca not found: ID does not exist" containerID="7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310331 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca"} err="failed to get container status \"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca\": rpc error: code = NotFound desc = could not find container \"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca\": container with ID starting with 7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310344 5030 scope.go:117] "RemoveContainer" containerID="0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310496 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data" (OuterVolumeSpecName: "config-data") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310512 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5"} err="failed to get container status \"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5\": rpc error: code = NotFound desc = could not find container \"0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5\": container with ID starting with 0e880ff531d78e1ed0859c9105fb72dbdec292547445b3f7d11dd5685cb42ba5 not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.310591 5030 scope.go:117] "RemoveContainer" containerID="7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.312996 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca"} err="failed to get container status \"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca\": rpc error: code = NotFound desc = could not find container \"7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca\": container with ID starting with 7c5970318f00de2101df30841d1bc2e0626981e9b1a4f7ddfaa2a1f5dd3b41ca not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.313050 5030 scope.go:117] "RemoveContainer" containerID="03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.327372 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bc601dc5-733a-4ccc-bffd-3ffac131f6c2" (UID: "bc601dc5-733a-4ccc-bffd-3ffac131f6c2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.338000 5030 scope.go:117] "RemoveContainer" containerID="733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.360952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361200 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361234 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361285 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361305 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbx2\" (UniqueName: \"kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361448 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361459 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361468 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361488 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361497 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkkmj\" (UniqueName: \"kubernetes.io/projected/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-kube-api-access-lkkmj\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.361505 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bc601dc5-733a-4ccc-bffd-3ffac131f6c2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.378995 5030 scope.go:117] "RemoveContainer" containerID="03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" Mar 16 13:29:08 crc kubenswrapper[5030]: E0316 13:29:08.383110 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c\": container with ID starting with 03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c not found: ID does not exist" containerID="03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.383152 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c"} err="failed to get container status \"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c\": rpc error: code = NotFound desc = could not find container \"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c\": container with ID starting with 03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.383184 5030 scope.go:117] "RemoveContainer" containerID="733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.384512 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:29:08 crc kubenswrapper[5030]: E0316 13:29:08.384629 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e\": container with ID starting with 733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e not found: ID does not exist" containerID="733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.384656 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e"} err="failed to get container status \"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e\": rpc error: code = NotFound desc = could not find container \"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e\": container with ID starting with 733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.384679 5030 scope.go:117] "RemoveContainer" containerID="03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.385138 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c"} err="failed to get container status \"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c\": rpc error: code = NotFound desc = could not find container \"03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c\": container with ID starting with 03966cc41fb61d3e31b0b4c8cf65890dad4d912586fa3b5f401fec2402bc176c not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.385153 5030 scope.go:117] "RemoveContainer" containerID="733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.385368 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e"} err="failed to get container status \"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e\": rpc error: code = NotFound desc = could not find container \"733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e\": container with ID starting with 733be58946da5ee88ce4cb5a6ec0c726772fc98607fc75d3c01169572499744e not found: ID does not exist" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463470 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463538 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463599 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463657 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463696 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463730 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbx2\" (UniqueName: \"kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.463897 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.464340 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.464427 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.464802 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.468973 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.469790 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.470379 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.471733 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.482666 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbx2\" (UniqueName: \"kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.495230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.535760 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.543494 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.555881 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.565418 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.566761 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" containerName="keystone-bootstrap" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.566787 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" containerName="keystone-bootstrap" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.567029 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" containerName="keystone-bootstrap" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.575009 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.577694 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.577923 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.584905 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.618214 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667581 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gxpg\" (UniqueName: \"kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667638 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667682 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667774 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.667835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts\") pod \"44990d1a-4e21-45fe-b82a-167db72971a0\" (UID: \"44990d1a-4e21-45fe-b82a-167db72971a0\") " Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668191 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbcp\" (UniqueName: \"kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668313 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668343 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668413 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.668475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.671646 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.673010 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts" (OuterVolumeSpecName: "scripts") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.673066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg" (OuterVolumeSpecName: "kube-api-access-6gxpg") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "kube-api-access-6gxpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.673397 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.689727 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.691073 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data" (OuterVolumeSpecName: "config-data") pod "44990d1a-4e21-45fe-b82a-167db72971a0" (UID: "44990d1a-4e21-45fe-b82a-167db72971a0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.770875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771307 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771410 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771479 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbcp\" (UniqueName: \"kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771713 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771752 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771823 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.771932 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772103 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gxpg\" (UniqueName: \"kubernetes.io/projected/44990d1a-4e21-45fe-b82a-167db72971a0-kube-api-access-6gxpg\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772122 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772131 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772158 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772167 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772174 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/44990d1a-4e21-45fe-b82a-167db72971a0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.772692 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.773205 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.774034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.783612 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.784386 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.784915 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.785742 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.789580 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbcp\" (UniqueName: \"kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.809639 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.862130 5030 scope.go:117] "RemoveContainer" containerID="3db4061287a8f73f223d32d5cdc4e23d588088d3f53aa827efff8d3c2a8549df" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.888140 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.914925 5030 scope.go:117] "RemoveContainer" containerID="a46ed22242ea0e278f996ec05e72462bfdc5f3c22c6a7ac05817baafdf46d274" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.932808 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.944839 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.945404 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.947738 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.947770 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.947994 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-hv6hw\"" Mar 16 13:29:08 crc kubenswrapper[5030]: I0316 13:29:08.952373 5030 scope.go:117] "RemoveContainer" containerID="3c3bea8b523adc05165c4565001827dbae9643ac92445cc8000debece520f45c" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.003227 5030 scope.go:117] "RemoveContainer" containerID="de6a6c57f89aa1a5e082cf727721a0f22f61e3323c8b3eca3df33ed58848d6bc" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.043566 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.050171 5030 scope.go:117] "RemoveContainer" containerID="e2524d4483dadd7cddf183d56dd12de84b3c11dac05a6a3338a688053a74bc3a" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.078697 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.078873 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.078960 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.079088 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh7pw\" (UniqueName: \"kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.079993 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.102262 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.102390 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.106794 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-l6f5s\"" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.107157 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.107368 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 13:29:09 crc kubenswrapper[5030]: W0316 13:29:09.113633 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13ff667c_98c7_48bd_9c93_e5e86dcc8f22.slice/crio-b11f7fbd5742a6e8a2804b01e9044401fcb2b925dc42d1d17312472c58c8141b WatchSource:0}: Error finding container b11f7fbd5742a6e8a2804b01e9044401fcb2b925dc42d1d17312472c58c8141b: Status 404 returned error can't find the container with id b11f7fbd5742a6e8a2804b01e9044401fcb2b925dc42d1d17312472c58c8141b Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.113808 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.121657 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.122077 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.126992 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.129603 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.182508 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.182642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.182681 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193267 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193342 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fh7pw\" (UniqueName: \"kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193397 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4zfp\" (UniqueName: \"kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193460 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxtq\" (UniqueName: \"kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193513 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193619 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193644 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193679 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.193765 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.194411 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.199950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.204006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.213261 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.224907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh7pw\" (UniqueName: \"kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw\") pod \"placement-58b6dcbb66-vgjkr\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.275492 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.280089 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295843 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295893 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.295976 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4zfp\" (UniqueName: \"kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.296001 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxtq\" (UniqueName: \"kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.296091 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.296162 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.305212 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.318449 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.320912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerStarted","Data":"b11f7fbd5742a6e8a2804b01e9044401fcb2b925dc42d1d17312472c58c8141b"} Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.325888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.326758 5030 scope.go:117] "RemoveContainer" containerID="a19761fa98b6a2702e69ac2d487e3660aebe22071221e5c59327efe5792a826e" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.334542 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.335293 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.336073 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.336485 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.336526 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.337082 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.343363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4zfp\" (UniqueName: \"kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp\") pod \"barbican-keystone-listener-7bd75957b8-9nbqv\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.363546 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.379458 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.379933 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxtq\" (UniqueName: \"kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq\") pod \"barbican-worker-54df8bddcf-mkcrg\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.401794 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.402191 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.402219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgs42\" (UniqueName: \"kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.402242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.402577 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.416559 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpb8"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.427492 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-tvpb8"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.465944 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.466667 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.503441 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dmkmz"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.507250 5030 scope.go:117] "RemoveContainer" containerID="96eecbf04f1add18d24bfbfc2961d6cf517cac5e15ee9b5b969930036d7898e8" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.507525 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2543bd72e0290bf6e944896637fca6d653e09aa114e4bafd5128bf16646e069c" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.507647 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.508571 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.509390 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.509476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.509534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgs42\" (UniqueName: \"kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.509576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.509701 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.511050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.515734 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dmkmz"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.516987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.517390 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.521349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.537196 5030 status_manager.go:895] "Failed to get status for pod" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" err="pods \"keystone-bootstrap-tvpb8\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.539770 5030 generic.go:358] "Generic (PLEG): container finished" podID="1d7fd9a6-353d-4c18-ae50-bd967e4b7116" containerID="f4ef1ea67f35b369bf6bc211bcfeb89dbb9b30ae98889d84f099a8d966b90302" exitCode=0 Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.539917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" event={"ID":"1d7fd9a6-353d-4c18-ae50-bd967e4b7116","Type":"ContainerDied","Data":"f4ef1ea67f35b369bf6bc211bcfeb89dbb9b30ae98889d84f099a8d966b90302"} Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.540350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgs42\" (UniqueName: \"kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42\") pod \"barbican-api-75cf6687fb-gzm22\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.543101 5030 status_manager.go:895] "Failed to get status for pod" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" pod="openstack-kuttl-tests/keystone-bootstrap-tvpb8" err="pods \"keystone-bootstrap-tvpb8\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.555564 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.578122 5030 scope.go:117] "RemoveContainer" containerID="151aa972a51c692def200bf0327ada3f9687ac3d3a695d8acfdb5b55858c15eb" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.611289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.614119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxg5f\" (UniqueName: \"kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.614229 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.614269 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.614419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.614462 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.690839 5030 scope.go:117] "RemoveContainer" containerID="79fcb8675447df9cfb7d0cebb9d431b613ebca60bc5200d6fa466d198199ac42" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.716582 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.716621 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.716749 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.716778 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxg5f\" (UniqueName: \"kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.717204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.717237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.721221 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.722136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.725491 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.725915 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.726606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.727391 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.734194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxg5f\" (UniqueName: \"kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f\") pod \"keystone-bootstrap-dmkmz\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.739374 5030 scope.go:117] "RemoveContainer" containerID="ebfc5edee8c5ac0c490697d24748ff5577fd67606b656ce55e79fd85892a42c9" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.775466 5030 scope.go:117] "RemoveContainer" containerID="a40e997a8ae67574bd07b0d721239bd9ed8e456f0474799f797149c1b36c7d4a" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.841293 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.863311 5030 scope.go:117] "RemoveContainer" containerID="2d41843f6d29b62208862b9ae8d2d99ce940800304a9e98801b848736c5efb6a" Mar 16 13:29:09 crc kubenswrapper[5030]: I0316 13:29:09.933825 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.004268 5030 scope.go:117] "RemoveContainer" containerID="a11db986e165d51cdf36db3e8fb96a7460232b00889059685ca0a0119d075daa" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.010855 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44990d1a-4e21-45fe-b82a-167db72971a0" path="/var/lib/kubelet/pods/44990d1a-4e21-45fe-b82a-167db72971a0/volumes" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.011800 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a1c9526-e2d0-4f87-9e29-31a18b721d82" path="/var/lib/kubelet/pods/7a1c9526-e2d0-4f87-9e29-31a18b721d82/volumes" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.012598 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc601dc5-733a-4ccc-bffd-3ffac131f6c2" path="/var/lib/kubelet/pods/bc601dc5-733a-4ccc-bffd-3ffac131f6c2/volumes" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.015324 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.052793 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.054210 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.058693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.059427 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.126705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127148 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxptc\" (UniqueName: \"kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127199 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127254 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.127347 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.206097 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.216839 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.218456 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.230862 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231140 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxptc\" (UniqueName: \"kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231173 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231192 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231229 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.231318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.234092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: W0316 13:29:10.242279 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc5b9b25_929d_49d3_af61_c713abc1d1b7.slice/crio-0e064d6c2c3a4ab473c391828f3719800f99b02fc5d8b8c9797a66d83cd3103c WatchSource:0}: Error finding container 0e064d6c2c3a4ab473c391828f3719800f99b02fc5d8b8c9797a66d83cd3103c: Status 404 returned error can't find the container with id 0e064d6c2c3a4ab473c391828f3719800f99b02fc5d8b8c9797a66d83cd3103c Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.243870 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.244194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.256800 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxptc\" (UniqueName: \"kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.259760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.266826 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.272370 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts\") pod \"placement-8488f86b5b-v6x8d\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.337270 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfx5m\" (UniqueName: \"kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m\") pod \"80e6745e-dd11-4a34-af91-2dfb661017d0\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.337567 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle\") pod \"80e6745e-dd11-4a34-af91-2dfb661017d0\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.337645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config\") pod \"80e6745e-dd11-4a34-af91-2dfb661017d0\" (UID: \"80e6745e-dd11-4a34-af91-2dfb661017d0\") " Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.352363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m" (OuterVolumeSpecName: "kube-api-access-pfx5m") pod "80e6745e-dd11-4a34-af91-2dfb661017d0" (UID: "80e6745e-dd11-4a34-af91-2dfb661017d0"). InnerVolumeSpecName "kube-api-access-pfx5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.365235 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.388621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "80e6745e-dd11-4a34-af91-2dfb661017d0" (UID: "80e6745e-dd11-4a34-af91-2dfb661017d0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.437299 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config" (OuterVolumeSpecName: "config") pod "80e6745e-dd11-4a34-af91-2dfb661017d0" (UID: "80e6745e-dd11-4a34-af91-2dfb661017d0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.441794 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.441818 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80e6745e-dd11-4a34-af91-2dfb661017d0-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.441828 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfx5m\" (UniqueName: \"kubernetes.io/projected/80e6745e-dd11-4a34-af91-2dfb661017d0-kube-api-access-pfx5m\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.480857 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.483662 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e6745e-dd11-4a34-af91-2dfb661017d0" containerName="neutron-db-sync" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.483817 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e6745e-dd11-4a34-af91-2dfb661017d0" containerName="neutron-db-sync" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.484489 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="80e6745e-dd11-4a34-af91-2dfb661017d0" containerName="neutron-db-sync" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.495133 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.497221 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.500511 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.507842 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.588872 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dmkmz"] Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.620771 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerStarted","Data":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.621032 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-central-agent" containerID="cri-o://5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" gracePeriod=30 Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.621405 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="proxy-httpd" containerID="cri-o://2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" gracePeriod=30 Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.621488 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="sg-core" containerID="cri-o://acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" gracePeriod=30 Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.621530 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-notification-agent" containerID="cri-o://0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" gracePeriod=30 Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.623207 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:10 crc kubenswrapper[5030]: W0316 13:29:10.627742 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eec7e4c_cba1_485c_b2be_183ebef9ef81.slice/crio-1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc WatchSource:0}: Error finding container 1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc: Status 404 returned error can't find the container with id 1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.631656 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerStarted","Data":"a2a878417ae985ef3fec87527d0e3844e87e0ebf9b7c68b0d1a8d1767b97983b"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.636723 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerStarted","Data":"bf2071fd09f364023075c4a1fb9271c6ee27467a215b16bb5ed3184a8b6e7be6"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.648995 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" event={"ID":"80e6745e-dd11-4a34-af91-2dfb661017d0","Type":"ContainerDied","Data":"6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649032 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6604e469d6dff6c946313665504693c2cb3b65284ccccdc9b1e6bfe43d8aca9c" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649169 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649237 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649371 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-cn5tq" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.649791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxsh\" (UniqueName: \"kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.661786 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerStarted","Data":"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.695033 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerStarted","Data":"01b33bfa699bad2b7412c74ca0d2ec00e848990cbfc1d50c82a113235f2c50d6"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.708391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerStarted","Data":"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.708431 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerStarted","Data":"e15e04e58c954fc53b0337034e0a779c710dd57a58e63f7bb2bb395d3ee977b7"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.723278 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerStarted","Data":"0e064d6c2c3a4ab473c391828f3719800f99b02fc5d8b8c9797a66d83cd3103c"} Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.759519 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.759871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxsh\" (UniqueName: \"kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.760177 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.760244 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.760369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.770444 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.773175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.776604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.776926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.778744 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxsh\" (UniqueName: \"kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh\") pod \"neutron-59cb7c74d9-9sd9l\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:10 crc kubenswrapper[5030]: I0316 13:29:10.832327 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.051293 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.758128443 podStartE2EDuration="8.051271238s" podCreationTimestamp="2026-03-16 13:29:03 +0000 UTC" firstStartedPulling="2026-03-16 13:29:04.402219336 +0000 UTC m=+1388.801531883" lastFinishedPulling="2026-03-16 13:29:09.695362131 +0000 UTC m=+1394.094674678" observedRunningTime="2026-03-16 13:29:10.645853446 +0000 UTC m=+1395.045165993" watchObservedRunningTime="2026-03-16 13:29:11.051271238 +0000 UTC m=+1395.450583785" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.054920 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:11 crc kubenswrapper[5030]: W0316 13:29:11.153495 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b4a6288_9830_43e1_aab7_83bd1eca7e07.slice/crio-98ca5ebd7127c05228a0a6939c666d96d0b2378d3aa75317258cb25893d86ede WatchSource:0}: Error finding container 98ca5ebd7127c05228a0a6939c666d96d0b2378d3aa75317258cb25893d86ede: Status 404 returned error can't find the container with id 98ca5ebd7127c05228a0a6939c666d96d0b2378d3aa75317258cb25893d86ede Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.275439 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.371943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.372106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.372134 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.372179 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.372205 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.372224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7sq7\" (UniqueName: \"kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7\") pod \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\" (UID: \"1d7fd9a6-353d-4c18-ae50-bd967e4b7116\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.373358 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.380259 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts" (OuterVolumeSpecName: "scripts") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.380983 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.386261 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7" (OuterVolumeSpecName: "kube-api-access-x7sq7") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "kube-api-access-x7sq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.409604 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.423736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data" (OuterVolumeSpecName: "config-data") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.446440 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1d7fd9a6-353d-4c18-ae50-bd967e4b7116" (UID: "1d7fd9a6-353d-4c18-ae50-bd967e4b7116"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480180 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480234 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480246 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480259 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480268 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.480296 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7sq7\" (UniqueName: \"kubernetes.io/projected/1d7fd9a6-353d-4c18-ae50-bd967e4b7116-kube-api-access-x7sq7\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.695890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.796497 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.797157 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.797253 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.797334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.797496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.804129 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcs56\" (UniqueName: \"kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.804301 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd\") pod \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\" (UID: \"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c\") " Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.805515 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.809703 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.812805 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.813045 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.813139 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-9r7r5" event={"ID":"1d7fd9a6-353d-4c18-ae50-bd967e4b7116","Type":"ContainerDied","Data":"0872e0fedea37e16faf1903adfa83321a43313c269a30e43445af5883cafd45b"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.813198 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0872e0fedea37e16faf1903adfa83321a43313c269a30e43445af5883cafd45b" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.821636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts" (OuterVolumeSpecName: "scripts") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.829537 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56" (OuterVolumeSpecName: "kube-api-access-hcs56") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "kube-api-access-hcs56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.834102 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerStarted","Data":"202959c1d24b1ec11546ccc4d1a217a89ef107366ce5b22403ff2b0f4385404a"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.834160 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerStarted","Data":"40bdd37586f9ed7bbbff4202b2e549b2f56dc9da3c42492cc1b37121e618373b"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.874574 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerStarted","Data":"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.874693 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.874719 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.914814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" event={"ID":"8eec7e4c-cba1-485c-b2be-183ebef9ef81","Type":"ContainerStarted","Data":"45cd776cfd3f2b62c621482d21f04df99fc2a5c7d13351dea5bdab697212b25c"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.914853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" event={"ID":"8eec7e4c-cba1-485c-b2be-183ebef9ef81","Type":"ContainerStarted","Data":"1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.917364 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerStarted","Data":"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.917411 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerStarted","Data":"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.925797 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.929066 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="proxy-httpd" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.929091 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="proxy-httpd" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.929143 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-notification-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.929149 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-notification-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930736 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-central-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930757 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-central-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930774 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d7fd9a6-353d-4c18-ae50-bd967e4b7116" containerName="cinder-db-sync" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930780 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d7fd9a6-353d-4c18-ae50-bd967e4b7116" containerName="cinder-db-sync" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930788 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="sg-core" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930793 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="sg-core" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.930987 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="sg-core" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.931005 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-central-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.931024 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="ceilometer-notification-agent" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.931036 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerName="proxy-httpd" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.931045 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1d7fd9a6-353d-4c18-ae50-bd967e4b7116" containerName="cinder-db-sync" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.935813 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcs56\" (UniqueName: \"kubernetes.io/projected/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-kube-api-access-hcs56\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.935850 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.935862 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.936485 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.936924 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerStarted","Data":"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.936952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerStarted","Data":"98ca5ebd7127c05228a0a6939c666d96d0b2378d3aa75317258cb25893d86ede"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.936970 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.937046 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.945320 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" podStartSLOduration=2.9452981449999998 podStartE2EDuration="2.945298145s" podCreationTimestamp="2026-03-16 13:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:11.874979086 +0000 UTC m=+1396.274291632" watchObservedRunningTime="2026-03-16 13:29:11.945298145 +0000 UTC m=+1396.344610691" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.946446 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.946924 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.947345 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.948823 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.949711 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-t8vf4\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.961413 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.964899 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" podStartSLOduration=3.964885834 podStartE2EDuration="3.964885834s" podCreationTimestamp="2026-03-16 13:29:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:11.927951838 +0000 UTC m=+1396.327264406" watchObservedRunningTime="2026-03-16 13:29:11.964885834 +0000 UTC m=+1396.364198381" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.967315 5030 generic.go:358] "Generic (PLEG): container finished" podID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" exitCode=0 Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.967342 5030 generic.go:358] "Generic (PLEG): container finished" podID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" exitCode=2 Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.967351 5030 generic.go:358] "Generic (PLEG): container finished" podID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" exitCode=0 Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.967359 5030 generic.go:358] "Generic (PLEG): container finished" podID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" exitCode=0 Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.967514 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.968116 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" podStartSLOduration=2.968107211 podStartE2EDuration="2.968107211s" podCreationTimestamp="2026-03-16 13:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:11.94922099 +0000 UTC m=+1396.348533537" watchObservedRunningTime="2026-03-16 13:29:11.968107211 +0000 UTC m=+1396.367419759" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.973323 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.981199 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" podStartSLOduration=2.981179431 podStartE2EDuration="2.981179431s" podCreationTimestamp="2026-03-16 13:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:11.973646156 +0000 UTC m=+1396.372958704" watchObservedRunningTime="2026-03-16 13:29:11.981179431 +0000 UTC m=+1396.380491968" Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerDied","Data":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997438 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerDied","Data":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerDied","Data":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997461 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerDied","Data":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"a70cfc92-d3bc-4ee9-bc7d-88e990b5204c","Type":"ContainerDied","Data":"89431d521351e6296a55b81c105d3a24653d72d23a5dcd517e6023dad0e6c4ac"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997486 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerStarted","Data":"2a11a5ba16df04154fd99356d83fa66d8a5b7868d1c57cf0a4a72643df6bb89b"} Mar 16 13:29:11 crc kubenswrapper[5030]: I0316 13:29:11.997487 5030 scope.go:117] "RemoveContainer" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.002458 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerStarted","Data":"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19"} Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.002498 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerStarted","Data":"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29"} Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.002644 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.002662 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.020921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerStarted","Data":"44d87d4f92c536a1a2003637240a7b977f576223d9b3c5cfda5154b8ab1faf4d"} Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.025703 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.039037 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.039313 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.061637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data" (OuterVolumeSpecName: "config-data") pod "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" (UID: "a70cfc92-d3bc-4ee9-bc7d-88e990b5204c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.073231 5030 scope.go:117] "RemoveContainer" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.145992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146077 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146121 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mff26\" (UniqueName: \"kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146264 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146344 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146386 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146404 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146486 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czknm\" (UniqueName: \"kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146501 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.146596 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.148585 5030 scope.go:117] "RemoveContainer" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.230679 5030 scope.go:117] "RemoveContainer" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.247873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.247911 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czknm\" (UniqueName: \"kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.247934 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.248032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.248090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.248274 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.248328 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.248380 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mff26\" (UniqueName: \"kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249501 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249570 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249596 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249664 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249688 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.249929 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.250234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.259215 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.264801 5030 scope.go:117] "RemoveContainer" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265137 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czknm\" (UniqueName: \"kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: E0316 13:29:12.265492 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": container with ID starting with 2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583 not found: ID does not exist" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265525 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} err="failed to get container status \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": rpc error: code = NotFound desc = could not find container \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": container with ID starting with 2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265562 5030 scope.go:117] "RemoveContainer" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: E0316 13:29:12.265907 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": container with ID starting with acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc not found: ID does not exist" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265941 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} err="failed to get container status \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": rpc error: code = NotFound desc = could not find container \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": container with ID starting with acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.265971 5030 scope.go:117] "RemoveContainer" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: E0316 13:29:12.266328 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": container with ID starting with 0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d not found: ID does not exist" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266408 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266411 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} err="failed to get container status \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": rpc error: code = NotFound desc = could not find container \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": container with ID starting with 0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266571 5030 scope.go:117] "RemoveContainer" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: E0316 13:29:12.266867 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": container with ID starting with 5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85 not found: ID does not exist" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266898 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} err="failed to get container status \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": rpc error: code = NotFound desc = could not find container \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": container with ID starting with 5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.266915 5030 scope.go:117] "RemoveContainer" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267052 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267081 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} err="failed to get container status \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": rpc error: code = NotFound desc = could not find container \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": container with ID starting with 2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267094 5030 scope.go:117] "RemoveContainer" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267257 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} err="failed to get container status \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": rpc error: code = NotFound desc = could not find container \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": container with ID starting with acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267281 5030 scope.go:117] "RemoveContainer" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267424 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} err="failed to get container status \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": rpc error: code = NotFound desc = could not find container \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": container with ID starting with 0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267442 5030 scope.go:117] "RemoveContainer" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267596 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} err="failed to get container status \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": rpc error: code = NotFound desc = could not find container \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": container with ID starting with 5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.267613 5030 scope.go:117] "RemoveContainer" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.268299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data\") pod \"cinder-api-0\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.268337 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.268456 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} err="failed to get container status \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": rpc error: code = NotFound desc = could not find container \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": container with ID starting with 2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.268497 5030 scope.go:117] "RemoveContainer" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.272174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mff26\" (UniqueName: \"kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.275673 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} err="failed to get container status \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": rpc error: code = NotFound desc = could not find container \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": container with ID starting with acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.275692 5030 scope.go:117] "RemoveContainer" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.276987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.279655 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} err="failed to get container status \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": rpc error: code = NotFound desc = could not find container \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": container with ID starting with 0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.279682 5030 scope.go:117] "RemoveContainer" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.283675 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} err="failed to get container status \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": rpc error: code = NotFound desc = could not find container \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": container with ID starting with 5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.283713 5030 scope.go:117] "RemoveContainer" containerID="2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284133 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583"} err="failed to get container status \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": rpc error: code = NotFound desc = could not find container \"2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583\": container with ID starting with 2d008dd768a45579499c2bce1b1738f44d16ef55b85391bd9b8d7361c2b7d583 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284158 5030 scope.go:117] "RemoveContainer" containerID="acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284373 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc"} err="failed to get container status \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": rpc error: code = NotFound desc = could not find container \"acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc\": container with ID starting with acf4ef2771449808d147ccef02187352dfbe0014c540efdbce622144032e47bc not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284388 5030 scope.go:117] "RemoveContainer" containerID="0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284545 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d"} err="failed to get container status \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": rpc error: code = NotFound desc = could not find container \"0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d\": container with ID starting with 0d85a5aee926b4d894fcf9253aca0177721e7e0c74d2e03c16a06b2277465f9d not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284578 5030 scope.go:117] "RemoveContainer" containerID="5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.284740 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85"} err="failed to get container status \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": rpc error: code = NotFound desc = could not find container \"5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85\": container with ID starting with 5d27e025c473e9498fdb1e1df47bdb7a7369e4c0b515e01197d6bd2253e8ce85 not found: ID does not exist" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.302634 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.346037 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" podStartSLOduration=3.346025017 podStartE2EDuration="3.346025017s" podCreationTimestamp="2026-03-16 13:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:12.053767786 +0000 UTC m=+1396.453080333" watchObservedRunningTime="2026-03-16 13:29:12.346025017 +0000 UTC m=+1396.745337563" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.353300 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.360836 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.377980 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.385891 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.386023 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.389961 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.390470 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467431 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467544 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467576 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmcg\" (UniqueName: \"kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.467764 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.566202 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.568907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.568938 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmcg\" (UniqueName: \"kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.568969 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.569022 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.569068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.569100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.569119 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.573282 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.573368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.587449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.590046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.591926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmcg\" (UniqueName: \"kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.592770 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.596267 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.702994 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:12 crc kubenswrapper[5030]: I0316 13:29:12.797607 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:12 crc kubenswrapper[5030]: W0316 13:29:12.807248 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d48c9b6_c4a8_4657_8205_ebb015e16f45.slice/crio-2cef814702f6fd8fe91eb4ffcffe4041cb3e101ec694bc75829e9845ea6333f8 WatchSource:0}: Error finding container 2cef814702f6fd8fe91eb4ffcffe4041cb3e101ec694bc75829e9845ea6333f8: Status 404 returned error can't find the container with id 2cef814702f6fd8fe91eb4ffcffe4041cb3e101ec694bc75829e9845ea6333f8 Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.008496 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.088586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerStarted","Data":"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.096885 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerStarted","Data":"2cef814702f6fd8fe91eb4ffcffe4041cb3e101ec694bc75829e9845ea6333f8"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.101847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerStarted","Data":"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.102258 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.103116 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.110330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerStarted","Data":"b51dd9109b450a8b4acfeedfdc72e44df1f4c74f3085203c10bb7112770ffc20"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.118908 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=5.118894345 podStartE2EDuration="5.118894345s" podCreationTimestamp="2026-03-16 13:29:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:13.108157587 +0000 UTC m=+1397.507470134" watchObservedRunningTime="2026-03-16 13:29:13.118894345 +0000 UTC m=+1397.518206892" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.127977 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerStarted","Data":"becd93d7e57d6348294f61bea5ea9a6abee232291ba6298376d6401562533188"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.128028 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerStarted","Data":"e806d9673e5f51ca84996e443bdbaace4d94b4c086e81f47b0e4f05be6acfa25"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.129021 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.132980 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.134216 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerStarted","Data":"ce04f7f5d2907354ec8c60eb24073e84f85408defb3f08b0c460612715d38c04"} Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.139083 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" podStartSLOduration=4.13906927 podStartE2EDuration="4.13906927s" podCreationTimestamp="2026-03-16 13:29:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:13.123877104 +0000 UTC m=+1397.523189650" watchObservedRunningTime="2026-03-16 13:29:13.13906927 +0000 UTC m=+1397.538381806" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.173148 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" podStartSLOduration=3.173135282 podStartE2EDuration="3.173135282s" podCreationTimestamp="2026-03-16 13:29:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:13.150314322 +0000 UTC m=+1397.549626860" watchObservedRunningTime="2026-03-16 13:29:13.173135282 +0000 UTC m=+1397.572447829" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.186733 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=5.186720466 podStartE2EDuration="5.186720466s" podCreationTimestamp="2026-03-16 13:29:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:13.163354521 +0000 UTC m=+1397.562667068" watchObservedRunningTime="2026-03-16 13:29:13.186720466 +0000 UTC m=+1397.586033012" Mar 16 13:29:13 crc kubenswrapper[5030]: I0316 13:29:13.965751 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70cfc92-d3bc-4ee9-bc7d-88e990b5204c" path="/var/lib/kubelet/pods/a70cfc92-d3bc-4ee9-bc7d-88e990b5204c/volumes" Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.146270 5030 generic.go:358] "Generic (PLEG): container finished" podID="8eec7e4c-cba1-485c-b2be-183ebef9ef81" containerID="45cd776cfd3f2b62c621482d21f04df99fc2a5c7d13351dea5bdab697212b25c" exitCode=0 Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.146356 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" event={"ID":"8eec7e4c-cba1-485c-b2be-183ebef9ef81","Type":"ContainerDied","Data":"45cd776cfd3f2b62c621482d21f04df99fc2a5c7d13351dea5bdab697212b25c"} Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.151482 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerStarted","Data":"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516"} Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.155002 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerStarted","Data":"ee003e188fda5d0e10a39831e45901266cc7f16b51a2cee3c70b9ec8747e937e"} Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.171806 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerStarted","Data":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} Mar 16 13:29:14 crc kubenswrapper[5030]: I0316 13:29:14.171836 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerStarted","Data":"6f56f4ba06b3690c5c517899f508c3c4ac73a58518eb48c302dec1fd8c1c50bb"} Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.185458 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerStarted","Data":"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551"} Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.187402 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.190867 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerStarted","Data":"88764ea97346f66c3355f30386a44033b8fceefa3f56bf714f302ccbe5783860"} Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.196144 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerStarted","Data":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.214027 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.213995057 podStartE2EDuration="4.213995057s" podCreationTimestamp="2026-03-16 13:29:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:15.208765244 +0000 UTC m=+1399.608077791" watchObservedRunningTime="2026-03-16 13:29:15.213995057 +0000 UTC m=+1399.613307595" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.519347 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.538584 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.538564733 podStartE2EDuration="4.538564733s" podCreationTimestamp="2026-03-16 13:29:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:15.228947441 +0000 UTC m=+1399.628259989" watchObservedRunningTime="2026-03-16 13:29:15.538564733 +0000 UTC m=+1399.937877280" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.554758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.554811 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxg5f\" (UniqueName: \"kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.554874 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.555027 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.555210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.555268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys\") pod \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\" (UID: \"8eec7e4c-cba1-485c-b2be-183ebef9ef81\") " Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.560352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.562695 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f" (OuterVolumeSpecName: "kube-api-access-xxg5f") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "kube-api-access-xxg5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.565387 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts" (OuterVolumeSpecName: "scripts") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.566344 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.580210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.580622 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data" (OuterVolumeSpecName: "config-data") pod "8eec7e4c-cba1-485c-b2be-183ebef9ef81" (UID: "8eec7e4c-cba1-485c-b2be-183ebef9ef81"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657757 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657781 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657794 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657803 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657810 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxg5f\" (UniqueName: \"kubernetes.io/projected/8eec7e4c-cba1-485c-b2be-183ebef9ef81-kube-api-access-xxg5f\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:15 crc kubenswrapper[5030]: I0316 13:29:15.657818 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8eec7e4c-cba1-485c-b2be-183ebef9ef81-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.217443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" event={"ID":"8eec7e4c-cba1-485c-b2be-183ebef9ef81","Type":"ContainerDied","Data":"1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc"} Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.217751 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b5c65bdcc12453d3be25908527311c33ba8c3453e87585bf955a41ccbfa8cbc" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.217479 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-dmkmz" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.222126 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerStarted","Data":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.321333 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.322264 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eec7e4c-cba1-485c-b2be-183ebef9ef81" containerName="keystone-bootstrap" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.322281 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eec7e4c-cba1-485c-b2be-183ebef9ef81" containerName="keystone-bootstrap" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.322429 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8eec7e4c-cba1-485c-b2be-183ebef9ef81" containerName="keystone-bootstrap" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.325661 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.328329 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-j667m\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.328647 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.328839 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.328988 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.331039 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.333212 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.338458 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373205 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clw6n\" (UniqueName: \"kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373776 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373950 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.373979 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.374066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.374167 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clw6n\" (UniqueName: \"kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475336 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475376 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475454 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.475492 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.482998 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.484316 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.484783 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.484997 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.490629 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.493773 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.493913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.496458 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clw6n\" (UniqueName: \"kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n\") pod \"keystone-68545f5864-422wp\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.642628 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.772242 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:16 crc kubenswrapper[5030]: I0316 13:29:16.972663 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:17 crc kubenswrapper[5030]: W0316 13:29:17.138002 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e8bc6b9_aee5_417e_aa2b_24ce6ac1a480.slice/crio-07628f0810624dee2786623e0ea239fe35939e1541ff02ddbaa79069de940503 WatchSource:0}: Error finding container 07628f0810624dee2786623e0ea239fe35939e1541ff02ddbaa79069de940503: Status 404 returned error can't find the container with id 07628f0810624dee2786623e0ea239fe35939e1541ff02ddbaa79069de940503 Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.149973 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.264353 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" event={"ID":"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480","Type":"ContainerStarted","Data":"07628f0810624dee2786623e0ea239fe35939e1541ff02ddbaa79069de940503"} Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.291875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerStarted","Data":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.292012 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.292008 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-central-agent" containerID="cri-o://8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" gracePeriod=30 Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.292150 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="proxy-httpd" containerID="cri-o://86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" gracePeriod=30 Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.292197 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="sg-core" containerID="cri-o://9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" gracePeriod=30 Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.292236 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-notification-agent" containerID="cri-o://8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" gracePeriod=30 Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.366226 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.605688556 podStartE2EDuration="5.366208967s" podCreationTimestamp="2026-03-16 13:29:12 +0000 UTC" firstStartedPulling="2026-03-16 13:29:13.160308354 +0000 UTC m=+1397.559620901" lastFinishedPulling="2026-03-16 13:29:16.920828764 +0000 UTC m=+1401.320141312" observedRunningTime="2026-03-16 13:29:17.345051145 +0000 UTC m=+1401.744363692" watchObservedRunningTime="2026-03-16 13:29:17.366208967 +0000 UTC m=+1401.765521513" Mar 16 13:29:17 crc kubenswrapper[5030]: I0316 13:29:17.567036 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.252180 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305826 5030 generic.go:358] "Generic (PLEG): container finished" podID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" exitCode=0 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305859 5030 generic.go:358] "Generic (PLEG): container finished" podID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" exitCode=2 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305867 5030 generic.go:358] "Generic (PLEG): container finished" podID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" exitCode=0 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305876 5030 generic.go:358] "Generic (PLEG): container finished" podID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" exitCode=0 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305916 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.305936 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerDied","Data":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.306027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerDied","Data":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.306039 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerDied","Data":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.306050 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerDied","Data":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.306061 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5657bdcb-e250-42eb-9580-6a290d523bfb","Type":"ContainerDied","Data":"6f56f4ba06b3690c5c517899f508c3c4ac73a58518eb48c302dec1fd8c1c50bb"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.306084 5030 scope.go:117] "RemoveContainer" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.311654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" event={"ID":"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480","Type":"ContainerStarted","Data":"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319"} Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.311722 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.312077 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api-log" containerID="cri-o://07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" gracePeriod=30 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.312096 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api" containerID="cri-o://b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" gracePeriod=30 Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330130 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xmcg\" (UniqueName: \"kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330239 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330316 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330678 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330703 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.330829 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.331050 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data\") pod \"5657bdcb-e250-42eb-9580-6a290d523bfb\" (UID: \"5657bdcb-e250-42eb-9580-6a290d523bfb\") " Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.331336 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.332154 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.335146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.358706 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts" (OuterVolumeSpecName: "scripts") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.358774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg" (OuterVolumeSpecName: "kube-api-access-6xmcg") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "kube-api-access-6xmcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.361286 5030 scope.go:117] "RemoveContainer" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.385869 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.406486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.409983 5030 scope.go:117] "RemoveContainer" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.416700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data" (OuterVolumeSpecName: "config-data") pod "5657bdcb-e250-42eb-9580-6a290d523bfb" (UID: "5657bdcb-e250-42eb-9580-6a290d523bfb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.426469 5030 scope.go:117] "RemoveContainer" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.441816 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.441938 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xmcg\" (UniqueName: \"kubernetes.io/projected/5657bdcb-e250-42eb-9580-6a290d523bfb-kube-api-access-6xmcg\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.442000 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5657bdcb-e250-42eb-9580-6a290d523bfb-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.442064 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.442114 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.442162 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5657bdcb-e250-42eb-9580-6a290d523bfb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.619517 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.619594 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.642220 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" podStartSLOduration=2.642207361 podStartE2EDuration="2.642207361s" podCreationTimestamp="2026-03-16 13:29:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:18.337332045 +0000 UTC m=+1402.736644592" watchObservedRunningTime="2026-03-16 13:29:18.642207361 +0000 UTC m=+1403.041519908" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.649210 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.657316 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.660472 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.665213 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667638 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-central-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667669 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-central-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667706 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-notification-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667714 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-notification-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667726 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="proxy-httpd" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667732 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="proxy-httpd" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667755 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="sg-core" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667760 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="sg-core" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667921 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="sg-core" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667938 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-notification-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667952 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="proxy-httpd" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.667960 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" containerName="ceilometer-central-agent" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.690813 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.690856 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.691370 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.703579 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.706736 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.744421 5030 scope.go:117] "RemoveContainer" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: E0316 13:29:18.745209 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": container with ID starting with 86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2 not found: ID does not exist" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.745258 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} err="failed to get container status \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": rpc error: code = NotFound desc = could not find container \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": container with ID starting with 86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.745285 5030 scope.go:117] "RemoveContainer" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: E0316 13:29:18.745739 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": container with ID starting with 9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354 not found: ID does not exist" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.745774 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} err="failed to get container status \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": rpc error: code = NotFound desc = could not find container \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": container with ID starting with 9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.745795 5030 scope.go:117] "RemoveContainer" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: E0316 13:29:18.746097 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": container with ID starting with 8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0 not found: ID does not exist" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746126 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} err="failed to get container status \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": rpc error: code = NotFound desc = could not find container \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": container with ID starting with 8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746141 5030 scope.go:117] "RemoveContainer" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: E0316 13:29:18.746321 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": container with ID starting with 8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8 not found: ID does not exist" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746337 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} err="failed to get container status \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": rpc error: code = NotFound desc = could not find container \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": container with ID starting with 8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746348 5030 scope.go:117] "RemoveContainer" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746527 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} err="failed to get container status \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": rpc error: code = NotFound desc = could not find container \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": container with ID starting with 86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746542 5030 scope.go:117] "RemoveContainer" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746744 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} err="failed to get container status \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": rpc error: code = NotFound desc = could not find container \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": container with ID starting with 9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746758 5030 scope.go:117] "RemoveContainer" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746916 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} err="failed to get container status \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": rpc error: code = NotFound desc = could not find container \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": container with ID starting with 8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.746934 5030 scope.go:117] "RemoveContainer" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747159 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} err="failed to get container status \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": rpc error: code = NotFound desc = could not find container \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": container with ID starting with 8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747176 5030 scope.go:117] "RemoveContainer" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747351 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} err="failed to get container status \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": rpc error: code = NotFound desc = could not find container \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": container with ID starting with 86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747363 5030 scope.go:117] "RemoveContainer" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747523 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} err="failed to get container status \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": rpc error: code = NotFound desc = could not find container \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": container with ID starting with 9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.747538 5030 scope.go:117] "RemoveContainer" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.753644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.753798 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.753951 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.753974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.754279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.754344 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} err="failed to get container status \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": rpc error: code = NotFound desc = could not find container \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": container with ID starting with 8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.754368 5030 scope.go:117] "RemoveContainer" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.754432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.754939 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmjh\" (UniqueName: \"kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.755767 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} err="failed to get container status \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": rpc error: code = NotFound desc = could not find container \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": container with ID starting with 8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.755827 5030 scope.go:117] "RemoveContainer" containerID="86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756199 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2"} err="failed to get container status \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": rpc error: code = NotFound desc = could not find container \"86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2\": container with ID starting with 86a83d65368a9e99ebb008c1d0a53d2728f53cb0c1a1f10b4fa6cce7e49908f2 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756233 5030 scope.go:117] "RemoveContainer" containerID="9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756575 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354"} err="failed to get container status \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": rpc error: code = NotFound desc = could not find container \"9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354\": container with ID starting with 9a238c27b51685101fcd7c3e47d8402f8c9c21efacfa98c83422665a20d6f354 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756600 5030 scope.go:117] "RemoveContainer" containerID="8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756820 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0"} err="failed to get container status \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": rpc error: code = NotFound desc = could not find container \"8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0\": container with ID starting with 8f791a5aedda4372440981f81fdf307ba3c9f22b52058ea6c02fb4fdd22ff0e0 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.756838 5030 scope.go:117] "RemoveContainer" containerID="8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.757026 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8"} err="failed to get container status \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": rpc error: code = NotFound desc = could not find container \"8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8\": container with ID starting with 8d40a4a310ae361b4bd1acb34e25e3938457600c3c098ed7b5f68f7a5cc661e8 not found: ID does not exist" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.861834 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.861910 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmjh\" (UniqueName: \"kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862112 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862235 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862248 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.862701 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.868329 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.869915 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.871515 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.874106 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.879837 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmjh\" (UniqueName: \"kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.884779 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.889530 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.889586 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.922823 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.923281 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:18 crc kubenswrapper[5030]: I0316 13:29:18.961118 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.007958 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.071536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.071621 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.071760 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.071784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.071860 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.072066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czknm\" (UniqueName: \"kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.072163 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id\") pod \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\" (UID: \"8d48c9b6-c4a8-4657-8205-ebb015e16f45\") " Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.073296 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.078885 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs" (OuterVolumeSpecName: "logs") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.082694 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.082733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts" (OuterVolumeSpecName: "scripts") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.082909 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm" (OuterVolumeSpecName: "kube-api-access-czknm") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "kube-api-access-czknm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.099928 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.127466 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data" (OuterVolumeSpecName: "config-data") pod "8d48c9b6-c4a8-4657-8205-ebb015e16f45" (UID: "8d48c9b6-c4a8-4657-8205-ebb015e16f45"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.174924 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.174971 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8d48c9b6-c4a8-4657-8205-ebb015e16f45-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.174981 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.174989 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.174997 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8d48c9b6-c4a8-4657-8205-ebb015e16f45-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.175007 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czknm\" (UniqueName: \"kubernetes.io/projected/8d48c9b6-c4a8-4657-8205-ebb015e16f45-kube-api-access-czknm\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.175059 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8d48c9b6-c4a8-4657-8205-ebb015e16f45-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.329042 5030 generic.go:358] "Generic (PLEG): container finished" podID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerID="b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" exitCode=0 Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.330113 5030 generic.go:358] "Generic (PLEG): container finished" podID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerID="07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" exitCode=143 Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.329238 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerDied","Data":"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551"} Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.330449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerDied","Data":"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516"} Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.330470 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8d48c9b6-c4a8-4657-8205-ebb015e16f45","Type":"ContainerDied","Data":"2cef814702f6fd8fe91eb4ffcffe4041cb3e101ec694bc75829e9845ea6333f8"} Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.330496 5030 scope.go:117] "RemoveContainer" containerID="b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.329386 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.338241 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.338288 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.338303 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.338314 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.366597 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.372496 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.387569 5030 scope.go:117] "RemoveContainer" containerID="07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.400585 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401541 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401582 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401599 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api-log" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401604 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api-log" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401767 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api-log" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.401784 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" containerName="cinder-api" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.405868 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.413085 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.413240 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.414649 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.414723 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.423915 5030 scope.go:117] "RemoveContainer" containerID="b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" Mar 16 13:29:19 crc kubenswrapper[5030]: E0316 13:29:19.424354 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551\": container with ID starting with b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551 not found: ID does not exist" containerID="b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.424379 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551"} err="failed to get container status \"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551\": rpc error: code = NotFound desc = could not find container \"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551\": container with ID starting with b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551 not found: ID does not exist" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.424398 5030 scope.go:117] "RemoveContainer" containerID="07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" Mar 16 13:29:19 crc kubenswrapper[5030]: E0316 13:29:19.427751 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516\": container with ID starting with 07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516 not found: ID does not exist" containerID="07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.427792 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516"} err="failed to get container status \"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516\": rpc error: code = NotFound desc = could not find container \"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516\": container with ID starting with 07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516 not found: ID does not exist" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.427808 5030 scope.go:117] "RemoveContainer" containerID="b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.432191 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551"} err="failed to get container status \"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551\": rpc error: code = NotFound desc = could not find container \"b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551\": container with ID starting with b2920841160486edac9dc329d4d9216b0e9921d04ec98055cbc009ad27577551 not found: ID does not exist" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.432230 5030 scope.go:117] "RemoveContainer" containerID="07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.438716 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516"} err="failed to get container status \"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516\": rpc error: code = NotFound desc = could not find container \"07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516\": container with ID starting with 07e2315226ca7481d0262ce552aa1c6f99b07c7e9c326040d881c0d5ef779516 not found: ID does not exist" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.458163 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488529 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcqnm\" (UniqueName: \"kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488763 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488806 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488863 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.488968 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.489003 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.489082 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.489125 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.564023 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.590861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.590899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.590960 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.590988 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591048 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcqnm\" (UniqueName: \"kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591216 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591261 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.591874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.592176 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.597409 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.597896 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.600339 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.604815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.610381 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.619942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcqnm\" (UniqueName: \"kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.630352 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.631192 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.636291 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.641029 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.642976 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.643255 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.648582 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693393 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm5dv\" (UniqueName: \"kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693740 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693819 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.693848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.748368 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795052 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm5dv\" (UniqueName: \"kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795167 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795214 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.795275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.805280 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.806707 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.807170 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.808050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.808868 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.819117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm5dv\" (UniqueName: \"kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.819142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config\") pod \"neutron-95d576b6b-prbcl\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.831607 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.848378 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.857755 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.867896 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.882758 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.894424 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.896858 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.896921 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.897070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.897210 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.897336 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcpvw\" (UniqueName: \"kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.961449 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.964649 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5657bdcb-e250-42eb-9580-6a290d523bfb" path="/var/lib/kubelet/pods/5657bdcb-e250-42eb-9580-6a290d523bfb/volumes" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.965363 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d48c9b6-c4a8-4657-8205-ebb015e16f45" path="/var/lib/kubelet/pods/8d48c9b6-c4a8-4657-8205-ebb015e16f45/volumes" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.981176 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999216 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcpvw\" (UniqueName: \"kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999256 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7vs6\" (UniqueName: \"kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999378 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999408 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:19 crc kubenswrapper[5030]: I0316 13:29:19.999478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:19.999956 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.001601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.004333 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.007282 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.008764 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.021144 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcpvw\" (UniqueName: \"kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw\") pod \"barbican-worker-5f75b49bc-fnqz9\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.039766 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.111660 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz9f6\" (UniqueName: \"kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.111980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112031 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112169 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7vs6\" (UniqueName: \"kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112252 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112422 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112482 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.112821 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.119308 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.120206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.125457 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.129312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.145760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7vs6\" (UniqueName: \"kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6\") pod \"barbican-keystone-listener-d5b8b9dfb-gs952\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.176954 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.201127 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.213798 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kz9f6\" (UniqueName: \"kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.213832 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.213883 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.213906 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.213963 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.215185 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.219286 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.220276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.221069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.249979 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz9f6\" (UniqueName: \"kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6\") pod \"barbican-api-7fd84ff5f6-jzjlm\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.301410 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.321578 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.374146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerStarted","Data":"203b000253eefb8e80f4809176114912d1051a04c4370730417bd32ca8c8cb32"} Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.383435 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerStarted","Data":"234b10f5c2cd31a37bd42ad4d6a1b6eded8595a7fd0b436ada813abf83c9d538"} Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.512162 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.536531 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.780513 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:29:20 crc kubenswrapper[5030]: I0316 13:29:20.948273 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.320633 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.324661 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.442465 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerStarted","Data":"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.442512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerStarted","Data":"d1d79726426e69ed8d2bd616f27b074ef1634a619220d6400a48740ccdebf46f"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.446141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerStarted","Data":"ad81b0809f607000870416a65320171bc2b3d5f7273f86c77dda2a555b68fd35"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.446176 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerStarted","Data":"0bb81a06629fb460fc5c38fad0e1818a7859f49a12fe3dd72b3fa1175317dcbe"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.446188 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerStarted","Data":"49fcccec27bee7cbab30f78fc2c78091405f1c57a8911ad6bee79abb0caf758d"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.448055 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.454606 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.470971 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerStarted","Data":"a49c7a7845a0906f07e8ac28626e7493a9512843f4b474707f75b95dee6c34f2"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.473830 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" podStartSLOduration=2.473815291 podStartE2EDuration="2.473815291s" podCreationTimestamp="2026-03-16 13:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:21.466580467 +0000 UTC m=+1405.865893014" watchObservedRunningTime="2026-03-16 13:29:21.473815291 +0000 UTC m=+1405.873127838" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.476490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerStarted","Data":"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.488336 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerStarted","Data":"565353abde25898aae519ab0e9ddc9e456d7210808177fc023f7dc8cf4679106"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.488376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerStarted","Data":"aeecbeddeeab6ce864d6a33de452c480d8d6a8aa217823ee7a20fa00e3fe33af"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.496106 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.496823 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerStarted","Data":"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.496852 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerStarted","Data":"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.496864 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerStarted","Data":"6ca035cfd8efa72af42e5285d0d6dbcf483ae8e4f45f6564131f44104dc7667b"} Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.525803 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" podStartSLOduration=2.525788525 podStartE2EDuration="2.525788525s" podCreationTimestamp="2026-03-16 13:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:21.507616696 +0000 UTC m=+1405.906929244" watchObservedRunningTime="2026-03-16 13:29:21.525788525 +0000 UTC m=+1405.925101072" Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.551329 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.551596 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker-log" containerID="cri-o://40bdd37586f9ed7bbbff4202b2e549b2f56dc9da3c42492cc1b37121e618373b" gracePeriod=30 Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.552640 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker" containerID="cri-o://202959c1d24b1ec11546ccc4d1a217a89ef107366ce5b22403ff2b0f4385404a" gracePeriod=30 Mar 16 13:29:21 crc kubenswrapper[5030]: I0316 13:29:21.627120 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.511269 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerStarted","Data":"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.511778 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.514672 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerStarted","Data":"a8b3fc8249b071a04258f1e5b56a89f2c260ca6b63e46153569d02a1ee307881"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.514721 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerStarted","Data":"e2d4c642e2e98b9c771f6edb42675466a1a4cf99f9aa530de442509cd3c93e28"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.516303 5030 generic.go:358] "Generic (PLEG): container finished" podID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerID="40bdd37586f9ed7bbbff4202b2e549b2f56dc9da3c42492cc1b37121e618373b" exitCode=143 Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.516405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerDied","Data":"40bdd37586f9ed7bbbff4202b2e549b2f56dc9da3c42492cc1b37121e618373b"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.518776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerStarted","Data":"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.519100 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.520891 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerStarted","Data":"d89ad58d84afea12dab69a708ae9ca36d50123c272f0d4bce2170ad3120a5050"} Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.574682 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.574666331 podStartE2EDuration="3.574666331s" podCreationTimestamp="2026-03-16 13:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:22.568509625 +0000 UTC m=+1406.967822162" watchObservedRunningTime="2026-03-16 13:29:22.574666331 +0000 UTC m=+1406.973978878" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.580162 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" podStartSLOduration=3.580141345 podStartE2EDuration="3.580141345s" podCreationTimestamp="2026-03-16 13:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:22.539878641 +0000 UTC m=+1406.939191198" watchObservedRunningTime="2026-03-16 13:29:22.580141345 +0000 UTC m=+1406.979453882" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.584681 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" podStartSLOduration=3.584672556 podStartE2EDuration="3.584672556s" podCreationTimestamp="2026-03-16 13:29:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:22.582821264 +0000 UTC m=+1406.982133812" watchObservedRunningTime="2026-03-16 13:29:22.584672556 +0000 UTC m=+1406.983985103" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.615573 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.615866 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener-log" containerID="cri-o://2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e" gracePeriod=30 Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.616207 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener" containerID="cri-o://e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98" gracePeriod=30 Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.904261 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.938506 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.946245 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.946574 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.949108 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.949414 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 13:29:22 crc kubenswrapper[5030]: I0316 13:29:22.963831 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.006146 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112274 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112353 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kwb\" (UniqueName: \"kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112417 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.112569 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.113051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.216627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.216942 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.216992 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.217180 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.217298 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.217415 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kwb\" (UniqueName: \"kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.217452 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.218046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.224185 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.227075 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.227636 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.230060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.234911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.238056 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kwb\" (UniqueName: \"kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb\") pod \"barbican-api-849d469cc6-28g6b\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.270153 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.540152 5030 generic.go:358] "Generic (PLEG): container finished" podID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerID="2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e" exitCode=143 Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.540366 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerDied","Data":"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e"} Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.541608 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="cinder-scheduler" containerID="cri-o://ee003e188fda5d0e10a39831e45901266cc7f16b51a2cee3c70b9ec8747e937e" gracePeriod=30 Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.542562 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.542574 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="probe" containerID="cri-o://88764ea97346f66c3355f30386a44033b8fceefa3f56bf714f302ccbe5783860" gracePeriod=30 Mar 16 13:29:23 crc kubenswrapper[5030]: I0316 13:29:23.745049 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:29:23 crc kubenswrapper[5030]: W0316 13:29:23.748050 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43abd798_ae7e_4ece_832d_6fdaa98b2964.slice/crio-c43e8e79ce69b81922a4932fe123cfad31199b2f69699b5d01cdae54012fd37d WatchSource:0}: Error finding container c43e8e79ce69b81922a4932fe123cfad31199b2f69699b5d01cdae54012fd37d: Status 404 returned error can't find the container with id c43e8e79ce69b81922a4932fe123cfad31199b2f69699b5d01cdae54012fd37d Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.287349 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.287836 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.287885 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.288618 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.288677 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5" gracePeriod=600 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.556385 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerID="88764ea97346f66c3355f30386a44033b8fceefa3f56bf714f302ccbe5783860" exitCode=0 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.556412 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerID="ee003e188fda5d0e10a39831e45901266cc7f16b51a2cee3c70b9ec8747e937e" exitCode=0 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.556426 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerDied","Data":"88764ea97346f66c3355f30386a44033b8fceefa3f56bf714f302ccbe5783860"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.556479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerDied","Data":"ee003e188fda5d0e10a39831e45901266cc7f16b51a2cee3c70b9ec8747e937e"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.560590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerStarted","Data":"d55195694cad34a2cc8da2bd114e7f31ad1129b25da6cb15dd183c6a849560ac"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.560643 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerStarted","Data":"3fb2ce245e24c48262e813f03a90e12d65a1defd05e5c7aedab7328f27348c56"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.560653 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerStarted","Data":"c43e8e79ce69b81922a4932fe123cfad31199b2f69699b5d01cdae54012fd37d"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.561942 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.561970 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.567370 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5" exitCode=0 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.567436 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.567469 5030 scope.go:117] "RemoveContainer" containerID="9d0dcf3b68c476173968db1e7620e4d52bb5cc33ea2fee9f32f1d47a29c88a61" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.570876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerStarted","Data":"f48247123138e8c96a54efd418b2ecc9dcd3abc77cc80fc6ed70f49e7c3792fe"} Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.570911 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api-log" containerID="cri-o://8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" gracePeriod=30 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.571003 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api" containerID="cri-o://3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" gracePeriod=30 Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.616183 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" podStartSLOduration=2.616151872 podStartE2EDuration="2.616151872s" podCreationTimestamp="2026-03-16 13:29:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:24.58612265 +0000 UTC m=+1408.985435197" watchObservedRunningTime="2026-03-16 13:29:24.616151872 +0000 UTC m=+1409.015464420" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.667484 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.001325593 podStartE2EDuration="6.667465666s" podCreationTimestamp="2026-03-16 13:29:18 +0000 UTC" firstStartedPulling="2026-03-16 13:29:19.459933933 +0000 UTC m=+1403.859246480" lastFinishedPulling="2026-03-16 13:29:24.126074006 +0000 UTC m=+1408.525386553" observedRunningTime="2026-03-16 13:29:24.63938126 +0000 UTC m=+1409.038693807" watchObservedRunningTime="2026-03-16 13:29:24.667465666 +0000 UTC m=+1409.066778213" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.837451 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870409 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870474 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870506 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870817 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.870856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mff26\" (UniqueName: \"kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26\") pod \"8fb13a54-4e05-45dc-849d-f13b50da41ce\" (UID: \"8fb13a54-4e05-45dc-849d-f13b50da41ce\") " Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.882848 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.885480 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26" (OuterVolumeSpecName: "kube-api-access-mff26") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "kube-api-access-mff26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.886188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.889640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts" (OuterVolumeSpecName: "scripts") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.925005 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.973331 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.973536 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.973652 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8fb13a54-4e05-45dc-849d-f13b50da41ce-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.973730 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mff26\" (UniqueName: \"kubernetes.io/projected/8fb13a54-4e05-45dc-849d-f13b50da41ce-kube-api-access-mff26\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.973788 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:24 crc kubenswrapper[5030]: I0316 13:29:24.988693 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data" (OuterVolumeSpecName: "config-data") pod "8fb13a54-4e05-45dc-849d-f13b50da41ce" (UID: "8fb13a54-4e05-45dc-849d-f13b50da41ce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.041435 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.075250 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz9f6\" (UniqueName: \"kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6\") pod \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.075298 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data\") pod \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.075340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle\") pod \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.075363 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom\") pod \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.075784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs\") pod \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\" (UID: \"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3\") " Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.076409 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fb13a54-4e05-45dc-849d-f13b50da41ce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.076826 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs" (OuterVolumeSpecName: "logs") pod "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" (UID: "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.081234 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6" (OuterVolumeSpecName: "kube-api-access-kz9f6") pod "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" (UID: "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3"). InnerVolumeSpecName "kube-api-access-kz9f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.092013 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" (UID: "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.105697 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" (UID: "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.135452 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data" (OuterVolumeSpecName: "config-data") pod "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" (UID: "1fd3d3b8-709f-4437-ad07-cb56fd87dbf3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.178108 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.178226 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz9f6\" (UniqueName: \"kubernetes.io/projected/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-kube-api-access-kz9f6\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.178286 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.178339 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.178405 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.583488 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7"} Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.586488 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.586521 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"8fb13a54-4e05-45dc-849d-f13b50da41ce","Type":"ContainerDied","Data":"b51dd9109b450a8b4acfeedfdc72e44df1f4c74f3085203c10bb7112770ffc20"} Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.586614 5030 scope.go:117] "RemoveContainer" containerID="88764ea97346f66c3355f30386a44033b8fceefa3f56bf714f302ccbe5783860" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589525 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerID="3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" exitCode=0 Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589568 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerID="8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" exitCode=143 Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589605 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerDied","Data":"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4"} Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589702 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerDied","Data":"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba"} Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.589716 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm" event={"ID":"1fd3d3b8-709f-4437-ad07-cb56fd87dbf3","Type":"ContainerDied","Data":"d1d79726426e69ed8d2bd616f27b074ef1634a619220d6400a48740ccdebf46f"} Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.590166 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.607275 5030 scope.go:117] "RemoveContainer" containerID="ee003e188fda5d0e10a39831e45901266cc7f16b51a2cee3c70b9ec8747e937e" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.636991 5030 scope.go:117] "RemoveContainer" containerID="3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.660094 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.667158 5030 scope.go:117] "RemoveContainer" containerID="8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.688863 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.741613 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742798 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742818 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742851 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="probe" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742857 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="probe" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742869 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="cinder-scheduler" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742874 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="cinder-scheduler" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742884 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api-log" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.742889 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api-log" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.743051 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="probe" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.743061 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" containerName="cinder-scheduler" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.743066 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.743074 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" containerName="barbican-api-log" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.747569 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.750193 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.754582 5030 scope.go:117] "RemoveContainer" containerID="3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.765571 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:25 crc kubenswrapper[5030]: E0316 13:29:25.774696 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4\": container with ID starting with 3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4 not found: ID does not exist" containerID="3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.774735 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4"} err="failed to get container status \"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4\": rpc error: code = NotFound desc = could not find container \"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4\": container with ID starting with 3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4 not found: ID does not exist" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.774762 5030 scope.go:117] "RemoveContainer" containerID="8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" Mar 16 13:29:25 crc kubenswrapper[5030]: E0316 13:29:25.777080 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba\": container with ID starting with 8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba not found: ID does not exist" containerID="8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.777211 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba"} err="failed to get container status \"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba\": rpc error: code = NotFound desc = could not find container \"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba\": container with ID starting with 8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba not found: ID does not exist" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.777248 5030 scope.go:117] "RemoveContainer" containerID="3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.780611 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7fd84ff5f6-jzjlm"] Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.781652 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4"} err="failed to get container status \"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4\": rpc error: code = NotFound desc = could not find container \"3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4\": container with ID starting with 3fdfd1657f143c21663a431ad4d6bf1c64829933b892e0087dcb5a1226ad56a4 not found: ID does not exist" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.781673 5030 scope.go:117] "RemoveContainer" containerID="8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.784788 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba"} err="failed to get container status \"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba\": rpc error: code = NotFound desc = could not find container \"8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba\": container with ID starting with 8d8218052831d643767ef5daac9c45d333f51c362b753ad7008c0ef5bffd5aba not found: ID does not exist" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.793900 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpmjw\" (UniqueName: \"kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.793955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.794028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.794079 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.794108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.794362 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.808762 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896470 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896590 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896629 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896811 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpmjw\" (UniqueName: \"kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.896990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.897631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.902249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.904384 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.904601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.904770 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.918006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpmjw\" (UniqueName: \"kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw\") pod \"cinder-scheduler-0\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.955766 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fd3d3b8-709f-4437-ad07-cb56fd87dbf3" path="/var/lib/kubelet/pods/1fd3d3b8-709f-4437-ad07-cb56fd87dbf3/volumes" Mar 16 13:29:25 crc kubenswrapper[5030]: I0316 13:29:25.956412 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb13a54-4e05-45dc-849d-f13b50da41ce" path="/var/lib/kubelet/pods/8fb13a54-4e05-45dc-849d-f13b50da41ce/volumes" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.096072 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.596509 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:29:26 crc kubenswrapper[5030]: W0316 13:29:26.609719 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb22a037_ccd0_4346_b587_e41a671f1535.slice/crio-03c023bf5e091270d1a4ebf9457d0a14a809a2ed3e7c07ecbbab2ded5025ec66 WatchSource:0}: Error finding container 03c023bf5e091270d1a4ebf9457d0a14a809a2ed3e7c07ecbbab2ded5025ec66: Status 404 returned error can't find the container with id 03c023bf5e091270d1a4ebf9457d0a14a809a2ed3e7c07ecbbab2ded5025ec66 Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.621107 5030 generic.go:358] "Generic (PLEG): container finished" podID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerID="202959c1d24b1ec11546ccc4d1a217a89ef107366ce5b22403ff2b0f4385404a" exitCode=0 Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.621273 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerDied","Data":"202959c1d24b1ec11546ccc4d1a217a89ef107366ce5b22403ff2b0f4385404a"} Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.879570 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.919508 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data\") pod \"c42c08a1-97c8-4955-8649-f0031f6a78e8\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.919584 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom\") pod \"c42c08a1-97c8-4955-8649-f0031f6a78e8\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.919894 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle\") pod \"c42c08a1-97c8-4955-8649-f0031f6a78e8\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.920269 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbxtq\" (UniqueName: \"kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq\") pod \"c42c08a1-97c8-4955-8649-f0031f6a78e8\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.920458 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs\") pod \"c42c08a1-97c8-4955-8649-f0031f6a78e8\" (UID: \"c42c08a1-97c8-4955-8649-f0031f6a78e8\") " Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.920859 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs" (OuterVolumeSpecName: "logs") pod "c42c08a1-97c8-4955-8649-f0031f6a78e8" (UID: "c42c08a1-97c8-4955-8649-f0031f6a78e8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.921464 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c42c08a1-97c8-4955-8649-f0031f6a78e8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.928087 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c42c08a1-97c8-4955-8649-f0031f6a78e8" (UID: "c42c08a1-97c8-4955-8649-f0031f6a78e8"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.929785 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq" (OuterVolumeSpecName: "kube-api-access-gbxtq") pod "c42c08a1-97c8-4955-8649-f0031f6a78e8" (UID: "c42c08a1-97c8-4955-8649-f0031f6a78e8"). InnerVolumeSpecName "kube-api-access-gbxtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.956216 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c42c08a1-97c8-4955-8649-f0031f6a78e8" (UID: "c42c08a1-97c8-4955-8649-f0031f6a78e8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:26 crc kubenswrapper[5030]: I0316 13:29:26.960342 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data" (OuterVolumeSpecName: "config-data") pod "c42c08a1-97c8-4955-8649-f0031f6a78e8" (UID: "c42c08a1-97c8-4955-8649-f0031f6a78e8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.023802 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.023838 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.023851 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c42c08a1-97c8-4955-8649-f0031f6a78e8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.023861 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbxtq\" (UniqueName: \"kubernetes.io/projected/c42c08a1-97c8-4955-8649-f0031f6a78e8-kube-api-access-gbxtq\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.225986 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.328996 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4zfp\" (UniqueName: \"kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp\") pod \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.329422 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle\") pod \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.329453 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data\") pod \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.329634 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom\") pod \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.329677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs\") pod \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\" (UID: \"dc5b9b25-929d-49d3-af61-c713abc1d1b7\") " Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.330064 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs" (OuterVolumeSpecName: "logs") pod "dc5b9b25-929d-49d3-af61-c713abc1d1b7" (UID: "dc5b9b25-929d-49d3-af61-c713abc1d1b7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.330659 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc5b9b25-929d-49d3-af61-c713abc1d1b7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.336706 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp" (OuterVolumeSpecName: "kube-api-access-x4zfp") pod "dc5b9b25-929d-49d3-af61-c713abc1d1b7" (UID: "dc5b9b25-929d-49d3-af61-c713abc1d1b7"). InnerVolumeSpecName "kube-api-access-x4zfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.338970 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "dc5b9b25-929d-49d3-af61-c713abc1d1b7" (UID: "dc5b9b25-929d-49d3-af61-c713abc1d1b7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.355414 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc5b9b25-929d-49d3-af61-c713abc1d1b7" (UID: "dc5b9b25-929d-49d3-af61-c713abc1d1b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.375526 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data" (OuterVolumeSpecName: "config-data") pod "dc5b9b25-929d-49d3-af61-c713abc1d1b7" (UID: "dc5b9b25-929d-49d3-af61-c713abc1d1b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.434062 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4zfp\" (UniqueName: \"kubernetes.io/projected/dc5b9b25-929d-49d3-af61-c713abc1d1b7-kube-api-access-x4zfp\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.434089 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.434102 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.434116 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/dc5b9b25-929d-49d3-af61-c713abc1d1b7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.642436 5030 generic.go:358] "Generic (PLEG): container finished" podID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerID="e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98" exitCode=0 Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.642540 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.642576 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerDied","Data":"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98"} Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.642620 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv" event={"ID":"dc5b9b25-929d-49d3-af61-c713abc1d1b7","Type":"ContainerDied","Data":"0e064d6c2c3a4ab473c391828f3719800f99b02fc5d8b8c9797a66d83cd3103c"} Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.642644 5030 scope.go:117] "RemoveContainer" containerID="e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.653073 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerStarted","Data":"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2"} Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.653114 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerStarted","Data":"03c023bf5e091270d1a4ebf9457d0a14a809a2ed3e7c07ecbbab2ded5025ec66"} Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.656811 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" event={"ID":"c42c08a1-97c8-4955-8649-f0031f6a78e8","Type":"ContainerDied","Data":"01b33bfa699bad2b7412c74ca0d2ec00e848990cbfc1d50c82a113235f2c50d6"} Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.656879 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.675423 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.685649 5030 scope.go:117] "RemoveContainer" containerID="2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.693740 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-7bd75957b8-9nbqv"] Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.701342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.707250 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-54df8bddcf-mkcrg"] Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.715778 5030 scope.go:117] "RemoveContainer" containerID="e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98" Mar 16 13:29:27 crc kubenswrapper[5030]: E0316 13:29:27.716132 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98\": container with ID starting with e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98 not found: ID does not exist" containerID="e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.716160 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98"} err="failed to get container status \"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98\": rpc error: code = NotFound desc = could not find container \"e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98\": container with ID starting with e91905ffe35e65752d18e4107d6975f5e2a72edbe84f063d8714ec2d05279d98 not found: ID does not exist" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.716178 5030 scope.go:117] "RemoveContainer" containerID="2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e" Mar 16 13:29:27 crc kubenswrapper[5030]: E0316 13:29:27.716484 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e\": container with ID starting with 2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e not found: ID does not exist" containerID="2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.716520 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e"} err="failed to get container status \"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e\": rpc error: code = NotFound desc = could not find container \"2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e\": container with ID starting with 2b1fb78b0d57669e17c16ea99de81c4f9071c43ecc2f7f27b6733df373290f3e not found: ID does not exist" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.716533 5030 scope.go:117] "RemoveContainer" containerID="202959c1d24b1ec11546ccc4d1a217a89ef107366ce5b22403ff2b0f4385404a" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.740313 5030 scope.go:117] "RemoveContainer" containerID="40bdd37586f9ed7bbbff4202b2e549b2f56dc9da3c42492cc1b37121e618373b" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.958755 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" path="/var/lib/kubelet/pods/c42c08a1-97c8-4955-8649-f0031f6a78e8/volumes" Mar 16 13:29:27 crc kubenswrapper[5030]: I0316 13:29:27.959942 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" path="/var/lib/kubelet/pods/dc5b9b25-929d-49d3-af61-c713abc1d1b7/volumes" Mar 16 13:29:28 crc kubenswrapper[5030]: I0316 13:29:28.679981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerStarted","Data":"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea"} Mar 16 13:29:28 crc kubenswrapper[5030]: I0316 13:29:28.700764 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.700748441 podStartE2EDuration="3.700748441s" podCreationTimestamp="2026-03-16 13:29:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:28.695856684 +0000 UTC m=+1413.095169231" watchObservedRunningTime="2026-03-16 13:29:28.700748441 +0000 UTC m=+1413.100060988" Mar 16 13:29:30 crc kubenswrapper[5030]: I0316 13:29:30.196615 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.096590 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.738693 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.843882 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.906014 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.906292 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api-log" containerID="cri-o://a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29" gracePeriod=30 Mar 16 13:29:31 crc kubenswrapper[5030]: I0316 13:29:31.906460 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api" containerID="cri-o://b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19" gracePeriod=30 Mar 16 13:29:32 crc kubenswrapper[5030]: I0316 13:29:32.723067 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerID="a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29" exitCode=143 Mar 16 13:29:32 crc kubenswrapper[5030]: I0316 13:29:32.723151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerDied","Data":"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29"} Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.058159 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.2:9311/healthcheck\": read tcp 10.217.0.2:41872->10.217.1.2:9311: read: connection reset by peer" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.058256 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.2:9311/healthcheck\": read tcp 10.217.0.2:41886->10.217.1.2:9311: read: connection reset by peer" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.451984 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.604087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle\") pod \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.604180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgs42\" (UniqueName: \"kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42\") pod \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.604348 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data\") pod \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.604431 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs\") pod \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.604486 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom\") pod \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\" (UID: \"3a82a33e-aec9-4213-a43c-e4a684f6eff2\") " Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.605604 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs" (OuterVolumeSpecName: "logs") pod "3a82a33e-aec9-4213-a43c-e4a684f6eff2" (UID: "3a82a33e-aec9-4213-a43c-e4a684f6eff2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.610236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42" (OuterVolumeSpecName: "kube-api-access-xgs42") pod "3a82a33e-aec9-4213-a43c-e4a684f6eff2" (UID: "3a82a33e-aec9-4213-a43c-e4a684f6eff2"). InnerVolumeSpecName "kube-api-access-xgs42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.610785 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3a82a33e-aec9-4213-a43c-e4a684f6eff2" (UID: "3a82a33e-aec9-4213-a43c-e4a684f6eff2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.627378 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3a82a33e-aec9-4213-a43c-e4a684f6eff2" (UID: "3a82a33e-aec9-4213-a43c-e4a684f6eff2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.642118 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data" (OuterVolumeSpecName: "config-data") pod "3a82a33e-aec9-4213-a43c-e4a684f6eff2" (UID: "3a82a33e-aec9-4213-a43c-e4a684f6eff2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.705896 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgs42\" (UniqueName: \"kubernetes.io/projected/3a82a33e-aec9-4213-a43c-e4a684f6eff2-kube-api-access-xgs42\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.706063 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.706133 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3a82a33e-aec9-4213-a43c-e4a684f6eff2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.706196 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.706252 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a82a33e-aec9-4213-a43c-e4a684f6eff2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.761919 5030 generic.go:358] "Generic (PLEG): container finished" podID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerID="b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19" exitCode=0 Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.762840 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerDied","Data":"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19"} Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.762990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" event={"ID":"3a82a33e-aec9-4213-a43c-e4a684f6eff2","Type":"ContainerDied","Data":"a2a878417ae985ef3fec87527d0e3844e87e0ebf9b7c68b0d1a8d1767b97983b"} Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.763086 5030 scope.go:117] "RemoveContainer" containerID="b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.763316 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.792268 5030 scope.go:117] "RemoveContainer" containerID="a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.813457 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.816378 5030 scope.go:117] "RemoveContainer" containerID="b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19" Mar 16 13:29:35 crc kubenswrapper[5030]: E0316 13:29:35.816814 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19\": container with ID starting with b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19 not found: ID does not exist" containerID="b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.816855 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19"} err="failed to get container status \"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19\": rpc error: code = NotFound desc = could not find container \"b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19\": container with ID starting with b1866b4eef1bb7c71c40f94d8057c3b0e916fb541de339cdd085268775194f19 not found: ID does not exist" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.816883 5030 scope.go:117] "RemoveContainer" containerID="a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29" Mar 16 13:29:35 crc kubenswrapper[5030]: E0316 13:29:35.817230 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29\": container with ID starting with a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29 not found: ID does not exist" containerID="a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.817252 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29"} err="failed to get container status \"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29\": rpc error: code = NotFound desc = could not find container \"a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29\": container with ID starting with a504ac4f9ca7e636ea0efafbd09dccf7fb96e5abf27d292592f486296318fc29 not found: ID does not exist" Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.821247 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-75cf6687fb-gzm22"] Mar 16 13:29:35 crc kubenswrapper[5030]: I0316 13:29:35.960044 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" path="/var/lib/kubelet/pods/3a82a33e-aec9-4213-a43c-e4a684f6eff2/volumes" Mar 16 13:29:36 crc kubenswrapper[5030]: I0316 13:29:36.351084 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.009099 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011111 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011138 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011154 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011161 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011180 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011185 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011196 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011201 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011207 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011214 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011221 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011226 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011400 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011414 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011425 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c42c08a1-97c8-4955-8649-f0031f6a78e8" containerName="barbican-worker-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011436 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc5b9b25-929d-49d3-af61-c713abc1d1b7" containerName="barbican-keystone-listener" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011447 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api-log" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.011455 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a82a33e-aec9-4213-a43c-e4a684f6eff2" containerName="barbican-api" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.017607 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.030338 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.042531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.042601 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b889b\" (UniqueName: \"kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.042935 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.146407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.146804 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b889b\" (UniqueName: \"kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.146959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.147224 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.147585 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.172430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b889b\" (UniqueName: \"kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b\") pod \"redhat-marketplace-b9tnb\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.339304 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.828203 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:42 crc kubenswrapper[5030]: W0316 13:29:42.834018 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9a9561_f07a_4370_b428_5c96d14ecfbd.slice/crio-bf7b6910512113fe043414b4583f77491c8e13091e88a6900d3d61dd4c2d3e3d WatchSource:0}: Error finding container bf7b6910512113fe043414b4583f77491c8e13091e88a6900d3d61dd4c2d3e3d: Status 404 returned error can't find the container with id bf7b6910512113fe043414b4583f77491c8e13091e88a6900d3d61dd4c2d3e3d Mar 16 13:29:42 crc kubenswrapper[5030]: I0316 13:29:42.879001 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerStarted","Data":"bf7b6910512113fe043414b4583f77491c8e13091e88a6900d3d61dd4c2d3e3d"} Mar 16 13:29:43 crc kubenswrapper[5030]: I0316 13:29:43.140388 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:43 crc kubenswrapper[5030]: I0316 13:29:43.895106 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerID="8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450" exitCode=0 Mar 16 13:29:43 crc kubenswrapper[5030]: I0316 13:29:43.895163 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerDied","Data":"8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450"} Mar 16 13:29:43 crc kubenswrapper[5030]: I0316 13:29:43.935601 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.149467 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.150278 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-log" containerID="cri-o://db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1" gracePeriod=30 Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.150358 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-api" containerID="cri-o://c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8" gracePeriod=30 Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.157537 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.4:8778/\": EOF" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.178544 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.180773 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.4:8778/\": EOF" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.190442 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.220299 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.299323 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.299822 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj74j\" (UniqueName: \"kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.299986 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.300279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.300349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.300537 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.300667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403419 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sj74j\" (UniqueName: \"kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403499 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403612 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403673 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403729 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.403962 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.404090 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.410121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.410179 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.413124 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.414723 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.420739 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.422412 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj74j\" (UniqueName: \"kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j\") pod \"placement-7bdbcdc58-mbp44\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.521599 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.913778 5030 generic.go:358] "Generic (PLEG): container finished" podID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerID="db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1" exitCode=143 Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.914279 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerDied","Data":"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1"} Mar 16 13:29:44 crc kubenswrapper[5030]: W0316 13:29:44.956376 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb712c4b1_f0a7_463d_b8d4_52ff8df7ee2e.slice/crio-b399b105c2e6e62ed1c6bd1df049454c3e414ac3847390537185a6240737ba1a WatchSource:0}: Error finding container b399b105c2e6e62ed1c6bd1df049454c3e414ac3847390537185a6240737ba1a: Status 404 returned error can't find the container with id b399b105c2e6e62ed1c6bd1df049454c3e414ac3847390537185a6240737ba1a Mar 16 13:29:44 crc kubenswrapper[5030]: I0316 13:29:44.957587 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.199339 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.927518 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerID="a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8" exitCode=0 Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.927647 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerDied","Data":"a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8"} Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.932011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerStarted","Data":"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800"} Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.932072 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerStarted","Data":"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37"} Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.932092 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.932103 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.932111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerStarted","Data":"b399b105c2e6e62ed1c6bd1df049454c3e414ac3847390537185a6240737ba1a"} Mar 16 13:29:45 crc kubenswrapper[5030]: I0316 13:29:45.971460 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" podStartSLOduration=1.971441218 podStartE2EDuration="1.971441218s" podCreationTimestamp="2026-03-16 13:29:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:45.969466776 +0000 UTC m=+1430.368779324" watchObservedRunningTime="2026-03-16 13:29:45.971441218 +0000 UTC m=+1430.370753766" Mar 16 13:29:46 crc kubenswrapper[5030]: I0316 13:29:46.946103 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerStarted","Data":"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3"} Mar 16 13:29:46 crc kubenswrapper[5030]: I0316 13:29:46.970944 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-b9tnb" podStartSLOduration=5.060112895 podStartE2EDuration="5.970923539s" podCreationTimestamp="2026-03-16 13:29:41 +0000 UTC" firstStartedPulling="2026-03-16 13:29:43.895914643 +0000 UTC m=+1428.295227190" lastFinishedPulling="2026-03-16 13:29:44.806725287 +0000 UTC m=+1429.206037834" observedRunningTime="2026-03-16 13:29:46.962890975 +0000 UTC m=+1431.362203522" watchObservedRunningTime="2026-03-16 13:29:46.970923539 +0000 UTC m=+1431.370236086" Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.860677 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.973110 5030 generic.go:358] "Generic (PLEG): container finished" podID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerID="c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8" exitCode=0 Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.973155 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerDied","Data":"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8"} Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.973203 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.973222 5030 scope.go:117] "RemoveContainer" containerID="c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8" Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.973207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-8488f86b5b-v6x8d" event={"ID":"7b4a6288-9830-43e1-aab7-83bd1eca7e07","Type":"ContainerDied","Data":"98ca5ebd7127c05228a0a6939c666d96d0b2378d3aa75317258cb25893d86ede"} Mar 16 13:29:48 crc kubenswrapper[5030]: I0316 13:29:48.996251 5030 scope.go:117] "RemoveContainer" containerID="db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000330 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxptc\" (UniqueName: \"kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000809 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.000979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.001115 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts\") pod \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\" (UID: \"7b4a6288-9830-43e1-aab7-83bd1eca7e07\") " Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.001217 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs" (OuterVolumeSpecName: "logs") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.001974 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7b4a6288-9830-43e1-aab7-83bd1eca7e07-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.008490 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc" (OuterVolumeSpecName: "kube-api-access-jxptc") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "kube-api-access-jxptc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.011040 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts" (OuterVolumeSpecName: "scripts") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.034064 5030 scope.go:117] "RemoveContainer" containerID="c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8" Mar 16 13:29:49 crc kubenswrapper[5030]: E0316 13:29:49.034894 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8\": container with ID starting with c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8 not found: ID does not exist" containerID="c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.034935 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8"} err="failed to get container status \"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8\": rpc error: code = NotFound desc = could not find container \"c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8\": container with ID starting with c82b5c0e4d3a78fd08e12f9ac5385189430afa50b69130cfbe828744afc410b8 not found: ID does not exist" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.034960 5030 scope.go:117] "RemoveContainer" containerID="db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1" Mar 16 13:29:49 crc kubenswrapper[5030]: E0316 13:29:49.035419 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1\": container with ID starting with db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1 not found: ID does not exist" containerID="db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.035442 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1"} err="failed to get container status \"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1\": rpc error: code = NotFound desc = could not find container \"db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1\": container with ID starting with db2ac1e2019bf56658494b7b03919d2d07e7be454e9ddf50147da488fbf6d4b1 not found: ID does not exist" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.044799 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.050257 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data" (OuterVolumeSpecName: "config-data") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.072874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.077428 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7b4a6288-9830-43e1-aab7-83bd1eca7e07" (UID: "7b4a6288-9830-43e1-aab7-83bd1eca7e07"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104345 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104363 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104372 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxptc\" (UniqueName: \"kubernetes.io/projected/7b4a6288-9830-43e1-aab7-83bd1eca7e07-kube-api-access-jxptc\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104383 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104394 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.104401 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4a6288-9830-43e1-aab7-83bd1eca7e07-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.305095 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.318077 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-8488f86b5b-v6x8d"] Mar 16 13:29:49 crc kubenswrapper[5030]: I0316 13:29:49.958290 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" path="/var/lib/kubelet/pods/7b4a6288-9830-43e1-aab7-83bd1eca7e07/volumes" Mar 16 13:29:50 crc kubenswrapper[5030]: I0316 13:29:50.622713 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.261042 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.261966 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-api" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.261988 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-api" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.262037 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-log" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.262043 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-log" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.262226 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-log" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.262239 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b4a6288-9830-43e1-aab7-83bd1eca7e07" containerName="placement-api" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.268912 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.281979 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.452623 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm54h\" (UniqueName: \"kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.452696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.453039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.555365 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm54h\" (UniqueName: \"kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.555479 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.555864 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.556494 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.556564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.577581 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm54h\" (UniqueName: \"kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h\") pod \"community-operators-thk85\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.588542 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.689818 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.728002 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.734108 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.736175 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-5r6d6\"" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.737567 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.744254 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.759334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwlj\" (UniqueName: \"kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.759427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.759447 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.759473 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.861785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.861848 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.861920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.862153 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwlj\" (UniqueName: \"kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.865117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.867995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.875083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:51 crc kubenswrapper[5030]: I0316 13:29:51.885190 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwlj\" (UniqueName: \"kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj\") pod \"openstackclient\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.067252 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.082414 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.342053 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.342449 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.388986 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:52 crc kubenswrapper[5030]: W0316 13:29:52.504601 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9f732be_2c17_4d8e_8a58_9997a325139a.slice/crio-cebbe7c944e4ff4c8545ed5b2e369539b34529fb73ff32fdc78160fe19bfb02d WatchSource:0}: Error finding container cebbe7c944e4ff4c8545ed5b2e369539b34529fb73ff32fdc78160fe19bfb02d: Status 404 returned error can't find the container with id cebbe7c944e4ff4c8545ed5b2e369539b34529fb73ff32fdc78160fe19bfb02d Mar 16 13:29:52 crc kubenswrapper[5030]: I0316 13:29:52.505112 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.015207 5030 generic.go:358] "Generic (PLEG): container finished" podID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerID="021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa" exitCode=0 Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.015322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerDied","Data":"021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa"} Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.015666 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerStarted","Data":"7f99d8d84c434b51a1fa8e8b172d5d5772111413a7476eba602f20b7ba3e3e34"} Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.020583 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b9f732be-2c17-4d8e-8a58-9997a325139a","Type":"ContainerStarted","Data":"7a57dc384153c1b7bffb4ec81726c72beceb1f5068e6382d44f88f1f73dfb0bf"} Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.020626 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b9f732be-2c17-4d8e-8a58-9997a325139a","Type":"ContainerStarted","Data":"cebbe7c944e4ff4c8545ed5b2e369539b34529fb73ff32fdc78160fe19bfb02d"} Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.059582 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.05954138 podStartE2EDuration="2.05954138s" podCreationTimestamp="2026-03-16 13:29:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:53.054170631 +0000 UTC m=+1437.453483178" watchObservedRunningTime="2026-03-16 13:29:53.05954138 +0000 UTC m=+1437.458853927" Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.071382 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.561328 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.655407 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.656297 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-api" containerID="cri-o://e806d9673e5f51ca84996e443bdbaace4d94b4c086e81f47b0e4f05be6acfa25" gracePeriod=30 Mar 16 13:29:53 crc kubenswrapper[5030]: I0316 13:29:53.656017 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-httpd" containerID="cri-o://becd93d7e57d6348294f61bea5ea9a6abee232291ba6298376d6401562533188" gracePeriod=30 Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.033884 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerStarted","Data":"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8"} Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.038127 5030 generic.go:358] "Generic (PLEG): container finished" podID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerID="becd93d7e57d6348294f61bea5ea9a6abee232291ba6298376d6401562533188" exitCode=0 Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.038200 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerDied","Data":"becd93d7e57d6348294f61bea5ea9a6abee232291ba6298376d6401562533188"} Mar 16 13:29:54 crc kubenswrapper[5030]: E0316 13:29:54.391141 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1693543 actualBytes=10240 Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.641772 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.719006 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.723417 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.725426 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.725662 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.725783 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.731451 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852207 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852383 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852448 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852810 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.852992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.853087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.853133 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bccf5\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955438 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955466 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bccf5\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955508 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955578 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.955706 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.957340 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.957471 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.963957 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.964525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.969971 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.970671 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.970960 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:54 crc kubenswrapper[5030]: I0316 13:29:54.974190 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bccf5\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5\") pod \"swift-proxy-599cdf5ccd-t7fmv\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.046540 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.053520 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.054153 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-central-agent" containerID="cri-o://a49c7a7845a0906f07e8ac28626e7493a9512843f4b474707f75b95dee6c34f2" gracePeriod=30 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.055152 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="proxy-httpd" containerID="cri-o://f48247123138e8c96a54efd418b2ecc9dcd3abc77cc80fc6ed70f49e7c3792fe" gracePeriod=30 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.055205 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-notification-agent" containerID="cri-o://e2d4c642e2e98b9c771f6edb42675466a1a4cf99f9aa530de442509cd3c93e28" gracePeriod=30 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.055311 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="sg-core" containerID="cri-o://a8b3fc8249b071a04258f1e5b56a89f2c260ca6b63e46153569d02a1ee307881" gracePeriod=30 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.074331 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.117285 5030 generic.go:358] "Generic (PLEG): container finished" podID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerID="9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8" exitCode=0 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.118678 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-b9tnb" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="registry-server" containerID="cri-o://8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3" gracePeriod=2 Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.118907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerDied","Data":"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8"} Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.509386 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.569630 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.579800 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities\") pod \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.579976 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b889b\" (UniqueName: \"kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b\") pod \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.580002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content\") pod \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\" (UID: \"0e9a9561-f07a-4370-b428-5c96d14ecfbd\") " Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.580770 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities" (OuterVolumeSpecName: "utilities") pod "0e9a9561-f07a-4370-b428-5c96d14ecfbd" (UID: "0e9a9561-f07a-4370-b428-5c96d14ecfbd"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.597410 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "0e9a9561-f07a-4370-b428-5c96d14ecfbd" (UID: "0e9a9561-f07a-4370-b428-5c96d14ecfbd"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.597759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b" (OuterVolumeSpecName: "kube-api-access-b889b") pod "0e9a9561-f07a-4370-b428-5c96d14ecfbd" (UID: "0e9a9561-f07a-4370-b428-5c96d14ecfbd"). InnerVolumeSpecName "kube-api-access-b889b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.688287 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.688321 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b889b\" (UniqueName: \"kubernetes.io/projected/0e9a9561-f07a-4370-b428-5c96d14ecfbd-kube-api-access-b889b\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:55 crc kubenswrapper[5030]: I0316 13:29:55.688333 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/0e9a9561-f07a-4370-b428-5c96d14ecfbd-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.131593 5030 generic.go:358] "Generic (PLEG): container finished" podID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerID="8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3" exitCode=0 Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.131724 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerDied","Data":"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.132526 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-b9tnb" event={"ID":"0e9a9561-f07a-4370-b428-5c96d14ecfbd","Type":"ContainerDied","Data":"bf7b6910512113fe043414b4583f77491c8e13091e88a6900d3d61dd4c2d3e3d"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.131829 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-b9tnb" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.132612 5030 scope.go:117] "RemoveContainer" containerID="8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.135400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerStarted","Data":"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.135452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerStarted","Data":"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.135467 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerStarted","Data":"93ad6e5d3f5967b56f75b0e86a953986be5bd5e66dd9bf93dc6f4c7b585b0334"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.135529 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.135576 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.141888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerStarted","Data":"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.146929 5030 generic.go:358] "Generic (PLEG): container finished" podID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerID="f48247123138e8c96a54efd418b2ecc9dcd3abc77cc80fc6ed70f49e7c3792fe" exitCode=0 Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.146949 5030 generic.go:358] "Generic (PLEG): container finished" podID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerID="a8b3fc8249b071a04258f1e5b56a89f2c260ca6b63e46153569d02a1ee307881" exitCode=2 Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.146957 5030 generic.go:358] "Generic (PLEG): container finished" podID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerID="a49c7a7845a0906f07e8ac28626e7493a9512843f4b474707f75b95dee6c34f2" exitCode=0 Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.147020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerDied","Data":"f48247123138e8c96a54efd418b2ecc9dcd3abc77cc80fc6ed70f49e7c3792fe"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.147070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerDied","Data":"a8b3fc8249b071a04258f1e5b56a89f2c260ca6b63e46153569d02a1ee307881"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.147084 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerDied","Data":"a49c7a7845a0906f07e8ac28626e7493a9512843f4b474707f75b95dee6c34f2"} Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.160089 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.164721 5030 scope.go:117] "RemoveContainer" containerID="a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.187681 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-b9tnb"] Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.188700 5030 scope.go:117] "RemoveContainer" containerID="8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.192081 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" podStartSLOduration=2.192058182 podStartE2EDuration="2.192058182s" podCreationTimestamp="2026-03-16 13:29:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:29:56.189220576 +0000 UTC m=+1440.588533124" watchObservedRunningTime="2026-03-16 13:29:56.192058182 +0000 UTC m=+1440.591370729" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.218633 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-thk85" podStartSLOduration=4.559004295 podStartE2EDuration="5.218607924s" podCreationTimestamp="2026-03-16 13:29:51 +0000 UTC" firstStartedPulling="2026-03-16 13:29:53.016252584 +0000 UTC m=+1437.415565131" lastFinishedPulling="2026-03-16 13:29:53.675856213 +0000 UTC m=+1438.075168760" observedRunningTime="2026-03-16 13:29:56.211942099 +0000 UTC m=+1440.611254646" watchObservedRunningTime="2026-03-16 13:29:56.218607924 +0000 UTC m=+1440.617920491" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.241665 5030 scope.go:117] "RemoveContainer" containerID="8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3" Mar 16 13:29:56 crc kubenswrapper[5030]: E0316 13:29:56.243746 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3\": container with ID starting with 8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3 not found: ID does not exist" containerID="8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.243804 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3"} err="failed to get container status \"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3\": rpc error: code = NotFound desc = could not find container \"8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3\": container with ID starting with 8d676ac52be9b7fcd6ab4086395844aad6502e86515a36aef312e67e67758be3 not found: ID does not exist" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.243834 5030 scope.go:117] "RemoveContainer" containerID="a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8" Mar 16 13:29:56 crc kubenswrapper[5030]: E0316 13:29:56.244283 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8\": container with ID starting with a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8 not found: ID does not exist" containerID="a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.244310 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8"} err="failed to get container status \"a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8\": rpc error: code = NotFound desc = could not find container \"a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8\": container with ID starting with a08e485be429e475155bc8b12db0bd1eb7383400b628c82e42bfbef9737e8ea8 not found: ID does not exist" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.244327 5030 scope.go:117] "RemoveContainer" containerID="8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450" Mar 16 13:29:56 crc kubenswrapper[5030]: E0316 13:29:56.244533 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450\": container with ID starting with 8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450 not found: ID does not exist" containerID="8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450" Mar 16 13:29:56 crc kubenswrapper[5030]: I0316 13:29:56.244570 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450"} err="failed to get container status \"8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450\": rpc error: code = NotFound desc = could not find container \"8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450\": container with ID starting with 8b756e26075eb9f15da3cc2b7d2c7e98c0f647e110dadbf6f547b0a386cfa450 not found: ID does not exist" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.082380 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-r74c4"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084020 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="registry-server" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084052 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="registry-server" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084086 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="extract-utilities" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084093 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="extract-utilities" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084099 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="extract-content" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084104 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="extract-content" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.084267 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" containerName="registry-server" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.090714 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.128680 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-r74c4"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.243672 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.243803 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vddqr\" (UniqueName: \"kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.288562 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hkl8r"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.293161 5030 generic.go:358] "Generic (PLEG): container finished" podID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerID="e2d4c642e2e98b9c771f6edb42675466a1a4cf99f9aa530de442509cd3c93e28" exitCode=0 Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.293351 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerDied","Data":"e2d4c642e2e98b9c771f6edb42675466a1a4cf99f9aa530de442509cd3c93e28"} Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.293460 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.308916 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hkl8r"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.319598 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.323588 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.326698 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.327490 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.348942 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.349234 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vddqr\" (UniqueName: \"kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.350223 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.374953 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vddqr\" (UniqueName: \"kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr\") pod \"nova-api-db-create-r74c4\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.401748 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-26jdr"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.407715 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.413939 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-26jdr"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.424540 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.440036 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.440146 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.444689 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.462970 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.463208 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqbfk\" (UniqueName: \"kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.463677 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvwc\" (UniqueName: \"kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.463806 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.537796 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.547400 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566303 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq6rj\" (UniqueName: \"kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566475 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87wn\" (UniqueName: \"kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566733 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqbfk\" (UniqueName: \"kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvwc\" (UniqueName: \"kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.566907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.567326 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.567697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.604891 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqbfk\" (UniqueName: \"kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk\") pod \"nova-cell0-db-create-hkl8r\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.606763 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvwc\" (UniqueName: \"kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc\") pod \"nova-api-762e-account-create-update-fj64p\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.619603 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620736 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-central-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620750 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-central-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620759 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="sg-core" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620765 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="sg-core" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620781 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-notification-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620787 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-notification-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620825 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="proxy-httpd" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620830 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="proxy-httpd" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.620991 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-central-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.621012 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="sg-core" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.621019 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="ceilometer-notification-agent" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.621032 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" containerName="proxy-httpd" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.632695 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.634956 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l"] Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.646048 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.646271 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.657947 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670511 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670614 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670665 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxmjh\" (UniqueName: \"kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670727 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670759 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670792 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml\") pod \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\" (UID: \"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823\") " Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.670907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.671139 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s87wn\" (UniqueName: \"kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.671401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.671424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.671478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xq6rj\" (UniqueName: \"kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.671542 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.672698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.677699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh" (OuterVolumeSpecName: "kube-api-access-xxmjh") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "kube-api-access-xxmjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.677929 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts" (OuterVolumeSpecName: "scripts") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.678662 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.682287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.697891 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87wn\" (UniqueName: \"kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn\") pod \"nova-cell0-c651-account-create-update-lf8w6\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.698641 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq6rj\" (UniqueName: \"kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj\") pod \"nova-cell1-db-create-26jdr\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.706776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.725061 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.753735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.767382 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.773352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data" (OuterVolumeSpecName: "config-data") pod "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" (UID: "f5b7dd4b-ed5d-4e92-8809-91f2a9d05823"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.773851 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfq9\" (UniqueName: \"kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.773892 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774720 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774735 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774751 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxmjh\" (UniqueName: \"kubernetes.io/projected/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-kube-api-access-xxmjh\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774759 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774768 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.774776 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.878925 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thfq9\" (UniqueName: \"kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.879207 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.880223 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.902219 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfq9\" (UniqueName: \"kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9\") pod \"nova-cell1-4896-account-create-update-q5h4l\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.960053 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9a9561-f07a-4370-b428-5c96d14ecfbd" path="/var/lib/kubelet/pods/0e9a9561-f07a-4370-b428-5c96d14ecfbd/volumes" Mar 16 13:29:57 crc kubenswrapper[5030]: I0316 13:29:57.973047 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.099874 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-r74c4"] Mar 16 13:29:58 crc kubenswrapper[5030]: W0316 13:29:58.156525 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80f781dd_8377_49f9_aef5_adadd6eab8f8.slice/crio-1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690 WatchSource:0}: Error finding container 1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690: Status 404 returned error can't find the container with id 1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690 Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.261628 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.269185 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hkl8r"] Mar 16 13:29:58 crc kubenswrapper[5030]: W0316 13:29:58.275562 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62da2c82_ab08_4bdf_b5c3_f225e976c42b.slice/crio-5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560 WatchSource:0}: Error finding container 5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560: Status 404 returned error can't find the container with id 5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560 Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.327476 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" event={"ID":"80f781dd-8377-49f9-aef5-adadd6eab8f8","Type":"ContainerStarted","Data":"1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690"} Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.331802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" event={"ID":"62da2c82-ab08-4bdf-b5c3-f225e976c42b","Type":"ContainerStarted","Data":"5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560"} Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.334475 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" event={"ID":"4bd71cdd-bd4e-48c9-aaf1-55856f014936","Type":"ContainerStarted","Data":"6914e6700718938d59dbbd4f7b1dbc9fc33ec6145b1d993f3d5f599809fa9f10"} Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.338590 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.338597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f5b7dd4b-ed5d-4e92-8809-91f2a9d05823","Type":"ContainerDied","Data":"203b000253eefb8e80f4809176114912d1051a04c4370730417bd32ca8c8cb32"} Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.338684 5030 scope.go:117] "RemoveContainer" containerID="f48247123138e8c96a54efd418b2ecc9dcd3abc77cc80fc6ed70f49e7c3792fe" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.347678 5030 generic.go:358] "Generic (PLEG): container finished" podID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerID="e806d9673e5f51ca84996e443bdbaace4d94b4c086e81f47b0e4f05be6acfa25" exitCode=0 Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.347770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerDied","Data":"e806d9673e5f51ca84996e443bdbaace4d94b4c086e81f47b0e4f05be6acfa25"} Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.356165 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-26jdr"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.377137 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.389872 5030 scope.go:117] "RemoveContainer" containerID="a8b3fc8249b071a04258f1e5b56a89f2c260ca6b63e46153569d02a1ee307881" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.394566 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.409972 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.431290 5030 scope.go:117] "RemoveContainer" containerID="e2d4c642e2e98b9c771f6edb42675466a1a4cf99f9aa530de442509cd3c93e28" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.434143 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.434323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.439263 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.454244 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.464338 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6"] Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495731 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495828 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tvb\" (UniqueName: \"kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.495982 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.496058 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.497426 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l"] Mar 16 13:29:58 crc kubenswrapper[5030]: W0316 13:29:58.500380 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd5aa14f_1185_4e9f_9758_8b7291e12780.slice/crio-26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17 WatchSource:0}: Error finding container 26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17: Status 404 returned error can't find the container with id 26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17 Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.502979 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:58 crc kubenswrapper[5030]: W0316 13:29:58.518668 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d88cc30_809d_4bfa_b22b_17978acce221.slice/crio-7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294 WatchSource:0}: Error finding container 7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294: Status 404 returned error can't find the container with id 7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294 Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.541252 5030 scope.go:117] "RemoveContainer" containerID="a49c7a7845a0906f07e8ac28626e7493a9512843f4b474707f75b95dee6c34f2" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.597324 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config\") pod \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.597415 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle\") pod \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.597780 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnxsh\" (UniqueName: \"kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh\") pod \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.597842 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs\") pod \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.597864 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config\") pod \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\" (UID: \"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f\") " Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.598782 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.598969 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.599006 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.599084 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.599129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.599152 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94tvb\" (UniqueName: \"kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.599303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.605018 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.608085 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.608342 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.618757 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" (UID: "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.619236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.619278 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.622107 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh" (OuterVolumeSpecName: "kube-api-access-jnxsh") pod "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" (UID: "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f"). InnerVolumeSpecName "kube-api-access-jnxsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.623057 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.638111 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tvb\" (UniqueName: \"kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb\") pod \"ceilometer-0\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.702054 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.702118 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnxsh\" (UniqueName: \"kubernetes.io/projected/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-kube-api-access-jnxsh\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.752657 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.762645 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" (UID: "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.778762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config" (OuterVolumeSpecName: "config") pod "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" (UID: "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.788740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" (UID: "1b4687d8-de17-4c8c-9c62-d1d1f5c4967f"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.804297 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.804325 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:58 crc kubenswrapper[5030]: I0316 13:29:58.804334 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.207213 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.365467 5030 generic.go:358] "Generic (PLEG): container finished" podID="80f781dd-8377-49f9-aef5-adadd6eab8f8" containerID="e52fd36ea4a9b71a4b9e1d332348b8e113df83007ce510f0b63219d335b3c2c3" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.365701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" event={"ID":"80f781dd-8377-49f9-aef5-adadd6eab8f8","Type":"ContainerDied","Data":"e52fd36ea4a9b71a4b9e1d332348b8e113df83007ce510f0b63219d335b3c2c3"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.369524 5030 generic.go:358] "Generic (PLEG): container finished" podID="386286f5-eb7f-4cb2-8722-f3e2336a213c" containerID="d00ca3258b8728f5a4b1544c8284e63ba022b5901bb0a1adf286404eefe58ce9" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.369694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" event={"ID":"386286f5-eb7f-4cb2-8722-f3e2336a213c","Type":"ContainerDied","Data":"d00ca3258b8728f5a4b1544c8284e63ba022b5901bb0a1adf286404eefe58ce9"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.369761 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" event={"ID":"386286f5-eb7f-4cb2-8722-f3e2336a213c","Type":"ContainerStarted","Data":"61f4009a651ea1d229536cf4a570eebc2567ea3a2781bca22701e993a4881a4a"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.382774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerStarted","Data":"ea62dd13c7ef2dff3e0b8142a0100f1262963bcf4cff9e375d1e9cce63d41619"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.385479 5030 generic.go:358] "Generic (PLEG): container finished" podID="62da2c82-ab08-4bdf-b5c3-f225e976c42b" containerID="be3021b0ad3241a0fd1fdaeafe2aeaf0f3ba124c5658485700f64f151898ba89" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.385539 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" event={"ID":"62da2c82-ab08-4bdf-b5c3-f225e976c42b","Type":"ContainerDied","Data":"be3021b0ad3241a0fd1fdaeafe2aeaf0f3ba124c5658485700f64f151898ba89"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.388059 5030 generic.go:358] "Generic (PLEG): container finished" podID="4bd71cdd-bd4e-48c9-aaf1-55856f014936" containerID="46cef5d1d64b356716135af45dbdb034352e8473e8cab3d5d9ad5170e6244801" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.388290 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" event={"ID":"4bd71cdd-bd4e-48c9-aaf1-55856f014936","Type":"ContainerDied","Data":"46cef5d1d64b356716135af45dbdb034352e8473e8cab3d5d9ad5170e6244801"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.393620 5030 generic.go:358] "Generic (PLEG): container finished" podID="7d88cc30-809d-4bfa-b22b-17978acce221" containerID="3d6a6b027551a674c70ccdac4cd42c3e402319a88552c11d881b43c4150d52fa" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.393765 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" event={"ID":"7d88cc30-809d-4bfa-b22b-17978acce221","Type":"ContainerDied","Data":"3d6a6b027551a674c70ccdac4cd42c3e402319a88552c11d881b43c4150d52fa"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.393863 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" event={"ID":"7d88cc30-809d-4bfa-b22b-17978acce221","Type":"ContainerStarted","Data":"7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.399787 5030 generic.go:358] "Generic (PLEG): container finished" podID="cd5aa14f-1185-4e9f-9758-8b7291e12780" containerID="6676b29fcc80e0bee745a0d2c16489fefb7d477acb3c5f2107b4eb383c1c9962" exitCode=0 Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.400094 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" event={"ID":"cd5aa14f-1185-4e9f-9758-8b7291e12780","Type":"ContainerDied","Data":"6676b29fcc80e0bee745a0d2c16489fefb7d477acb3c5f2107b4eb383c1c9962"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.400160 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" event={"ID":"cd5aa14f-1185-4e9f-9758-8b7291e12780","Type":"ContainerStarted","Data":"26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.403167 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" event={"ID":"1b4687d8-de17-4c8c-9c62-d1d1f5c4967f","Type":"ContainerDied","Data":"2a11a5ba16df04154fd99356d83fa66d8a5b7868d1c57cf0a4a72643df6bb89b"} Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.403297 5030 scope.go:117] "RemoveContainer" containerID="becd93d7e57d6348294f61bea5ea9a6abee232291ba6298376d6401562533188" Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.403472 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l" Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.441788 5030 scope.go:117] "RemoveContainer" containerID="e806d9673e5f51ca84996e443bdbaace4d94b4c086e81f47b0e4f05be6acfa25" Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.465079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.469268 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-59cb7c74d9-9sd9l"] Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.957901 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" path="/var/lib/kubelet/pods/1b4687d8-de17-4c8c-9c62-d1d1f5c4967f/volumes" Mar 16 13:29:59 crc kubenswrapper[5030]: I0316 13:29:59.958932 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b7dd4b-ed5d-4e92-8809-91f2a9d05823" path="/var/lib/kubelet/pods/f5b7dd4b-ed5d-4e92-8809-91f2a9d05823/volumes" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.130123 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561130-bphmj"] Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131348 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-httpd" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131369 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-httpd" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131380 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-api" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131386 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-api" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131621 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-api" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.131644 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b4687d8-de17-4c8c-9c62-d1d1f5c4967f" containerName="neutron-httpd" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.134694 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.136855 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.137525 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.139578 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561130-bphmj"] Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.140703 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.228166 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9"] Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.238532 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt98n\" (UniqueName: \"kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n\") pod \"auto-csr-approver-29561130-bphmj\" (UID: \"0f263c53-55a3-4d42-9b1a-d2f3d2600126\") " pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.241287 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9"] Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.241427 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.243332 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.243442 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.342266 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.342531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.342675 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt98n\" (UniqueName: \"kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n\") pod \"auto-csr-approver-29561130-bphmj\" (UID: \"0f263c53-55a3-4d42-9b1a-d2f3d2600126\") " pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.342797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrq6f\" (UniqueName: \"kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.364060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt98n\" (UniqueName: \"kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n\") pod \"auto-csr-approver-29561130-bphmj\" (UID: \"0f263c53-55a3-4d42-9b1a-d2f3d2600126\") " pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.413087 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerStarted","Data":"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd"} Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.445094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.445423 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.445463 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrq6f\" (UniqueName: \"kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.446193 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.449778 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.453346 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.461679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrq6f\" (UniqueName: \"kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f\") pod \"collect-profiles-29561130-cpmc9\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.562016 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:00 crc kubenswrapper[5030]: I0316 13:30:00.904761 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.034524 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.062334 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.074223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts\") pod \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.074339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kvwc\" (UniqueName: \"kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc\") pod \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\" (UID: \"4bd71cdd-bd4e-48c9-aaf1-55856f014936\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.075340 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4bd71cdd-bd4e-48c9-aaf1-55856f014936" (UID: "4bd71cdd-bd4e-48c9-aaf1-55856f014936"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.076500 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4bd71cdd-bd4e-48c9-aaf1-55856f014936-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.082508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.082608 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc" (OuterVolumeSpecName: "kube-api-access-6kvwc") pod "4bd71cdd-bd4e-48c9-aaf1-55856f014936" (UID: "4bd71cdd-bd4e-48c9-aaf1-55856f014936"). InnerVolumeSpecName "kube-api-access-6kvwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.119321 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.139650 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.177762 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts\") pod \"cd5aa14f-1185-4e9f-9758-8b7291e12780\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.177901 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq6rj\" (UniqueName: \"kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj\") pod \"386286f5-eb7f-4cb2-8722-f3e2336a213c\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.178054 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s87wn\" (UniqueName: \"kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn\") pod \"cd5aa14f-1185-4e9f-9758-8b7291e12780\" (UID: \"cd5aa14f-1185-4e9f-9758-8b7291e12780\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.178266 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cd5aa14f-1185-4e9f-9758-8b7291e12780" (UID: "cd5aa14f-1185-4e9f-9758-8b7291e12780"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.178353 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts\") pod \"386286f5-eb7f-4cb2-8722-f3e2336a213c\" (UID: \"386286f5-eb7f-4cb2-8722-f3e2336a213c\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.178922 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kvwc\" (UniqueName: \"kubernetes.io/projected/4bd71cdd-bd4e-48c9-aaf1-55856f014936-kube-api-access-6kvwc\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.178940 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cd5aa14f-1185-4e9f-9758-8b7291e12780-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.179124 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "386286f5-eb7f-4cb2-8722-f3e2336a213c" (UID: "386286f5-eb7f-4cb2-8722-f3e2336a213c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.182247 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj" (OuterVolumeSpecName: "kube-api-access-xq6rj") pod "386286f5-eb7f-4cb2-8722-f3e2336a213c" (UID: "386286f5-eb7f-4cb2-8722-f3e2336a213c"). InnerVolumeSpecName "kube-api-access-xq6rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.182727 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn" (OuterVolumeSpecName: "kube-api-access-s87wn") pod "cd5aa14f-1185-4e9f-9758-8b7291e12780" (UID: "cd5aa14f-1185-4e9f-9758-8b7291e12780"). InnerVolumeSpecName "kube-api-access-s87wn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282391 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thfq9\" (UniqueName: \"kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9\") pod \"7d88cc30-809d-4bfa-b22b-17978acce221\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282541 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqbfk\" (UniqueName: \"kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk\") pod \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts\") pod \"7d88cc30-809d-4bfa-b22b-17978acce221\" (UID: \"7d88cc30-809d-4bfa-b22b-17978acce221\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282873 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts\") pod \"80f781dd-8377-49f9-aef5-adadd6eab8f8\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282901 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vddqr\" (UniqueName: \"kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr\") pod \"80f781dd-8377-49f9-aef5-adadd6eab8f8\" (UID: \"80f781dd-8377-49f9-aef5-adadd6eab8f8\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.282931 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts\") pod \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\" (UID: \"62da2c82-ab08-4bdf-b5c3-f225e976c42b\") " Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.283584 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/386286f5-eb7f-4cb2-8722-f3e2336a213c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.283604 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq6rj\" (UniqueName: \"kubernetes.io/projected/386286f5-eb7f-4cb2-8722-f3e2336a213c-kube-api-access-xq6rj\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.283616 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s87wn\" (UniqueName: \"kubernetes.io/projected/cd5aa14f-1185-4e9f-9758-8b7291e12780-kube-api-access-s87wn\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.283877 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "80f781dd-8377-49f9-aef5-adadd6eab8f8" (UID: "80f781dd-8377-49f9-aef5-adadd6eab8f8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.283999 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "62da2c82-ab08-4bdf-b5c3-f225e976c42b" (UID: "62da2c82-ab08-4bdf-b5c3-f225e976c42b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.284317 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7d88cc30-809d-4bfa-b22b-17978acce221" (UID: "7d88cc30-809d-4bfa-b22b-17978acce221"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.289157 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk" (OuterVolumeSpecName: "kube-api-access-mqbfk") pod "62da2c82-ab08-4bdf-b5c3-f225e976c42b" (UID: "62da2c82-ab08-4bdf-b5c3-f225e976c42b"). InnerVolumeSpecName "kube-api-access-mqbfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.289675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr" (OuterVolumeSpecName: "kube-api-access-vddqr") pod "80f781dd-8377-49f9-aef5-adadd6eab8f8" (UID: "80f781dd-8377-49f9-aef5-adadd6eab8f8"). InnerVolumeSpecName "kube-api-access-vddqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.291045 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9" (OuterVolumeSpecName: "kube-api-access-thfq9") pod "7d88cc30-809d-4bfa-b22b-17978acce221" (UID: "7d88cc30-809d-4bfa-b22b-17978acce221"). InnerVolumeSpecName "kube-api-access-thfq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386339 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thfq9\" (UniqueName: \"kubernetes.io/projected/7d88cc30-809d-4bfa-b22b-17978acce221-kube-api-access-thfq9\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386379 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqbfk\" (UniqueName: \"kubernetes.io/projected/62da2c82-ab08-4bdf-b5c3-f225e976c42b-kube-api-access-mqbfk\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386392 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d88cc30-809d-4bfa-b22b-17978acce221-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386407 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/80f781dd-8377-49f9-aef5-adadd6eab8f8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386417 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vddqr\" (UniqueName: \"kubernetes.io/projected/80f781dd-8377-49f9-aef5-adadd6eab8f8-kube-api-access-vddqr\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.386428 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/62da2c82-ab08-4bdf-b5c3-f225e976c42b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:01 crc kubenswrapper[5030]: W0316 13:30:01.406864 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f263c53_55a3_4d42_9b1a_d2f3d2600126.slice/crio-e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f WatchSource:0}: Error finding container e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f: Status 404 returned error can't find the container with id e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.408440 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561130-bphmj"] Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.435413 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" event={"ID":"7d88cc30-809d-4bfa-b22b-17978acce221","Type":"ContainerDied","Data":"7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.435458 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a274383f1afe3e6c5ab1868ede0a87e8c29359130f32af9c9da9d5491183294" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.435544 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l" Mar 16 13:30:01 crc kubenswrapper[5030]: W0316 13:30:01.437876 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83539942_66dd_4a22_aec2_1c71b3a5b104.slice/crio-67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239 WatchSource:0}: Error finding container 67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239: Status 404 returned error can't find the container with id 67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239 Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.438969 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.439295 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6" event={"ID":"cd5aa14f-1185-4e9f-9758-8b7291e12780","Type":"ContainerDied","Data":"26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.439346 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26044ba7f2ffbf2d02884ec337819c9f504da6df245a58647bf360e7160f7f17" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.441367 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9"] Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.442926 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561130-bphmj" event={"ID":"0f263c53-55a3-4d42-9b1a-d2f3d2600126","Type":"ContainerStarted","Data":"e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.447440 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" event={"ID":"80f781dd-8377-49f9-aef5-adadd6eab8f8","Type":"ContainerDied","Data":"1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.447465 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c5d01df4bdb14d23361a7edda011e944182311f3d6e869fb88b6b85a75ab690" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.447472 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-r74c4" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.449828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" event={"ID":"386286f5-eb7f-4cb2-8722-f3e2336a213c","Type":"ContainerDied","Data":"61f4009a651ea1d229536cf4a570eebc2567ea3a2781bca22701e993a4881a4a"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.449872 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61f4009a651ea1d229536cf4a570eebc2567ea3a2781bca22701e993a4881a4a" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.449848 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-26jdr" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.455511 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerStarted","Data":"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.456929 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" event={"ID":"62da2c82-ab08-4bdf-b5c3-f225e976c42b","Type":"ContainerDied","Data":"5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.457041 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a8bb6c0f02c7730e7197c4dc91d2c73992436c822712ece05b0e47221747560" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.456941 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-hkl8r" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.458999 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" event={"ID":"4bd71cdd-bd4e-48c9-aaf1-55856f014936","Type":"ContainerDied","Data":"6914e6700718938d59dbbd4f7b1dbc9fc33ec6145b1d993f3d5f599809fa9f10"} Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.459049 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6914e6700718938d59dbbd4f7b1dbc9fc33ec6145b1d993f3d5f599809fa9f10" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.459108 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.588755 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.588794 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:01 crc kubenswrapper[5030]: I0316 13:30:01.631007 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.309688 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.311915 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.473848 5030 generic.go:358] "Generic (PLEG): container finished" podID="83539942-66dd-4a22-aec2-1c71b3a5b104" containerID="489913792b0b421c936b7c1ae486fac9c093aa9feb7820df22c6fce870ccdd16" exitCode=0 Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.474153 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" event={"ID":"83539942-66dd-4a22-aec2-1c71b3a5b104","Type":"ContainerDied","Data":"489913792b0b421c936b7c1ae486fac9c093aa9feb7820df22c6fce870ccdd16"} Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.474194 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" event={"ID":"83539942-66dd-4a22-aec2-1c71b3a5b104","Type":"ContainerStarted","Data":"67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239"} Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.478290 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerStarted","Data":"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592"} Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.544655 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.597101 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.611460 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh"] Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.613817 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f781dd-8377-49f9-aef5-adadd6eab8f8" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.613961 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f781dd-8377-49f9-aef5-adadd6eab8f8" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614068 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d88cc30-809d-4bfa-b22b-17978acce221" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614123 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d88cc30-809d-4bfa-b22b-17978acce221" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614184 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62da2c82-ab08-4bdf-b5c3-f225e976c42b" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614232 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="62da2c82-ab08-4bdf-b5c3-f225e976c42b" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614382 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd71cdd-bd4e-48c9-aaf1-55856f014936" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614438 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd71cdd-bd4e-48c9-aaf1-55856f014936" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614498 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386286f5-eb7f-4cb2-8722-f3e2336a213c" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.614543 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="386286f5-eb7f-4cb2-8722-f3e2336a213c" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.615189 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5aa14f-1185-4e9f-9758-8b7291e12780" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.615247 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5aa14f-1185-4e9f-9758-8b7291e12780" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.615799 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="62da2c82-ab08-4bdf-b5c3-f225e976c42b" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.615911 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="80f781dd-8377-49f9-aef5-adadd6eab8f8" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.615978 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bd71cdd-bd4e-48c9-aaf1-55856f014936" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.616060 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="386286f5-eb7f-4cb2-8722-f3e2336a213c" containerName="mariadb-database-create" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.616138 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d88cc30-809d-4bfa-b22b-17978acce221" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.616187 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd5aa14f-1185-4e9f-9758-8b7291e12780" containerName="mariadb-account-create-update" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.628788 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.636055 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.636524 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.640529 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh"] Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.644520 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xcxzn\"" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.741206 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9h5\" (UniqueName: \"kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.741530 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.741701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.741986 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.844909 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.846300 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9h5\" (UniqueName: \"kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.846754 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.846860 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.854576 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.854694 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.868724 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.873099 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9h5\" (UniqueName: \"kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5\") pod \"nova-cell0-conductor-db-sync-httfh\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:02 crc kubenswrapper[5030]: I0316 13:30:02.958574 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.418240 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh"] Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.489857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" event={"ID":"1cc340be-9e7c-4e8c-82ce-c69304641291","Type":"ContainerStarted","Data":"1d2de9ec6dd7fc39fd3b79385eba399618b55c278eb66a3cf6fa5b7ddc6d8e66"} Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.801305 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.868396 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrq6f\" (UniqueName: \"kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f\") pod \"83539942-66dd-4a22-aec2-1c71b3a5b104\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.869581 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume\") pod \"83539942-66dd-4a22-aec2-1c71b3a5b104\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.870399 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume\") pod \"83539942-66dd-4a22-aec2-1c71b3a5b104\" (UID: \"83539942-66dd-4a22-aec2-1c71b3a5b104\") " Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.871050 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume" (OuterVolumeSpecName: "config-volume") pod "83539942-66dd-4a22-aec2-1c71b3a5b104" (UID: "83539942-66dd-4a22-aec2-1c71b3a5b104"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.871609 5030 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83539942-66dd-4a22-aec2-1c71b3a5b104-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.874831 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f" (OuterVolumeSpecName: "kube-api-access-qrq6f") pod "83539942-66dd-4a22-aec2-1c71b3a5b104" (UID: "83539942-66dd-4a22-aec2-1c71b3a5b104"). InnerVolumeSpecName "kube-api-access-qrq6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.874948 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "83539942-66dd-4a22-aec2-1c71b3a5b104" (UID: "83539942-66dd-4a22-aec2-1c71b3a5b104"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.974154 5030 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/83539942-66dd-4a22-aec2-1c71b3a5b104-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:03 crc kubenswrapper[5030]: I0316 13:30:03.974394 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrq6f\" (UniqueName: \"kubernetes.io/projected/83539942-66dd-4a22-aec2-1c71b3a5b104-kube-api-access-qrq6f\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.331839 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.512067 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" event={"ID":"1cc340be-9e7c-4e8c-82ce-c69304641291","Type":"ContainerStarted","Data":"27cbf1661e45377b3ba39b34e3b8d84ed1a32926de78d78f885c4057edf37aeb"} Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.514011 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.514042 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561130-cpmc9" event={"ID":"83539942-66dd-4a22-aec2-1c71b3a5b104","Type":"ContainerDied","Data":"67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239"} Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.514063 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67985bf89d2ed877f618e9e49a161ad25d8207072ab382f7ef1ff8aa294ba239" Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.514340 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-thk85" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="registry-server" containerID="cri-o://6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d" gracePeriod=2 Mar 16 13:30:04 crc kubenswrapper[5030]: I0316 13:30:04.531063 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" podStartSLOduration=2.5310544459999997 podStartE2EDuration="2.531054446s" podCreationTimestamp="2026-03-16 13:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:04.526859378 +0000 UTC m=+1448.926171925" watchObservedRunningTime="2026-03-16 13:30:04.531054446 +0000 UTC m=+1448.930366993" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.016259 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.102616 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities\") pod \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.102893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm54h\" (UniqueName: \"kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h\") pod \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.102985 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content\") pod \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\" (UID: \"f2312c80-d81c-4e18-bfdf-4a77aaf85f24\") " Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.103615 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities" (OuterVolumeSpecName: "utilities") pod "f2312c80-d81c-4e18-bfdf-4a77aaf85f24" (UID: "f2312c80-d81c-4e18-bfdf-4a77aaf85f24"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.103831 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.111896 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h" (OuterVolumeSpecName: "kube-api-access-bm54h") pod "f2312c80-d81c-4e18-bfdf-4a77aaf85f24" (UID: "f2312c80-d81c-4e18-bfdf-4a77aaf85f24"). InnerVolumeSpecName "kube-api-access-bm54h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.153687 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "f2312c80-d81c-4e18-bfdf-4a77aaf85f24" (UID: "f2312c80-d81c-4e18-bfdf-4a77aaf85f24"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.206864 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm54h\" (UniqueName: \"kubernetes.io/projected/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-kube-api-access-bm54h\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.206900 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/f2312c80-d81c-4e18-bfdf-4a77aaf85f24-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.528624 5030 generic.go:358] "Generic (PLEG): container finished" podID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" containerID="c5e8822170f352c1e727e24e5a897d47bba1a09b493a06a33fa46f991961dc16" exitCode=0 Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.528738 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561130-bphmj" event={"ID":"0f263c53-55a3-4d42-9b1a-d2f3d2600126","Type":"ContainerDied","Data":"c5e8822170f352c1e727e24e5a897d47bba1a09b493a06a33fa46f991961dc16"} Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.532620 5030 generic.go:358] "Generic (PLEG): container finished" podID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerID="6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d" exitCode=0 Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.532741 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-thk85" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.533701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerDied","Data":"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d"} Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.533734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-thk85" event={"ID":"f2312c80-d81c-4e18-bfdf-4a77aaf85f24","Type":"ContainerDied","Data":"7f99d8d84c434b51a1fa8e8b172d5d5772111413a7476eba602f20b7ba3e3e34"} Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.533755 5030 scope.go:117] "RemoveContainer" containerID="6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.563359 5030 scope.go:117] "RemoveContainer" containerID="9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.581464 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.587782 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-thk85"] Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.606155 5030 scope.go:117] "RemoveContainer" containerID="021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.628681 5030 scope.go:117] "RemoveContainer" containerID="6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d" Mar 16 13:30:05 crc kubenswrapper[5030]: E0316 13:30:05.629122 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d\": container with ID starting with 6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d not found: ID does not exist" containerID="6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.629156 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d"} err="failed to get container status \"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d\": rpc error: code = NotFound desc = could not find container \"6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d\": container with ID starting with 6d7622008bfd42c2c33dfc249f9ecad56a276604a51d4e94e7228d4d9c9bcf2d not found: ID does not exist" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.629182 5030 scope.go:117] "RemoveContainer" containerID="9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8" Mar 16 13:30:05 crc kubenswrapper[5030]: E0316 13:30:05.629508 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8\": container with ID starting with 9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8 not found: ID does not exist" containerID="9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.629854 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8"} err="failed to get container status \"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8\": rpc error: code = NotFound desc = could not find container \"9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8\": container with ID starting with 9fc3b0ac2c008f5b2f610cf09ae089c2d7dcbd16e1ae17280d2e84d3766617b8 not found: ID does not exist" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.629894 5030 scope.go:117] "RemoveContainer" containerID="021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa" Mar 16 13:30:05 crc kubenswrapper[5030]: E0316 13:30:05.630441 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa\": container with ID starting with 021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa not found: ID does not exist" containerID="021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.630472 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa"} err="failed to get container status \"021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa\": rpc error: code = NotFound desc = could not find container \"021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa\": container with ID starting with 021bfe66dab4300046ce7c97689225f4bcbe65065f19fbc80a8fcbf1d97772fa not found: ID does not exist" Mar 16 13:30:05 crc kubenswrapper[5030]: I0316 13:30:05.971005 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" path="/var/lib/kubelet/pods/f2312c80-d81c-4e18-bfdf-4a77aaf85f24/volumes" Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.083831 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.084616 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-log" containerID="cri-o://44d87d4f92c536a1a2003637240a7b977f576223d9b3c5cfda5154b8ab1faf4d" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.084803 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-httpd" containerID="cri-o://ce04f7f5d2907354ec8c60eb24073e84f85408defb3f08b0c460612715d38c04" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.546650 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerStarted","Data":"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da"} Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.546878 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="sg-core" containerID="cri-o://3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.546857 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-central-agent" containerID="cri-o://9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.546901 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="proxy-httpd" containerID="cri-o://421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.547130 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.546923 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-notification-agent" containerID="cri-o://b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0" gracePeriod=30 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.557785 5030 generic.go:358] "Generic (PLEG): container finished" podID="db90caf8-5705-4ef5-899f-39a94574bac2" containerID="44d87d4f92c536a1a2003637240a7b977f576223d9b3c5cfda5154b8ab1faf4d" exitCode=143 Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.558137 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerDied","Data":"44d87d4f92c536a1a2003637240a7b977f576223d9b3c5cfda5154b8ab1faf4d"} Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.586140 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.101199708 podStartE2EDuration="8.586122989s" podCreationTimestamp="2026-03-16 13:29:58 +0000 UTC" firstStartedPulling="2026-03-16 13:29:59.205037188 +0000 UTC m=+1443.604349736" lastFinishedPulling="2026-03-16 13:30:05.689960479 +0000 UTC m=+1450.089273017" observedRunningTime="2026-03-16 13:30:06.575876222 +0000 UTC m=+1450.975188769" watchObservedRunningTime="2026-03-16 13:30:06.586122989 +0000 UTC m=+1450.985435536" Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.866517 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.957268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt98n\" (UniqueName: \"kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n\") pod \"0f263c53-55a3-4d42-9b1a-d2f3d2600126\" (UID: \"0f263c53-55a3-4d42-9b1a-d2f3d2600126\") " Mar 16 13:30:06 crc kubenswrapper[5030]: I0316 13:30:06.962905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n" (OuterVolumeSpecName: "kube-api-access-lt98n") pod "0f263c53-55a3-4d42-9b1a-d2f3d2600126" (UID: "0f263c53-55a3-4d42-9b1a-d2f3d2600126"). InnerVolumeSpecName "kube-api-access-lt98n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.060824 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt98n\" (UniqueName: \"kubernetes.io/projected/0f263c53-55a3-4d42-9b1a-d2f3d2600126-kube-api-access-lt98n\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.501274 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.501657 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-httpd" containerID="cri-o://7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624" gracePeriod=30 Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.501680 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-log" containerID="cri-o://5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06" gracePeriod=30 Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.570228 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561130-bphmj" Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.570854 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561130-bphmj" event={"ID":"0f263c53-55a3-4d42-9b1a-d2f3d2600126","Type":"ContainerDied","Data":"e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f"} Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.571130 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e03c5300bd8efea22b272ab2c9a51733d699627ceb08440d1f5d748f88e1441f" Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574229 5030 generic.go:358] "Generic (PLEG): container finished" podID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerID="421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da" exitCode=0 Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574257 5030 generic.go:358] "Generic (PLEG): container finished" podID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerID="3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592" exitCode=2 Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574265 5030 generic.go:358] "Generic (PLEG): container finished" podID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerID="b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0" exitCode=0 Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574347 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerDied","Data":"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da"} Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574394 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerDied","Data":"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592"} Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.574407 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerDied","Data":"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0"} Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.933612 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561124-xqhfm"] Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.938818 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561124-xqhfm"] Mar 16 13:30:07 crc kubenswrapper[5030]: I0316 13:30:07.956534 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c03aa3-3751-4cda-a944-d0a561269a82" path="/var/lib/kubelet/pods/a6c03aa3-3751-4cda-a944-d0a561269a82/volumes" Mar 16 13:30:08 crc kubenswrapper[5030]: I0316 13:30:08.586181 5030 generic.go:358] "Generic (PLEG): container finished" podID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerID="5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06" exitCode=143 Mar 16 13:30:08 crc kubenswrapper[5030]: I0316 13:30:08.586662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerDied","Data":"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06"} Mar 16 13:30:08 crc kubenswrapper[5030]: I0316 13:30:08.589076 5030 generic.go:358] "Generic (PLEG): container finished" podID="1cc340be-9e7c-4e8c-82ce-c69304641291" containerID="27cbf1661e45377b3ba39b34e3b8d84ed1a32926de78d78f885c4057edf37aeb" exitCode=0 Mar 16 13:30:08 crc kubenswrapper[5030]: I0316 13:30:08.589337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" event={"ID":"1cc340be-9e7c-4e8c-82ce-c69304641291","Type":"ContainerDied","Data":"27cbf1661e45377b3ba39b34e3b8d84ed1a32926de78d78f885c4057edf37aeb"} Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.610691 5030 generic.go:358] "Generic (PLEG): container finished" podID="db90caf8-5705-4ef5-899f-39a94574bac2" containerID="ce04f7f5d2907354ec8c60eb24073e84f85408defb3f08b0c460612715d38c04" exitCode=0 Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.610904 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerDied","Data":"ce04f7f5d2907354ec8c60eb24073e84f85408defb3f08b0c460612715d38c04"} Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.760323 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.938920 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939165 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939226 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqbcp\" (UniqueName: \"kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939449 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939513 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.939700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts\") pod \"db90caf8-5705-4ef5-899f-39a94574bac2\" (UID: \"db90caf8-5705-4ef5-899f-39a94574bac2\") " Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.940497 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.940677 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs" (OuterVolumeSpecName: "logs") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.949492 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.952080 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts" (OuterVolumeSpecName: "scripts") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.948974 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp" (OuterVolumeSpecName: "kube-api-access-qqbcp") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "kube-api-access-qqbcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.965243 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.980174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.987841 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:09 crc kubenswrapper[5030]: I0316 13:30:09.993320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data" (OuterVolumeSpecName: "config-data") pod "db90caf8-5705-4ef5-899f-39a94574bac2" (UID: "db90caf8-5705-4ef5-899f-39a94574bac2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.043958 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.043977 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.043990 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.044000 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.044008 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/db90caf8-5705-4ef5-899f-39a94574bac2-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.044017 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.044032 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/db90caf8-5705-4ef5-899f-39a94574bac2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.044040 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqbcp\" (UniqueName: \"kubernetes.io/projected/db90caf8-5705-4ef5-899f-39a94574bac2-kube-api-access-qqbcp\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.065201 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.145713 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle\") pod \"1cc340be-9e7c-4e8c-82ce-c69304641291\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.145775 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data\") pod \"1cc340be-9e7c-4e8c-82ce-c69304641291\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.145800 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv9h5\" (UniqueName: \"kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5\") pod \"1cc340be-9e7c-4e8c-82ce-c69304641291\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.145865 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts\") pod \"1cc340be-9e7c-4e8c-82ce-c69304641291\" (UID: \"1cc340be-9e7c-4e8c-82ce-c69304641291\") " Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.146417 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.151177 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts" (OuterVolumeSpecName: "scripts") pod "1cc340be-9e7c-4e8c-82ce-c69304641291" (UID: "1cc340be-9e7c-4e8c-82ce-c69304641291"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.151229 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5" (OuterVolumeSpecName: "kube-api-access-tv9h5") pod "1cc340be-9e7c-4e8c-82ce-c69304641291" (UID: "1cc340be-9e7c-4e8c-82ce-c69304641291"). InnerVolumeSpecName "kube-api-access-tv9h5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.170043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1cc340be-9e7c-4e8c-82ce-c69304641291" (UID: "1cc340be-9e7c-4e8c-82ce-c69304641291"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.172399 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data" (OuterVolumeSpecName: "config-data") pod "1cc340be-9e7c-4e8c-82ce-c69304641291" (UID: "1cc340be-9e7c-4e8c-82ce-c69304641291"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.249773 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.249814 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.249829 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cc340be-9e7c-4e8c-82ce-c69304641291-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.249839 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv9h5\" (UniqueName: \"kubernetes.io/projected/1cc340be-9e7c-4e8c-82ce-c69304641291-kube-api-access-tv9h5\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.635062 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"db90caf8-5705-4ef5-899f-39a94574bac2","Type":"ContainerDied","Data":"bf2071fd09f364023075c4a1fb9271c6ee27467a215b16bb5ed3184a8b6e7be6"} Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.635117 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.635141 5030 scope.go:117] "RemoveContainer" containerID="ce04f7f5d2907354ec8c60eb24073e84f85408defb3f08b0c460612715d38c04" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.655646 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" event={"ID":"1cc340be-9e7c-4e8c-82ce-c69304641291","Type":"ContainerDied","Data":"1d2de9ec6dd7fc39fd3b79385eba399618b55c278eb66a3cf6fa5b7ddc6d8e66"} Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.656223 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d2de9ec6dd7fc39fd3b79385eba399618b55c278eb66a3cf6fa5b7ddc6d8e66" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.656644 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.690799 5030 scope.go:117] "RemoveContainer" containerID="44d87d4f92c536a1a2003637240a7b977f576223d9b3c5cfda5154b8ab1faf4d" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.691152 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.711892 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.720701 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721754 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc340be-9e7c-4e8c-82ce-c69304641291" containerName="nova-cell0-conductor-db-sync" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721775 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc340be-9e7c-4e8c-82ce-c69304641291" containerName="nova-cell0-conductor-db-sync" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721796 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="registry-server" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721802 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="registry-server" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721830 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-log" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721835 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-log" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721842 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83539942-66dd-4a22-aec2-1c71b3a5b104" containerName="collect-profiles" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721849 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="83539942-66dd-4a22-aec2-1c71b3a5b104" containerName="collect-profiles" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721867 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-httpd" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721872 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-httpd" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721879 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="extract-content" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721884 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="extract-content" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721894 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="extract-utilities" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721899 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="extract-utilities" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721909 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" containerName="oc" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.721915 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" containerName="oc" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722091 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cc340be-9e7c-4e8c-82ce-c69304641291" containerName="nova-cell0-conductor-db-sync" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722106 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-httpd" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722115 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" containerName="glance-log" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722123 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" containerName="oc" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722130 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="83539942-66dd-4a22-aec2-1c71b3a5b104" containerName="collect-profiles" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.722138 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2312c80-d81c-4e18-bfdf-4a77aaf85f24" containerName="registry-server" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.739016 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.739173 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.742634 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.742916 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.752441 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.752565 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.756199 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.756363 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xcxzn\"" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.767021 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.863496 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.863602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxf9w\" (UniqueName: \"kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.863633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.863692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prjcz\" (UniqueName: \"kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.863730 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864233 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864369 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864467 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864606 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.864703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.966721 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.966787 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.966814 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.966854 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.966881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967032 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967141 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxf9w\" (UniqueName: \"kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967170 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967240 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prjcz\" (UniqueName: \"kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967285 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967442 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.967856 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.972989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.973667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.975188 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.978204 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.978646 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.986060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxf9w\" (UniqueName: \"kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w\") pod \"nova-cell0-conductor-0\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.986369 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prjcz\" (UniqueName: \"kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.988595 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:10 crc kubenswrapper[5030]: I0316 13:30:10.996875 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.111991 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.152418 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.179610 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.264894 5030 scope.go:117] "RemoveContainer" containerID="ec72be981bb2ecb158f3559793f0c849c8180922b1e6fc527a1ec72ae1108818" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.283672 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.284096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzbx2\" (UniqueName: \"kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.284289 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs" (OuterVolumeSpecName: "logs") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.284536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.285677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.285709 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.286072 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.286265 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.286781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts\") pod \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\" (UID: \"13ff667c-98c7-48bd-9c93-e5e86dcc8f22\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.287501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.288844 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.288868 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.291122 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2" (OuterVolumeSpecName: "kube-api-access-rzbx2") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "kube-api-access-rzbx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.291582 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.304800 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts" (OuterVolumeSpecName: "scripts") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.328775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.346719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.346933 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data" (OuterVolumeSpecName: "config-data") pod "13ff667c-98c7-48bd-9c93-e5e86dcc8f22" (UID: "13ff667c-98c7-48bd-9c93-e5e86dcc8f22"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.354277 5030 scope.go:117] "RemoveContainer" containerID="f77227176351f9a70ba2fa4b6cbba0937201bb733f07507ce91c7cd65e9d3a0f" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391337 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391384 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391396 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391404 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391412 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzbx2\" (UniqueName: \"kubernetes.io/projected/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-kube-api-access-rzbx2\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.391422 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/13ff667c-98c7-48bd-9c93-e5e86dcc8f22-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.408203 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.434767 5030 scope.go:117] "RemoveContainer" containerID="4882038dd1f6cc0950ae53b1f1dcb0276ad17a63c21299344097ac2a9f506774" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.474189 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.479404 5030 scope.go:117] "RemoveContainer" containerID="5f152614e6d0dd672732d2eec2b354582233088ed1bef901b75576d907482b9e" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492338 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492474 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492530 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492639 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94tvb\" (UniqueName: \"kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492749 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492895 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.492924 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd\") pod \"b04f826a-5479-4364-a3ba-a6937ee4bf76\" (UID: \"b04f826a-5479-4364-a3ba-a6937ee4bf76\") " Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.493479 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.494505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.496322 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.498274 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts" (OuterVolumeSpecName: "scripts") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.505303 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb" (OuterVolumeSpecName: "kube-api-access-94tvb") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "kube-api-access-94tvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.514976 5030 scope.go:117] "RemoveContainer" containerID="e35825ee9ef0e298e9003e305fa662e0eedce9e0465e0919927342d4166c47f7" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.555871 5030 scope.go:117] "RemoveContainer" containerID="82db00f32c8c63cb49cb3c25884311387e32089d4a6d91059fdcc7c52d1424cd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.565459 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.596835 5030 scope.go:117] "RemoveContainer" containerID="19ea9ccb4b96c925aacc7c8b1fb8719ae3dbf9e8aec6a1f3296793b97e59ff8f" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.602615 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.602648 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.602663 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.602673 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b04f826a-5479-4364-a3ba-a6937ee4bf76-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.602683 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94tvb\" (UniqueName: \"kubernetes.io/projected/b04f826a-5479-4364-a3ba-a6937ee4bf76-kube-api-access-94tvb\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.623097 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.629443 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.632765 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data" (OuterVolumeSpecName: "config-data") pod "b04f826a-5479-4364-a3ba-a6937ee4bf76" (UID: "b04f826a-5479-4364-a3ba-a6937ee4bf76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.649937 5030 scope.go:117] "RemoveContainer" containerID="bbe6774c8f150b12cb2463c6bb3430b81b09ba392e78a838a531ad23ea931c0a" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.667702 5030 generic.go:358] "Generic (PLEG): container finished" podID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerID="9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd" exitCode=0 Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.667813 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.667816 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerDied","Data":"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd"} Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.668206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b04f826a-5479-4364-a3ba-a6937ee4bf76","Type":"ContainerDied","Data":"ea62dd13c7ef2dff3e0b8142a0100f1262963bcf4cff9e375d1e9cce63d41619"} Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.668238 5030 scope.go:117] "RemoveContainer" containerID="421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.674598 5030 generic.go:358] "Generic (PLEG): container finished" podID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerID="7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624" exitCode=0 Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.674750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerDied","Data":"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624"} Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.674777 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"13ff667c-98c7-48bd-9c93-e5e86dcc8f22","Type":"ContainerDied","Data":"b11f7fbd5742a6e8a2804b01e9044401fcb2b925dc42d1d17312472c58c8141b"} Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.674873 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.709570 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.709594 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b04f826a-5479-4364-a3ba-a6937ee4bf76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.709776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerStarted","Data":"f4dce32474a23025eecf747ed4a39b41cdd9cbd3e599174ddfd4ab5bc06d5adf"} Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.709826 5030 scope.go:117] "RemoveContainer" containerID="1d2f58014296e00a29c7d6d35e1fac9bea1b25227a3a049e601087265c03eea0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.735671 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.751730 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.752085 5030 scope.go:117] "RemoveContainer" containerID="3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.776599 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.792602 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.808683 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809874 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809896 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809912 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-notification-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809919 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-notification-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809931 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-log" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809937 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-log" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809955 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="proxy-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809960 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="proxy-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809978 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="sg-core" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809983 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="sg-core" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.809996 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-central-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810002 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-central-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810187 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="sg-core" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810202 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="proxy-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810210 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-httpd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810225 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" containerName="glance-log" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810237 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-central-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.810242 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" containerName="ceilometer-notification-agent" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.814291 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.816633 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.816640 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.820250 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.830541 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.841598 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.848798 5030 scope.go:117] "RemoveContainer" containerID="b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.851453 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.851602 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.855942 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.856199 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.875122 5030 scope.go:117] "RemoveContainer" containerID="1c3eaab187f0425aa62de437b371e6c07798e47404c1adf3f564edabdba98e8e" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.889203 5030 scope.go:117] "RemoveContainer" containerID="9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917495 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917573 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fph9x\" (UniqueName: \"kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917866 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.917981 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918040 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7572\" (UniqueName: \"kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918201 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918248 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918404 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918624 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918664 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.918737 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.936730 5030 scope.go:117] "RemoveContainer" containerID="e46c5e54e3492f3557ef19d5fe7f6aa7298b41f8b7461bbed7d3821ce011807c" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.960045 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ff667c-98c7-48bd-9c93-e5e86dcc8f22" path="/var/lib/kubelet/pods/13ff667c-98c7-48bd-9c93-e5e86dcc8f22/volumes" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.960963 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04f826a-5479-4364-a3ba-a6937ee4bf76" path="/var/lib/kubelet/pods/b04f826a-5479-4364-a3ba-a6937ee4bf76/volumes" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.962541 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db90caf8-5705-4ef5-899f-39a94574bac2" path="/var/lib/kubelet/pods/db90caf8-5705-4ef5-899f-39a94574bac2/volumes" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.971747 5030 scope.go:117] "RemoveContainer" containerID="421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da" Mar 16 13:30:11 crc kubenswrapper[5030]: E0316 13:30:11.972660 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da\": container with ID starting with 421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da not found: ID does not exist" containerID="421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.972703 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da"} err="failed to get container status \"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da\": rpc error: code = NotFound desc = could not find container \"421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da\": container with ID starting with 421681a2d00e69c691384b0ed690ee95e2b5e4ea6d9d7f05be5e4635a57fe3da not found: ID does not exist" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.972729 5030 scope.go:117] "RemoveContainer" containerID="3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592" Mar 16 13:30:11 crc kubenswrapper[5030]: E0316 13:30:11.973635 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592\": container with ID starting with 3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592 not found: ID does not exist" containerID="3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.973675 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592"} err="failed to get container status \"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592\": rpc error: code = NotFound desc = could not find container \"3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592\": container with ID starting with 3e8b2b844939e2341eff90b5cf51b7d8d0ee1523c6794157badde14d95fe3592 not found: ID does not exist" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.973700 5030 scope.go:117] "RemoveContainer" containerID="b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0" Mar 16 13:30:11 crc kubenswrapper[5030]: E0316 13:30:11.974210 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0\": container with ID starting with b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0 not found: ID does not exist" containerID="b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.974238 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0"} err="failed to get container status \"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0\": rpc error: code = NotFound desc = could not find container \"b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0\": container with ID starting with b9cae54e8bc6c946c811e9b86af617f9d268a62b54dbbebac5af9534b0bec4a0 not found: ID does not exist" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.974256 5030 scope.go:117] "RemoveContainer" containerID="9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd" Mar 16 13:30:11 crc kubenswrapper[5030]: E0316 13:30:11.974577 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd\": container with ID starting with 9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd not found: ID does not exist" containerID="9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.974596 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd"} err="failed to get container status \"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd\": rpc error: code = NotFound desc = could not find container \"9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd\": container with ID starting with 9b298b08fbbd6032529471ecd734d603087463b28ae4eefa42f5ece58bd2f9cd not found: ID does not exist" Mar 16 13:30:11 crc kubenswrapper[5030]: I0316 13:30:11.974609 5030 scope.go:117] "RemoveContainer" containerID="7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.006693 5030 scope.go:117] "RemoveContainer" containerID="5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.017728 5030 scope.go:117] "RemoveContainer" containerID="ad042e39fd32034a8827951f4b6bc2b1e662a22c2b751ca4b7409760e088ae0f" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020409 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7572\" (UniqueName: \"kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020492 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020518 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020578 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020608 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020685 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020732 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020836 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fph9x\" (UniqueName: \"kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020896 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020938 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.020993 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.021379 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.021724 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.022008 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.022187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.022225 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.026050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.026899 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.028782 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.029118 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.030005 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.031764 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.032917 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.033335 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.034438 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7572\" (UniqueName: \"kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572\") pod \"ceilometer-0\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.036731 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fph9x\" (UniqueName: \"kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.047189 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.049376 5030 scope.go:117] "RemoveContainer" containerID="7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624" Mar 16 13:30:12 crc kubenswrapper[5030]: E0316 13:30:12.049774 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624\": container with ID starting with 7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624 not found: ID does not exist" containerID="7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.049810 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624"} err="failed to get container status \"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624\": rpc error: code = NotFound desc = could not find container \"7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624\": container with ID starting with 7508dea8092ae8426827814fb5b35b54e468bedb53f584ad2d12bcf805599624 not found: ID does not exist" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.049834 5030 scope.go:117] "RemoveContainer" containerID="5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06" Mar 16 13:30:12 crc kubenswrapper[5030]: E0316 13:30:12.050474 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06\": container with ID starting with 5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06 not found: ID does not exist" containerID="5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.050506 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06"} err="failed to get container status \"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06\": rpc error: code = NotFound desc = could not find container \"5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06\": container with ID starting with 5929955a769cf62acf458feab6522a0ba2281eaa755ae0d74ffe594b583daf06 not found: ID does not exist" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.137207 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.157308 5030 scope.go:117] "RemoveContainer" containerID="de4d712802cd08f4c434ff0b0ce8bc6c035ad10788cb2674d81fe90fe411a59c" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.169152 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.205748 5030 scope.go:117] "RemoveContainer" containerID="85d38f1a0d5bf34c9f33b986e904c30877828bb187767fa9b5e2d4d1d27d718e" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.246136 5030 scope.go:117] "RemoveContainer" containerID="63d8104a12db77ce8b29b21242600360c8c210e5397fbe0339ff1df3fb9452eb" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.308344 5030 scope.go:117] "RemoveContainer" containerID="9d06f49392371fdbf3db80072d2345373b4e2e2c4f74c9e46410d9e0df837e57" Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.637698 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.756056 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.761386 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerStarted","Data":"553bc2a05eaa52fe9b18b4c57b12887b056a560b4e7bdd2c996f18b8a9dee7ef"} Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.788653 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerStarted","Data":"8997984f3554cc009bd50b2decffe59a16f88c0cecd7e44c38430fc4e9d7a3b5"} Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.788709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerStarted","Data":"942be6cdcf8722e04d8a6c4d3ba368245cff95219c67fe2e4cce152b6116146a"} Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.788917 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:12 crc kubenswrapper[5030]: W0316 13:30:12.791151 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac16078d_9b45_4ae6_8c14_43691fc5ac7a.slice/crio-164460c2d0341922e0b0fbd51b40247217394b0fc797d6866bdd247972f48537 WatchSource:0}: Error finding container 164460c2d0341922e0b0fbd51b40247217394b0fc797d6866bdd247972f48537: Status 404 returned error can't find the container with id 164460c2d0341922e0b0fbd51b40247217394b0fc797d6866bdd247972f48537 Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.795211 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerStarted","Data":"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595"} Mar 16 13:30:12 crc kubenswrapper[5030]: I0316 13:30:12.812063 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.811933904 podStartE2EDuration="2.811933904s" podCreationTimestamp="2026-03-16 13:30:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:12.803417009 +0000 UTC m=+1457.202729556" watchObservedRunningTime="2026-03-16 13:30:12.811933904 +0000 UTC m=+1457.211246440" Mar 16 13:30:13 crc kubenswrapper[5030]: I0316 13:30:13.828002 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerStarted","Data":"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03"} Mar 16 13:30:13 crc kubenswrapper[5030]: I0316 13:30:13.841597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerStarted","Data":"d783b170b26f0401eb296e7f0305718beb7face59f74c18d6d21d96c3a5eb405"} Mar 16 13:30:13 crc kubenswrapper[5030]: I0316 13:30:13.853870 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerStarted","Data":"164460c2d0341922e0b0fbd51b40247217394b0fc797d6866bdd247972f48537"} Mar 16 13:30:13 crc kubenswrapper[5030]: I0316 13:30:13.855471 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.8554554210000003 podStartE2EDuration="3.855455421s" podCreationTimestamp="2026-03-16 13:30:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:13.854139936 +0000 UTC m=+1458.253452484" watchObservedRunningTime="2026-03-16 13:30:13.855455421 +0000 UTC m=+1458.254767957" Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.870784 5030 generic.go:358] "Generic (PLEG): container finished" podID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerID="8997984f3554cc009bd50b2decffe59a16f88c0cecd7e44c38430fc4e9d7a3b5" exitCode=1 Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.870872 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerDied","Data":"8997984f3554cc009bd50b2decffe59a16f88c0cecd7e44c38430fc4e9d7a3b5"} Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.872416 5030 scope.go:117] "RemoveContainer" containerID="8997984f3554cc009bd50b2decffe59a16f88c0cecd7e44c38430fc4e9d7a3b5" Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.879662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerStarted","Data":"7c4ac03000a557b6ca65c98eee26a52d4cc8d5dbabc00f8ad6656e9f79e2852b"} Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.887299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerStarted","Data":"9c15195e86251abe634de7a885c641073402ef05deee47d0a20fcad73854a4bc"} Mar 16 13:30:14 crc kubenswrapper[5030]: I0316 13:30:14.914432 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.914410627 podStartE2EDuration="3.914410627s" podCreationTimestamp="2026-03-16 13:30:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:14.905419312 +0000 UTC m=+1459.304731848" watchObservedRunningTime="2026-03-16 13:30:14.914410627 +0000 UTC m=+1459.313723174" Mar 16 13:30:15 crc kubenswrapper[5030]: I0316 13:30:15.900883 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerStarted","Data":"3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4"} Mar 16 13:30:15 crc kubenswrapper[5030]: I0316 13:30:15.901297 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:15 crc kubenswrapper[5030]: I0316 13:30:15.903222 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerStarted","Data":"3f6562c4ac152291af2f3b18a088b58b2190d7c7e9466e801812dae99e162c8a"} Mar 16 13:30:15 crc kubenswrapper[5030]: I0316 13:30:15.903247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerStarted","Data":"e22a9533541547a3482a1d3706282c1d387873ee9eeefb7bc34de12aec547b89"} Mar 16 13:30:16 crc kubenswrapper[5030]: I0316 13:30:16.954382 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.824355 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.881614 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.882274 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-log" containerID="cri-o://18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1" gracePeriod=30 Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.883935 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-api" containerID="cri-o://e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee" gracePeriod=30 Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.931446 5030 generic.go:358] "Generic (PLEG): container finished" podID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerID="3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4" exitCode=1 Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.931544 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerDied","Data":"3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4"} Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.931656 5030 scope.go:117] "RemoveContainer" containerID="8997984f3554cc009bd50b2decffe59a16f88c0cecd7e44c38430fc4e9d7a3b5" Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.932115 5030 scope.go:117] "RemoveContainer" containerID="3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4" Mar 16 13:30:17 crc kubenswrapper[5030]: E0316 13:30:17.932444 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(fae527ec-d6d8-4dba-a38f-a23f5c040e4d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.940936 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerStarted","Data":"5a3c35c28c6d7959b2b356ec6704c3437205a6400290985f18fca0bb1bbce064"} Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.940974 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:17 crc kubenswrapper[5030]: I0316 13:30:17.983204 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.398300234 podStartE2EDuration="6.983171821s" podCreationTimestamp="2026-03-16 13:30:11 +0000 UTC" firstStartedPulling="2026-03-16 13:30:12.792958243 +0000 UTC m=+1457.192270790" lastFinishedPulling="2026-03-16 13:30:17.377829829 +0000 UTC m=+1461.777142377" observedRunningTime="2026-03-16 13:30:17.973793837 +0000 UTC m=+1462.373106385" watchObservedRunningTime="2026-03-16 13:30:17.983171821 +0000 UTC m=+1462.382484498" Mar 16 13:30:18 crc kubenswrapper[5030]: I0316 13:30:18.952762 5030 generic.go:358] "Generic (PLEG): container finished" podID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerID="18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1" exitCode=143 Mar 16 13:30:18 crc kubenswrapper[5030]: I0316 13:30:18.952853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerDied","Data":"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1"} Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.102641 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.108120 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.120018 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.192499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.192966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs9vw\" (UniqueName: \"kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.193064 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.295317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs9vw\" (UniqueName: \"kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.295377 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.295445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.295846 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.295900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.314223 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs9vw\" (UniqueName: \"kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw\") pod \"certified-operators-55c25\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.424072 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.864513 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:19 crc kubenswrapper[5030]: W0316 13:30:19.871687 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55aca69_13c4_4944_b587_9d3ce839b678.slice/crio-c628e419154ccd5863a1cccccdd5797dad3f5a57a66d83840fe780dfb3145fab WatchSource:0}: Error finding container c628e419154ccd5863a1cccccdd5797dad3f5a57a66d83840fe780dfb3145fab: Status 404 returned error can't find the container with id c628e419154ccd5863a1cccccdd5797dad3f5a57a66d83840fe780dfb3145fab Mar 16 13:30:19 crc kubenswrapper[5030]: I0316 13:30:19.983411 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerStarted","Data":"c628e419154ccd5863a1cccccdd5797dad3f5a57a66d83840fe780dfb3145fab"} Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.152790 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.153423 5030 scope.go:117] "RemoveContainer" containerID="3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4" Mar 16 13:30:20 crc kubenswrapper[5030]: E0316 13:30:20.153821 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nova-cell0-conductor-conductor\" with CrashLoopBackOff: \"back-off 10s restarting failed container=nova-cell0-conductor-conductor pod=nova-cell0-conductor-0_openstack-kuttl-tests(fae527ec-d6d8-4dba-a38f-a23f5c040e4d)\"" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.344079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.389647 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.389982 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-central-agent" containerID="cri-o://9c15195e86251abe634de7a885c641073402ef05deee47d0a20fcad73854a4bc" gracePeriod=30 Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.390034 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="proxy-httpd" containerID="cri-o://5a3c35c28c6d7959b2b356ec6704c3437205a6400290985f18fca0bb1bbce064" gracePeriod=30 Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.390041 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="sg-core" containerID="cri-o://3f6562c4ac152291af2f3b18a088b58b2190d7c7e9466e801812dae99e162c8a" gracePeriod=30 Mar 16 13:30:20 crc kubenswrapper[5030]: I0316 13:30:20.390115 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-notification-agent" containerID="cri-o://e22a9533541547a3482a1d3706282c1d387873ee9eeefb7bc34de12aec547b89" gracePeriod=30 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.026342 5030 generic.go:358] "Generic (PLEG): container finished" podID="d55aca69-13c4-4944-b587-9d3ce839b678" containerID="c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d" exitCode=0 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.026878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerDied","Data":"c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d"} Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034009 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerID="5a3c35c28c6d7959b2b356ec6704c3437205a6400290985f18fca0bb1bbce064" exitCode=0 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034062 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerID="3f6562c4ac152291af2f3b18a088b58b2190d7c7e9466e801812dae99e162c8a" exitCode=2 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034069 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerID="e22a9533541547a3482a1d3706282c1d387873ee9eeefb7bc34de12aec547b89" exitCode=0 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034077 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerID="9c15195e86251abe634de7a885c641073402ef05deee47d0a20fcad73854a4bc" exitCode=0 Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034084 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerDied","Data":"5a3c35c28c6d7959b2b356ec6704c3437205a6400290985f18fca0bb1bbce064"} Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034117 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerDied","Data":"3f6562c4ac152291af2f3b18a088b58b2190d7c7e9466e801812dae99e162c8a"} Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034129 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerDied","Data":"e22a9533541547a3482a1d3706282c1d387873ee9eeefb7bc34de12aec547b89"} Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.034141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerDied","Data":"9c15195e86251abe634de7a885c641073402ef05deee47d0a20fcad73854a4bc"} Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.112850 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.112891 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.141810 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.149134 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.154785 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.236301 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.251189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.251616 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.254539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.254602 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.254784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7572\" (UniqueName: \"kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.254893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.254916 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.255065 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd\") pod \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\" (UID: \"ac16078d-9b45-4ae6-8c14-43691fc5ac7a\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.255865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.256687 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.256714 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.260692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572" (OuterVolumeSpecName: "kube-api-access-m7572") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "kube-api-access-m7572". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.261344 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts" (OuterVolumeSpecName: "scripts") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.292475 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.323999 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.336049 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data" (OuterVolumeSpecName: "config-data") pod "ac16078d-9b45-4ae6-8c14-43691fc5ac7a" (UID: "ac16078d-9b45-4ae6-8c14-43691fc5ac7a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.358200 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxf9w\" (UniqueName: \"kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w\") pod \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.358370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data\") pod \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.358830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle\") pod \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\" (UID: \"fae527ec-d6d8-4dba-a38f-a23f5c040e4d\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.359606 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.359627 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.359639 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7572\" (UniqueName: \"kubernetes.io/projected/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-kube-api-access-m7572\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.359650 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.359658 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ac16078d-9b45-4ae6-8c14-43691fc5ac7a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.361416 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w" (OuterVolumeSpecName: "kube-api-access-jxf9w") pod "fae527ec-d6d8-4dba-a38f-a23f5c040e4d" (UID: "fae527ec-d6d8-4dba-a38f-a23f5c040e4d"). InnerVolumeSpecName "kube-api-access-jxf9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.376297 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data" (OuterVolumeSpecName: "config-data") pod "fae527ec-d6d8-4dba-a38f-a23f5c040e4d" (UID: "fae527ec-d6d8-4dba-a38f-a23f5c040e4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.382248 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fae527ec-d6d8-4dba-a38f-a23f5c040e4d" (UID: "fae527ec-d6d8-4dba-a38f-a23f5c040e4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.402652 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.462933 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.462981 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxf9w\" (UniqueName: \"kubernetes.io/projected/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-kube-api-access-jxf9w\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.462996 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fae527ec-d6d8-4dba-a38f-a23f5c040e4d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.564721 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle\") pod \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.564923 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts\") pod \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.565045 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh7pw\" (UniqueName: \"kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw\") pod \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.565103 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data\") pod \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.565481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs\") pod \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\" (UID: \"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4\") " Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.565998 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs" (OuterVolumeSpecName: "logs") pod "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" (UID: "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.566744 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.568775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts" (OuterVolumeSpecName: "scripts") pod "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" (UID: "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.571767 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw" (OuterVolumeSpecName: "kube-api-access-fh7pw") pod "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" (UID: "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4"). InnerVolumeSpecName "kube-api-access-fh7pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.606153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" (UID: "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.612962 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data" (OuterVolumeSpecName: "config-data") pod "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" (UID: "0eea2715-5b9b-47e0-9d1e-9c20c632f0c4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.668568 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.668598 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh7pw\" (UniqueName: \"kubernetes.io/projected/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-kube-api-access-fh7pw\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.668610 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:21 crc kubenswrapper[5030]: I0316 13:30:21.668622 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.047045 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.047079 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fae527ec-d6d8-4dba-a38f-a23f5c040e4d","Type":"ContainerDied","Data":"942be6cdcf8722e04d8a6c4d3ba368245cff95219c67fe2e4cce152b6116146a"} Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.047411 5030 scope.go:117] "RemoveContainer" containerID="3df7b2987c120bce65f87b6523c2afe5dc4dc97637448d8cca4ca14311aa08f4" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.049802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerStarted","Data":"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3"} Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.057786 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ac16078d-9b45-4ae6-8c14-43691fc5ac7a","Type":"ContainerDied","Data":"164460c2d0341922e0b0fbd51b40247217394b0fc797d6866bdd247972f48537"} Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.057849 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.067229 5030 generic.go:358] "Generic (PLEG): container finished" podID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerID="e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee" exitCode=0 Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.067904 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.067944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerDied","Data":"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee"} Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.069301 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.069334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-58b6dcbb66-vgjkr" event={"ID":"0eea2715-5b9b-47e0-9d1e-9c20c632f0c4","Type":"ContainerDied","Data":"e15e04e58c954fc53b0337034e0a779c710dd57a58e63f7bb2bb395d3ee977b7"} Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.069359 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.138263 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.138307 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.141664 5030 scope.go:117] "RemoveContainer" containerID="5a3c35c28c6d7959b2b356ec6704c3437205a6400290985f18fca0bb1bbce064" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.144994 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.156189 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.164320 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.170151 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.183499 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185199 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="sg-core" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185229 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="sg-core" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185249 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-notification-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185258 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-notification-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185300 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185308 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185345 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="proxy-httpd" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185356 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="proxy-httpd" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185366 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-api" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185373 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-api" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185389 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-log" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185394 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-log" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185408 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185414 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185443 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-central-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185449 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-central-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185770 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-api" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185815 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185839 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" containerName="placement-log" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185851 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-central-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185865 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="sg-core" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185876 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="ceilometer-notification-agent" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.185885 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" containerName="proxy-httpd" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.199427 5030 scope.go:117] "RemoveContainer" containerID="3f6562c4ac152291af2f3b18a088b58b2190d7c7e9466e801812dae99e162c8a" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.202455 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.207760 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xcxzn\"" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.207981 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.211773 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.211813 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.211884 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.241471 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.245412 5030 scope.go:117] "RemoveContainer" containerID="e22a9533541547a3482a1d3706282c1d387873ee9eeefb7bc34de12aec547b89" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.270152 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-58b6dcbb66-vgjkr"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.275656 5030 scope.go:117] "RemoveContainer" containerID="9c15195e86251abe634de7a885c641073402ef05deee47d0a20fcad73854a4bc" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.279935 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.284010 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.290448 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.290611 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.297221 5030 scope.go:117] "RemoveContainer" containerID="e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.298524 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.300143 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.322706 5030 scope.go:117] "RemoveContainer" containerID="18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.347980 5030 scope.go:117] "RemoveContainer" containerID="e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee" Mar 16 13:30:22 crc kubenswrapper[5030]: E0316 13:30:22.348588 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee\": container with ID starting with e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee not found: ID does not exist" containerID="e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.348644 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee"} err="failed to get container status \"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee\": rpc error: code = NotFound desc = could not find container \"e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee\": container with ID starting with e5c2e1d7d359f0b80209b9a694795aa8d6c80deffeb6aeab60cf95555ea50bee not found: ID does not exist" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.348667 5030 scope.go:117] "RemoveContainer" containerID="18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1" Mar 16 13:30:22 crc kubenswrapper[5030]: E0316 13:30:22.349017 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1\": container with ID starting with 18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1 not found: ID does not exist" containerID="18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.349077 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1"} err="failed to get container status \"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1\": rpc error: code = NotFound desc = could not find container \"18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1\": container with ID starting with 18956f5e458ff372773545a4b68061e9691ac541642d7cd088a788f7f285d3d1 not found: ID does not exist" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.383370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.383424 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.383452 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.383650 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.383876 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwb69\" (UniqueName: \"kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.384035 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.384360 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.384416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.384467 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.384497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.487383 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.487457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.487504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.487847 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488047 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488567 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488603 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488651 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488812 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwb69\" (UniqueName: \"kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488883 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.488987 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.496920 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.498805 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.505691 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.505730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.508138 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwb69\" (UniqueName: \"kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.511088 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts\") pod \"ceilometer-0\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.511725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.512167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l\") pod \"nova-cell0-conductor-0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.545765 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:22 crc kubenswrapper[5030]: I0316 13:30:22.612231 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.014149 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.093038 5030 generic.go:358] "Generic (PLEG): container finished" podID="d55aca69-13c4-4944-b587-9d3ce839b678" containerID="22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3" exitCode=0 Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.093382 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerDied","Data":"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3"} Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.093420 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerStarted","Data":"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc"} Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.101578 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2137cf84-8d68-4069-96cd-33b996b682f0","Type":"ContainerStarted","Data":"26db0434ad7d8a22ee4123ee114fb0145eeec46c33249a42280b066465812115"} Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.107995 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.108678 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.111749 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.116793 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-55c25" podStartSLOduration=3.409295082 podStartE2EDuration="4.116777829s" podCreationTimestamp="2026-03-16 13:30:19 +0000 UTC" firstStartedPulling="2026-03-16 13:30:21.02803648 +0000 UTC m=+1465.427349027" lastFinishedPulling="2026-03-16 13:30:21.735519237 +0000 UTC m=+1466.134831774" observedRunningTime="2026-03-16 13:30:23.112956444 +0000 UTC m=+1467.512268990" watchObservedRunningTime="2026-03-16 13:30:23.116777829 +0000 UTC m=+1467.516090375" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.867880 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.876634 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.958010 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eea2715-5b9b-47e0-9d1e-9c20c632f0c4" path="/var/lib/kubelet/pods/0eea2715-5b9b-47e0-9d1e-9c20c632f0c4/volumes" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.958667 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac16078d-9b45-4ae6-8c14-43691fc5ac7a" path="/var/lib/kubelet/pods/ac16078d-9b45-4ae6-8c14-43691fc5ac7a/volumes" Mar 16 13:30:23 crc kubenswrapper[5030]: I0316 13:30:23.959345 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fae527ec-d6d8-4dba-a38f-a23f5c040e4d" path="/var/lib/kubelet/pods/fae527ec-d6d8-4dba-a38f-a23f5c040e4d/volumes" Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.116590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2137cf84-8d68-4069-96cd-33b996b682f0","Type":"ContainerStarted","Data":"f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407"} Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.116754 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.118942 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerStarted","Data":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.118993 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerStarted","Data":"ee766310efda799cbafa5a7f528cc56e04b9b48e4b06e3e86a1b1f4607f6e68d"} Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.133525 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.133505947 podStartE2EDuration="2.133505947s" podCreationTimestamp="2026-03-16 13:30:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:24.130160245 +0000 UTC m=+1468.529472792" watchObservedRunningTime="2026-03-16 13:30:24.133505947 +0000 UTC m=+1468.532818494" Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.776562 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:24 crc kubenswrapper[5030]: I0316 13:30:24.846128 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:30:25 crc kubenswrapper[5030]: I0316 13:30:25.136592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerStarted","Data":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} Mar 16 13:30:26 crc kubenswrapper[5030]: I0316 13:30:26.149530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerStarted","Data":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} Mar 16 13:30:28 crc kubenswrapper[5030]: I0316 13:30:28.176820 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerStarted","Data":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} Mar 16 13:30:28 crc kubenswrapper[5030]: I0316 13:30:28.177881 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:28 crc kubenswrapper[5030]: I0316 13:30:28.207760 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.850924199 podStartE2EDuration="6.207740675s" podCreationTimestamp="2026-03-16 13:30:22 +0000 UTC" firstStartedPulling="2026-03-16 13:30:23.124197359 +0000 UTC m=+1467.523509896" lastFinishedPulling="2026-03-16 13:30:27.481013825 +0000 UTC m=+1471.880326372" observedRunningTime="2026-03-16 13:30:28.195344627 +0000 UTC m=+1472.594657174" watchObservedRunningTime="2026-03-16 13:30:28.207740675 +0000 UTC m=+1472.607053222" Mar 16 13:30:28 crc kubenswrapper[5030]: I0316 13:30:28.890105 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:28 crc kubenswrapper[5030]: I0316 13:30:28.890638 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" containerName="nova-cell0-conductor-conductor" containerID="cri-o://f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" gracePeriod=30 Mar 16 13:30:28 crc kubenswrapper[5030]: E0316 13:30:28.893021 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:30:28 crc kubenswrapper[5030]: E0316 13:30:28.896699 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:30:28 crc kubenswrapper[5030]: E0316 13:30:28.899246 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:30:28 crc kubenswrapper[5030]: E0316 13:30:28.899325 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:30:29 crc kubenswrapper[5030]: I0316 13:30:29.424976 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:29 crc kubenswrapper[5030]: I0316 13:30:29.426455 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:29 crc kubenswrapper[5030]: I0316 13:30:29.469085 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.220468 5030 generic.go:358] "Generic (PLEG): container finished" podID="2137cf84-8d68-4069-96cd-33b996b682f0" containerID="f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" exitCode=0 Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.220580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2137cf84-8d68-4069-96cd-33b996b682f0","Type":"ContainerDied","Data":"f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407"} Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.263586 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.320890 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.378213 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.378527 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-central-agent" containerID="cri-o://792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" gracePeriod=30 Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.378605 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="proxy-httpd" containerID="cri-o://e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" gracePeriod=30 Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.378628 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-notification-agent" containerID="cri-o://a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" gracePeriod=30 Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.378634 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="sg-core" containerID="cri-o://541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" gracePeriod=30 Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.449424 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.473694 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data\") pod \"2137cf84-8d68-4069-96cd-33b996b682f0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.473865 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle\") pod \"2137cf84-8d68-4069-96cd-33b996b682f0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.473950 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l\") pod \"2137cf84-8d68-4069-96cd-33b996b682f0\" (UID: \"2137cf84-8d68-4069-96cd-33b996b682f0\") " Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.480905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l" (OuterVolumeSpecName: "kube-api-access-s5d4l") pod "2137cf84-8d68-4069-96cd-33b996b682f0" (UID: "2137cf84-8d68-4069-96cd-33b996b682f0"). InnerVolumeSpecName "kube-api-access-s5d4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.504786 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data" (OuterVolumeSpecName: "config-data") pod "2137cf84-8d68-4069-96cd-33b996b682f0" (UID: "2137cf84-8d68-4069-96cd-33b996b682f0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.505501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2137cf84-8d68-4069-96cd-33b996b682f0" (UID: "2137cf84-8d68-4069-96cd-33b996b682f0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.577660 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.577690 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2137cf84-8d68-4069-96cd-33b996b682f0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.577703 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5d4l\" (UniqueName: \"kubernetes.io/projected/2137cf84-8d68-4069-96cd-33b996b682f0-kube-api-access-s5d4l\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:30 crc kubenswrapper[5030]: I0316 13:30:30.976635 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.086739 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.086849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087016 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087093 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087190 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087220 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087305 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwb69\" (UniqueName: \"kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69\") pod \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\" (UID: \"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a\") " Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.087664 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.088796 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.090047 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.090075 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.093421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts" (OuterVolumeSpecName: "scripts") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.094801 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69" (OuterVolumeSpecName: "kube-api-access-hwb69") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "kube-api-access-hwb69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.119990 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.148705 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.160732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data" (OuterVolumeSpecName: "config-data") pod "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" (UID: "8979b39a-c2bd-42a3-9d57-d760b4f3ae9a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.200329 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.200363 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.200374 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwb69\" (UniqueName: \"kubernetes.io/projected/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-kube-api-access-hwb69\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.200384 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.200392 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.233026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"2137cf84-8d68-4069-96cd-33b996b682f0","Type":"ContainerDied","Data":"26db0434ad7d8a22ee4123ee114fb0145eeec46c33249a42280b066465812115"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.233097 5030 scope.go:117] "RemoveContainer" containerID="f1900c8e01ee9282c3fc5d4d8c4c347501ed2340a0a0f439d2e4ce980de52407" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.233254 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.236688 5030 generic.go:358] "Generic (PLEG): container finished" podID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" exitCode=0 Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.236723 5030 generic.go:358] "Generic (PLEG): container finished" podID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" exitCode=2 Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.236731 5030 generic.go:358] "Generic (PLEG): container finished" podID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" exitCode=0 Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.236738 5030 generic.go:358] "Generic (PLEG): container finished" podID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" exitCode=0 Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237046 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerDied","Data":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237099 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerDied","Data":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerDied","Data":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237122 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerDied","Data":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237131 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8979b39a-c2bd-42a3-9d57-d760b4f3ae9a","Type":"ContainerDied","Data":"ee766310efda799cbafa5a7f528cc56e04b9b48e4b06e3e86a1b1f4607f6e68d"} Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.237282 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.258580 5030 scope.go:117] "RemoveContainer" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.270701 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.284880 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.293500 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294454 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="proxy-httpd" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294467 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="proxy-httpd" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294494 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-central-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294500 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-central-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294509 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294515 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294525 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="sg-core" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294529 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="sg-core" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294544 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-notification-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294562 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-notification-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294731 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="proxy-httpd" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294746 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-notification-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294755 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="ceilometer-central-agent" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294762 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" containerName="sg-core" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.294775 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" containerName="nova-cell0-conductor-conductor" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.305325 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.314277 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-xcxzn\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.318063 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.330850 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.333703 5030 scope.go:117] "RemoveContainer" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.341941 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.348763 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.352679 5030 scope.go:117] "RemoveContainer" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.353355 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.359348 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.359472 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.361297 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.361522 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.379939 5030 scope.go:117] "RemoveContainer" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.398466 5030 scope.go:117] "RemoveContainer" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: E0316 13:30:31.398757 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": container with ID starting with e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c not found: ID does not exist" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.398788 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} err="failed to get container status \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": rpc error: code = NotFound desc = could not find container \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": container with ID starting with e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.398811 5030 scope.go:117] "RemoveContainer" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: E0316 13:30:31.399064 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": container with ID starting with 541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3 not found: ID does not exist" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399088 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} err="failed to get container status \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": rpc error: code = NotFound desc = could not find container \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": container with ID starting with 541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399102 5030 scope.go:117] "RemoveContainer" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: E0316 13:30:31.399330 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": container with ID starting with a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d not found: ID does not exist" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399352 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} err="failed to get container status \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": rpc error: code = NotFound desc = could not find container \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": container with ID starting with a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399392 5030 scope.go:117] "RemoveContainer" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: E0316 13:30:31.399643 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": container with ID starting with 792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1 not found: ID does not exist" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399661 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} err="failed to get container status \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": rpc error: code = NotFound desc = could not find container \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": container with ID starting with 792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399674 5030 scope.go:117] "RemoveContainer" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399884 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} err="failed to get container status \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": rpc error: code = NotFound desc = could not find container \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": container with ID starting with e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.399900 5030 scope.go:117] "RemoveContainer" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400173 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} err="failed to get container status \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": rpc error: code = NotFound desc = could not find container \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": container with ID starting with 541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400222 5030 scope.go:117] "RemoveContainer" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400598 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} err="failed to get container status \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": rpc error: code = NotFound desc = could not find container \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": container with ID starting with a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400620 5030 scope.go:117] "RemoveContainer" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400933 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} err="failed to get container status \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": rpc error: code = NotFound desc = could not find container \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": container with ID starting with 792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.400977 5030 scope.go:117] "RemoveContainer" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.401292 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} err="failed to get container status \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": rpc error: code = NotFound desc = could not find container \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": container with ID starting with e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.401311 5030 scope.go:117] "RemoveContainer" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.401696 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} err="failed to get container status \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": rpc error: code = NotFound desc = could not find container \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": container with ID starting with 541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.401720 5030 scope.go:117] "RemoveContainer" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.401993 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} err="failed to get container status \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": rpc error: code = NotFound desc = could not find container \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": container with ID starting with a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402012 5030 scope.go:117] "RemoveContainer" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402304 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} err="failed to get container status \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": rpc error: code = NotFound desc = could not find container \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": container with ID starting with 792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402324 5030 scope.go:117] "RemoveContainer" containerID="e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402607 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c"} err="failed to get container status \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": rpc error: code = NotFound desc = could not find container \"e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c\": container with ID starting with e719a1f3b6b1a88602738800a3b12a85225c76cbf72c2c0404e702543c8de61c not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402628 5030 scope.go:117] "RemoveContainer" containerID="541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402834 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3"} err="failed to get container status \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": rpc error: code = NotFound desc = could not find container \"541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3\": container with ID starting with 541c49d962863b00388f6df7ef8f34dc40a20011f10585980456c6fbd29940c3 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.402856 5030 scope.go:117] "RemoveContainer" containerID="a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.403059 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d"} err="failed to get container status \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": rpc error: code = NotFound desc = could not find container \"a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d\": container with ID starting with a4c61cb8fd08e67d7227bdeac05e5326ecf42d9386ec6f9ee6752d8885d8ac6d not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.403082 5030 scope.go:117] "RemoveContainer" containerID="792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.403297 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1"} err="failed to get container status \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": rpc error: code = NotFound desc = could not find container \"792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1\": container with ID starting with 792a16377a308d7a40990705845f951d989a4549cce19ec0736cdec93d1276f1 not found: ID does not exist" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.405724 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.405802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.405831 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.405895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrpq\" (UniqueName: \"kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406040 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406139 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-564f2\" (UniqueName: \"kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406172 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.406357 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508157 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508256 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508297 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508320 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508363 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrpq\" (UniqueName: \"kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508392 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508443 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-564f2\" (UniqueName: \"kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508468 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.508506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.510251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.510600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.522134 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.522132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.522244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.522246 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.523003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.523229 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.524386 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrpq\" (UniqueName: \"kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq\") pod \"nova-cell0-conductor-0\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.527115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-564f2\" (UniqueName: \"kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2\") pod \"ceilometer-0\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.635733 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.676307 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.962050 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2137cf84-8d68-4069-96cd-33b996b682f0" path="/var/lib/kubelet/pods/2137cf84-8d68-4069-96cd-33b996b682f0/volumes" Mar 16 13:30:31 crc kubenswrapper[5030]: I0316 13:30:31.963215 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8979b39a-c2bd-42a3-9d57-d760b4f3ae9a" path="/var/lib/kubelet/pods/8979b39a-c2bd-42a3-9d57-d760b4f3ae9a/volumes" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.070972 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.162698 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.251481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerStarted","Data":"0f26fef7005c029c8219cd670613821af1772701fa1cfeb982fd39fb40d63188"} Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.253837 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fb73c1c0-4b3e-4378-9919-625b1a3dc75d","Type":"ContainerStarted","Data":"fb384a57573f0a5b0ee9e367579e09ca439c3b7a6b0080ec05077c9770c79c9e"} Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.257099 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-55c25" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="registry-server" containerID="cri-o://c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc" gracePeriod=2 Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.646141 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.747512 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content\") pod \"d55aca69-13c4-4944-b587-9d3ce839b678\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.747767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities\") pod \"d55aca69-13c4-4944-b587-9d3ce839b678\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.747978 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs9vw\" (UniqueName: \"kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw\") pod \"d55aca69-13c4-4944-b587-9d3ce839b678\" (UID: \"d55aca69-13c4-4944-b587-9d3ce839b678\") " Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.749759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities" (OuterVolumeSpecName: "utilities") pod "d55aca69-13c4-4944-b587-9d3ce839b678" (UID: "d55aca69-13c4-4944-b587-9d3ce839b678"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.752416 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw" (OuterVolumeSpecName: "kube-api-access-gs9vw") pod "d55aca69-13c4-4944-b587-9d3ce839b678" (UID: "d55aca69-13c4-4944-b587-9d3ce839b678"). InnerVolumeSpecName "kube-api-access-gs9vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.789813 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "d55aca69-13c4-4944-b587-9d3ce839b678" (UID: "d55aca69-13c4-4944-b587-9d3ce839b678"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.854299 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.854330 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs9vw\" (UniqueName: \"kubernetes.io/projected/d55aca69-13c4-4944-b587-9d3ce839b678-kube-api-access-gs9vw\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:32 crc kubenswrapper[5030]: I0316 13:30:32.854340 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/d55aca69-13c4-4944-b587-9d3ce839b678-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.272779 5030 generic.go:358] "Generic (PLEG): container finished" podID="d55aca69-13c4-4944-b587-9d3ce839b678" containerID="c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc" exitCode=0 Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.272888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerDied","Data":"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc"} Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.272920 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-55c25" event={"ID":"d55aca69-13c4-4944-b587-9d3ce839b678","Type":"ContainerDied","Data":"c628e419154ccd5863a1cccccdd5797dad3f5a57a66d83840fe780dfb3145fab"} Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.272939 5030 scope.go:117] "RemoveContainer" containerID="c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.273094 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-55c25" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.285137 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fb73c1c0-4b3e-4378-9919-625b1a3dc75d","Type":"ContainerStarted","Data":"acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc"} Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.285254 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.287889 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerStarted","Data":"184cbde0e42e23cd5ced8d1fed6a4f894ced84bde3170d125c5433d191774551"} Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.304211 5030 scope.go:117] "RemoveContainer" containerID="22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.307850 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.307834841 podStartE2EDuration="2.307834841s" podCreationTimestamp="2026-03-16 13:30:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:33.29861265 +0000 UTC m=+1477.697925188" watchObservedRunningTime="2026-03-16 13:30:33.307834841 +0000 UTC m=+1477.707147388" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.315873 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.321833 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-55c25"] Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.344074 5030 scope.go:117] "RemoveContainer" containerID="c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.368394 5030 scope.go:117] "RemoveContainer" containerID="c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc" Mar 16 13:30:33 crc kubenswrapper[5030]: E0316 13:30:33.368788 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc\": container with ID starting with c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc not found: ID does not exist" containerID="c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.368821 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc"} err="failed to get container status \"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc\": rpc error: code = NotFound desc = could not find container \"c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc\": container with ID starting with c99c74cb805e8dfcdfcd3b76b7bbd3e41f11dcb98218073280ddbe01f622f4fc not found: ID does not exist" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.368842 5030 scope.go:117] "RemoveContainer" containerID="22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3" Mar 16 13:30:33 crc kubenswrapper[5030]: E0316 13:30:33.369116 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3\": container with ID starting with 22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3 not found: ID does not exist" containerID="22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.369149 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3"} err="failed to get container status \"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3\": rpc error: code = NotFound desc = could not find container \"22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3\": container with ID starting with 22223667a55b64ef845c08e9e4830dc05287d2a2755a3dd4f73c62364f3a46e3 not found: ID does not exist" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.369172 5030 scope.go:117] "RemoveContainer" containerID="c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d" Mar 16 13:30:33 crc kubenswrapper[5030]: E0316 13:30:33.369400 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d\": container with ID starting with c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d not found: ID does not exist" containerID="c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.369423 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d"} err="failed to get container status \"c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d\": rpc error: code = NotFound desc = could not find container \"c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d\": container with ID starting with c36b0810744783af9c0966633b56107ec55fa5996626d9eedcd0d585c161a74d not found: ID does not exist" Mar 16 13:30:33 crc kubenswrapper[5030]: I0316 13:30:33.958155 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" path="/var/lib/kubelet/pods/d55aca69-13c4-4944-b587-9d3ce839b678/volumes" Mar 16 13:30:34 crc kubenswrapper[5030]: I0316 13:30:34.303998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerStarted","Data":"ae3c00a086ffb9540e109d9dd4bdea4ffb4df59b0de399b28528123d3b51024b"} Mar 16 13:30:34 crc kubenswrapper[5030]: I0316 13:30:34.304239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerStarted","Data":"e0c624216f9a8b0dc60142157436ade04842468989ea34d5106e9230d16c31d0"} Mar 16 13:30:36 crc kubenswrapper[5030]: I0316 13:30:36.325214 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerStarted","Data":"0d02716169f8922cb948dff46d895603d30abda801981e4cd1782ffcb2d6a49a"} Mar 16 13:30:36 crc kubenswrapper[5030]: I0316 13:30:36.325723 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:30:36 crc kubenswrapper[5030]: I0316 13:30:36.353275 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.623348395 podStartE2EDuration="5.353260877s" podCreationTimestamp="2026-03-16 13:30:31 +0000 UTC" firstStartedPulling="2026-03-16 13:30:32.165700744 +0000 UTC m=+1476.565013290" lastFinishedPulling="2026-03-16 13:30:35.895613224 +0000 UTC m=+1480.294925772" observedRunningTime="2026-03-16 13:30:36.343260554 +0000 UTC m=+1480.742573101" watchObservedRunningTime="2026-03-16 13:30:36.353260877 +0000 UTC m=+1480.752573424" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.329471 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.791490 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw"] Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792679 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="extract-content" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792699 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="extract-content" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792721 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="registry-server" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792727 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="registry-server" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792733 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="extract-utilities" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792739 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="extract-utilities" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.792926 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d55aca69-13c4-4944-b587-9d3ce839b678" containerName="registry-server" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.795795 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.798662 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.799067 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.806568 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw"] Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.902294 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.902351 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.902381 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xggjq\" (UniqueName: \"kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.902491 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.933668 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.938450 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.941514 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:30:39 crc kubenswrapper[5030]: I0316 13:30:39.960206 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.031665 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032348 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032427 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xggjq\" (UniqueName: \"kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032518 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nvtd\" (UniqueName: \"kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032693 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.032785 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.042888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.057181 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.068041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xggjq\" (UniqueName: \"kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.077052 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.082000 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.104562 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts\") pod \"nova-cell0-cell-mapping-kwzfw\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.111948 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.127729 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.134865 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.134980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.135046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nvtd\" (UniqueName: \"kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.135155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.135174 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpc7l\" (UniqueName: \"kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.135196 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.135310 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.143167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.152092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.155942 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.164040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.185986 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nvtd\" (UniqueName: \"kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd\") pod \"nova-api-0\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.200778 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.225080 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.228007 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.237181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.237237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpc7l\" (UniqueName: \"kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.237332 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.256831 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.258260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.259304 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.263536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.270004 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpc7l\" (UniqueName: \"kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l\") pod \"nova-scheduler-0\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.297985 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.302930 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.304343 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.306727 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.339594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkrs\" (UniqueName: \"kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.339768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.339914 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.339982 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.442397 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkrs\" (UniqueName: \"kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.442879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.442965 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.443017 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.443075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.443109 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsbqw\" (UniqueName: \"kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.443259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.443588 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.448669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.448996 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.460777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkrs\" (UniqueName: \"kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs\") pod \"nova-metadata-0\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.542051 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.544525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.544603 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsbqw\" (UniqueName: \"kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.544687 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.551226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.551232 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.563497 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.564605 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsbqw\" (UniqueName: \"kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw\") pod \"nova-cell1-novncproxy-0\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.633508 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.684277 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.777538 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.961694 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.994850 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6"] Mar 16 13:30:40 crc kubenswrapper[5030]: I0316 13:30:40.999254 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.001286 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.002108 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.021712 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6"] Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.056533 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.059747 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.059881 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.060310 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvsm\" (UniqueName: \"kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.060384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: W0316 13:30:41.062855 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b1e437_7dcf_4307_92c7_fa092eddf7f5.slice/crio-c4f5e5ea796808aaf8099b86e0ef6854b0d522659cdd1f860b9dfc897a266113 WatchSource:0}: Error finding container c4f5e5ea796808aaf8099b86e0ef6854b0d522659cdd1f860b9dfc897a266113: Status 404 returned error can't find the container with id c4f5e5ea796808aaf8099b86e0ef6854b0d522659cdd1f860b9dfc897a266113 Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.148490 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.162637 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.162821 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.162883 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.163974 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvsm\" (UniqueName: \"kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.166416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.166679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.167047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.180660 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvsm\" (UniqueName: \"kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm\") pod \"nova-cell1-conductor-db-sync-rrzj6\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.319278 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.403006 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b8a333fd-c208-456d-a50a-233e24eaa3a1","Type":"ContainerStarted","Data":"5aabcc7e678a9ea894e01cccc3af80140c609d9c30e91765d2cdd0ba46b1cf98"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.415010 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerStarted","Data":"c4f5e5ea796808aaf8099b86e0ef6854b0d522659cdd1f860b9dfc897a266113"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.419747 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" event={"ID":"3384fab3-f36e-4fc4-85f7-17d4fa97fa37","Type":"ContainerStarted","Data":"087d84a59bd672366fcf7c9b3657d264f9c114f00453062046cc49b1ee6feac4"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.419791 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" event={"ID":"3384fab3-f36e-4fc4-85f7-17d4fa97fa37","Type":"ContainerStarted","Data":"e9f330f188d9ff06fab077c4fc69996740ad631f750cb6c01f29cec8ec5e7f42"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.425475 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerStarted","Data":"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.425525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerStarted","Data":"17825e8d250432b6587091b6d94563bf097f495f05634860838b3d7553f962c3"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.427274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1b2dc54b-ec0d-4046-bce8-a20bf7225346","Type":"ContainerStarted","Data":"5d90493b82932c7a3247a19ab5c125cc4f3fe21123a7afa5dfff9417a71d1887"} Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.444681 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" podStartSLOduration=2.444667227 podStartE2EDuration="2.444667227s" podCreationTimestamp="2026-03-16 13:30:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:41.434643539 +0000 UTC m=+1485.833956087" watchObservedRunningTime="2026-03-16 13:30:41.444667227 +0000 UTC m=+1485.843979774" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.450340 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.450322651 podStartE2EDuration="2.450322651s" podCreationTimestamp="2026-03-16 13:30:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:41.448477271 +0000 UTC m=+1485.847789808" watchObservedRunningTime="2026-03-16 13:30:41.450322651 +0000 UTC m=+1485.849635199" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.468204 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.468183855 podStartE2EDuration="1.468183855s" podCreationTimestamp="2026-03-16 13:30:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:41.460170598 +0000 UTC m=+1485.859483145" watchObservedRunningTime="2026-03-16 13:30:41.468183855 +0000 UTC m=+1485.867496403" Mar 16 13:30:41 crc kubenswrapper[5030]: I0316 13:30:41.796396 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6"] Mar 16 13:30:41 crc kubenswrapper[5030]: W0316 13:30:41.798940 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1762a7e_1637_45a8_923c_bc0514d708d4.slice/crio-44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2 WatchSource:0}: Error finding container 44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2: Status 404 returned error can't find the container with id 44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2 Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.446267 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerStarted","Data":"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.446334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerStarted","Data":"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.450657 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" event={"ID":"d1762a7e-1637-45a8-923c-bc0514d708d4","Type":"ContainerStarted","Data":"5a23d06e53851f97be22ab06a21f645e95cf529dfa4e470862faec235ae2a506"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.450740 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" event={"ID":"d1762a7e-1637-45a8-923c-bc0514d708d4","Type":"ContainerStarted","Data":"44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.466962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerStarted","Data":"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.470408 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1b2dc54b-ec0d-4046-bce8-a20bf7225346","Type":"ContainerStarted","Data":"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.473623 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b8a333fd-c208-456d-a50a-233e24eaa3a1","Type":"ContainerStarted","Data":"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636"} Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.474542 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.474521216 podStartE2EDuration="2.474521216s" podCreationTimestamp="2026-03-16 13:30:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:42.462783595 +0000 UTC m=+1486.862096143" watchObservedRunningTime="2026-03-16 13:30:42.474521216 +0000 UTC m=+1486.873833763" Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.491517 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" podStartSLOduration=2.491497826 podStartE2EDuration="2.491497826s" podCreationTimestamp="2026-03-16 13:30:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:42.486337183 +0000 UTC m=+1486.885649730" watchObservedRunningTime="2026-03-16 13:30:42.491497826 +0000 UTC m=+1486.890810374" Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.502923 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.502903592 podStartE2EDuration="3.502903592s" podCreationTimestamp="2026-03-16 13:30:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:42.501862194 +0000 UTC m=+1486.901174742" watchObservedRunningTime="2026-03-16 13:30:42.502903592 +0000 UTC m=+1486.902216139" Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.770792 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:42 crc kubenswrapper[5030]: I0316 13:30:42.791626 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:44 crc kubenswrapper[5030]: I0316 13:30:44.497565 5030 generic.go:358] "Generic (PLEG): container finished" podID="d1762a7e-1637-45a8-923c-bc0514d708d4" containerID="5a23d06e53851f97be22ab06a21f645e95cf529dfa4e470862faec235ae2a506" exitCode=0 Mar 16 13:30:44 crc kubenswrapper[5030]: I0316 13:30:44.497667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" event={"ID":"d1762a7e-1637-45a8-923c-bc0514d708d4","Type":"ContainerDied","Data":"5a23d06e53851f97be22ab06a21f645e95cf529dfa4e470862faec235ae2a506"} Mar 16 13:30:44 crc kubenswrapper[5030]: I0316 13:30:44.498876 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-log" containerID="cri-o://29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" gracePeriod=30 Mar 16 13:30:44 crc kubenswrapper[5030]: I0316 13:30:44.499004 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-metadata" containerID="cri-o://99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" gracePeriod=30 Mar 16 13:30:44 crc kubenswrapper[5030]: I0316 13:30:44.499014 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3" gracePeriod=30 Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.139920 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.146334 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.268129 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsbqw\" (UniqueName: \"kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw\") pod \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.268859 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle\") pod \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.268964 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle\") pod \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.269216 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data\") pod \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.269531 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vkrs\" (UniqueName: \"kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs\") pod \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.269652 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data\") pod \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\" (UID: \"1b2dc54b-ec0d-4046-bce8-a20bf7225346\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.269686 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs\") pod \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\" (UID: \"d8b1e437-7dcf-4307-92c7-fa092eddf7f5\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.270275 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs" (OuterVolumeSpecName: "logs") pod "d8b1e437-7dcf-4307-92c7-fa092eddf7f5" (UID: "d8b1e437-7dcf-4307-92c7-fa092eddf7f5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.271406 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.275610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw" (OuterVolumeSpecName: "kube-api-access-bsbqw") pod "1b2dc54b-ec0d-4046-bce8-a20bf7225346" (UID: "1b2dc54b-ec0d-4046-bce8-a20bf7225346"). InnerVolumeSpecName "kube-api-access-bsbqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.275692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs" (OuterVolumeSpecName: "kube-api-access-8vkrs") pod "d8b1e437-7dcf-4307-92c7-fa092eddf7f5" (UID: "d8b1e437-7dcf-4307-92c7-fa092eddf7f5"). InnerVolumeSpecName "kube-api-access-8vkrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.293913 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data" (OuterVolumeSpecName: "config-data") pod "1b2dc54b-ec0d-4046-bce8-a20bf7225346" (UID: "1b2dc54b-ec0d-4046-bce8-a20bf7225346"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.294454 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b2dc54b-ec0d-4046-bce8-a20bf7225346" (UID: "1b2dc54b-ec0d-4046-bce8-a20bf7225346"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.294775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d8b1e437-7dcf-4307-92c7-fa092eddf7f5" (UID: "d8b1e437-7dcf-4307-92c7-fa092eddf7f5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.295678 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data" (OuterVolumeSpecName: "config-data") pod "d8b1e437-7dcf-4307-92c7-fa092eddf7f5" (UID: "d8b1e437-7dcf-4307-92c7-fa092eddf7f5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374504 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374537 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsbqw\" (UniqueName: \"kubernetes.io/projected/1b2dc54b-ec0d-4046-bce8-a20bf7225346-kube-api-access-bsbqw\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374566 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b2dc54b-ec0d-4046-bce8-a20bf7225346-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374576 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374592 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.374603 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vkrs\" (UniqueName: \"kubernetes.io/projected/d8b1e437-7dcf-4307-92c7-fa092eddf7f5-kube-api-access-8vkrs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.521979 5030 generic.go:358] "Generic (PLEG): container finished" podID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" containerID="c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3" exitCode=0 Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.522063 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.522273 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1b2dc54b-ec0d-4046-bce8-a20bf7225346","Type":"ContainerDied","Data":"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.522303 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"1b2dc54b-ec0d-4046-bce8-a20bf7225346","Type":"ContainerDied","Data":"5d90493b82932c7a3247a19ab5c125cc4f3fe21123a7afa5dfff9417a71d1887"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.522324 5030 scope.go:117] "RemoveContainer" containerID="c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525613 5030 generic.go:358] "Generic (PLEG): container finished" podID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerID="99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" exitCode=0 Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525639 5030 generic.go:358] "Generic (PLEG): container finished" podID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerID="29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" exitCode=143 Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerDied","Data":"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerDied","Data":"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525867 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"d8b1e437-7dcf-4307-92c7-fa092eddf7f5","Type":"ContainerDied","Data":"c4f5e5ea796808aaf8099b86e0ef6854b0d522659cdd1f860b9dfc897a266113"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.525949 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.529426 5030 generic.go:358] "Generic (PLEG): container finished" podID="3384fab3-f36e-4fc4-85f7-17d4fa97fa37" containerID="087d84a59bd672366fcf7c9b3657d264f9c114f00453062046cc49b1ee6feac4" exitCode=0 Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.529646 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" event={"ID":"3384fab3-f36e-4fc4-85f7-17d4fa97fa37","Type":"ContainerDied","Data":"087d84a59bd672366fcf7c9b3657d264f9c114f00453062046cc49b1ee6feac4"} Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.542418 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.547925 5030 scope.go:117] "RemoveContainer" containerID="c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3" Mar 16 13:30:45 crc kubenswrapper[5030]: E0316 13:30:45.548482 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3\": container with ID starting with c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3 not found: ID does not exist" containerID="c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.548516 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3"} err="failed to get container status \"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3\": rpc error: code = NotFound desc = could not find container \"c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3\": container with ID starting with c2b63671becb38c32f2916bd69a54efe244874b87d6e263b9649ce26aeb53dc3 not found: ID does not exist" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.548565 5030 scope.go:117] "RemoveContainer" containerID="99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.565215 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.574140 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.594647 5030 scope.go:117] "RemoveContainer" containerID="29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.602715 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.648238 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.658347 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659596 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-log" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659619 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-log" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659648 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-metadata" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659654 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-metadata" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659671 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659677 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659887 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659908 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-log" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.659921 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" containerName="nova-metadata-metadata" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.663857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.664376 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.665617 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.665879 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.666810 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.669716 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.670668 5030 scope.go:117] "RemoveContainer" containerID="99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" Mar 16 13:30:45 crc kubenswrapper[5030]: E0316 13:30:45.671047 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77\": container with ID starting with 99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77 not found: ID does not exist" containerID="99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.671081 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77"} err="failed to get container status \"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77\": rpc error: code = NotFound desc = could not find container \"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77\": container with ID starting with 99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77 not found: ID does not exist" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.671111 5030 scope.go:117] "RemoveContainer" containerID="29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" Mar 16 13:30:45 crc kubenswrapper[5030]: E0316 13:30:45.671794 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f\": container with ID starting with 29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f not found: ID does not exist" containerID="29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.671823 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f"} err="failed to get container status \"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f\": rpc error: code = NotFound desc = could not find container \"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f\": container with ID starting with 29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f not found: ID does not exist" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.671842 5030 scope.go:117] "RemoveContainer" containerID="99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.672051 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77"} err="failed to get container status \"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77\": rpc error: code = NotFound desc = could not find container \"99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77\": container with ID starting with 99476b0e8bbf77643f5d4462389203fb357274469736f1d09b3a78c74d0e4b77 not found: ID does not exist" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.672069 5030 scope.go:117] "RemoveContainer" containerID="29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.672329 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f"} err="failed to get container status \"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f\": rpc error: code = NotFound desc = could not find container \"29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f\": container with ID starting with 29076434d12b1220034e8ad817fd5ccc3b65c5507a5b528ff71a2d98fbdb582f not found: ID does not exist" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.680755 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.680905 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684119 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684196 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684647 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684687 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684713 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684773 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.684790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sxw\" (UniqueName: \"kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.787376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2crq\" (UniqueName: \"kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.787583 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.787710 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788350 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788527 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788614 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788649 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sxw\" (UniqueName: \"kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.788735 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.789113 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.792990 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.793860 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.794136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.795686 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.805157 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sxw\" (UniqueName: \"kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2crq\" (UniqueName: \"kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891530 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891565 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.891973 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.895607 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.896426 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.903763 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.906125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2crq\" (UniqueName: \"kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq\") pod \"nova-metadata-0\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.926937 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.965995 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2dc54b-ec0d-4046-bce8-a20bf7225346" path="/var/lib/kubelet/pods/1b2dc54b-ec0d-4046-bce8-a20bf7225346/volumes" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.970844 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b1e437-7dcf-4307-92c7-fa092eddf7f5" path="/var/lib/kubelet/pods/d8b1e437-7dcf-4307-92c7-fa092eddf7f5/volumes" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.982821 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.993377 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrvsm\" (UniqueName: \"kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm\") pod \"d1762a7e-1637-45a8-923c-bc0514d708d4\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.993452 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle\") pod \"d1762a7e-1637-45a8-923c-bc0514d708d4\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.993610 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts\") pod \"d1762a7e-1637-45a8-923c-bc0514d708d4\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.993643 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data\") pod \"d1762a7e-1637-45a8-923c-bc0514d708d4\" (UID: \"d1762a7e-1637-45a8-923c-bc0514d708d4\") " Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.995943 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.997245 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm" (OuterVolumeSpecName: "kube-api-access-wrvsm") pod "d1762a7e-1637-45a8-923c-bc0514d708d4" (UID: "d1762a7e-1637-45a8-923c-bc0514d708d4"). InnerVolumeSpecName "kube-api-access-wrvsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:45 crc kubenswrapper[5030]: I0316 13:30:45.997454 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts" (OuterVolumeSpecName: "scripts") pod "d1762a7e-1637-45a8-923c-bc0514d708d4" (UID: "d1762a7e-1637-45a8-923c-bc0514d708d4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.014446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d1762a7e-1637-45a8-923c-bc0514d708d4" (UID: "d1762a7e-1637-45a8-923c-bc0514d708d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.014884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data" (OuterVolumeSpecName: "config-data") pod "d1762a7e-1637-45a8-923c-bc0514d708d4" (UID: "d1762a7e-1637-45a8-923c-bc0514d708d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.096682 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrvsm\" (UniqueName: \"kubernetes.io/projected/d1762a7e-1637-45a8-923c-bc0514d708d4-kube-api-access-wrvsm\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.096913 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.096923 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.096930 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d1762a7e-1637-45a8-923c-bc0514d708d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.414335 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:30:46 crc kubenswrapper[5030]: W0316 13:30:46.416780 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0545996_15bd_4f02_9fcf_ca5a6ac6a4b9.slice/crio-84a59293dc064763013059438d2b6f3f0bba70ce4e6a202629944f8007c240be WatchSource:0}: Error finding container 84a59293dc064763013059438d2b6f3f0bba70ce4e6a202629944f8007c240be: Status 404 returned error can't find the container with id 84a59293dc064763013059438d2b6f3f0bba70ce4e6a202629944f8007c240be Mar 16 13:30:46 crc kubenswrapper[5030]: W0316 13:30:46.459542 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb7e99a4_cd0f_487e_a1b9_678a321a078f.slice/crio-72091ca0ea75377fdc2a7585b4c0b9bfd2d3be3b92b5a0b7b78a3a813d8066e9 WatchSource:0}: Error finding container 72091ca0ea75377fdc2a7585b4c0b9bfd2d3be3b92b5a0b7b78a3a813d8066e9: Status 404 returned error can't find the container with id 72091ca0ea75377fdc2a7585b4c0b9bfd2d3be3b92b5a0b7b78a3a813d8066e9 Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.465981 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.544299 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.544888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6" event={"ID":"d1762a7e-1637-45a8-923c-bc0514d708d4","Type":"ContainerDied","Data":"44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2"} Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.544922 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44c75814a9e368bc73507faaa746089ec4476f4b85065b6e3b53837dae07e1c2" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.547263 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9","Type":"ContainerStarted","Data":"84a59293dc064763013059438d2b6f3f0bba70ce4e6a202629944f8007c240be"} Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.549051 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerStarted","Data":"72091ca0ea75377fdc2a7585b4c0b9bfd2d3be3b92b5a0b7b78a3a813d8066e9"} Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.594566 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.595533 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1762a7e-1637-45a8-923c-bc0514d708d4" containerName="nova-cell1-conductor-db-sync" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.595591 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1762a7e-1637-45a8-923c-bc0514d708d4" containerName="nova-cell1-conductor-db-sync" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.595778 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1762a7e-1637-45a8-923c-bc0514d708d4" containerName="nova-cell1-conductor-db-sync" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.601365 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.603164 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.604797 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.709205 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgrv8\" (UniqueName: \"kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.709431 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.709637 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.811606 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.812043 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgrv8\" (UniqueName: \"kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.812118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.821449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.830995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.831941 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgrv8\" (UniqueName: \"kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8\") pod \"nova-cell1-conductor-0\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.885853 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.913044 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle\") pod \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.913093 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data\") pod \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.913325 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xggjq\" (UniqueName: \"kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq\") pod \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.913360 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts\") pod \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\" (UID: \"3384fab3-f36e-4fc4-85f7-17d4fa97fa37\") " Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.920755 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq" (OuterVolumeSpecName: "kube-api-access-xggjq") pod "3384fab3-f36e-4fc4-85f7-17d4fa97fa37" (UID: "3384fab3-f36e-4fc4-85f7-17d4fa97fa37"). InnerVolumeSpecName "kube-api-access-xggjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.920972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts" (OuterVolumeSpecName: "scripts") pod "3384fab3-f36e-4fc4-85f7-17d4fa97fa37" (UID: "3384fab3-f36e-4fc4-85f7-17d4fa97fa37"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.937292 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data" (OuterVolumeSpecName: "config-data") pod "3384fab3-f36e-4fc4-85f7-17d4fa97fa37" (UID: "3384fab3-f36e-4fc4-85f7-17d4fa97fa37"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:46 crc kubenswrapper[5030]: I0316 13:30:46.940120 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3384fab3-f36e-4fc4-85f7-17d4fa97fa37" (UID: "3384fab3-f36e-4fc4-85f7-17d4fa97fa37"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.015882 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xggjq\" (UniqueName: \"kubernetes.io/projected/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-kube-api-access-xggjq\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.015912 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.015923 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.015931 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3384fab3-f36e-4fc4-85f7-17d4fa97fa37-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.065606 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.440655 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:30:47 crc kubenswrapper[5030]: W0316 13:30:47.447421 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb916b3f_66ac_4845_9be0_713995168651.slice/crio-503e2e0d26dadca02b0e7091033a6acd307b1675957368dd56a39d815b03c548 WatchSource:0}: Error finding container 503e2e0d26dadca02b0e7091033a6acd307b1675957368dd56a39d815b03c548: Status 404 returned error can't find the container with id 503e2e0d26dadca02b0e7091033a6acd307b1675957368dd56a39d815b03c548 Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.572935 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9","Type":"ContainerStarted","Data":"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8"} Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.574358 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fb916b3f-66ac-4845-9be0-713995168651","Type":"ContainerStarted","Data":"503e2e0d26dadca02b0e7091033a6acd307b1675957368dd56a39d815b03c548"} Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.578392 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.578440 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw" event={"ID":"3384fab3-f36e-4fc4-85f7-17d4fa97fa37","Type":"ContainerDied","Data":"e9f330f188d9ff06fab077c4fc69996740ad631f750cb6c01f29cec8ec5e7f42"} Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.578470 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9f330f188d9ff06fab077c4fc69996740ad631f750cb6c01f29cec8ec5e7f42" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.584275 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerStarted","Data":"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251"} Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.584306 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerStarted","Data":"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71"} Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.597576 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.597559353 podStartE2EDuration="2.597559353s" podCreationTimestamp="2026-03-16 13:30:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:47.587840167 +0000 UTC m=+1491.987152715" watchObservedRunningTime="2026-03-16 13:30:47.597559353 +0000 UTC m=+1491.996871900" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.612803 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.612786104 podStartE2EDuration="2.612786104s" podCreationTimestamp="2026-03-16 13:30:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:47.603110831 +0000 UTC m=+1492.002423379" watchObservedRunningTime="2026-03-16 13:30:47.612786104 +0000 UTC m=+1492.012098651" Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.760856 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.761127 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="b8a333fd-c208-456d-a50a-233e24eaa3a1" containerName="nova-scheduler-scheduler" containerID="cri-o://53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636" gracePeriod=30 Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.770485 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.770778 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-log" containerID="cri-o://28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" gracePeriod=30 Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.771156 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-api" containerID="cri-o://846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" gracePeriod=30 Mar 16 13:30:47 crc kubenswrapper[5030]: I0316 13:30:47.782370 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.358460 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.454052 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs\") pod \"3c37933f-e0d4-4353-992b-85108525fdca\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.454496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nvtd\" (UniqueName: \"kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd\") pod \"3c37933f-e0d4-4353-992b-85108525fdca\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.454816 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle\") pod \"3c37933f-e0d4-4353-992b-85108525fdca\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.454873 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data\") pod \"3c37933f-e0d4-4353-992b-85108525fdca\" (UID: \"3c37933f-e0d4-4353-992b-85108525fdca\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.456990 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs" (OuterVolumeSpecName: "logs") pod "3c37933f-e0d4-4353-992b-85108525fdca" (UID: "3c37933f-e0d4-4353-992b-85108525fdca"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.465019 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd" (OuterVolumeSpecName: "kube-api-access-9nvtd") pod "3c37933f-e0d4-4353-992b-85108525fdca" (UID: "3c37933f-e0d4-4353-992b-85108525fdca"). InnerVolumeSpecName "kube-api-access-9nvtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.494399 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c37933f-e0d4-4353-992b-85108525fdca" (UID: "3c37933f-e0d4-4353-992b-85108525fdca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.515803 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data" (OuterVolumeSpecName: "config-data") pod "3c37933f-e0d4-4353-992b-85108525fdca" (UID: "3c37933f-e0d4-4353-992b-85108525fdca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.534670 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.559391 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nvtd\" (UniqueName: \"kubernetes.io/projected/3c37933f-e0d4-4353-992b-85108525fdca-kube-api-access-9nvtd\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.559422 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.559436 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c37933f-e0d4-4353-992b-85108525fdca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.559446 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c37933f-e0d4-4353-992b-85108525fdca-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.602054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fb916b3f-66ac-4845-9be0-713995168651","Type":"ContainerStarted","Data":"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.602163 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.606956 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c37933f-e0d4-4353-992b-85108525fdca" containerID="846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" exitCode=0 Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.606994 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c37933f-e0d4-4353-992b-85108525fdca" containerID="28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" exitCode=143 Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.607042 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerDied","Data":"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.607097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerDied","Data":"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.607115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"3c37933f-e0d4-4353-992b-85108525fdca","Type":"ContainerDied","Data":"17825e8d250432b6587091b6d94563bf097f495f05634860838b3d7553f962c3"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.607129 5030 scope.go:117] "RemoveContainer" containerID="846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.607181 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.609965 5030 generic.go:358] "Generic (PLEG): container finished" podID="b8a333fd-c208-456d-a50a-233e24eaa3a1" containerID="53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636" exitCode=0 Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.610616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b8a333fd-c208-456d-a50a-233e24eaa3a1","Type":"ContainerDied","Data":"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.610697 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"b8a333fd-c208-456d-a50a-233e24eaa3a1","Type":"ContainerDied","Data":"5aabcc7e678a9ea894e01cccc3af80140c609d9c30e91765d2cdd0ba46b1cf98"} Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.610740 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.623812 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.6237910700000002 podStartE2EDuration="2.62379107s" podCreationTimestamp="2026-03-16 13:30:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:48.620868244 +0000 UTC m=+1493.020180791" watchObservedRunningTime="2026-03-16 13:30:48.62379107 +0000 UTC m=+1493.023103617" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.660702 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpc7l\" (UniqueName: \"kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l\") pod \"b8a333fd-c208-456d-a50a-233e24eaa3a1\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.661457 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle\") pod \"b8a333fd-c208-456d-a50a-233e24eaa3a1\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.661805 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data\") pod \"b8a333fd-c208-456d-a50a-233e24eaa3a1\" (UID: \"b8a333fd-c208-456d-a50a-233e24eaa3a1\") " Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.673968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l" (OuterVolumeSpecName: "kube-api-access-gpc7l") pod "b8a333fd-c208-456d-a50a-233e24eaa3a1" (UID: "b8a333fd-c208-456d-a50a-233e24eaa3a1"). InnerVolumeSpecName "kube-api-access-gpc7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.684438 5030 scope.go:117] "RemoveContainer" containerID="28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.689460 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b8a333fd-c208-456d-a50a-233e24eaa3a1" (UID: "b8a333fd-c208-456d-a50a-233e24eaa3a1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.692007 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data" (OuterVolumeSpecName: "config-data") pod "b8a333fd-c208-456d-a50a-233e24eaa3a1" (UID: "b8a333fd-c208-456d-a50a-233e24eaa3a1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.763770 5030 scope.go:117] "RemoveContainer" containerID="846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" Mar 16 13:30:48 crc kubenswrapper[5030]: E0316 13:30:48.764301 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866\": container with ID starting with 846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866 not found: ID does not exist" containerID="846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.764413 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866"} err="failed to get container status \"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866\": rpc error: code = NotFound desc = could not find container \"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866\": container with ID starting with 846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866 not found: ID does not exist" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.764586 5030 scope.go:117] "RemoveContainer" containerID="28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" Mar 16 13:30:48 crc kubenswrapper[5030]: E0316 13:30:48.764878 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff\": container with ID starting with 28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff not found: ID does not exist" containerID="28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.764993 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff"} err="failed to get container status \"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff\": rpc error: code = NotFound desc = could not find container \"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff\": container with ID starting with 28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff not found: ID does not exist" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.765162 5030 scope.go:117] "RemoveContainer" containerID="846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.768624 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866"} err="failed to get container status \"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866\": rpc error: code = NotFound desc = could not find container \"846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866\": container with ID starting with 846792dedbc69d5f25c49b1d380506df0579fed2e800a18127bbc405fd3ea866 not found: ID does not exist" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.768664 5030 scope.go:117] "RemoveContainer" containerID="28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.771956 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff"} err="failed to get container status \"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff\": rpc error: code = NotFound desc = could not find container \"28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff\": container with ID starting with 28107c99ea55195f04ff958f8f70f45cc37f6a949f2327506ec265eae830c8ff not found: ID does not exist" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.771984 5030 scope.go:117] "RemoveContainer" containerID="53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.773626 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.773646 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b8a333fd-c208-456d-a50a-233e24eaa3a1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.773656 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpc7l\" (UniqueName: \"kubernetes.io/projected/b8a333fd-c208-456d-a50a-233e24eaa3a1-kube-api-access-gpc7l\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.774581 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.791318 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.801722 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803112 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a333fd-c208-456d-a50a-233e24eaa3a1" containerName="nova-scheduler-scheduler" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803133 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a333fd-c208-456d-a50a-233e24eaa3a1" containerName="nova-scheduler-scheduler" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803147 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3384fab3-f36e-4fc4-85f7-17d4fa97fa37" containerName="nova-manage" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803153 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3384fab3-f36e-4fc4-85f7-17d4fa97fa37" containerName="nova-manage" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803166 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-api" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803171 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-api" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803184 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-log" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803189 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-log" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803642 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8a333fd-c208-456d-a50a-233e24eaa3a1" containerName="nova-scheduler-scheduler" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803664 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3384fab3-f36e-4fc4-85f7-17d4fa97fa37" containerName="nova-manage" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803683 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-api" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.803695 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c37933f-e0d4-4353-992b-85108525fdca" containerName="nova-api-log" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.807640 5030 scope.go:117] "RemoveContainer" containerID="53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636" Mar 16 13:30:48 crc kubenswrapper[5030]: E0316 13:30:48.808166 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636\": container with ID starting with 53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636 not found: ID does not exist" containerID="53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.808209 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636"} err="failed to get container status \"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636\": rpc error: code = NotFound desc = could not find container \"53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636\": container with ID starting with 53e1f087c3de1c851483769323425746b477086bcdc015723a0e364b99d8a636 not found: ID does not exist" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.808534 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.810732 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.811977 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.875159 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.875223 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wqf\" (UniqueName: \"kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.875247 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.875736 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.951886 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.975276 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.981937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.982083 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wqf\" (UniqueName: \"kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.982119 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.982322 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.982974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.983320 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.989132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.990516 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:48 crc kubenswrapper[5030]: I0316 13:30:48.992972 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.003216 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.003336 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.003740 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wqf\" (UniqueName: \"kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf\") pod \"nova-api-0\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.085401 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rtc\" (UniqueName: \"kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.085460 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.085648 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.125503 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.188604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28rtc\" (UniqueName: \"kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.188912 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.189004 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.195913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.195958 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.205244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rtc\" (UniqueName: \"kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc\") pod \"nova-scheduler-0\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.377635 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.543944 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:30:49 crc kubenswrapper[5030]: W0316 13:30:49.549471 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf580733a_7832_4ece_b8a7_f77d3364de08.slice/crio-acd06717f5ab1bcdad11877e72c77235cfb3246deddb3908a19582950ea463ff WatchSource:0}: Error finding container acd06717f5ab1bcdad11877e72c77235cfb3246deddb3908a19582950ea463ff: Status 404 returned error can't find the container with id acd06717f5ab1bcdad11877e72c77235cfb3246deddb3908a19582950ea463ff Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.625454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-log" containerID="cri-o://391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" gracePeriod=30 Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.625824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerStarted","Data":"acd06717f5ab1bcdad11877e72c77235cfb3246deddb3908a19582950ea463ff"} Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.627171 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-metadata" containerID="cri-o://17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" gracePeriod=30 Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.802105 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:30:49 crc kubenswrapper[5030]: W0316 13:30:49.804513 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf62e8eab_1b88_4e21_826e_03699958fcf3.slice/crio-1751fd749b5ab920cbcbd989b6c498b1d5b7482df320f37429fb2ce4e8251424 WatchSource:0}: Error finding container 1751fd749b5ab920cbcbd989b6c498b1d5b7482df320f37429fb2ce4e8251424: Status 404 returned error can't find the container with id 1751fd749b5ab920cbcbd989b6c498b1d5b7482df320f37429fb2ce4e8251424 Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.959058 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c37933f-e0d4-4353-992b-85108525fdca" path="/var/lib/kubelet/pods/3c37933f-e0d4-4353-992b-85108525fdca/volumes" Mar 16 13:30:49 crc kubenswrapper[5030]: I0316 13:30:49.959790 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a333fd-c208-456d-a50a-233e24eaa3a1" path="/var/lib/kubelet/pods/b8a333fd-c208-456d-a50a-233e24eaa3a1/volumes" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.132403 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.216662 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs\") pod \"db7e99a4-cd0f-487e-a1b9-678a321a078f\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.216848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs\") pod \"db7e99a4-cd0f-487e-a1b9-678a321a078f\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.216959 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2crq\" (UniqueName: \"kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq\") pod \"db7e99a4-cd0f-487e-a1b9-678a321a078f\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.217015 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle\") pod \"db7e99a4-cd0f-487e-a1b9-678a321a078f\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.217045 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs" (OuterVolumeSpecName: "logs") pod "db7e99a4-cd0f-487e-a1b9-678a321a078f" (UID: "db7e99a4-cd0f-487e-a1b9-678a321a078f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.217060 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data\") pod \"db7e99a4-cd0f-487e-a1b9-678a321a078f\" (UID: \"db7e99a4-cd0f-487e-a1b9-678a321a078f\") " Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.218168 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db7e99a4-cd0f-487e-a1b9-678a321a078f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.221201 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq" (OuterVolumeSpecName: "kube-api-access-b2crq") pod "db7e99a4-cd0f-487e-a1b9-678a321a078f" (UID: "db7e99a4-cd0f-487e-a1b9-678a321a078f"). InnerVolumeSpecName "kube-api-access-b2crq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.239413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db7e99a4-cd0f-487e-a1b9-678a321a078f" (UID: "db7e99a4-cd0f-487e-a1b9-678a321a078f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.246350 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data" (OuterVolumeSpecName: "config-data") pod "db7e99a4-cd0f-487e-a1b9-678a321a078f" (UID: "db7e99a4-cd0f-487e-a1b9-678a321a078f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.261008 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "db7e99a4-cd0f-487e-a1b9-678a321a078f" (UID: "db7e99a4-cd0f-487e-a1b9-678a321a078f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.321939 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2crq\" (UniqueName: \"kubernetes.io/projected/db7e99a4-cd0f-487e-a1b9-678a321a078f-kube-api-access-b2crq\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.321974 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.321985 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.321996 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db7e99a4-cd0f-487e-a1b9-678a321a078f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638061 5030 generic.go:358] "Generic (PLEG): container finished" podID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerID="17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" exitCode=0 Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638099 5030 generic.go:358] "Generic (PLEG): container finished" podID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerID="391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" exitCode=143 Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerDied","Data":"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerDied","Data":"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638374 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db7e99a4-cd0f-487e-a1b9-678a321a078f","Type":"ContainerDied","Data":"72091ca0ea75377fdc2a7585b4c0b9bfd2d3be3b92b5a0b7b78a3a813d8066e9"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638396 5030 scope.go:117] "RemoveContainer" containerID="17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.638603 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.652482 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerStarted","Data":"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.652582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerStarted","Data":"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.656763 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f62e8eab-1b88-4e21-826e-03699958fcf3","Type":"ContainerStarted","Data":"04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.656806 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f62e8eab-1b88-4e21-826e-03699958fcf3","Type":"ContainerStarted","Data":"1751fd749b5ab920cbcbd989b6c498b1d5b7482df320f37429fb2ce4e8251424"} Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.683063 5030 scope.go:117] "RemoveContainer" containerID="391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.685559 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.685528558 podStartE2EDuration="2.685528558s" podCreationTimestamp="2026-03-16 13:30:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:50.670460544 +0000 UTC m=+1495.069773090" watchObservedRunningTime="2026-03-16 13:30:50.685528558 +0000 UTC m=+1495.084841104" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.699255 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.713986 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.726770 5030 scope.go:117] "RemoveContainer" containerID="17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" Mar 16 13:30:50 crc kubenswrapper[5030]: E0316 13:30:50.728651 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251\": container with ID starting with 17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251 not found: ID does not exist" containerID="17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.728697 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251"} err="failed to get container status \"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251\": rpc error: code = NotFound desc = could not find container \"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251\": container with ID starting with 17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251 not found: ID does not exist" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.728726 5030 scope.go:117] "RemoveContainer" containerID="391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.729720 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:50 crc kubenswrapper[5030]: E0316 13:30:50.731980 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71\": container with ID starting with 391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71 not found: ID does not exist" containerID="391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.732021 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71"} err="failed to get container status \"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71\": rpc error: code = NotFound desc = could not find container \"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71\": container with ID starting with 391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71 not found: ID does not exist" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.732059 5030 scope.go:117] "RemoveContainer" containerID="17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.733496 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251"} err="failed to get container status \"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251\": rpc error: code = NotFound desc = could not find container \"17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251\": container with ID starting with 17463478327f2d2060bd71e878a375c3e3b36f5b164acc37480876cdb762d251 not found: ID does not exist" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.733533 5030 scope.go:117] "RemoveContainer" containerID="391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.733979 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71"} err="failed to get container status \"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71\": rpc error: code = NotFound desc = could not find container \"391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71\": container with ID starting with 391a00bf2c5c52c586ba8de7ae95bf7978958304f10d9c906e27eca674632d71 not found: ID does not exist" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.735598 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.735578672 podStartE2EDuration="2.735578672s" podCreationTimestamp="2026-03-16 13:30:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:50.700151024 +0000 UTC m=+1495.099463561" watchObservedRunningTime="2026-03-16 13:30:50.735578672 +0000 UTC m=+1495.134891219" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738519 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-log" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738569 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-log" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738711 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-metadata" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738725 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-metadata" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738954 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-metadata" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.738998 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" containerName="nova-metadata-log" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.743436 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.743630 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.746364 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.746979 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.833644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.833816 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.833918 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.834104 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.834129 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftl5n\" (UniqueName: \"kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.935899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.936274 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.936399 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.936419 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftl5n\" (UniqueName: \"kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.936867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.937046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.944199 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.944419 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.948951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.951013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftl5n\" (UniqueName: \"kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n\") pod \"nova-metadata-0\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:50 crc kubenswrapper[5030]: I0316 13:30:50.983236 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:51 crc kubenswrapper[5030]: I0316 13:30:51.061156 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:30:51 crc kubenswrapper[5030]: I0316 13:30:51.489248 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:30:51 crc kubenswrapper[5030]: W0316 13:30:51.490045 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb0caf5e_4718_4b49_b311_ab577fb91bcb.slice/crio-f41c182a8c6faaaf98492f40d1ec2ad145c39ab24bc77a4f946fc80cb3ae52c7 WatchSource:0}: Error finding container f41c182a8c6faaaf98492f40d1ec2ad145c39ab24bc77a4f946fc80cb3ae52c7: Status 404 returned error can't find the container with id f41c182a8c6faaaf98492f40d1ec2ad145c39ab24bc77a4f946fc80cb3ae52c7 Mar 16 13:30:51 crc kubenswrapper[5030]: I0316 13:30:51.673952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerStarted","Data":"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e"} Mar 16 13:30:51 crc kubenswrapper[5030]: I0316 13:30:51.674956 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerStarted","Data":"f41c182a8c6faaaf98492f40d1ec2ad145c39ab24bc77a4f946fc80cb3ae52c7"} Mar 16 13:30:51 crc kubenswrapper[5030]: I0316 13:30:51.957746 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7e99a4-cd0f-487e-a1b9-678a321a078f" path="/var/lib/kubelet/pods/db7e99a4-cd0f-487e-a1b9-678a321a078f/volumes" Mar 16 13:30:52 crc kubenswrapper[5030]: I0316 13:30:52.714212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerStarted","Data":"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6"} Mar 16 13:30:52 crc kubenswrapper[5030]: I0316 13:30:52.739842 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.73982413 podStartE2EDuration="2.73982413s" podCreationTimestamp="2026-03-16 13:30:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:52.731440855 +0000 UTC m=+1497.130753422" watchObservedRunningTime="2026-03-16 13:30:52.73982413 +0000 UTC m=+1497.139136676" Mar 16 13:30:53 crc kubenswrapper[5030]: E0316 13:30:53.911696 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1764389 actualBytes=10240 Mar 16 13:30:54 crc kubenswrapper[5030]: I0316 13:30:54.379597 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:54 crc kubenswrapper[5030]: I0316 13:30:54.650823 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:30:55 crc kubenswrapper[5030]: I0316 13:30:55.983196 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.009567 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.617388 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.633507 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.645718 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.652466 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.772511 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.894091 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml"] Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.901043 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.903473 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.904031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:30:56 crc kubenswrapper[5030]: I0316 13:30:56.904074 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml"] Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.074114 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.074313 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.074350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.074828 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj8q\" (UniqueName: \"kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.177660 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.177840 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.177876 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.178287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj8q\" (UniqueName: \"kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.189245 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.189497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.190112 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.200368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj8q\" (UniqueName: \"kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q\") pod \"nova-cell1-cell-mapping-tb7ml\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.219086 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.696626 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml"] Mar 16 13:30:57 crc kubenswrapper[5030]: I0316 13:30:57.765465 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" event={"ID":"d79da2d9-12a8-44a6-bcaa-b404eee94ee6","Type":"ContainerStarted","Data":"fb0c3d75d9c32e645d1afbccdb8ba5103130879c47fb33e1f5133aec693ffd80"} Mar 16 13:30:58 crc kubenswrapper[5030]: I0316 13:30:58.779754 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" event={"ID":"d79da2d9-12a8-44a6-bcaa-b404eee94ee6","Type":"ContainerStarted","Data":"29aeb4a686aab6275ce9c52bb68f9c373648b8df65f4677d1fba4278e98719a7"} Mar 16 13:30:58 crc kubenswrapper[5030]: I0316 13:30:58.803392 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" podStartSLOduration=2.803376805 podStartE2EDuration="2.803376805s" podCreationTimestamp="2026-03-16 13:30:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:30:58.794973704 +0000 UTC m=+1503.194286251" watchObservedRunningTime="2026-03-16 13:30:58.803376805 +0000 UTC m=+1503.202689343" Mar 16 13:30:59 crc kubenswrapper[5030]: I0316 13:30:59.126816 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:59 crc kubenswrapper[5030]: I0316 13:30:59.126884 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:30:59 crc kubenswrapper[5030]: I0316 13:30:59.379691 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:59 crc kubenswrapper[5030]: I0316 13:30:59.399692 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:30:59 crc kubenswrapper[5030]: I0316 13:30:59.834139 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:00 crc kubenswrapper[5030]: I0316 13:31:00.167677 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.51:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:00 crc kubenswrapper[5030]: I0316 13:31:00.167699 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.51:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:01 crc kubenswrapper[5030]: I0316 13:31:01.063330 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:01 crc kubenswrapper[5030]: I0316 13:31:01.063781 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:01 crc kubenswrapper[5030]: I0316 13:31:01.823342 5030 generic.go:358] "Generic (PLEG): container finished" podID="d79da2d9-12a8-44a6-bcaa-b404eee94ee6" containerID="29aeb4a686aab6275ce9c52bb68f9c373648b8df65f4677d1fba4278e98719a7" exitCode=0 Mar 16 13:31:01 crc kubenswrapper[5030]: I0316 13:31:01.823430 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" event={"ID":"d79da2d9-12a8-44a6-bcaa-b404eee94ee6","Type":"ContainerDied","Data":"29aeb4a686aab6275ce9c52bb68f9c373648b8df65f4677d1fba4278e98719a7"} Mar 16 13:31:02 crc kubenswrapper[5030]: I0316 13:31:02.067756 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.53:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:02 crc kubenswrapper[5030]: I0316 13:31:02.067757 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.53:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.152880 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.215053 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts\") pod \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.215353 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data\") pod \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.215754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle\") pod \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.215799 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmj8q\" (UniqueName: \"kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q\") pod \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\" (UID: \"d79da2d9-12a8-44a6-bcaa-b404eee94ee6\") " Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.223598 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts" (OuterVolumeSpecName: "scripts") pod "d79da2d9-12a8-44a6-bcaa-b404eee94ee6" (UID: "d79da2d9-12a8-44a6-bcaa-b404eee94ee6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.228756 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q" (OuterVolumeSpecName: "kube-api-access-fmj8q") pod "d79da2d9-12a8-44a6-bcaa-b404eee94ee6" (UID: "d79da2d9-12a8-44a6-bcaa-b404eee94ee6"). InnerVolumeSpecName "kube-api-access-fmj8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.243531 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data" (OuterVolumeSpecName: "config-data") pod "d79da2d9-12a8-44a6-bcaa-b404eee94ee6" (UID: "d79da2d9-12a8-44a6-bcaa-b404eee94ee6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.246543 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d79da2d9-12a8-44a6-bcaa-b404eee94ee6" (UID: "d79da2d9-12a8-44a6-bcaa-b404eee94ee6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.319107 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.319147 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.319159 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.319172 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmj8q\" (UniqueName: \"kubernetes.io/projected/d79da2d9-12a8-44a6-bcaa-b404eee94ee6-kube-api-access-fmj8q\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.847364 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.847725 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml" event={"ID":"d79da2d9-12a8-44a6-bcaa-b404eee94ee6","Type":"ContainerDied","Data":"fb0c3d75d9c32e645d1afbccdb8ba5103130879c47fb33e1f5133aec693ffd80"} Mar 16 13:31:03 crc kubenswrapper[5030]: I0316 13:31:03.847774 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb0c3d75d9c32e645d1afbccdb8ba5103130879c47fb33e1f5133aec693ffd80" Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.017275 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.017561 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-log" containerID="cri-o://684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8" gracePeriod=30 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.017650 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-api" containerID="cri-o://3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7" gracePeriod=30 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.035173 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.038249 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerName="nova-scheduler-scheduler" containerID="cri-o://04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" gracePeriod=30 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.047804 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.048023 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-log" containerID="cri-o://98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e" gracePeriod=30 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.048762 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-metadata" containerID="cri-o://4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6" gracePeriod=30 Mar 16 13:31:04 crc kubenswrapper[5030]: E0316 13:31:04.801713 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:31:04 crc kubenswrapper[5030]: E0316 13:31:04.803536 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:31:04 crc kubenswrapper[5030]: E0316 13:31:04.805092 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:31:04 crc kubenswrapper[5030]: E0316 13:31:04.805197 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.861481 5030 generic.go:358] "Generic (PLEG): container finished" podID="f580733a-7832-4ece-b8a7-f77d3364de08" containerID="684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8" exitCode=143 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.861856 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerDied","Data":"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8"} Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.864109 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerID="98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e" exitCode=143 Mar 16 13:31:04 crc kubenswrapper[5030]: I0316 13:31:04.864243 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerDied","Data":"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e"} Mar 16 13:31:05 crc kubenswrapper[5030]: I0316 13:31:05.875379 5030 generic.go:358] "Generic (PLEG): container finished" podID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerID="04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" exitCode=0 Mar 16 13:31:05 crc kubenswrapper[5030]: I0316 13:31:05.875571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f62e8eab-1b88-4e21-826e-03699958fcf3","Type":"ContainerDied","Data":"04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592"} Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.061787 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.187833 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle\") pod \"f62e8eab-1b88-4e21-826e-03699958fcf3\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.188063 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28rtc\" (UniqueName: \"kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc\") pod \"f62e8eab-1b88-4e21-826e-03699958fcf3\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.188127 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data\") pod \"f62e8eab-1b88-4e21-826e-03699958fcf3\" (UID: \"f62e8eab-1b88-4e21-826e-03699958fcf3\") " Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.194899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc" (OuterVolumeSpecName: "kube-api-access-28rtc") pod "f62e8eab-1b88-4e21-826e-03699958fcf3" (UID: "f62e8eab-1b88-4e21-826e-03699958fcf3"). InnerVolumeSpecName "kube-api-access-28rtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.224899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data" (OuterVolumeSpecName: "config-data") pod "f62e8eab-1b88-4e21-826e-03699958fcf3" (UID: "f62e8eab-1b88-4e21-826e-03699958fcf3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.227607 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f62e8eab-1b88-4e21-826e-03699958fcf3" (UID: "f62e8eab-1b88-4e21-826e-03699958fcf3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.292422 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.292459 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rtc\" (UniqueName: \"kubernetes.io/projected/f62e8eab-1b88-4e21-826e-03699958fcf3-kube-api-access-28rtc\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.292472 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f62e8eab-1b88-4e21-826e-03699958fcf3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.890517 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.890501 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"f62e8eab-1b88-4e21-826e-03699958fcf3","Type":"ContainerDied","Data":"1751fd749b5ab920cbcbd989b6c498b1d5b7482df320f37429fb2ce4e8251424"} Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.891029 5030 scope.go:117] "RemoveContainer" containerID="04a4cf1b10fd30518ceaa9b6b978e0c2795e5902e6c92b9f0be21f70c05d6592" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.930918 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.942518 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.949759 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.950864 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79da2d9-12a8-44a6-bcaa-b404eee94ee6" containerName="nova-manage" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.950885 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79da2d9-12a8-44a6-bcaa-b404eee94ee6" containerName="nova-manage" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.950918 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerName="nova-scheduler-scheduler" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.950925 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerName="nova-scheduler-scheduler" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.951149 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d79da2d9-12a8-44a6-bcaa-b404eee94ee6" containerName="nova-manage" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.951174 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" containerName="nova-scheduler-scheduler" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.955074 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.955340 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:06 crc kubenswrapper[5030]: I0316 13:31:06.957615 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.024106 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtx8z\" (UniqueName: \"kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.024538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.024720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.126532 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.126607 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.126960 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.127022 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.127089 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtx8z\" (UniqueName: \"kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.132874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.133142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.146291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtx8z\" (UniqueName: \"kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z\") pod \"nova-scheduler-0\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.273730 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.347676 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:07 crc kubenswrapper[5030]: E0316 13:31:07.417876 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf580733a_7832_4ece_b8a7_f77d3364de08.slice/crio-3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.583013 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.621155 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.660517 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle\") pod \"f580733a-7832-4ece-b8a7-f77d3364de08\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.660628 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs\") pod \"f580733a-7832-4ece-b8a7-f77d3364de08\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.660665 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data\") pod \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.660922 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle\") pod \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.661070 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data\") pod \"f580733a-7832-4ece-b8a7-f77d3364de08\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.661096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs\") pod \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.661142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs\") pod \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.661189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5wqf\" (UniqueName: \"kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf\") pod \"f580733a-7832-4ece-b8a7-f77d3364de08\" (UID: \"f580733a-7832-4ece-b8a7-f77d3364de08\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.661312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftl5n\" (UniqueName: \"kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n\") pod \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\" (UID: \"cb0caf5e-4718-4b49-b311-ab577fb91bcb\") " Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.663257 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs" (OuterVolumeSpecName: "logs") pod "f580733a-7832-4ece-b8a7-f77d3364de08" (UID: "f580733a-7832-4ece-b8a7-f77d3364de08"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.663598 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs" (OuterVolumeSpecName: "logs") pod "cb0caf5e-4718-4b49-b311-ab577fb91bcb" (UID: "cb0caf5e-4718-4b49-b311-ab577fb91bcb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.673434 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf" (OuterVolumeSpecName: "kube-api-access-v5wqf") pod "f580733a-7832-4ece-b8a7-f77d3364de08" (UID: "f580733a-7832-4ece-b8a7-f77d3364de08"). InnerVolumeSpecName "kube-api-access-v5wqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.678509 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n" (OuterVolumeSpecName: "kube-api-access-ftl5n") pod "cb0caf5e-4718-4b49-b311-ab577fb91bcb" (UID: "cb0caf5e-4718-4b49-b311-ab577fb91bcb"). InnerVolumeSpecName "kube-api-access-ftl5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.687826 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data" (OuterVolumeSpecName: "config-data") pod "f580733a-7832-4ece-b8a7-f77d3364de08" (UID: "f580733a-7832-4ece-b8a7-f77d3364de08"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.707110 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f580733a-7832-4ece-b8a7-f77d3364de08" (UID: "f580733a-7832-4ece-b8a7-f77d3364de08"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.707592 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data" (OuterVolumeSpecName: "config-data") pod "cb0caf5e-4718-4b49-b311-ab577fb91bcb" (UID: "cb0caf5e-4718-4b49-b311-ab577fb91bcb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.709809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb0caf5e-4718-4b49-b311-ab577fb91bcb" (UID: "cb0caf5e-4718-4b49-b311-ab577fb91bcb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.725701 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "cb0caf5e-4718-4b49-b311-ab577fb91bcb" (UID: "cb0caf5e-4718-4b49-b311-ab577fb91bcb"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.763999 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764028 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764046 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764061 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cb0caf5e-4718-4b49-b311-ab577fb91bcb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764071 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5wqf\" (UniqueName: \"kubernetes.io/projected/f580733a-7832-4ece-b8a7-f77d3364de08-kube-api-access-v5wqf\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764081 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftl5n\" (UniqueName: \"kubernetes.io/projected/cb0caf5e-4718-4b49-b311-ab577fb91bcb-kube-api-access-ftl5n\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764090 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f580733a-7832-4ece-b8a7-f77d3364de08-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764100 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f580733a-7832-4ece-b8a7-f77d3364de08-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.764110 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cb0caf5e-4718-4b49-b311-ab577fb91bcb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:07 crc kubenswrapper[5030]: W0316 13:31:07.843413 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f88a0ef_8412_4a16_99f8_df4794c0da80.slice/crio-87a0a974ac4fdb0caafdc2e01c3a4a5719f97aaa3f10e1357b1627cbad748997 WatchSource:0}: Error finding container 87a0a974ac4fdb0caafdc2e01c3a4a5719f97aaa3f10e1357b1627cbad748997: Status 404 returned error can't find the container with id 87a0a974ac4fdb0caafdc2e01c3a4a5719f97aaa3f10e1357b1627cbad748997 Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.843897 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.901703 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerID="4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6" exitCode=0 Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.901756 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerDied","Data":"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6"} Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.901818 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"cb0caf5e-4718-4b49-b311-ab577fb91bcb","Type":"ContainerDied","Data":"f41c182a8c6faaaf98492f40d1ec2ad145c39ab24bc77a4f946fc80cb3ae52c7"} Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.901841 5030 scope.go:117] "RemoveContainer" containerID="4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.902483 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.904698 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7f88a0ef-8412-4a16-99f8-df4794c0da80","Type":"ContainerStarted","Data":"87a0a974ac4fdb0caafdc2e01c3a4a5719f97aaa3f10e1357b1627cbad748997"} Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.907658 5030 generic.go:358] "Generic (PLEG): container finished" podID="f580733a-7832-4ece-b8a7-f77d3364de08" containerID="3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7" exitCode=0 Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.907742 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerDied","Data":"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7"} Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.907792 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f580733a-7832-4ece-b8a7-f77d3364de08","Type":"ContainerDied","Data":"acd06717f5ab1bcdad11877e72c77235cfb3246deddb3908a19582950ea463ff"} Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.907747 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.932358 5030 scope.go:117] "RemoveContainer" containerID="98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.940660 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.963466 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f62e8eab-1b88-4e21-826e-03699958fcf3" path="/var/lib/kubelet/pods/f62e8eab-1b88-4e21-826e-03699958fcf3/volumes" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.964144 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.964187 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.978670 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979777 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-metadata" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979801 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-metadata" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979825 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979832 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979855 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979861 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979882 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-api" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.979887 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-api" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.980037 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.980066 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" containerName="nova-api-api" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.980076 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-log" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.980086 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" containerName="nova-metadata-metadata" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.980913 5030 scope.go:117] "RemoveContainer" containerID="4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6" Mar 16 13:31:07 crc kubenswrapper[5030]: E0316 13:31:07.981447 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6\": container with ID starting with 4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6 not found: ID does not exist" containerID="4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.981565 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6"} err="failed to get container status \"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6\": rpc error: code = NotFound desc = could not find container \"4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6\": container with ID starting with 4e668cb1ae8aecd01f9399bc3b4eaed333587dffddccb26eed276532644fe3c6 not found: ID does not exist" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.981646 5030 scope.go:117] "RemoveContainer" containerID="98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e" Mar 16 13:31:07 crc kubenswrapper[5030]: E0316 13:31:07.981944 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e\": container with ID starting with 98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e not found: ID does not exist" containerID="98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.982025 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e"} err="failed to get container status \"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e\": rpc error: code = NotFound desc = could not find container \"98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e\": container with ID starting with 98b30285f2970d861e012bf8cd7291bbb71d96460155d7d5e6c1dc13826b4d3e not found: ID does not exist" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.982098 5030 scope.go:117] "RemoveContainer" containerID="3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.985520 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.990458 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.990803 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:31:07 crc kubenswrapper[5030]: I0316 13:31:07.991314 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.006796 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.015028 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.019920 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.022565 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.022830 5030 scope.go:117] "RemoveContainer" containerID="684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.022957 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.043264 5030 scope.go:117] "RemoveContainer" containerID="3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7" Mar 16 13:31:08 crc kubenswrapper[5030]: E0316 13:31:08.043608 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7\": container with ID starting with 3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7 not found: ID does not exist" containerID="3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.043641 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7"} err="failed to get container status \"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7\": rpc error: code = NotFound desc = could not find container \"3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7\": container with ID starting with 3d5fbffd8d824aad4e7b33fe8c3cc69f1f3081463e4ac250e04f7e5a401fafe7 not found: ID does not exist" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.043666 5030 scope.go:117] "RemoveContainer" containerID="684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8" Mar 16 13:31:08 crc kubenswrapper[5030]: E0316 13:31:08.043976 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8\": container with ID starting with 684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8 not found: ID does not exist" containerID="684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.044017 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8"} err="failed to get container status \"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8\": rpc error: code = NotFound desc = could not find container \"684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8\": container with ID starting with 684d0a0fbcf562e6617180d931cc08d2385def3e9758192cccf8d4eafde14ff8 not found: ID does not exist" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.073717 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5wx4\" (UniqueName: \"kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.073771 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.074616 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-444p5\" (UniqueName: \"kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.074745 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.074852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.074913 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.075097 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.075239 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.075378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177669 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177756 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177848 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177877 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177921 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5wx4\" (UniqueName: \"kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.177945 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.178047 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-444p5\" (UniqueName: \"kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.181309 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.182060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.192818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.202136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5wx4\" (UniqueName: \"kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.202769 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.213159 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-444p5\" (UniqueName: \"kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.213994 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.217869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data\") pod \"nova-metadata-0\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.218152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data\") pod \"nova-api-0\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.311248 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.336261 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:08 crc kubenswrapper[5030]: W0316 13:31:08.806661 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb6ddcb0_3f63_467f_92d8_67320056f141.slice/crio-eaa8ff12eaac4af5f1b75ae0f44508e2263ff85dc93030e3fa125e05ddb1221f WatchSource:0}: Error finding container eaa8ff12eaac4af5f1b75ae0f44508e2263ff85dc93030e3fa125e05ddb1221f: Status 404 returned error can't find the container with id eaa8ff12eaac4af5f1b75ae0f44508e2263ff85dc93030e3fa125e05ddb1221f Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.809262 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.854585 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.919652 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerStarted","Data":"dcf23cdceb6212d6dbb3561a01f99737538d7d33985a82984648700c4c07a710"} Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.924142 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7f88a0ef-8412-4a16-99f8-df4794c0da80","Type":"ContainerStarted","Data":"f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b"} Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.926218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerStarted","Data":"eaa8ff12eaac4af5f1b75ae0f44508e2263ff85dc93030e3fa125e05ddb1221f"} Mar 16 13:31:08 crc kubenswrapper[5030]: I0316 13:31:08.952626 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.952610765 podStartE2EDuration="2.952610765s" podCreationTimestamp="2026-03-16 13:31:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:31:08.940565685 +0000 UTC m=+1513.339878232" watchObservedRunningTime="2026-03-16 13:31:08.952610765 +0000 UTC m=+1513.351923311" Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.941828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerStarted","Data":"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806"} Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.942206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerStarted","Data":"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11"} Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.958184 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0caf5e-4718-4b49-b311-ab577fb91bcb" path="/var/lib/kubelet/pods/cb0caf5e-4718-4b49-b311-ab577fb91bcb/volumes" Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.959061 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f580733a-7832-4ece-b8a7-f77d3364de08" path="/var/lib/kubelet/pods/f580733a-7832-4ece-b8a7-f77d3364de08/volumes" Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.960000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerStarted","Data":"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f"} Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.960036 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerStarted","Data":"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497"} Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.970131 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.970113343 podStartE2EDuration="2.970113343s" podCreationTimestamp="2026-03-16 13:31:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:31:09.962348271 +0000 UTC m=+1514.361660808" watchObservedRunningTime="2026-03-16 13:31:09.970113343 +0000 UTC m=+1514.369425890" Mar 16 13:31:09 crc kubenswrapper[5030]: I0316 13:31:09.983518 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.9834979820000003 podStartE2EDuration="2.983497982s" podCreationTimestamp="2026-03-16 13:31:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:31:09.9797265 +0000 UTC m=+1514.379039047" watchObservedRunningTime="2026-03-16 13:31:09.983497982 +0000 UTC m=+1514.382810528" Mar 16 13:31:10 crc kubenswrapper[5030]: I0316 13:31:10.843464 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:10 crc kubenswrapper[5030]: I0316 13:31:10.844186 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="a7e47a34-3b99-4202-a013-fad458954964" containerName="kube-state-metrics" containerID="cri-o://b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074" gracePeriod=30 Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.299084 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.464293 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnlcq\" (UniqueName: \"kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq\") pod \"a7e47a34-3b99-4202-a013-fad458954964\" (UID: \"a7e47a34-3b99-4202-a013-fad458954964\") " Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.471721 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq" (OuterVolumeSpecName: "kube-api-access-gnlcq") pod "a7e47a34-3b99-4202-a013-fad458954964" (UID: "a7e47a34-3b99-4202-a013-fad458954964"). InnerVolumeSpecName "kube-api-access-gnlcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.568301 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnlcq\" (UniqueName: \"kubernetes.io/projected/a7e47a34-3b99-4202-a013-fad458954964-kube-api-access-gnlcq\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.972935 5030 generic.go:358] "Generic (PLEG): container finished" podID="a7e47a34-3b99-4202-a013-fad458954964" containerID="b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074" exitCode=2 Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.973070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a7e47a34-3b99-4202-a013-fad458954964","Type":"ContainerDied","Data":"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074"} Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.973138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"a7e47a34-3b99-4202-a013-fad458954964","Type":"ContainerDied","Data":"2a825dac0490e6b0d53cabae2c25b19524ba5b7b0422987686525756dce36d91"} Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.973025 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.973198 5030 scope.go:117] "RemoveContainer" containerID="b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074" Mar 16 13:31:11 crc kubenswrapper[5030]: I0316 13:31:11.996972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.005538 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.009414 5030 scope.go:117] "RemoveContainer" containerID="b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074" Mar 16 13:31:12 crc kubenswrapper[5030]: E0316 13:31:12.009807 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074\": container with ID starting with b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074 not found: ID does not exist" containerID="b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.009840 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074"} err="failed to get container status \"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074\": rpc error: code = NotFound desc = could not find container \"b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074\": container with ID starting with b9c07cf1f623737f669b317e97e4a140a56f4afbf4924f6f7913d15dd800b074 not found: ID does not exist" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.015921 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.016948 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e47a34-3b99-4202-a013-fad458954964" containerName="kube-state-metrics" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.016969 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e47a34-3b99-4202-a013-fad458954964" containerName="kube-state-metrics" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.017157 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7e47a34-3b99-4202-a013-fad458954964" containerName="kube-state-metrics" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.020887 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.025823 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.026015 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.032071 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.182992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.183184 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.183440 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.183566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96mq\" (UniqueName: \"kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.274111 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.287681 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.287959 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.288074 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g96mq\" (UniqueName: \"kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.288149 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.294151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.299856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.302738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.319127 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96mq\" (UniqueName: \"kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq\") pod \"kube-state-metrics-0\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.340889 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.479981 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.480362 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-central-agent" containerID="cri-o://184cbde0e42e23cd5ced8d1fed6a4f894ced84bde3170d125c5433d191774551" gracePeriod=30 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.480567 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-notification-agent" containerID="cri-o://e0c624216f9a8b0dc60142157436ade04842468989ea34d5106e9230d16c31d0" gracePeriod=30 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.480624 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="proxy-httpd" containerID="cri-o://0d02716169f8922cb948dff46d895603d30abda801981e4cd1782ffcb2d6a49a" gracePeriod=30 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.480703 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="sg-core" containerID="cri-o://ae3c00a086ffb9540e109d9dd4bdea4ffb4df59b0de399b28528123d3b51024b" gracePeriod=30 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.753108 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.987158 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"05b2eb18-282d-42e9-9b68-f348caaad8d6","Type":"ContainerStarted","Data":"30f9b5188673e25a1f3ae53a0d02a710df2e4d339ff46641ef2a57072eaeca9f"} Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993467 5030 generic.go:358] "Generic (PLEG): container finished" podID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerID="0d02716169f8922cb948dff46d895603d30abda801981e4cd1782ffcb2d6a49a" exitCode=0 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993498 5030 generic.go:358] "Generic (PLEG): container finished" podID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerID="ae3c00a086ffb9540e109d9dd4bdea4ffb4df59b0de399b28528123d3b51024b" exitCode=2 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993506 5030 generic.go:358] "Generic (PLEG): container finished" podID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerID="184cbde0e42e23cd5ced8d1fed6a4f894ced84bde3170d125c5433d191774551" exitCode=0 Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993588 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerDied","Data":"0d02716169f8922cb948dff46d895603d30abda801981e4cd1782ffcb2d6a49a"} Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993647 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerDied","Data":"ae3c00a086ffb9540e109d9dd4bdea4ffb4df59b0de399b28528123d3b51024b"} Mar 16 13:31:12 crc kubenswrapper[5030]: I0316 13:31:12.993658 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerDied","Data":"184cbde0e42e23cd5ced8d1fed6a4f894ced84bde3170d125c5433d191774551"} Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.348797 5030 scope.go:117] "RemoveContainer" containerID="47e275d6b60aa76a49a572f37a65e31aa3f43d845288dab61d5e5b368e6d66ee" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.368005 5030 scope.go:117] "RemoveContainer" containerID="bc20eaaadeb3ad1b260d080bfced970205680d1af449e78b8968357099595a03" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.389835 5030 scope.go:117] "RemoveContainer" containerID="269ac7b70a052f724c15a180e26354ce33127e0b6b16c18817d80a7c3f3cc829" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.406430 5030 scope.go:117] "RemoveContainer" containerID="702f7b29fbd473ea5b18b1d283206cddf84ab25b8ce8f2d3fc07e9a31dac1c6b" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.426762 5030 scope.go:117] "RemoveContainer" containerID="c2cd43506a91a5e11cfa5e16233edd85796456e9f6d9e96f25e8c54765c60a49" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.447279 5030 scope.go:117] "RemoveContainer" containerID="28d2b6c1154c4e2e7c02f38efdf02ffa92f341c9078e51b32ff06ade08369284" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.476928 5030 scope.go:117] "RemoveContainer" containerID="50cf0e50e87d9371c455b37ce50e82e2608e8746b3bc96b0840e2f0053fa3c42" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.504933 5030 scope.go:117] "RemoveContainer" containerID="fd603db9017ea18e32e104394c13a6249a68273e9c7dfd4b3469595d93092066" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.531024 5030 scope.go:117] "RemoveContainer" containerID="f4e98c92cdbe24b70cac2d6f5073c2dff6eb434f2a726c5c09fa269d5aa2c6dc" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.557102 5030 scope.go:117] "RemoveContainer" containerID="081371a1bc630f0222de645b48a9ead168f8f5b9467629eb604488759f57432a" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.591517 5030 scope.go:117] "RemoveContainer" containerID="03bec67835cdc8e8d65802af5d0b340b126b95f546733b446cc78e5cdeb431ae" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.616639 5030 scope.go:117] "RemoveContainer" containerID="30330ec7a8f6f0b678c7a56ec3e39dc58a576efa085bf0d9df7d1c4580cded94" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.656514 5030 scope.go:117] "RemoveContainer" containerID="7ba37912dff97635b19219822d83130b2684c85cd4b13a053456862a4f7eefed" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.694212 5030 scope.go:117] "RemoveContainer" containerID="06af05c99ec5dc0b030b1a9666ac11d65c83c426c39ebf3c2c06f91ef3795e46" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.718367 5030 scope.go:117] "RemoveContainer" containerID="7ab99802850440fa4b0c123a57a6dbc7fd5f9c7895c271504c56a39e49ed24fc" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.762008 5030 scope.go:117] "RemoveContainer" containerID="fce3378e22a01aa92e5104d394ec2686065dd7062dba935766b7ac1e47397dec" Mar 16 13:31:13 crc kubenswrapper[5030]: I0316 13:31:13.956038 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e47a34-3b99-4202-a013-fad458954964" path="/var/lib/kubelet/pods/a7e47a34-3b99-4202-a013-fad458954964/volumes" Mar 16 13:31:14 crc kubenswrapper[5030]: I0316 13:31:14.017058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"05b2eb18-282d-42e9-9b68-f348caaad8d6","Type":"ContainerStarted","Data":"47b306e2b88d355e8391ba403bb9d6e6a1d065cb9e38d7055bd852e3506c841e"} Mar 16 13:31:14 crc kubenswrapper[5030]: I0316 13:31:14.017195 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:14 crc kubenswrapper[5030]: I0316 13:31:14.042286 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.773625379 podStartE2EDuration="3.042266646s" podCreationTimestamp="2026-03-16 13:31:11 +0000 UTC" firstStartedPulling="2026-03-16 13:31:12.761255922 +0000 UTC m=+1517.160568469" lastFinishedPulling="2026-03-16 13:31:13.029897189 +0000 UTC m=+1517.429209736" observedRunningTime="2026-03-16 13:31:14.030748496 +0000 UTC m=+1518.430061043" watchObservedRunningTime="2026-03-16 13:31:14.042266646 +0000 UTC m=+1518.441579193" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.044488 5030 generic.go:358] "Generic (PLEG): container finished" podID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerID="e0c624216f9a8b0dc60142157436ade04842468989ea34d5106e9230d16c31d0" exitCode=0 Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.044713 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerDied","Data":"e0c624216f9a8b0dc60142157436ade04842468989ea34d5106e9230d16c31d0"} Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.261089 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.367439 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368097 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368245 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368417 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368567 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.368834 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.369064 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-564f2\" (UniqueName: \"kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2\") pod \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\" (UID: \"0808d22c-57d8-4aa9-bc07-5838ebd6cf76\") " Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.370334 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.370353 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.375832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts" (OuterVolumeSpecName: "scripts") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.376026 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2" (OuterVolumeSpecName: "kube-api-access-564f2") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "kube-api-access-564f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.395729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.431201 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.442305 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data" (OuterVolumeSpecName: "config-data") pod "0808d22c-57d8-4aa9-bc07-5838ebd6cf76" (UID: "0808d22c-57d8-4aa9-bc07-5838ebd6cf76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.474275 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.474304 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.474315 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-564f2\" (UniqueName: \"kubernetes.io/projected/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-kube-api-access-564f2\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.474327 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:15 crc kubenswrapper[5030]: I0316 13:31:15.474338 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0808d22c-57d8-4aa9-bc07-5838ebd6cf76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.063970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.063979 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"0808d22c-57d8-4aa9-bc07-5838ebd6cf76","Type":"ContainerDied","Data":"0f26fef7005c029c8219cd670613821af1772701fa1cfeb982fd39fb40d63188"} Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.064067 5030 scope.go:117] "RemoveContainer" containerID="0d02716169f8922cb948dff46d895603d30abda801981e4cd1782ffcb2d6a49a" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.106800 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.111267 5030 scope.go:117] "RemoveContainer" containerID="ae3c00a086ffb9540e109d9dd4bdea4ffb4df59b0de399b28528123d3b51024b" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.120750 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.131815 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.132936 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="proxy-httpd" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.132958 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="proxy-httpd" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.132988 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="sg-core" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.132994 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="sg-core" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133009 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-notification-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133015 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-notification-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133032 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-central-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133038 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-central-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133235 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="proxy-httpd" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133259 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-central-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133271 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="ceilometer-notification-agent" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.133301 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" containerName="sg-core" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.142643 5030 scope.go:117] "RemoveContainer" containerID="e0c624216f9a8b0dc60142157436ade04842468989ea34d5106e9230d16c31d0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.142758 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.142964 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.145582 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.146328 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.146513 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.177626 5030 scope.go:117] "RemoveContainer" containerID="184cbde0e42e23cd5ced8d1fed6a4f894ced84bde3170d125c5433d191774551" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189191 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189588 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189835 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.189896 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkzx\" (UniqueName: \"kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291103 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291189 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291225 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291274 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291312 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291342 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smkzx\" (UniqueName: \"kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.291366 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.292214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.292525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.297107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.297510 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.297604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.298230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.301213 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.317352 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkzx\" (UniqueName: \"kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx\") pod \"ceilometer-0\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.465440 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:16 crc kubenswrapper[5030]: I0316 13:31:16.898017 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:17 crc kubenswrapper[5030]: I0316 13:31:17.079961 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerStarted","Data":"79c75def69b85f7a100c3c001a19aa9c233d48a431d009a5318dbe6ad7de07ce"} Mar 16 13:31:17 crc kubenswrapper[5030]: I0316 13:31:17.274468 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:17 crc kubenswrapper[5030]: I0316 13:31:17.304658 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:17 crc kubenswrapper[5030]: I0316 13:31:17.955822 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0808d22c-57d8-4aa9-bc07-5838ebd6cf76" path="/var/lib/kubelet/pods/0808d22c-57d8-4aa9-bc07-5838ebd6cf76/volumes" Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.089377 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerStarted","Data":"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1"} Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.119099 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.312378 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.313599 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.336621 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:18 crc kubenswrapper[5030]: I0316 13:31:18.336667 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:19 crc kubenswrapper[5030]: I0316 13:31:19.108640 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerStarted","Data":"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc"} Mar 16 13:31:19 crc kubenswrapper[5030]: I0316 13:31:19.318762 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.56:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:19 crc kubenswrapper[5030]: I0316 13:31:19.318767 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.56:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:19 crc kubenswrapper[5030]: I0316 13:31:19.377674 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.57:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:19 crc kubenswrapper[5030]: I0316 13:31:19.377762 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.57:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:20 crc kubenswrapper[5030]: I0316 13:31:20.121890 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerStarted","Data":"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8"} Mar 16 13:31:23 crc kubenswrapper[5030]: I0316 13:31:23.162118 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerStarted","Data":"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef"} Mar 16 13:31:23 crc kubenswrapper[5030]: I0316 13:31:23.162895 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:23 crc kubenswrapper[5030]: I0316 13:31:23.198959 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.043630316 podStartE2EDuration="7.198944855s" podCreationTimestamp="2026-03-16 13:31:16 +0000 UTC" firstStartedPulling="2026-03-16 13:31:16.9019169 +0000 UTC m=+1521.301229447" lastFinishedPulling="2026-03-16 13:31:22.057231439 +0000 UTC m=+1526.456543986" observedRunningTime="2026-03-16 13:31:23.183931514 +0000 UTC m=+1527.583244071" watchObservedRunningTime="2026-03-16 13:31:23.198944855 +0000 UTC m=+1527.598257403" Mar 16 13:31:24 crc kubenswrapper[5030]: I0316 13:31:24.286965 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:31:24 crc kubenswrapper[5030]: I0316 13:31:24.287423 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:31:25 crc kubenswrapper[5030]: I0316 13:31:25.050942 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:31:26 crc kubenswrapper[5030]: I0316 13:31:26.312188 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:26 crc kubenswrapper[5030]: I0316 13:31:26.312261 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:26 crc kubenswrapper[5030]: I0316 13:31:26.336966 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:26 crc kubenswrapper[5030]: I0316 13:31:26.337090 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.317059 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.318124 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.322178 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.324421 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.342213 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.342365 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.344658 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:28 crc kubenswrapper[5030]: I0316 13:31:28.346113 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.009737 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.010335 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-central-agent" containerID="cri-o://713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" gracePeriod=30 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.010379 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="sg-core" containerID="cri-o://ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" gracePeriod=30 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.010398 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="proxy-httpd" containerID="cri-o://77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" gracePeriod=30 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.010438 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-notification-agent" containerID="cri-o://0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" gracePeriod=30 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.243066 5030 generic.go:358] "Generic (PLEG): container finished" podID="018eeba1-5037-4190-805b-eb880f115f51" containerID="77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" exitCode=0 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.243101 5030 generic.go:358] "Generic (PLEG): container finished" podID="018eeba1-5037-4190-805b-eb880f115f51" containerID="ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" exitCode=2 Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.243151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerDied","Data":"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef"} Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.243199 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerDied","Data":"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8"} Mar 16 13:31:30 crc kubenswrapper[5030]: I0316 13:31:30.778312 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.047966 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069619 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069853 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smkzx\" (UniqueName: \"kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.069984 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.070026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.070216 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data\") pod \"018eeba1-5037-4190-805b-eb880f115f51\" (UID: \"018eeba1-5037-4190-805b-eb880f115f51\") " Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.071508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.074136 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.079875 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx" (OuterVolumeSpecName: "kube-api-access-smkzx") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "kube-api-access-smkzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.081633 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts" (OuterVolumeSpecName: "scripts") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.104526 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.129790 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172331 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172507 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172606 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172687 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172754 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smkzx\" (UniqueName: \"kubernetes.io/projected/018eeba1-5037-4190-805b-eb880f115f51-kube-api-access-smkzx\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.172812 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/018eeba1-5037-4190-805b-eb880f115f51-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.175651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.178451 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data" (OuterVolumeSpecName: "config-data") pod "018eeba1-5037-4190-805b-eb880f115f51" (UID: "018eeba1-5037-4190-805b-eb880f115f51"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258288 5030 generic.go:358] "Generic (PLEG): container finished" podID="018eeba1-5037-4190-805b-eb880f115f51" containerID="0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" exitCode=0 Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258313 5030 generic.go:358] "Generic (PLEG): container finished" podID="018eeba1-5037-4190-805b-eb880f115f51" containerID="713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" exitCode=0 Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerDied","Data":"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc"} Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerDied","Data":"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1"} Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258569 5030 scope.go:117] "RemoveContainer" containerID="77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258575 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"018eeba1-5037-4190-805b-eb880f115f51","Type":"ContainerDied","Data":"79c75def69b85f7a100c3c001a19aa9c233d48a431d009a5318dbe6ad7de07ce"} Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258682 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-log" containerID="cri-o://3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11" gracePeriod=30 Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258770 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.258915 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-api" containerID="cri-o://6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806" gracePeriod=30 Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.278309 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.278335 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/018eeba1-5037-4190-805b-eb880f115f51-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.301480 5030 scope.go:117] "RemoveContainer" containerID="ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.306245 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.326285 5030 scope.go:117] "RemoveContainer" containerID="0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.330882 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.337588 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338690 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-notification-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338713 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-notification-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338726 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="proxy-httpd" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338732 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="proxy-httpd" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338754 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="sg-core" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338759 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="sg-core" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338769 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-central-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338774 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-central-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338951 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="proxy-httpd" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338965 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-notification-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338981 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="ceilometer-central-agent" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.338992 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="018eeba1-5037-4190-805b-eb880f115f51" containerName="sg-core" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.360959 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.361632 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.363336 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.363538 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.364369 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.380953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381024 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381044 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381241 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381275 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scv6l\" (UniqueName: \"kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.381839 5030 scope.go:117] "RemoveContainer" containerID="713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.423428 5030 scope.go:117] "RemoveContainer" containerID="77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" Mar 16 13:31:31 crc kubenswrapper[5030]: E0316 13:31:31.424031 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef\": container with ID starting with 77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef not found: ID does not exist" containerID="77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424084 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef"} err="failed to get container status \"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef\": rpc error: code = NotFound desc = could not find container \"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef\": container with ID starting with 77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424115 5030 scope.go:117] "RemoveContainer" containerID="ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" Mar 16 13:31:31 crc kubenswrapper[5030]: E0316 13:31:31.424485 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8\": container with ID starting with ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8 not found: ID does not exist" containerID="ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424507 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8"} err="failed to get container status \"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8\": rpc error: code = NotFound desc = could not find container \"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8\": container with ID starting with ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8 not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424522 5030 scope.go:117] "RemoveContainer" containerID="0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" Mar 16 13:31:31 crc kubenswrapper[5030]: E0316 13:31:31.424826 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc\": container with ID starting with 0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc not found: ID does not exist" containerID="0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424862 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc"} err="failed to get container status \"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc\": rpc error: code = NotFound desc = could not find container \"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc\": container with ID starting with 0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.424883 5030 scope.go:117] "RemoveContainer" containerID="713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" Mar 16 13:31:31 crc kubenswrapper[5030]: E0316 13:31:31.425091 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1\": container with ID starting with 713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1 not found: ID does not exist" containerID="713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.425121 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1"} err="failed to get container status \"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1\": rpc error: code = NotFound desc = could not find container \"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1\": container with ID starting with 713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1 not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.425136 5030 scope.go:117] "RemoveContainer" containerID="77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.425854 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef"} err="failed to get container status \"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef\": rpc error: code = NotFound desc = could not find container \"77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef\": container with ID starting with 77077b13d5d0ac07240326000f1ed42e6b2dfc5e41c01ffabb80c713be47ffef not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.425880 5030 scope.go:117] "RemoveContainer" containerID="ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.426171 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8"} err="failed to get container status \"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8\": rpc error: code = NotFound desc = could not find container \"ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8\": container with ID starting with ccc945aa3f67e101219dc64822b7bf4b80d4826ddda0cfba3b0be24b1257a1c8 not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.426197 5030 scope.go:117] "RemoveContainer" containerID="0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.426571 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc"} err="failed to get container status \"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc\": rpc error: code = NotFound desc = could not find container \"0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc\": container with ID starting with 0d6d72dcaf1802bf028ee0023aa6e0961c6d24d8e502f18ce20053d80fa04fdc not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.426592 5030 scope.go:117] "RemoveContainer" containerID="713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.427243 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1"} err="failed to get container status \"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1\": rpc error: code = NotFound desc = could not find container \"713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1\": container with ID starting with 713d6c6a8585419fd6200aac904fefbc791378c964a105e4945716fc77d00ac1 not found: ID does not exist" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.484523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.484812 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.484872 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.484916 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485021 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485097 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485136 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485156 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scv6l\" (UniqueName: \"kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485371 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.485580 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.491291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.495568 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.495903 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.498113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.501856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.503737 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scv6l\" (UniqueName: \"kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l\") pod \"ceilometer-0\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.682195 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:31 crc kubenswrapper[5030]: I0316 13:31:31.955428 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018eeba1-5037-4190-805b-eb880f115f51" path="/var/lib/kubelet/pods/018eeba1-5037-4190-805b-eb880f115f51/volumes" Mar 16 13:31:32 crc kubenswrapper[5030]: I0316 13:31:32.123992 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:32 crc kubenswrapper[5030]: I0316 13:31:32.273185 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerStarted","Data":"bf8eb0c5329c0557f1bd53eddeefff21b6c884f3a761af00dbd94297426f7370"} Mar 16 13:31:32 crc kubenswrapper[5030]: I0316 13:31:32.275778 5030 generic.go:358] "Generic (PLEG): container finished" podID="5e3cd922-1fba-4149-a2f9-2213af528002" containerID="3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11" exitCode=143 Mar 16 13:31:32 crc kubenswrapper[5030]: I0316 13:31:32.275857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerDied","Data":"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11"} Mar 16 13:31:33 crc kubenswrapper[5030]: I0316 13:31:33.289570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerStarted","Data":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} Mar 16 13:31:33 crc kubenswrapper[5030]: I0316 13:31:33.317051 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.305385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerStarted","Data":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.834747 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.996376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-444p5\" (UniqueName: \"kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5\") pod \"5e3cd922-1fba-4149-a2f9-2213af528002\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.996817 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data\") pod \"5e3cd922-1fba-4149-a2f9-2213af528002\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.997037 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs\") pod \"5e3cd922-1fba-4149-a2f9-2213af528002\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.997079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle\") pod \"5e3cd922-1fba-4149-a2f9-2213af528002\" (UID: \"5e3cd922-1fba-4149-a2f9-2213af528002\") " Mar 16 13:31:34 crc kubenswrapper[5030]: I0316 13:31:34.997664 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs" (OuterVolumeSpecName: "logs") pod "5e3cd922-1fba-4149-a2f9-2213af528002" (UID: "5e3cd922-1fba-4149-a2f9-2213af528002"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.013777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5" (OuterVolumeSpecName: "kube-api-access-444p5") pod "5e3cd922-1fba-4149-a2f9-2213af528002" (UID: "5e3cd922-1fba-4149-a2f9-2213af528002"). InnerVolumeSpecName "kube-api-access-444p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.025129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e3cd922-1fba-4149-a2f9-2213af528002" (UID: "5e3cd922-1fba-4149-a2f9-2213af528002"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.026952 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data" (OuterVolumeSpecName: "config-data") pod "5e3cd922-1fba-4149-a2f9-2213af528002" (UID: "5e3cd922-1fba-4149-a2f9-2213af528002"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.100315 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.100477 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e3cd922-1fba-4149-a2f9-2213af528002-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.100574 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e3cd922-1fba-4149-a2f9-2213af528002-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.100643 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-444p5\" (UniqueName: \"kubernetes.io/projected/5e3cd922-1fba-4149-a2f9-2213af528002-kube-api-access-444p5\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.322285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerStarted","Data":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.325114 5030 generic.go:358] "Generic (PLEG): container finished" podID="5e3cd922-1fba-4149-a2f9-2213af528002" containerID="6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806" exitCode=0 Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.325201 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerDied","Data":"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806"} Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.325397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"5e3cd922-1fba-4149-a2f9-2213af528002","Type":"ContainerDied","Data":"dcf23cdceb6212d6dbb3561a01f99737538d7d33985a82984648700c4c07a710"} Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.325431 5030 scope.go:117] "RemoveContainer" containerID="6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.325262 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.361262 5030 scope.go:117] "RemoveContainer" containerID="3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.368164 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.387669 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.391293 5030 scope.go:117] "RemoveContainer" containerID="6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806" Mar 16 13:31:35 crc kubenswrapper[5030]: E0316 13:31:35.391666 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806\": container with ID starting with 6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806 not found: ID does not exist" containerID="6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.391699 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806"} err="failed to get container status \"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806\": rpc error: code = NotFound desc = could not find container \"6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806\": container with ID starting with 6ae8bbda8e989182b2667c918ddc312671f23147f7ba1cb00e0bb42d05946806 not found: ID does not exist" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.391720 5030 scope.go:117] "RemoveContainer" containerID="3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11" Mar 16 13:31:35 crc kubenswrapper[5030]: E0316 13:31:35.391999 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11\": container with ID starting with 3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11 not found: ID does not exist" containerID="3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.392036 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11"} err="failed to get container status \"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11\": rpc error: code = NotFound desc = could not find container \"3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11\": container with ID starting with 3bab9f4e21ebad08ed01517e592ab78fc7d313822a071bc0e59dbab1082f9c11 not found: ID does not exist" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.397906 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399405 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-log" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399430 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-log" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399454 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-api" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399460 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-api" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399667 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-log" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.399686 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" containerName="nova-api-api" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.406638 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.408140 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.410102 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.410359 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.412717 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.509775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.510076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.510113 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.510236 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.510470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvmd\" (UniqueName: \"kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.510542 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612203 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612229 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612281 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npvmd\" (UniqueName: \"kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.612436 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.613991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.618617 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.620578 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.623130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.635895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvmd\" (UniqueName: \"kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.636445 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data\") pod \"nova-api-0\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.762333 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:35 crc kubenswrapper[5030]: I0316 13:31:35.957313 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3cd922-1fba-4149-a2f9-2213af528002" path="/var/lib/kubelet/pods/5e3cd922-1fba-4149-a2f9-2213af528002/volumes" Mar 16 13:31:36 crc kubenswrapper[5030]: I0316 13:31:36.203397 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:31:36 crc kubenswrapper[5030]: I0316 13:31:36.345435 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerStarted","Data":"961efe0edf994537f6ac0cde21d708950738004824b6283a115ea16090296ef9"} Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.360659 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerStarted","Data":"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a"} Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.361334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerStarted","Data":"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755"} Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370772 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-central-agent" containerID="cri-o://c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" gracePeriod=30 Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerStarted","Data":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370899 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="proxy-httpd" containerID="cri-o://2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" gracePeriod=30 Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370915 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370943 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="sg-core" containerID="cri-o://fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" gracePeriod=30 Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.370998 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-notification-agent" containerID="cri-o://d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" gracePeriod=30 Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.389080 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.389060885 podStartE2EDuration="2.389060885s" podCreationTimestamp="2026-03-16 13:31:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:31:37.377696816 +0000 UTC m=+1541.777009364" watchObservedRunningTime="2026-03-16 13:31:37.389060885 +0000 UTC m=+1541.788373432" Mar 16 13:31:37 crc kubenswrapper[5030]: I0316 13:31:37.405023 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.70761176 podStartE2EDuration="6.40500153s" podCreationTimestamp="2026-03-16 13:31:31 +0000 UTC" firstStartedPulling="2026-03-16 13:31:32.148145129 +0000 UTC m=+1536.547457677" lastFinishedPulling="2026-03-16 13:31:36.8455349 +0000 UTC m=+1541.244847447" observedRunningTime="2026-03-16 13:31:37.402026045 +0000 UTC m=+1541.801338592" watchObservedRunningTime="2026-03-16 13:31:37.40500153 +0000 UTC m=+1541.804314077" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.021749 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175591 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175717 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175779 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.175992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scv6l\" (UniqueName: \"kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.176021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.176159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml\") pod \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\" (UID: \"2b0a9124-edd8-4199-afe1-46d7af9ad1b5\") " Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.176827 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.177071 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.177091 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.182953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l" (OuterVolumeSpecName: "kube-api-access-scv6l") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "kube-api-access-scv6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.182955 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts" (OuterVolumeSpecName: "scripts") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.201740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.218244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.233448 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.248478 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data" (OuterVolumeSpecName: "config-data") pod "2b0a9124-edd8-4199-afe1-46d7af9ad1b5" (UID: "2b0a9124-edd8-4199-afe1-46d7af9ad1b5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278499 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scv6l\" (UniqueName: \"kubernetes.io/projected/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-kube-api-access-scv6l\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278531 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278544 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278566 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278578 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.278588 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b0a9124-edd8-4199-afe1-46d7af9ad1b5-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389492 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" exitCode=0 Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389520 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" exitCode=2 Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389527 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" exitCode=0 Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389533 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" exitCode=0 Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389581 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerDied","Data":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389635 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerDied","Data":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389649 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerDied","Data":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerDied","Data":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"2b0a9124-edd8-4199-afe1-46d7af9ad1b5","Type":"ContainerDied","Data":"bf8eb0c5329c0557f1bd53eddeefff21b6c884f3a761af00dbd94297426f7370"} Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389589 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.389689 5030 scope.go:117] "RemoveContainer" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.414918 5030 scope.go:117] "RemoveContainer" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.424735 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.435719 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.446698 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447898 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-notification-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447918 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-notification-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447940 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-central-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447945 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-central-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447961 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="proxy-httpd" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447967 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="proxy-httpd" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447987 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="sg-core" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.447992 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="sg-core" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.448204 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-notification-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.448225 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="ceilometer-central-agent" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.448236 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="proxy-httpd" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.448247 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" containerName="sg-core" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.454988 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.457358 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.457697 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.458313 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.463574 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481536 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jcw4\" (UniqueName: \"kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481604 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481771 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.481916 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.482001 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.493742 5030 scope.go:117] "RemoveContainer" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.540537 5030 scope.go:117] "RemoveContainer" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.583590 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.583924 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jcw4\" (UniqueName: \"kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.584145 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.584332 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.584568 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.584681 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.584808 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.585076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.585890 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.588025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.594080 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.599615 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.601716 5030 scope.go:117] "RemoveContainer" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: E0316 13:31:38.605649 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": container with ID starting with 2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b not found: ID does not exist" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.605689 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} err="failed to get container status \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": rpc error: code = NotFound desc = could not find container \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": container with ID starting with 2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.605711 5030 scope.go:117] "RemoveContainer" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.606377 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.611138 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: E0316 13:31:38.611628 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": container with ID starting with fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9 not found: ID does not exist" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.611659 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} err="failed to get container status \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": rpc error: code = NotFound desc = could not find container \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": container with ID starting with fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9 not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.611673 5030 scope.go:117] "RemoveContainer" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: E0316 13:31:38.615618 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": container with ID starting with d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d not found: ID does not exist" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.615649 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} err="failed to get container status \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": rpc error: code = NotFound desc = could not find container \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": container with ID starting with d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.615663 5030 scope.go:117] "RemoveContainer" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: E0316 13:31:38.619640 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": container with ID starting with c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb not found: ID does not exist" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.619662 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} err="failed to get container status \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": rpc error: code = NotFound desc = could not find container \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": container with ID starting with c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.619674 5030 scope.go:117] "RemoveContainer" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.620274 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.620505 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jcw4\" (UniqueName: \"kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4\") pod \"ceilometer-0\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.622512 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} err="failed to get container status \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": rpc error: code = NotFound desc = could not find container \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": container with ID starting with 2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.622648 5030 scope.go:117] "RemoveContainer" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.626707 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} err="failed to get container status \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": rpc error: code = NotFound desc = could not find container \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": container with ID starting with fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9 not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.626757 5030 scope.go:117] "RemoveContainer" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.654010 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} err="failed to get container status \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": rpc error: code = NotFound desc = could not find container \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": container with ID starting with d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.654356 5030 scope.go:117] "RemoveContainer" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.659625 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} err="failed to get container status \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": rpc error: code = NotFound desc = could not find container \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": container with ID starting with c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.659741 5030 scope.go:117] "RemoveContainer" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.661064 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} err="failed to get container status \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": rpc error: code = NotFound desc = could not find container \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": container with ID starting with 2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.661172 5030 scope.go:117] "RemoveContainer" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.664766 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} err="failed to get container status \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": rpc error: code = NotFound desc = could not find container \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": container with ID starting with fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9 not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.664887 5030 scope.go:117] "RemoveContainer" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.668753 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} err="failed to get container status \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": rpc error: code = NotFound desc = could not find container \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": container with ID starting with d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.668853 5030 scope.go:117] "RemoveContainer" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.672784 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} err="failed to get container status \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": rpc error: code = NotFound desc = could not find container \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": container with ID starting with c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.672909 5030 scope.go:117] "RemoveContainer" containerID="2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.675827 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b"} err="failed to get container status \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": rpc error: code = NotFound desc = could not find container \"2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b\": container with ID starting with 2bb23092f9639cb6ad33016d73894cdb909eb34eaf8e8b7108344074519da72b not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.675942 5030 scope.go:117] "RemoveContainer" containerID="fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.676978 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9"} err="failed to get container status \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": rpc error: code = NotFound desc = could not find container \"fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9\": container with ID starting with fb2b2c4555b143726d54637641452f6e81b72017dcac0cfdfc466f82ff3182f9 not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.677102 5030 scope.go:117] "RemoveContainer" containerID="d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.677403 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d"} err="failed to get container status \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": rpc error: code = NotFound desc = could not find container \"d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d\": container with ID starting with d0dd8faeafd6bacfd1c7704331f3dccc8935dea96c68f4dca72c50d2684ad19d not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.677480 5030 scope.go:117] "RemoveContainer" containerID="c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.677924 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb"} err="failed to get container status \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": rpc error: code = NotFound desc = could not find container \"c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb\": container with ID starting with c37887f64ac723287ebdc149e39520cd7c48972a42c4449b5509c48081ed56eb not found: ID does not exist" Mar 16 13:31:38 crc kubenswrapper[5030]: I0316 13:31:38.788857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:39 crc kubenswrapper[5030]: I0316 13:31:39.209803 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:31:39 crc kubenswrapper[5030]: I0316 13:31:39.406237 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerStarted","Data":"432e8a6c49df5022a065732fec6d3f98c81f1f3c2a48144fa09de7706b044410"} Mar 16 13:31:39 crc kubenswrapper[5030]: I0316 13:31:39.958725 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0a9124-edd8-4199-afe1-46d7af9ad1b5" path="/var/lib/kubelet/pods/2b0a9124-edd8-4199-afe1-46d7af9ad1b5/volumes" Mar 16 13:31:40 crc kubenswrapper[5030]: I0316 13:31:40.435312 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerStarted","Data":"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502"} Mar 16 13:31:41 crc kubenswrapper[5030]: I0316 13:31:41.444293 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerStarted","Data":"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f"} Mar 16 13:31:41 crc kubenswrapper[5030]: I0316 13:31:41.444817 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerStarted","Data":"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e"} Mar 16 13:31:43 crc kubenswrapper[5030]: I0316 13:31:43.473313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerStarted","Data":"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff"} Mar 16 13:31:43 crc kubenswrapper[5030]: I0316 13:31:43.473791 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:31:43 crc kubenswrapper[5030]: I0316 13:31:43.508283 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.499610098 podStartE2EDuration="5.508264859s" podCreationTimestamp="2026-03-16 13:31:38 +0000 UTC" firstStartedPulling="2026-03-16 13:31:39.224848642 +0000 UTC m=+1543.624161189" lastFinishedPulling="2026-03-16 13:31:43.233503404 +0000 UTC m=+1547.632815950" observedRunningTime="2026-03-16 13:31:43.503185989 +0000 UTC m=+1547.902498536" watchObservedRunningTime="2026-03-16 13:31:43.508264859 +0000 UTC m=+1547.907577406" Mar 16 13:31:45 crc kubenswrapper[5030]: I0316 13:31:45.763294 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:45 crc kubenswrapper[5030]: I0316 13:31:45.763682 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:46 crc kubenswrapper[5030]: I0316 13:31:46.771741 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.61:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:46 crc kubenswrapper[5030]: I0316 13:31:46.773428 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.61:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:31:53 crc kubenswrapper[5030]: I0316 13:31:53.762710 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:53 crc kubenswrapper[5030]: I0316 13:31:53.764015 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:53 crc kubenswrapper[5030]: E0316 13:31:53.919587 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763061 actualBytes=10240 Mar 16 13:31:54 crc kubenswrapper[5030]: I0316 13:31:54.287283 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:31:54 crc kubenswrapper[5030]: I0316 13:31:54.287405 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:31:55 crc kubenswrapper[5030]: I0316 13:31:55.770331 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:55 crc kubenswrapper[5030]: I0316 13:31:55.772436 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:55 crc kubenswrapper[5030]: I0316 13:31:55.777075 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:31:56 crc kubenswrapper[5030]: I0316 13:31:56.670395 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.138349 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561132-qnrs4"] Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.143742 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.146008 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.146153 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.146945 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.151374 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561132-qnrs4"] Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.268094 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wq4\" (UniqueName: \"kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4\") pod \"auto-csr-approver-29561132-qnrs4\" (UID: \"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6\") " pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.369659 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wq4\" (UniqueName: \"kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4\") pod \"auto-csr-approver-29561132-qnrs4\" (UID: \"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6\") " pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.389157 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wq4\" (UniqueName: \"kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4\") pod \"auto-csr-approver-29561132-qnrs4\" (UID: \"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6\") " pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.465203 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:00 crc kubenswrapper[5030]: I0316 13:32:00.902340 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561132-qnrs4"] Mar 16 13:32:00 crc kubenswrapper[5030]: W0316 13:32:00.906045 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a7e2317_4c45_440f_9a0c_f1ceeb6b84c6.slice/crio-d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d WatchSource:0}: Error finding container d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d: Status 404 returned error can't find the container with id d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d Mar 16 13:32:01 crc kubenswrapper[5030]: I0316 13:32:01.711798 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" event={"ID":"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6","Type":"ContainerStarted","Data":"d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d"} Mar 16 13:32:02 crc kubenswrapper[5030]: I0316 13:32:02.723490 5030 generic.go:358] "Generic (PLEG): container finished" podID="5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" containerID="a26b9e9da454d6eca51cbe99bcca6a3a822aa0352b903441f1cfbcdfe1a58adf" exitCode=0 Mar 16 13:32:02 crc kubenswrapper[5030]: I0316 13:32:02.723622 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" event={"ID":"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6","Type":"ContainerDied","Data":"a26b9e9da454d6eca51cbe99bcca6a3a822aa0352b903441f1cfbcdfe1a58adf"} Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.031073 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.053537 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7wq4\" (UniqueName: \"kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4\") pod \"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6\" (UID: \"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6\") " Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.059509 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4" (OuterVolumeSpecName: "kube-api-access-x7wq4") pod "5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" (UID: "5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6"). InnerVolumeSpecName "kube-api-access-x7wq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.157267 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7wq4\" (UniqueName: \"kubernetes.io/projected/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6-kube-api-access-x7wq4\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.748316 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.748641 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561132-qnrs4" event={"ID":"5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6","Type":"ContainerDied","Data":"d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d"} Mar 16 13:32:04 crc kubenswrapper[5030]: I0316 13:32:04.748777 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2846ab7dd38e522ed4668b1e60b2f6da16edd7b51c99fcf125f3837dc548d4d" Mar 16 13:32:05 crc kubenswrapper[5030]: I0316 13:32:05.098898 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561126-xckbz"] Mar 16 13:32:05 crc kubenswrapper[5030]: I0316 13:32:05.104726 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561126-xckbz"] Mar 16 13:32:05 crc kubenswrapper[5030]: I0316 13:32:05.960029 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b020c3fb-8562-4b9b-86c6-2048b9ecabaf" path="/var/lib/kubelet/pods/b020c3fb-8562-4b9b-86c6-2048b9ecabaf/volumes" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.195752 5030 scope.go:117] "RemoveContainer" containerID="163415f418b956470547945a7ccb5a958e13f4da64b713bc0053c88f171d2360" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.222064 5030 scope.go:117] "RemoveContainer" containerID="a1e80273a1bc2579497f4574ab52b8a3cb9721d1193c102dba93b5fbeeb2296d" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.264908 5030 scope.go:117] "RemoveContainer" containerID="767b7552fbf5200db3f5f800a5f567717f8b76fbf35e0fc7d084705cff1eea09" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.309608 5030 scope.go:117] "RemoveContainer" containerID="01fe29b1e8624825dbaa7271d9aed0a877a6fe47b3675ad1282643cb16b69969" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.327598 5030 scope.go:117] "RemoveContainer" containerID="47fa1e3a947e0e203651b727fa0ef8d9a70d09b909653ef1ccc9a12133a12fe7" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.351597 5030 scope.go:117] "RemoveContainer" containerID="ad53a5be399e7abb78da8e8f7af24615a9de7e9f77fa35133494130c04fe560c" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.382533 5030 scope.go:117] "RemoveContainer" containerID="166669405acde68d22c4d2043fd75a235ee79a587bd884d22ab15c05177f67be" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.416369 5030 scope.go:117] "RemoveContainer" containerID="48cc5172d33256450320c6106c7aa053e5d4f2631862739922852d70bfcca79f" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.434825 5030 scope.go:117] "RemoveContainer" containerID="2522493bd1bdf376d451159efa759914e33d5283ab8d458fdb4dff049ecc746b" Mar 16 13:32:14 crc kubenswrapper[5030]: I0316 13:32:14.495013 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.651342 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.655230 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" containerName="oc" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.655386 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" containerName="oc" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.655862 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" containerName="oc" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.662703 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.663144 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.666688 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-scripts\"" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.666985 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-ovncontroller-dockercfg-gkmjv\"" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.667159 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovncontroller-ovndbs\"" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.683965 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.690189 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.731351 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.740068 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.745512 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.748085 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-metrics-config\"" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.754623 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756354 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756411 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756464 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756518 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756542 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7f7p\" (UniqueName: \"kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756769 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756841 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.756977 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdnxx\" (UniqueName: \"kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.790094 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.795536 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.801796 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr"] Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.804025 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-extra-scripts\"" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.858754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zxj\" (UniqueName: \"kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.858830 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.858898 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.858927 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.858964 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7f7p\" (UniqueName: \"kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859052 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjmwl\" (UniqueName: \"kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859131 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859181 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859215 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859239 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdnxx\" (UniqueName: \"kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859292 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859321 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859402 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859688 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859748 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859793 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859830 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859851 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.859983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860191 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860469 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860498 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860530 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.860959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.861691 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.862817 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.863475 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.866586 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.867278 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.876255 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdnxx\" (UniqueName: \"kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx\") pod \"ovn-controller-ovs-mkkz8\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.879399 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7f7p\" (UniqueName: \"kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p\") pod \"ovn-controller-tl9gr\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962567 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962613 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zxj\" (UniqueName: \"kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962762 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962800 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjmwl\" (UniqueName: \"kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962831 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962935 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.962994 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963031 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963097 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963135 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963296 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963971 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.963993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.965156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.965746 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.967911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.971208 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.977820 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zxj\" (UniqueName: \"kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj\") pod \"ovn-controller-metrics-677pp\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.978714 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjmwl\" (UniqueName: \"kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl\") pod \"ovn-controller-tl9gr-config-4n6qr\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.981174 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:18 crc kubenswrapper[5030]: I0316 13:32:18.999122 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.068002 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.119193 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.409400 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:19 crc kubenswrapper[5030]: W0316 13:32:19.509158 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883176ea_be20_4804_95d3_c578effa438a.slice/crio-d620532bb0a3ff725f44989bad87098f060f6d714b9e3df55c72035d03775942 WatchSource:0}: Error finding container d620532bb0a3ff725f44989bad87098f060f6d714b9e3df55c72035d03775942: Status 404 returned error can't find the container with id d620532bb0a3ff725f44989bad87098f060f6d714b9e3df55c72035d03775942 Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.509301 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.564872 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr"] Mar 16 13:32:19 crc kubenswrapper[5030]: W0316 13:32:19.567707 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bc28cad_a87a_4b1d_9a73_3f99b632b1ff.slice/crio-d6124f8fd4652f79e04d651ba89c690681abdcd4b912a327bc2c0078cd8bc000 WatchSource:0}: Error finding container d6124f8fd4652f79e04d651ba89c690681abdcd4b912a327bc2c0078cd8bc000: Status 404 returned error can't find the container with id d6124f8fd4652f79e04d651ba89c690681abdcd4b912a327bc2c0078cd8bc000 Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.572038 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.911429 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" event={"ID":"e27f81f1-a1a9-4207-84d2-cc7dc6870691","Type":"ContainerStarted","Data":"497f0dbd7b06336ae19a6a31f52e9a41139e2c7e809bcbfa2bf2517f7f2dc3fb"} Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.911761 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" event={"ID":"e27f81f1-a1a9-4207-84d2-cc7dc6870691","Type":"ContainerStarted","Data":"486dcd7c72c8876a112f2af29af693c1df937cb680a1b682bd87cc0ae1bfac66"} Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.913943 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" event={"ID":"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff","Type":"ContainerStarted","Data":"d6124f8fd4652f79e04d651ba89c690681abdcd4b912a327bc2c0078cd8bc000"} Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.915342 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerStarted","Data":"d620532bb0a3ff725f44989bad87098f060f6d714b9e3df55c72035d03775942"} Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.916856 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr" event={"ID":"c25458eb-bb6a-4289-aff8-f703053736bf","Type":"ContainerStarted","Data":"8e69d5bde9d1f3895093b91e7c121922e3e99f90465b7aee249d5156bd0fa8f8"} Mar 16 13:32:19 crc kubenswrapper[5030]: I0316 13:32:19.932525 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" podStartSLOduration=1.932511298 podStartE2EDuration="1.932511298s" podCreationTimestamp="2026-03-16 13:32:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:32:19.929110795 +0000 UTC m=+1584.328423341" watchObservedRunningTime="2026-03-16 13:32:19.932511298 +0000 UTC m=+1584.331823846" Mar 16 13:32:20 crc kubenswrapper[5030]: I0316 13:32:20.931595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerStarted","Data":"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1"} Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.950025 5030 generic.go:358] "Generic (PLEG): container finished" podID="883176ea-be20-4804-95d3-c578effa438a" containerID="f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1" exitCode=0 Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.960533 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" event={"ID":"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff","Type":"ContainerStarted","Data":"899281aeae2ff69a7b79ab2070ee94c667666639412204c1a49e3aa2c3326d84"} Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.960603 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.960621 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerDied","Data":"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1"} Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.960640 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr" event={"ID":"c25458eb-bb6a-4289-aff8-f703053736bf","Type":"ContainerStarted","Data":"51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a"} Mar 16 13:32:21 crc kubenswrapper[5030]: I0316 13:32:21.982631 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" podStartSLOduration=2.497923669 podStartE2EDuration="3.982611851s" podCreationTimestamp="2026-03-16 13:32:18 +0000 UTC" firstStartedPulling="2026-03-16 13:32:19.570020736 +0000 UTC m=+1583.969333283" lastFinishedPulling="2026-03-16 13:32:21.054708917 +0000 UTC m=+1585.454021465" observedRunningTime="2026-03-16 13:32:21.979200738 +0000 UTC m=+1586.378513284" watchObservedRunningTime="2026-03-16 13:32:21.982611851 +0000 UTC m=+1586.381924399" Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.000711 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-tl9gr" podStartSLOduration=2.363125942 podStartE2EDuration="4.000691408s" podCreationTimestamp="2026-03-16 13:32:18 +0000 UTC" firstStartedPulling="2026-03-16 13:32:19.415144263 +0000 UTC m=+1583.814456810" lastFinishedPulling="2026-03-16 13:32:21.052709729 +0000 UTC m=+1585.452022276" observedRunningTime="2026-03-16 13:32:21.992726882 +0000 UTC m=+1586.392039429" watchObservedRunningTime="2026-03-16 13:32:22.000691408 +0000 UTC m=+1586.400003965" Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.970483 5030 generic.go:358] "Generic (PLEG): container finished" podID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" containerID="899281aeae2ff69a7b79ab2070ee94c667666639412204c1a49e3aa2c3326d84" exitCode=0 Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.970570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" event={"ID":"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff","Type":"ContainerDied","Data":"899281aeae2ff69a7b79ab2070ee94c667666639412204c1a49e3aa2c3326d84"} Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.973774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerStarted","Data":"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365"} Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.973901 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerStarted","Data":"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a"} Mar 16 13:32:22 crc kubenswrapper[5030]: I0316 13:32:22.973977 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:23 crc kubenswrapper[5030]: I0316 13:32:23.008363 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podStartSLOduration=4.042904166 podStartE2EDuration="5.008349756s" podCreationTimestamp="2026-03-16 13:32:18 +0000 UTC" firstStartedPulling="2026-03-16 13:32:19.512020651 +0000 UTC m=+1583.911333198" lastFinishedPulling="2026-03-16 13:32:20.477466241 +0000 UTC m=+1584.876778788" observedRunningTime="2026-03-16 13:32:23.000659235 +0000 UTC m=+1587.399971792" watchObservedRunningTime="2026-03-16 13:32:23.008349756 +0000 UTC m=+1587.407662303" Mar 16 13:32:23 crc kubenswrapper[5030]: I0316 13:32:23.987161 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.284526 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.287615 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.287688 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.287759 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.288891 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.288962 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" gracePeriod=600 Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402283 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402357 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjmwl\" (UniqueName: \"kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402415 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402447 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402478 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.402512 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts\") pod \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\" (UID: \"8bc28cad-a87a-4b1d-9a73-3f99b632b1ff\") " Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.403327 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts" (OuterVolumeSpecName: "scripts") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.403369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.403824 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.403819 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run" (OuterVolumeSpecName: "var-run") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.403853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: E0316 13:32:24.404491 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.410736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl" (OuterVolumeSpecName: "kube-api-access-vjmwl") pod "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" (UID: "8bc28cad-a87a-4b1d-9a73-3f99b632b1ff"). InnerVolumeSpecName "kube-api-access-vjmwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506059 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506101 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjmwl\" (UniqueName: \"kubernetes.io/projected/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-kube-api-access-vjmwl\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506114 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506125 5030 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506137 5030 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.506147 5030 reconciler_common.go:299] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff-additional-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.697503 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.697841 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" podUID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" containerName="openstack-network-exporter" containerID="cri-o://497f0dbd7b06336ae19a6a31f52e9a41139e2c7e809bcbfa2bf2517f7f2dc3fb" gracePeriod=30 Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.718363 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.729617 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr"] Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.741826 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.751678 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr"] Mar 16 13:32:24 crc kubenswrapper[5030]: E0316 13:32:24.801718 5030 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-tl9gr" message="Exiting ovn-controller (1) " Mar 16 13:32:24 crc kubenswrapper[5030]: E0316 13:32:24.801777 5030 kuberuntime_container.go:741] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-tl9gr" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" containerName="ovn-controller" containerID="cri-o://51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a" Mar 16 13:32:24 crc kubenswrapper[5030]: I0316 13:32:24.801838 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-tl9gr" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" containerName="ovn-controller" containerID="cri-o://51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a" gracePeriod=30 Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.004813 5030 generic.go:358] "Generic (PLEG): container finished" podID="c25458eb-bb6a-4289-aff8-f703053736bf" containerID="51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a" exitCode=0 Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.004907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr" event={"ID":"c25458eb-bb6a-4289-aff8-f703053736bf","Type":"ContainerDied","Data":"51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a"} Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.008824 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" exitCode=0 Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.008905 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7"} Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.009017 5030 scope.go:117] "RemoveContainer" containerID="9abd6d21ddb20d4ee8233e2f55702e7673a0bd3fcd3fd0ae9dc96ad7ba22c0a5" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.010143 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:32:25 crc kubenswrapper[5030]: E0316 13:32:25.010854 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.012695 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-677pp_e27f81f1-a1a9-4207-84d2-cc7dc6870691/openstack-network-exporter/0.log" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.012742 5030 generic.go:358] "Generic (PLEG): container finished" podID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" containerID="497f0dbd7b06336ae19a6a31f52e9a41139e2c7e809bcbfa2bf2517f7f2dc3fb" exitCode=2 Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.012982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" event={"ID":"e27f81f1-a1a9-4207-84d2-cc7dc6870691","Type":"ContainerDied","Data":"497f0dbd7b06336ae19a6a31f52e9a41139e2c7e809bcbfa2bf2517f7f2dc3fb"} Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.016307 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.016381 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6124f8fd4652f79e04d651ba89c690681abdcd4b912a327bc2c0078cd8bc000" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.017154 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-gkmjv\" not found" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.043455 5030 status_manager.go:895] "Failed to get status for pod" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" err="pods \"ovn-controller-tl9gr-config-4n6qr\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:25 crc kubenswrapper[5030]: E0316 13:32:25.044354 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:25 crc kubenswrapper[5030]: E0316 13:32:25.044426 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:25.544407584 +0000 UTC m=+1589.943720131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.138226 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.139882 5030 status_manager.go:895] "Failed to get status for pod" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" err="pods \"ovn-controller-tl9gr-config-4n6qr\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144032 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144283 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144318 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7f7p\" (UniqueName: \"kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144385 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144435 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144516 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run" (OuterVolumeSpecName: "var-run") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144638 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.144700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts\") pod \"c25458eb-bb6a-4289-aff8-f703053736bf\" (UID: \"c25458eb-bb6a-4289-aff8-f703053736bf\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.145023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.145698 5030 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.145722 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.145732 5030 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/c25458eb-bb6a-4289-aff8-f703053736bf-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.145900 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts" (OuterVolumeSpecName: "scripts") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.149725 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p" (OuterVolumeSpecName: "kube-api-access-t7f7p") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "kube-api-access-t7f7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.174073 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.206529 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-677pp_e27f81f1-a1a9-4207-84d2-cc7dc6870691/openstack-network-exporter/0.log" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.206609 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.208133 5030 status_manager.go:895] "Failed to get status for pod" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" err="pods \"ovn-controller-tl9gr-config-4n6qr\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.213152 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "c25458eb-bb6a-4289-aff8-f703053736bf" (UID: "c25458eb-bb6a-4289-aff8-f703053736bf"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.246798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.246858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.246935 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6zxj\" (UniqueName: \"kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247215 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle\") pod \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\" (UID: \"e27f81f1-a1a9-4207-84d2-cc7dc6870691\") " Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247525 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247542 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7f7p\" (UniqueName: \"kubernetes.io/projected/c25458eb-bb6a-4289-aff8-f703053736bf-kube-api-access-t7f7p\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247565 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/c25458eb-bb6a-4289-aff8-f703053736bf-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.247574 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/c25458eb-bb6a-4289-aff8-f703053736bf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.248037 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.248085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.248666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config" (OuterVolumeSpecName: "config") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.253122 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj" (OuterVolumeSpecName: "kube-api-access-z6zxj") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "kube-api-access-z6zxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.272287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.302119 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "e27f81f1-a1a9-4207-84d2-cc7dc6870691" (UID: "e27f81f1-a1a9-4207-84d2-cc7dc6870691"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349785 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349826 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349838 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e27f81f1-a1a9-4207-84d2-cc7dc6870691-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349852 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/e27f81f1-a1a9-4207-84d2-cc7dc6870691-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349862 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6zxj\" (UniqueName: \"kubernetes.io/projected/e27f81f1-a1a9-4207-84d2-cc7dc6870691-kube-api-access-z6zxj\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.349872 5030 reconciler_common.go:299] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/e27f81f1-a1a9-4207-84d2-cc7dc6870691-ovs-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:25 crc kubenswrapper[5030]: E0316 13:32:25.564488 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:25 crc kubenswrapper[5030]: E0316 13:32:25.564604 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:26.564584914 +0000 UTC m=+1590.963897461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.959240 5030 status_manager.go:895] "Failed to get status for pod" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" pod="openstack-kuttl-tests/ovn-controller-tl9gr-config-4n6qr" err="pods \"ovn-controller-tl9gr-config-4n6qr\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:25 crc kubenswrapper[5030]: I0316 13:32:25.961319 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" path="/var/lib/kubelet/pods/8bc28cad-a87a-4b1d-9a73-3f99b632b1ff/volumes" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.031202 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-677pp_e27f81f1-a1a9-4207-84d2-cc7dc6870691/openstack-network-exporter/0.log" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.031398 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.031413 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-677pp" event={"ID":"e27f81f1-a1a9-4207-84d2-cc7dc6870691","Type":"ContainerDied","Data":"486dcd7c72c8876a112f2af29af693c1df937cb680a1b682bd87cc0ae1bfac66"} Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.031507 5030 scope.go:117] "RemoveContainer" containerID="497f0dbd7b06336ae19a6a31f52e9a41139e2c7e809bcbfa2bf2517f7f2dc3fb" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.036015 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-tl9gr" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.036033 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-tl9gr" event={"ID":"c25458eb-bb6a-4289-aff8-f703053736bf","Type":"ContainerDied","Data":"8e69d5bde9d1f3895093b91e7c121922e3e99f90465b7aee249d5156bd0fa8f8"} Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.066327 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.080599 5030 scope.go:117] "RemoveContainer" containerID="51ce639e194375a1814b3e2d79b593ca2721b9120db10e52c909306c58c1e11a" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.088054 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-677pp"] Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.093034 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.097595 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-tl9gr"] Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.372947 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovs-vswitchd" containerID="cri-o://6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" gracePeriod=30 Mar 16 13:32:26 crc kubenswrapper[5030]: E0316 13:32:26.590585 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:26 crc kubenswrapper[5030]: E0316 13:32:26.590865 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:28.590840842 +0000 UTC m=+1592.990153389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:26 crc kubenswrapper[5030]: E0316 13:32:26.649335 5030 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 13:32:26 crc kubenswrapper[5030]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:32:26 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:32:26 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:32:26 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:32:26 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:32:26 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:32:26 crc kubenswrapper[5030]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" message=< Mar 16 13:32:26 crc kubenswrapper[5030]: Exiting ovsdb-server (5) [ OK ] Mar 16 13:32:26 crc kubenswrapper[5030]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:32:26 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:32:26 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:32:26 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:32:26 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:32:26 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:32:26 crc kubenswrapper[5030]: > Mar 16 13:32:26 crc kubenswrapper[5030]: E0316 13:32:26.649383 5030 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 13:32:26 crc kubenswrapper[5030]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:32:26 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:32:26 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:32:26 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:32:26 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:32:26 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:32:26 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:32:26 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:32:26 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:32:26 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:32:26 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:32:26 crc kubenswrapper[5030]: > pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" containerID="cri-o://98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" Mar 16 13:32:26 crc kubenswrapper[5030]: I0316 13:32:26.649442 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" containerID="cri-o://98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" gracePeriod=30 Mar 16 13:32:27 crc kubenswrapper[5030]: I0316 13:32:27.048194 5030 generic.go:358] "Generic (PLEG): container finished" podID="883176ea-be20-4804-95d3-c578effa438a" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" exitCode=0 Mar 16 13:32:27 crc kubenswrapper[5030]: I0316 13:32:27.048270 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerDied","Data":"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a"} Mar 16 13:32:27 crc kubenswrapper[5030]: I0316 13:32:27.959243 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" path="/var/lib/kubelet/pods/c25458eb-bb6a-4289-aff8-f703053736bf/volumes" Mar 16 13:32:27 crc kubenswrapper[5030]: I0316 13:32:27.960728 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" path="/var/lib/kubelet/pods/e27f81f1-a1a9-4207-84d2-cc7dc6870691/volumes" Mar 16 13:32:28 crc kubenswrapper[5030]: E0316 13:32:28.634742 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:28 crc kubenswrapper[5030]: E0316 13:32:28.634839 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:32.634818232 +0000 UTC m=+1597.034130778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:32 crc kubenswrapper[5030]: E0316 13:32:32.729085 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:32 crc kubenswrapper[5030]: E0316 13:32:32.730439 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:40.73039372 +0000 UTC m=+1605.129706267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:35 crc kubenswrapper[5030]: I0316 13:32:35.953859 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:32:35 crc kubenswrapper[5030]: E0316 13:32:35.954599 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:32:40 crc kubenswrapper[5030]: E0316 13:32:40.804499 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:32:40 crc kubenswrapper[5030]: E0316 13:32:40.805200 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts podName:883176ea-be20-4804-95d3-c578effa438a nodeName:}" failed. No retries permitted until 2026-03-16 13:32:56.805180174 +0000 UTC m=+1621.204492721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts") pod "ovn-controller-ovs-mkkz8" (UID: "883176ea-be20-4804-95d3-c578effa438a") : configmap "ovncontroller-scripts" not found Mar 16 13:32:48 crc kubenswrapper[5030]: I0316 13:32:48.946573 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:32:48 crc kubenswrapper[5030]: E0316 13:32:48.947531 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:32:53 crc kubenswrapper[5030]: E0316 13:32:53.819226 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1773115 actualBytes=10240 Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.037460 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a is running failed: container process not found" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.038038 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a is running failed: container process not found" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.038266 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a is running failed: container process not found" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" cmd=["/usr/local/bin/container-scripts/ovsdb_server_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.038296 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" probeResult="unknown" Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.040406 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.047816 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.050149 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" cmd=["/usr/local/bin/container-scripts/vswitchd_readiness.sh"] Mar 16 13:32:56 crc kubenswrapper[5030]: E0316 13:32:56.050186 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovs-vswitchd" probeResult="unknown" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.789453 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-mkkz8_883176ea-be20-4804-95d3-c578effa438a/ovs-vswitchd/0.log" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.790976 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872310 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log" (OuterVolumeSpecName: "var-log") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872691 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdnxx\" (UniqueName: \"kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872894 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run" (OuterVolumeSpecName: "var-run") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.872910 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib\") pod \"883176ea-be20-4804-95d3-c578effa438a\" (UID: \"883176ea-be20-4804-95d3-c578effa438a\") " Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.873114 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib" (OuterVolumeSpecName: "var-lib") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.873776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts" (OuterVolumeSpecName: "scripts") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.874766 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.874794 5030 reconciler_common.go:299] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-lib\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.874804 5030 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.874815 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/883176ea-be20-4804-95d3-c578effa438a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.874824 5030 reconciler_common.go:299] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/883176ea-be20-4804-95d3-c578effa438a-etc-ovs\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.878246 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx" (OuterVolumeSpecName: "kube-api-access-mdnxx") pod "883176ea-be20-4804-95d3-c578effa438a" (UID: "883176ea-be20-4804-95d3-c578effa438a"). InnerVolumeSpecName "kube-api-access-mdnxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:32:56 crc kubenswrapper[5030]: I0316 13:32:56.976667 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdnxx\" (UniqueName: \"kubernetes.io/projected/883176ea-be20-4804-95d3-c578effa438a-kube-api-access-mdnxx\") on node \"crc\" DevicePath \"\"" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.381612 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-mkkz8_883176ea-be20-4804-95d3-c578effa438a/ovs-vswitchd/0.log" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.382511 5030 generic.go:358] "Generic (PLEG): container finished" podID="883176ea-be20-4804-95d3-c578effa438a" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" exitCode=137 Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.382611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerDied","Data":"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365"} Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.382655 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" event={"ID":"883176ea-be20-4804-95d3-c578effa438a","Type":"ContainerDied","Data":"d620532bb0a3ff725f44989bad87098f060f6d714b9e3df55c72035d03775942"} Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.382683 5030 scope.go:117] "RemoveContainer" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.382932 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-mkkz8" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.410673 5030 scope.go:117] "RemoveContainer" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.415530 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.422963 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-mkkz8"] Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.426997 5030 scope.go:117] "RemoveContainer" containerID="f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.478330 5030 scope.go:117] "RemoveContainer" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" Mar 16 13:32:57 crc kubenswrapper[5030]: E0316 13:32:57.479352 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365\": container with ID starting with 6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365 not found: ID does not exist" containerID="6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.479388 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365"} err="failed to get container status \"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365\": rpc error: code = NotFound desc = could not find container \"6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365\": container with ID starting with 6707b9f947b7254badb4849d26543aa6b5a9e690532f8e5ab2a1c124bfdf0365 not found: ID does not exist" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.479409 5030 scope.go:117] "RemoveContainer" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" Mar 16 13:32:57 crc kubenswrapper[5030]: E0316 13:32:57.479796 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a\": container with ID starting with 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a not found: ID does not exist" containerID="98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.479842 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a"} err="failed to get container status \"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a\": rpc error: code = NotFound desc = could not find container \"98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a\": container with ID starting with 98af2c20da70afe8cbba4f35ca2acf759403561352dc84fa462c19b862eb4b2a not found: ID does not exist" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.479864 5030 scope.go:117] "RemoveContainer" containerID="f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1" Mar 16 13:32:57 crc kubenswrapper[5030]: E0316 13:32:57.480129 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1\": container with ID starting with f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1 not found: ID does not exist" containerID="f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.480167 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1"} err="failed to get container status \"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1\": rpc error: code = NotFound desc = could not find container \"f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1\": container with ID starting with f0c7592b436d5471f91507bff4d80e41480cb99480d49119a5831ac4555ef8b1 not found: ID does not exist" Mar 16 13:32:57 crc kubenswrapper[5030]: I0316 13:32:57.957971 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883176ea-be20-4804-95d3-c578effa438a" path="/var/lib/kubelet/pods/883176ea-be20-4804-95d3-c578effa438a/volumes" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.695192 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.695448 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" containerName="openstackclient" containerID="cri-o://7a57dc384153c1b7bffb4ec81726c72beceb1f5068e6382d44f88f1f73dfb0bf" gracePeriod=2 Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.720204 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.820007 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.903503 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.905988 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server-init" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906014 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server-init" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906056 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" containerName="openstackclient" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906430 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" containerName="openstackclient" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906457 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906463 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906476 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" containerName="ovn-config" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906503 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" containerName="ovn-config" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906514 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" containerName="ovn-controller" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906519 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" containerName="ovn-controller" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906624 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" containerName="openstack-network-exporter" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906633 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" containerName="openstack-network-exporter" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906665 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovs-vswitchd" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.906670 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovs-vswitchd" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907323 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bc28cad-a87a-4b1d-9a73-3f99b632b1ff" containerName="ovn-config" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907338 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e27f81f1-a1a9-4207-84d2-cc7dc6870691" containerName="openstack-network-exporter" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907351 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c25458eb-bb6a-4289-aff8-f703053736bf" containerName="ovn-controller" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907412 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovs-vswitchd" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907420 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="883176ea-be20-4804-95d3-c578effa438a" containerName="ovsdb-server" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.907431 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" containerName="openstackclient" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.920523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.924640 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.928220 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:32:58 crc kubenswrapper[5030]: I0316 13:32:58.928450 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.003123 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-2kkdg"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.013728 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-2kkdg"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.024230 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.024369 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghlq\" (UniqueName: \"kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.026764 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.035480 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-fj64p"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.043748 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.063958 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-d6dd-account-create-update-7zhfq"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.127642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.127791 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hghlq\" (UniqueName: \"kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.128883 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.133604 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.139676 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.144249 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.144479 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.175300 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghlq\" (UniqueName: \"kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq\") pod \"root-account-create-update-ftzgb\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.182671 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.235940 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.236171 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkr7\" (UniqueName: \"kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.249853 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.295950 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.300784 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.315959 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.335094 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.335161 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.335905 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="openstack-network-exporter" containerID="cri-o://8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" gracePeriod=300 Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.341726 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.344585 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.344805 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkr7\" (UniqueName: \"kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.346299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.442350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkr7\" (UniqueName: \"kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7\") pod \"nova-api-762e-account-create-update-zwhkv\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.465064 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnhd9\" (UniqueName: \"kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.465167 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.495328 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.508700 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-w28zr"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.575094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnhd9\" (UniqueName: \"kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.575159 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.575962 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.600964 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-w28zr"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.601586 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnhd9\" (UniqueName: \"kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9\") pod \"barbican-a165-account-create-update-4cqvl\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.607727 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="ovsdbserver-nb" containerID="cri-o://029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" gracePeriod=300 Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.621442 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cn5tq"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.632260 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.639365 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-cn5tq"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.663839 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.679939 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-lf8w6"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.688098 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.703158 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.729181 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.734669 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sfkfl"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.739027 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.740400 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.788406 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-sfkfl"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.818744 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.838731 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.868657 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-9hhwz"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.887455 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-9hhwz"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.889422 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxwx\" (UniqueName: \"kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.889785 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:32:59 crc kubenswrapper[5030]: E0316 13:32:59.898103 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod314a6460_082f_4fbb_a520_26438f689a6a.slice/crio-conmon-029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.901381 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.913769 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-f67f-account-create-update-t8l7b"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.916878 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.917152 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="ovn-northd" containerID="cri-o://708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" gracePeriod=30 Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.917615 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="openstack-network-exporter" containerID="cri-o://da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570" gracePeriod=30 Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.922821 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.923935 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.924429 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="openstack-network-exporter" containerID="cri-o://0fee0be6c904ce3c9dcaf670d16cd5b3d4fd713b77776a1d54bfac9adb32c910" gracePeriod=300 Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.935041 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.974028 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5" path="/var/lib/kubelet/pods/1a5cd1f7-ebe5-41c8-8821-7e9c8a9be7c5/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.978311 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22e9cb31-8a02-4def-a045-e677b45035bb" path="/var/lib/kubelet/pods/22e9cb31-8a02-4def-a045-e677b45035bb/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.981275 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd71cdd-bd4e-48c9-aaf1-55856f014936" path="/var/lib/kubelet/pods/4bd71cdd-bd4e-48c9-aaf1-55856f014936/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.982179 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e6745e-dd11-4a34-af91-2dfb661017d0" path="/var/lib/kubelet/pods/80e6745e-dd11-4a34-af91-2dfb661017d0/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.983633 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4eb3d6a-bc6a-4042-a238-0de6589f3da6" path="/var/lib/kubelet/pods/b4eb3d6a-bc6a-4042-a238-0de6589f3da6/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.984651 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb7c4513-747f-481f-ae6e-4a81eba22639" path="/var/lib/kubelet/pods/cb7c4513-747f-481f-ae6e-4a81eba22639/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.987810 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc90587f-7ae0-4ee8-836d-433aca0e7f65" path="/var/lib/kubelet/pods/cc90587f-7ae0-4ee8-836d-433aca0e7f65/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.988423 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd5aa14f-1185-4e9f-9758-8b7291e12780" path="/var/lib/kubelet/pods/cd5aa14f-1185-4e9f-9758-8b7291e12780/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.995086 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9f2d89e-5413-416f-a84a-43a5cc05bbfa" path="/var/lib/kubelet/pods/e9f2d89e-5413-416f-a84a-43a5cc05bbfa/volumes" Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.995885 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-9r7r5"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.996061 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-9r7r5"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.996176 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l"] Mar 16 13:32:59 crc kubenswrapper[5030]: I0316 13:32:59.996262 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-4896-account-create-update-q5h4l"] Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.000659 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.000741 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data podName:e8553f68-b65a-4220-8445-7fb5e36ba36b nodeName:}" failed. No retries permitted until 2026-03-16 13:33:00.500721948 +0000 UTC m=+1624.900034495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data") pod "rabbitmq-cell1-server-0" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.001521 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.001844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxwx\" (UniqueName: \"kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.007311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.058387 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-27rfr"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.076130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxwx\" (UniqueName: \"kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx\") pod \"nova-cell0-c651-account-create-update-cxs7z\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.076269 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="ovsdbserver-sb" containerID="cri-o://50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" gracePeriod=300 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.082001 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.097318 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-27rfr"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.117935 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.118355 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-api" containerID="cri-o://0bb81a06629fb460fc5c38fad0e1818a7859f49a12fe3dd72b3fa1175317dcbe" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.119174 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-httpd" containerID="cri-o://ad81b0809f607000870416a65320171bc2b3d5f7273f86c77dda2a555b68fd35" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.131843 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.139059 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.149784 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.166405 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw"] Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.248030 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 is running failed: container process not found" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.249609 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-tb7ml"] Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.254470 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 is running failed: container process not found" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.267513 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 is running failed: container process not found" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.267640 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.289045 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-kwzfw"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.357841 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.358622 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-log" containerID="cri-o://5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.358734 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-api" containerID="cri-o://1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.414377 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.414715 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-log" containerID="cri-o://5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.414827 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-httpd" containerID="cri-o://b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.420677 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_314a6460-082f-4fbb-a520-26438f689a6a/ovsdbserver-nb/0.log" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.420778 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.469186 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.469518 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-log" containerID="cri-o://d783b170b26f0401eb296e7f0305718beb7face59f74c18d6d21d96c3a5eb405" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.471597 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-httpd" containerID="cri-o://7c4ac03000a557b6ca65c98eee26a52d4cc8d5dbabc00f8ad6656e9f79e2852b" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.539461 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzgb8\" (UniqueName: \"kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.539502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.540777 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_314a6460-082f-4fbb-a520-26438f689a6a/ovsdbserver-nb/0.log" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.540820 5030 generic.go:358] "Generic (PLEG): container finished" podID="314a6460-082f-4fbb-a520-26438f689a6a" containerID="8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" exitCode=2 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.540849 5030 generic.go:358] "Generic (PLEG): container finished" podID="314a6460-082f-4fbb-a520-26438f689a6a" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" exitCode=143 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.541308 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.542229 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerDied","Data":"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.542664 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerDied","Data":"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.542682 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"314a6460-082f-4fbb-a520-26438f689a6a","Type":"ContainerDied","Data":"be22fda69ce8a0b6052728a0dd630efe61b75d2d359bb1dccb7a8da97cda7cb0"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.542703 5030 scope.go:117] "RemoveContainer" containerID="8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.548595 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.549568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.549679 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.549798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.549813 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.550294 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts" (OuterVolumeSpecName: "scripts") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.550722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config\") pod \"314a6460-082f-4fbb-a520-26438f689a6a\" (UID: \"314a6460-082f-4fbb-a520-26438f689a6a\") " Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.552664 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.552814 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config" (OuterVolumeSpecName: "config") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.552951 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8" (OuterVolumeSpecName: "kube-api-access-zzgb8") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "kube-api-access-zzgb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.554506 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data podName:e8553f68-b65a-4220-8445-7fb5e36ba36b nodeName:}" failed. No retries permitted until 2026-03-16 13:33:01.554476905 +0000 UTC m=+1625.953789451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data") pod "rabbitmq-cell1-server-0" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.556875 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.566137 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.566161 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/314a6460-082f-4fbb-a520-26438f689a6a-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.566171 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/314a6460-082f-4fbb-a520-26438f689a6a-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.566179 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzgb8\" (UniqueName: \"kubernetes.io/projected/314a6460-082f-4fbb-a520-26438f689a6a-kube-api-access-zzgb8\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.569050 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_f14a2769-6106-4965-bd88-9feb130a7485/ovsdbserver-sb/0.log" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.569105 5030 generic.go:358] "Generic (PLEG): container finished" podID="f14a2769-6106-4965-bd88-9feb130a7485" containerID="0fee0be6c904ce3c9dcaf670d16cd5b3d4fd713b77776a1d54bfac9adb32c910" exitCode=2 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.569122 5030 generic.go:358] "Generic (PLEG): container finished" podID="f14a2769-6106-4965-bd88-9feb130a7485" containerID="50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" exitCode=143 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.569393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerDied","Data":"0fee0be6c904ce3c9dcaf670d16cd5b3d4fd713b77776a1d54bfac9adb32c910"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.569424 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerDied","Data":"50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.570966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.578972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579510 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-server" containerID="cri-o://c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579568 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-server" containerID="cri-o://bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579654 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-updater" containerID="cri-o://f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579702 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-auditor" containerID="cri-o://972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579741 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-replicator" containerID="cri-o://a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579773 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-server" containerID="cri-o://62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579826 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-reaper" containerID="cri-o://6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579857 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-auditor" containerID="cri-o://56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.579900 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-replicator" containerID="cri-o://d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580029 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-expirer" containerID="cri-o://8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580086 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="swift-recon-cron" containerID="cri-o://1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580108 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-updater" containerID="cri-o://80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580140 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="rsync" containerID="cri-o://ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580214 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-auditor" containerID="cri-o://ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.580262 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-replicator" containerID="cri-o://ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.591743 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" event={"ID":"2c36e489-01b1-4370-a5e9-d9794d6fb52d","Type":"ContainerStarted","Data":"49ca15dd1917d12a5eb1aad8d3662679bc0050c2723b9fea6817445a0fafedee"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.603669 5030 generic.go:358] "Generic (PLEG): container finished" podID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerID="da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570" exitCode=2 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.603865 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerDied","Data":"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570"} Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.612245 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-vprnh"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.624254 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.657284 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-vprnh"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.668491 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.668539 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.725682 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.726028 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="cinder-scheduler" containerID="cri-o://1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.726220 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="probe" containerID="cri-o://fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.728561 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729593 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="openstack-network-exporter" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729613 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="openstack-network-exporter" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729660 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="ovsdbserver-nb" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729666 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="ovsdbserver-nb" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729879 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="ovsdbserver-nb" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.729905 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="314a6460-082f-4fbb-a520-26438f689a6a" containerName="openstack-network-exporter" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.745122 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.745143 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkjnl"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.745155 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkjnl"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.745247 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.747942 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.748172 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api-log" containerID="cri-o://576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.748311 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api" containerID="cri-o://00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.752054 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-tzkn4"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.766517 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-tzkn4"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.778959 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.786387 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-cf3f-account-create-update-nfsvg"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.792955 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tfzcb"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.800839 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-tfzcb"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.805204 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.820105 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.829252 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.845749 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.847155 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" containerID="cri-o://19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.847346 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" containerID="cri-o://2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.857349 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6n5jr"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.862624 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-6n5jr"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.871265 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.871605 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-log" containerID="cri-o://e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.872205 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-metadata" containerID="cri-o://75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.877020 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.877069 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.877157 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.877221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.877306 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rl78\" (UniqueName: \"kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.879649 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-central-agent" containerID="cri-o://c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.880616 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="proxy-httpd" containerID="cri-o://55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.880689 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="sg-core" containerID="cri-o://5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.880757 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-notification-agent" containerID="cri-o://2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e" gracePeriod=30 Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.912659 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.921813 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.957785 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-26jdr"] Mar 16 13:33:00 crc kubenswrapper[5030]: I0316 13:33:00.958790 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:33:00 crc kubenswrapper[5030]: E0316 13:33:00.963827 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.006391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.006575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.007128 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rl78\" (UniqueName: \"kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.007344 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.007575 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.007731 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.012455 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="rabbitmq" containerID="cri-o://8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463" gracePeriod=604800 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.034601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rl78\" (UniqueName: \"kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78\") pod \"dnsmasq-dnsmasq-79dcd846c5-2l7rc\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.034921 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.079030 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-zlgxh"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.097841 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.100272 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "314a6460-082f-4fbb-a520-26438f689a6a" (UID: "314a6460-082f-4fbb-a520-26438f689a6a"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.121649 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.121675 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/314a6460-082f-4fbb-a520-26438f689a6a-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.159808 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-26jdr"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.198424 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-zlgxh"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.212263 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-r74c4"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.222601 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-e762-account-create-update-7d5js"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.227723 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.234855 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-e762-account-create-update-7d5js"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.241225 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-r74c4"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.248493 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hkl8r"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.254531 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-hkl8r"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.259129 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.263757 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.264043 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-httpd" containerID="cri-o://79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.264533 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-server" containerID="cri-o://d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.278689 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.278915 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener-log" containerID="cri-o://565353abde25898aae519ab0e9ddc9e456d7210808177fc023f7dc8cf4679106" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.279326 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener" containerID="cri-o://d89ad58d84afea12dab69a708ae9ca36d50123c272f0d4bce2170ad3120a5050" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.286373 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa is running failed: container process not found" containerID="50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.293181 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa is running failed: container process not found" containerID="50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.303636 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa is running failed: container process not found" containerID="50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.303692 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.303982 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.304158 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api-log" containerID="cri-o://3fb2ce245e24c48262e813f03a90e12d65a1defd05e5c7aedab7328f27348c56" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.304462 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api" containerID="cri-o://d55195694cad34a2cc8da2bd114e7f31ad1129b25da6cb15dd183c6a849560ac" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.325382 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.325887 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.363707 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.363943 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker-log" containerID="cri-o://d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.368099 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker" containerID="cri-o://2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.387707 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.416211 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.439209 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="galera" containerID="cri-o://659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.439898 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.440154 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="05b2eb18-282d-42e9-9b68-f348caaad8d6" containerName="kube-state-metrics" containerID="cri-o://47b306e2b88d355e8391ba403bb9d6e6a1d065cb9e38d7055bd852e3506c841e" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.460631 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.464754 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.471284 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.471792 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.480139 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.484059 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-wxt4f"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.488939 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.500513 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.525603 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="rabbitmq" containerID="cri-o://8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737" gracePeriod=604800 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.553040 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dmkmz"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.559069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.559119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f25b\" (UniqueName: \"kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.559328 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.559401 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data podName:e8553f68-b65a-4220-8445-7fb5e36ba36b nodeName:}" failed. No retries permitted until 2026-03-16 13:33:03.559377486 +0000 UTC m=+1627.958690033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data") pod "rabbitmq-cell1-server-0" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.578794 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-dmkmz"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.578840 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8pg2v"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.586657 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-8pg2v"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.598561 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx"] Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.599423 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2f25b operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" podUID="5c1a8bd4-ea43-438d-89f4-b4870cbe368a" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.603389 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.603648 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" podUID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" containerName="keystone-api" containerID="cri-o://9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.607366 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.611860 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-vk7hb"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.616341 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-vk7hb"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.624821 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.627533 5030 generic.go:358] "Generic (PLEG): container finished" podID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerID="5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.627662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerDied","Data":"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.630326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" event={"ID":"5cf5bc21-928d-47a3-9696-4580afc7bb2e","Type":"ContainerStarted","Data":"1846cef3934d0742ec3317b4b362e6f211c49a3de1093dcfb7a2f50e4dbd0539"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.632687 5030 generic.go:358] "Generic (PLEG): container finished" podID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerID="5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.632810 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerDied","Data":"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.635810 5030 generic.go:358] "Generic (PLEG): container finished" podID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerID="576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.635923 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerDied","Data":"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.639106 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerID="22da61fc0955bfe033e67399f39358d969977b7d96a4cf9defdbf767a1215bde" exitCode=1 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.639191 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" event={"ID":"2c36e489-01b1-4370-a5e9-d9794d6fb52d","Type":"ContainerDied","Data":"22da61fc0955bfe033e67399f39358d969977b7d96a4cf9defdbf767a1215bde"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.639660 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/root-account-create-update-ftzgb" secret="" err="secret \"galera-openstack-dockercfg-w8dtc\" not found" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.639709 5030 scope.go:117] "RemoveContainer" containerID="22da61fc0955bfe033e67399f39358d969977b7d96a4cf9defdbf767a1215bde" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644279 5030 generic.go:358] "Generic (PLEG): container finished" podID="66b587a8-6b3d-4814-944c-60b475063c0e" containerID="55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644299 5030 generic.go:358] "Generic (PLEG): container finished" podID="66b587a8-6b3d-4814-944c-60b475063c0e" containerID="5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f" exitCode=2 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644306 5030 generic.go:358] "Generic (PLEG): container finished" podID="66b587a8-6b3d-4814-944c-60b475063c0e" containerID="c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644448 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerDied","Data":"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerDied","Data":"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.644481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerDied","Data":"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.647171 5030 generic.go:358] "Generic (PLEG): container finished" podID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerID="3fb2ce245e24c48262e813f03a90e12d65a1defd05e5c7aedab7328f27348c56" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.647239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerDied","Data":"3fb2ce245e24c48262e813f03a90e12d65a1defd05e5c7aedab7328f27348c56"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.650650 5030 generic.go:358] "Generic (PLEG): container finished" podID="4851d886-9022-4ea6-90c8-067d86e198df" containerID="d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.650753 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerDied","Data":"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.663395 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.663430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f25b\" (UniqueName: \"kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.663840 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.663925 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts podName:5c1a8bd4-ea43-438d-89f4-b4870cbe368a nodeName:}" failed. No retries permitted until 2026-03-16 13:33:02.163906719 +0000 UTC m=+1626.563219266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts") pod "keystone-675a-account-create-update-xtxxx" (UID: "5c1a8bd4-ea43-438d-89f4-b4870cbe368a") : configmap "openstack-scripts" not found Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.666619 5030 generic.go:358] "Generic (PLEG): container finished" podID="05b2eb18-282d-42e9-9b68-f348caaad8d6" containerID="47b306e2b88d355e8391ba403bb9d6e6a1d065cb9e38d7055bd852e3506c841e" exitCode=2 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.667047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"05b2eb18-282d-42e9-9b68-f348caaad8d6","Type":"ContainerDied","Data":"47b306e2b88d355e8391ba403bb9d6e6a1d065cb9e38d7055bd852e3506c841e"} Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.667864 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2f25b for pod openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.668034 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b podName:5c1a8bd4-ea43-438d-89f4-b4870cbe368a nodeName:}" failed. No retries permitted until 2026-03-16 13:33:02.16801255 +0000 UTC m=+1626.567325096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2f25b" (UniqueName: "kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b") pod "keystone-675a-account-create-update-xtxxx" (UID: "5c1a8bd4-ea43-438d-89f4-b4870cbe368a") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.669512 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9f732be-2c17-4d8e-8a58-9997a325139a" containerID="7a57dc384153c1b7bffb4ec81726c72beceb1f5068e6382d44f88f1f73dfb0bf" exitCode=137 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.672828 5030 generic.go:358] "Generic (PLEG): container finished" podID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerID="d783b170b26f0401eb296e7f0305718beb7face59f74c18d6d21d96c3a5eb405" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.672920 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerDied","Data":"d783b170b26f0401eb296e7f0305718beb7face59f74c18d6d21d96c3a5eb405"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.676413 5030 generic.go:358] "Generic (PLEG): container finished" podID="db6ddcb0-3f63-467f-92d8-67320056f141" containerID="e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.676514 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerDied","Data":"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.678379 5030 generic.go:358] "Generic (PLEG): container finished" podID="35df6249-dce2-4828-b469-2fda1b340a1b" containerID="ad81b0809f607000870416a65320171bc2b3d5f7273f86c77dda2a555b68fd35" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.678449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerDied","Data":"ad81b0809f607000870416a65320171bc2b3d5f7273f86c77dda2a555b68fd35"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.685987 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688507 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688644 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688721 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688827 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688880 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688976 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689164 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689247 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689347 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689568 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689706 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689808 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.689889 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9" exitCode=0 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.688481 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690266 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690474 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690720 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690784 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690869 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.690981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691633 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691649 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691660 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.691690 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.697119 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerDied","Data":"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.697132 5030 generic.go:358] "Generic (PLEG): container finished" podID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerID="19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.700284 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerID="565353abde25898aae519ab0e9ddc9e456d7210808177fc023f7dc8cf4679106" exitCode=143 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.700363 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerDied","Data":"565353abde25898aae519ab0e9ddc9e456d7210808177fc023f7dc8cf4679106"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.701941 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.702876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" event={"ID":"0c38aa3d-b633-4f15-904d-328e49583cf8","Type":"ContainerStarted","Data":"758ba710d5566db42034f9df3f5e0f3a327e1017d6afe7f6e2a75163e6730906"} Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.718588 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.752306 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.48:6080/vnc_lite.html\": dial tcp 10.217.1.48:6080: connect: connection refused" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.768487 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.768571 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts podName:2c36e489-01b1-4370-a5e9-d9794d6fb52d nodeName:}" failed. No retries permitted until 2026-03-16 13:33:02.268534276 +0000 UTC m=+1626.667846823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts") pod "root-account-create-update-ftzgb" (UID: "2c36e489-01b1-4370-a5e9-d9794d6fb52d") : configmap "openstack-scripts" not found Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.831083 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:33:01 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: if [ -n "barbican" ]; then Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="barbican" Mar 16 13:33:01 crc kubenswrapper[5030]: else Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:33:01 crc kubenswrapper[5030]: fi Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:33:01 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:33:01 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:33:01 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:33:01 crc kubenswrapper[5030]: # support updates Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.831902 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:33:01 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: if [ -n "nova_cell0" ]; then Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="nova_cell0" Mar 16 13:33:01 crc kubenswrapper[5030]: else Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:33:01 crc kubenswrapper[5030]: fi Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:33:01 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:33:01 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:33:01 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:33:01 crc kubenswrapper[5030]: # support updates Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.832786 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" podUID="0c38aa3d-b633-4f15-904d-328e49583cf8" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.833390 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" podUID="60ea6f78-b45a-4f57-8dc9-114516e29b32" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.835431 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:33:01 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: if [ -n "nova_api" ]; then Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="nova_api" Mar 16 13:33:01 crc kubenswrapper[5030]: else Mar 16 13:33:01 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:33:01 crc kubenswrapper[5030]: fi Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:33:01 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:33:01 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:33:01 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:33:01 crc kubenswrapper[5030]: # support updates Mar 16 13:33:01 crc kubenswrapper[5030]: Mar 16 13:33:01 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:33:01 crc kubenswrapper[5030]: E0316 13:33:01.836847 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" podUID="5cf5bc21-928d-47a3-9696-4580afc7bb2e" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.870907 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_f14a2769-6106-4965-bd88-9feb130a7485/ovsdbserver-sb/0.log" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.871237 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.872508 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="galera" containerID="cri-o://f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de" gracePeriod=30 Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.890778 5030 scope.go:117] "RemoveContainer" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979168 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979315 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979483 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979530 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979637 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6xz5\" (UniqueName: \"kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.979788 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs\") pod \"f14a2769-6106-4965-bd88-9feb130a7485\" (UID: \"f14a2769-6106-4965-bd88-9feb130a7485\") " Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.981898 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114c5991-4a9a-484f-88a9-ba1a07b4c6ca" path="/var/lib/kubelet/pods/114c5991-4a9a-484f-88a9-ba1a07b4c6ca/volumes" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.986123 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.991016 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config" (OuterVolumeSpecName: "config") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.991121 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d7fd9a6-353d-4c18-ae50-bd967e4b7116" path="/var/lib/kubelet/pods/1d7fd9a6-353d-4c18-ae50-bd967e4b7116/volumes" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.993432 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="314a6460-082f-4fbb-a520-26438f689a6a" path="/var/lib/kubelet/pods/314a6460-082f-4fbb-a520-26438f689a6a/volumes" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.995721 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5" (OuterVolumeSpecName: "kube-api-access-h6xz5") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "kube-api-access-h6xz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.997939 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3384fab3-f36e-4fc4-85f7-17d4fa97fa37" path="/var/lib/kubelet/pods/3384fab3-f36e-4fc4-85f7-17d4fa97fa37/volumes" Mar 16 13:33:01 crc kubenswrapper[5030]: I0316 13:33:01.998811 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="386286f5-eb7f-4cb2-8722-f3e2336a213c" path="/var/lib/kubelet/pods/386286f5-eb7f-4cb2-8722-f3e2336a213c/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:01.999977 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d41150-83f5-40f5-bb52-2be58b73a852" path="/var/lib/kubelet/pods/59d41150-83f5-40f5-bb52-2be58b73a852/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.000797 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9438a4-2e25-4af1-bc80-3ce36b537d95" path="/var/lib/kubelet/pods/5d9438a4-2e25-4af1-bc80-3ce36b537d95/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.000919 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.001498 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f469802-ea7b-408f-8672-5daef83c9050" path="/var/lib/kubelet/pods/5f469802-ea7b-408f-8672-5daef83c9050/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.002107 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62da2c82-ab08-4bdf-b5c3-f225e976c42b" path="/var/lib/kubelet/pods/62da2c82-ab08-4bdf-b5c3-f225e976c42b/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.003127 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69a9985f-641a-43ae-90fa-5770f0bf4b6b" path="/var/lib/kubelet/pods/69a9985f-641a-43ae-90fa-5770f0bf4b6b/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.003840 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d88cc30-809d-4bfa-b22b-17978acce221" path="/var/lib/kubelet/pods/7d88cc30-809d-4bfa-b22b-17978acce221/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.004368 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f781dd-8377-49f9-aef5-adadd6eab8f8" path="/var/lib/kubelet/pods/80f781dd-8377-49f9-aef5-adadd6eab8f8/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.005434 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f827ba-f56b-44db-bbe7-edee2f1dc11f" path="/var/lib/kubelet/pods/84f827ba-f56b-44db-bbe7-edee2f1dc11f/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.006010 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c097fbf-7f83-43b0-a8c0-bb0e0399b2af" path="/var/lib/kubelet/pods/8c097fbf-7f83-43b0-a8c0-bb0e0399b2af/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.006353 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts" (OuterVolumeSpecName: "scripts") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.020125 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eec7e4c-cba1-485c-b2be-183ebef9ef81" path="/var/lib/kubelet/pods/8eec7e4c-cba1-485c-b2be-183ebef9ef81/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.028640 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d72dcff8-fe6d-44b2-8268-704269965202" path="/var/lib/kubelet/pods/d72dcff8-fe6d-44b2-8268-704269965202/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.029763 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79da2d9-12a8-44a6-bcaa-b404eee94ee6" path="/var/lib/kubelet/pods/d79da2d9-12a8-44a6-bcaa-b404eee94ee6/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.030279 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e05c082d-aba5-46a8-aa3f-c411583939bc" path="/var/lib/kubelet/pods/e05c082d-aba5-46a8-aa3f-c411583939bc/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.030758 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efee2114-7d16-44d3-ad75-7224b8ae4077" path="/var/lib/kubelet/pods/efee2114-7d16-44d3-ad75-7224b8ae4077/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.031749 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb36a14c-9dff-4400-90b6-91f3089ea6bd" path="/var/lib/kubelet/pods/fb36a14c-9dff-4400-90b6-91f3089ea6bd/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.032278 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc8a05b9-b460-45ec-9689-d0e34f761e9f" path="/var/lib/kubelet/pods/fc8a05b9-b460-45ec-9689-d0e34f761e9f/volumes" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.033387 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.061271 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.067816 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "f14a2769-6106-4965-bd88-9feb130a7485" (UID: "f14a2769-6106-4965-bd88-9feb130a7485"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087090 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087134 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087146 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087158 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6xz5\" (UniqueName: \"kubernetes.io/projected/f14a2769-6106-4965-bd88-9feb130a7485-kube-api-access-h6xz5\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087167 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f14a2769-6106-4965-bd88-9feb130a7485-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087175 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f14a2769-6106-4965-bd88-9feb130a7485-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087202 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f14a2769-6106-4965-bd88-9feb130a7485-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.087222 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.099184 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.102523 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.151296 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.190434 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config\") pod \"b9f732be-2c17-4d8e-8a58-9997a325139a\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.190862 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle\") pod \"b9f732be-2c17-4d8e-8a58-9997a325139a\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.191001 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret\") pod \"b9f732be-2c17-4d8e-8a58-9997a325139a\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.195237 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpwlj\" (UniqueName: \"kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj\") pod \"b9f732be-2c17-4d8e-8a58-9997a325139a\" (UID: \"b9f732be-2c17-4d8e-8a58-9997a325139a\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.195998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.196054 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f25b\" (UniqueName: \"kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b\") pod \"keystone-675a-account-create-update-xtxxx\" (UID: \"5c1a8bd4-ea43-438d-89f4-b4870cbe368a\") " pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.196234 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.196909 5030 scope.go:117] "RemoveContainer" containerID="8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.198059 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.198143 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts podName:5c1a8bd4-ea43-438d-89f4-b4870cbe368a nodeName:}" failed. No retries permitted until 2026-03-16 13:33:03.198124913 +0000 UTC m=+1627.597437460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts") pod "keystone-675a-account-create-update-xtxxx" (UID: "5c1a8bd4-ea43-438d-89f4-b4870cbe368a") : configmap "openstack-scripts" not found Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.201274 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2f25b for pod openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.201363 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b podName:5c1a8bd4-ea43-438d-89f4-b4870cbe368a nodeName:}" failed. No retries permitted until 2026-03-16 13:33:03.201342824 +0000 UTC m=+1627.600655362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2f25b" (UniqueName: "kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b") pod "keystone-675a-account-create-update-xtxxx" (UID: "5c1a8bd4-ea43-438d-89f4-b4870cbe368a") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.201461 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687\": container with ID starting with 8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687 not found: ID does not exist" containerID="8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.201500 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687"} err="failed to get container status \"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687\": rpc error: code = NotFound desc = could not find container \"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687\": container with ID starting with 8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.201528 5030 scope.go:117] "RemoveContainer" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.202038 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6\": container with ID starting with 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 not found: ID does not exist" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.202283 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6"} err="failed to get container status \"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6\": rpc error: code = NotFound desc = could not find container \"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6\": container with ID starting with 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.202310 5030 scope.go:117] "RemoveContainer" containerID="8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.202690 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687"} err="failed to get container status \"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687\": rpc error: code = NotFound desc = could not find container \"8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687\": container with ID starting with 8a8daac67fcce0e115306872b46bf68b0be954ed62e51e3a4c07c6a7dc67d687 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.202729 5030 scope.go:117] "RemoveContainer" containerID="029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.202950 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6"} err="failed to get container status \"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6\": rpc error: code = NotFound desc = could not find container \"029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6\": container with ID starting with 029bb2343ee524816b8b1ca78a531cee423fe6f846da6b1fa7b0085e18e7f6f6 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.209973 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj" (OuterVolumeSpecName: "kube-api-access-cpwlj") pod "b9f732be-2c17-4d8e-8a58-9997a325139a" (UID: "b9f732be-2c17-4d8e-8a58-9997a325139a"). InnerVolumeSpecName "kube-api-access-cpwlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.237669 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "b9f732be-2c17-4d8e-8a58-9997a325139a" (UID: "b9f732be-2c17-4d8e-8a58-9997a325139a"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.250258 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9f732be-2c17-4d8e-8a58-9997a325139a" (UID: "b9f732be-2c17-4d8e-8a58-9997a325139a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.280715 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "b9f732be-2c17-4d8e-8a58-9997a325139a" (UID: "b9f732be-2c17-4d8e-8a58-9997a325139a"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.297503 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle\") pod \"05b2eb18-282d-42e9-9b68-f348caaad8d6\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.297620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config\") pod \"05b2eb18-282d-42e9-9b68-f348caaad8d6\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.297665 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g96mq\" (UniqueName: \"kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq\") pod \"05b2eb18-282d-42e9-9b68-f348caaad8d6\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.297798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs\") pod \"05b2eb18-282d-42e9-9b68-f348caaad8d6\" (UID: \"05b2eb18-282d-42e9-9b68-f348caaad8d6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.298255 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.298266 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpwlj\" (UniqueName: \"kubernetes.io/projected/b9f732be-2c17-4d8e-8a58-9997a325139a-kube-api-access-cpwlj\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.298275 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b9f732be-2c17-4d8e-8a58-9997a325139a-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.298283 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9f732be-2c17-4d8e-8a58-9997a325139a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.298356 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.298420 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts podName:2c36e489-01b1-4370-a5e9-d9794d6fb52d nodeName:}" failed. No retries permitted until 2026-03-16 13:33:03.298401818 +0000 UTC m=+1627.697714365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts") pod "root-account-create-update-ftzgb" (UID: "2c36e489-01b1-4370-a5e9-d9794d6fb52d") : configmap "openstack-scripts" not found Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.306198 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq" (OuterVolumeSpecName: "kube-api-access-g96mq") pod "05b2eb18-282d-42e9-9b68-f348caaad8d6" (UID: "05b2eb18-282d-42e9-9b68-f348caaad8d6"). InnerVolumeSpecName "kube-api-access-g96mq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.321331 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "05b2eb18-282d-42e9-9b68-f348caaad8d6" (UID: "05b2eb18-282d-42e9-9b68-f348caaad8d6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.325097 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "05b2eb18-282d-42e9-9b68-f348caaad8d6" (UID: "05b2eb18-282d-42e9-9b68-f348caaad8d6"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.345408 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "05b2eb18-282d-42e9-9b68-f348caaad8d6" (UID: "05b2eb18-282d-42e9-9b68-f348caaad8d6"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.400299 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.400348 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.400358 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.400369 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g96mq\" (UniqueName: \"kubernetes.io/projected/05b2eb18-282d-42e9-9b68-f348caaad8d6-kube-api-access-g96mq\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.568576 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.577776 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.651023 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.663996 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.672498 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710480 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710588 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data\") pod \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bccf5\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle\") pod \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710877 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710911 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.710986 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2sxw\" (UniqueName: \"kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw\") pod \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.711062 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs\") pod \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.711130 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.711234 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs\") pod \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\" (UID: \"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.711345 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs\") pod \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\" (UID: \"0c84ed78-85e2-4260-ad5b-07b8dccdba58\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.712891 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.713440 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.714854 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.714878 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/0c84ed78-85e2-4260-ad5b-07b8dccdba58-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.719903 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw" (OuterVolumeSpecName: "kube-api-access-k2sxw") pod "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" (UID: "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9"). InnerVolumeSpecName "kube-api-access-k2sxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.723860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5" (OuterVolumeSpecName: "kube-api-access-bccf5") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "kube-api-access-bccf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.725887 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb22a037-ccd0-4346-b587-e41a671f1535" containerID="fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.725990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerDied","Data":"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.727750 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.730229 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerID="e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.730308 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9","Type":"ContainerDied","Data":"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.730326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9","Type":"ContainerDied","Data":"84a59293dc064763013059438d2b6f3f0bba70ce4e6a202629944f8007c240be"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.730344 5030 scope.go:117] "RemoveContainer" containerID="e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.730460 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.735134 5030 generic.go:358] "Generic (PLEG): container finished" podID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerID="659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.735198 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerDied","Data":"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.735215 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"be781d6b-b9fc-40ad-a0b1-ad375d4533e6","Type":"ContainerDied","Data":"c5abf05c454a4f2bfd3e6954877f7b064bc8eb5313cd4c59524a1b86ea267205"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.735238 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.741159 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_f14a2769-6106-4965-bd88-9feb130a7485/ovsdbserver-sb/0.log" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.741302 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.741321 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"f14a2769-6106-4965-bd88-9feb130a7485","Type":"ContainerDied","Data":"464f956a987ec86e400a18343c87d7e076ad2a5deb9f1e317c39a8d2048b80ce"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.744442 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerID="f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.744535 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerDied","Data":"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.744568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"4b5e6f15-6858-49ff-9570-39f56bf0b83b","Type":"ContainerDied","Data":"dbcb21a9cf924251c3640591187d39122e5aaa4593df6d0f057fda6a99d0d23c"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.744635 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.751393 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerID="02f945a0fa1726adf3ecffc98fd76fe697ad5c296a834e087d971821259f4355" exitCode=1 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.751450 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" event={"ID":"2c36e489-01b1-4370-a5e9-d9794d6fb52d","Type":"ContainerDied","Data":"02f945a0fa1726adf3ecffc98fd76fe697ad5c296a834e087d971821259f4355"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768573 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerID="d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768597 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerID="79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" exitCode=0 Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerDied","Data":"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768725 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerDied","Data":"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768737 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" event={"ID":"0c84ed78-85e2-4260-ad5b-07b8dccdba58","Type":"ContainerDied","Data":"93ad6e5d3f5967b56f75b0e86a953986be5bd5e66dd9bf93dc6f4c7b585b0334"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.768801 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.773494 5030 scope.go:117] "RemoveContainer" containerID="e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8" Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.774009 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8\": container with ID starting with e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8 not found: ID does not exist" containerID="e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.774064 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8"} err="failed to get container status \"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8\": rpc error: code = NotFound desc = could not find container \"e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8\": container with ID starting with e8e5e386706f84e12e620e0f99573d0d00f2dbf3aab6bfa58b017f3010d212d8 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.774098 5030 scope.go:117] "RemoveContainer" containerID="659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.773542 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" event={"ID":"60ea6f78-b45a-4f57-8dc9-114516e29b32","Type":"ContainerStarted","Data":"eab055240ea03ca7d3a35f11da07f2e047b099c2f453053ca625bf6c80dbb101"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.785811 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data" (OuterVolumeSpecName: "config-data") pod "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" (UID: "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.785914 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.785931 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"05b2eb18-282d-42e9-9b68-f348caaad8d6","Type":"ContainerDied","Data":"30f9b5188673e25a1f3ae53a0d02a710df2e4d339ff46641ef2a57072eaeca9f"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.787288 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" (UID: "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.795084 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.798135 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.806189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" event={"ID":"c4c4d14b-81e6-4949-a22c-ebfaea862b78","Type":"ContainerStarted","Data":"9dd9f8437d9a30bfdfe36bd77a1af3091294a0ea03aae065323d0a9c45c707fd"} Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.809797 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.818846 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.818880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.818925 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819055 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819102 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819130 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819213 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819260 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819288 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819303 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819360 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mhmn\" (UniqueName: \"kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.819410 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.820453 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.820492 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821119 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle\") pod \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\" (UID: \"4b5e6f15-6858-49ff-9570-39f56bf0b83b\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821338 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc8s5\" (UniqueName: \"kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5\") pod \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\" (UID: \"be781d6b-b9fc-40ad-a0b1-ad375d4533e6\") " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821835 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821850 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821858 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821867 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bccf5\" (UniqueName: \"kubernetes.io/projected/0c84ed78-85e2-4260-ad5b-07b8dccdba58-kube-api-access-bccf5\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821875 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821884 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2sxw\" (UniqueName: \"kubernetes.io/projected/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-kube-api-access-k2sxw\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821892 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.821939 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.822712 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.823135 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.823855 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.823917 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.824408 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.823598 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.829658 5030 scope.go:117] "RemoveContainer" containerID="2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.832091 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5" (OuterVolumeSpecName: "kube-api-access-gc8s5") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "kube-api-access-gc8s5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.838070 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn" (OuterVolumeSpecName: "kube-api-access-8mhmn") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "kube-api-access-8mhmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.847459 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.857723 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.863809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "mysql-db") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.865356 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.870396 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.871047 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.897455 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.897850 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924901 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924934 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924947 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924962 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc8s5\" (UniqueName: \"kubernetes.io/projected/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kube-api-access-gc8s5\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924972 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.924982 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925013 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925024 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925033 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925042 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/4b5e6f15-6858-49ff-9570-39f56bf0b83b-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925056 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.925065 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mhmn\" (UniqueName: \"kubernetes.io/projected/4b5e6f15-6858-49ff-9570-39f56bf0b83b-kube-api-access-8mhmn\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.934749 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx"] Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.941092 5030 scope.go:117] "RemoveContainer" containerID="659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.942351 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-675a-account-create-update-xtxxx"] Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.942365 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740\": container with ID starting with 659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740 not found: ID does not exist" containerID="659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.942428 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740"} err="failed to get container status \"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740\": rpc error: code = NotFound desc = could not find container \"659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740\": container with ID starting with 659a8ae6d3380de73afb44ab5cd21602edc3b81851c726d25bcc86c0b46a9740 not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.942456 5030 scope.go:117] "RemoveContainer" containerID="2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b" Mar 16 13:33:02 crc kubenswrapper[5030]: E0316 13:33:02.942864 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b\": container with ID starting with 2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b not found: ID does not exist" containerID="2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.942893 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b"} err="failed to get container status \"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b\": rpc error: code = NotFound desc = could not find container \"2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b\": container with ID starting with 2c20c4a9b03c9888923b96045e27328c81ae1495a05bc49e94f769c8be08953b not found: ID does not exist" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.942912 5030 scope.go:117] "RemoveContainer" containerID="0fee0be6c904ce3c9dcaf670d16cd5b3d4fd713b77776a1d54bfac9adb32c910" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.954393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:02 crc kubenswrapper[5030]: I0316 13:33:02.988719 5030 scope.go:117] "RemoveContainer" containerID="50d1b12067498321d9bd9a6eb36f77a8d1172ada3efd4ed52e2f990deb8733fa" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.031589 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.031622 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.031644 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f25b\" (UniqueName: \"kubernetes.io/projected/5c1a8bd4-ea43-438d-89f4-b4870cbe368a-kube-api-access-2f25b\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.041059 5030 scope.go:117] "RemoveContainer" containerID="f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.060874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.062128 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.073650 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.086862 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "4b5e6f15-6858-49ff-9570-39f56bf0b83b" (UID: "4b5e6f15-6858-49ff-9570-39f56bf0b83b"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.087188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.092719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" (UID: "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.099807 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data" (OuterVolumeSpecName: "config-data") pod "0c84ed78-85e2-4260-ad5b-07b8dccdba58" (UID: "0c84ed78-85e2-4260-ad5b-07b8dccdba58"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.107156 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" (UID: "c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.111853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "be781d6b-b9fc-40ad-a0b1-ad375d4533e6" (UID: "be781d6b-b9fc-40ad-a0b1-ad375d4533e6"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.114139 5030 scope.go:117] "RemoveContainer" containerID="1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135089 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135117 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135128 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135142 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135152 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be781d6b-b9fc-40ad-a0b1-ad375d4533e6-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135160 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135169 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c84ed78-85e2-4260-ad5b-07b8dccdba58-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135178 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5e6f15-6858-49ff-9570-39f56bf0b83b-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.135187 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.175255 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.181734 5030 scope.go:117] "RemoveContainer" containerID="f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de" Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.182052 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de\": container with ID starting with f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de not found: ID does not exist" containerID="f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.182093 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de"} err="failed to get container status \"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de\": rpc error: code = NotFound desc = could not find container \"f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de\": container with ID starting with f373a1748198420d39672c8e68305e5e402788272bf8203f7a2bf8d72bc188de not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.182115 5030 scope.go:117] "RemoveContainer" containerID="1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c" Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.182354 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c\": container with ID starting with 1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c not found: ID does not exist" containerID="1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.182378 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c"} err="failed to get container status \"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c\": rpc error: code = NotFound desc = could not find container \"1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c\": container with ID starting with 1aae64134da423f2e45f5fe21b330fdb42c1108c55f268e830ce16097832161c not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.182392 5030 scope.go:117] "RemoveContainer" containerID="22da61fc0955bfe033e67399f39358d969977b7d96a4cf9defdbf767a1215bde" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.198590 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.222864 5030 scope.go:117] "RemoveContainer" containerID="d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.338137 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts\") pod \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.338755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hghlq\" (UniqueName: \"kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq\") pod \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\" (UID: \"2c36e489-01b1-4370-a5e9-d9794d6fb52d\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.339357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2c36e489-01b1-4370-a5e9-d9794d6fb52d" (UID: "2c36e489-01b1-4370-a5e9-d9794d6fb52d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.346391 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq" (OuterVolumeSpecName: "kube-api-access-hghlq") pod "2c36e489-01b1-4370-a5e9-d9794d6fb52d" (UID: "2c36e489-01b1-4370-a5e9-d9794d6fb52d"). InnerVolumeSpecName "kube-api-access-hghlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.415500 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.417539 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.423493 5030 scope.go:117] "RemoveContainer" containerID="79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.441459 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hghlq\" (UniqueName: \"kubernetes.io/projected/2c36e489-01b1-4370-a5e9-d9794d6fb52d-kube-api-access-hghlq\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.441488 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2c36e489-01b1-4370-a5e9-d9794d6fb52d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.444643 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.447728 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.452793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.476041 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.477154 5030 scope.go:117] "RemoveContainer" containerID="d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.477630 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f\": container with ID starting with d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f not found: ID does not exist" containerID="d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.477672 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f"} err="failed to get container status \"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f\": rpc error: code = NotFound desc = could not find container \"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f\": container with ID starting with d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.477702 5030 scope.go:117] "RemoveContainer" containerID="79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.480131 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e\": container with ID starting with 79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e not found: ID does not exist" containerID="79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480157 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e"} err="failed to get container status \"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e\": rpc error: code = NotFound desc = could not find container \"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e\": container with ID starting with 79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480174 5030 scope.go:117] "RemoveContainer" containerID="d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480422 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f"} err="failed to get container status \"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f\": rpc error: code = NotFound desc = could not find container \"d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f\": container with ID starting with d8b25d51b22f10692ac01aaccd0f7fc217a0f2367ff716fb2a0b69e0cdbe982f not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480443 5030 scope.go:117] "RemoveContainer" containerID="79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480703 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e"} err="failed to get container status \"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e\": rpc error: code = NotFound desc = could not find container \"79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e\": container with ID starting with 79493fda9c121f4671f16d82e05515414b31b7508501d6333e35fa320707571e not found: ID does not exist" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.480751 5030 scope.go:117] "RemoveContainer" containerID="47b306e2b88d355e8391ba403bb9d6e6a1d065cb9e38d7055bd852e3506c841e" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.490232 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.510850 5030 scope.go:117] "RemoveContainer" containerID="7a57dc384153c1b7bffb4ec81726c72beceb1f5068e6382d44f88f1f73dfb0bf" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.511793 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.521561 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.525337 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.537293 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.540742 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.542726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxkr7\" (UniqueName: \"kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7\") pod \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.542802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts\") pod \"0c38aa3d-b633-4f15-904d-328e49583cf8\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.543448 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0c38aa3d-b633-4f15-904d-328e49583cf8" (UID: "0c38aa3d-b633-4f15-904d-328e49583cf8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.543497 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnhd9\" (UniqueName: \"kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9\") pod \"0c38aa3d-b633-4f15-904d-328e49583cf8\" (UID: \"0c38aa3d-b633-4f15-904d-328e49583cf8\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.543568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts\") pod \"60ea6f78-b45a-4f57-8dc9-114516e29b32\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.543735 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxwx\" (UniqueName: \"kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx\") pod \"60ea6f78-b45a-4f57-8dc9-114516e29b32\" (UID: \"60ea6f78-b45a-4f57-8dc9-114516e29b32\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.543784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts\") pod \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\" (UID: \"5cf5bc21-928d-47a3-9696-4580afc7bb2e\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.544313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "60ea6f78-b45a-4f57-8dc9-114516e29b32" (UID: "60ea6f78-b45a-4f57-8dc9-114516e29b32"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.544402 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5cf5bc21-928d-47a3-9696-4580afc7bb2e" (UID: "5cf5bc21-928d-47a3-9696-4580afc7bb2e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.544987 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0c38aa3d-b633-4f15-904d-328e49583cf8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.545007 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/60ea6f78-b45a-4f57-8dc9-114516e29b32-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.545016 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5cf5bc21-928d-47a3-9696-4580afc7bb2e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.546121 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7" (OuterVolumeSpecName: "kube-api-access-xxkr7") pod "5cf5bc21-928d-47a3-9696-4580afc7bb2e" (UID: "5cf5bc21-928d-47a3-9696-4580afc7bb2e"). InnerVolumeSpecName "kube-api-access-xxkr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.546955 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9" (OuterVolumeSpecName: "kube-api-access-fnhd9") pod "0c38aa3d-b633-4f15-904d-328e49583cf8" (UID: "0c38aa3d-b633-4f15-904d-328e49583cf8"). InnerVolumeSpecName "kube-api-access-fnhd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.549137 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.551006 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx" (OuterVolumeSpecName: "kube-api-access-2cxwx") pod "60ea6f78-b45a-4f57-8dc9-114516e29b32" (UID: "60ea6f78-b45a-4f57-8dc9-114516e29b32"). InnerVolumeSpecName "kube-api-access-2cxwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.555368 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.568625 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.572362 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.646845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcpvw\" (UniqueName: \"kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw\") pod \"4851d886-9022-4ea6-90c8-067d86e198df\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647115 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs\") pod \"4851d886-9022-4ea6-90c8-067d86e198df\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647252 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle\") pod \"4851d886-9022-4ea6-90c8-067d86e198df\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data\") pod \"4851d886-9022-4ea6-90c8-067d86e198df\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom\") pod \"4851d886-9022-4ea6-90c8-067d86e198df\" (UID: \"4851d886-9022-4ea6-90c8-067d86e198df\") " Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647923 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxkr7\" (UniqueName: \"kubernetes.io/projected/5cf5bc21-928d-47a3-9696-4580afc7bb2e-kube-api-access-xxkr7\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647960 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnhd9\" (UniqueName: \"kubernetes.io/projected/0c38aa3d-b633-4f15-904d-328e49583cf8-kube-api-access-fnhd9\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.647972 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxwx\" (UniqueName: \"kubernetes.io/projected/60ea6f78-b45a-4f57-8dc9-114516e29b32-kube-api-access-2cxwx\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.648036 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:03 crc kubenswrapper[5030]: E0316 13:33:03.648135 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data podName:e8553f68-b65a-4220-8445-7fb5e36ba36b nodeName:}" failed. No retries permitted until 2026-03-16 13:33:07.648111654 +0000 UTC m=+1632.047424200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data") pod "rabbitmq-cell1-server-0" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.648179 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs" (OuterVolumeSpecName: "logs") pod "4851d886-9022-4ea6-90c8-067d86e198df" (UID: "4851d886-9022-4ea6-90c8-067d86e198df"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.664044 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4851d886-9022-4ea6-90c8-067d86e198df" (UID: "4851d886-9022-4ea6-90c8-067d86e198df"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.669450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4851d886-9022-4ea6-90c8-067d86e198df" (UID: "4851d886-9022-4ea6-90c8-067d86e198df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.674181 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw" (OuterVolumeSpecName: "kube-api-access-rcpvw") pod "4851d886-9022-4ea6-90c8-067d86e198df" (UID: "4851d886-9022-4ea6-90c8-067d86e198df"). InnerVolumeSpecName "kube-api-access-rcpvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.686821 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data" (OuterVolumeSpecName: "config-data") pod "4851d886-9022-4ea6-90c8-067d86e198df" (UID: "4851d886-9022-4ea6-90c8-067d86e198df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.750004 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4851d886-9022-4ea6-90c8-067d86e198df-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.750277 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.750290 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.750302 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4851d886-9022-4ea6-90c8-067d86e198df-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.750313 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcpvw\" (UniqueName: \"kubernetes.io/projected/4851d886-9022-4ea6-90c8-067d86e198df-kube-api-access-rcpvw\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.825797 5030 generic.go:358] "Generic (PLEG): container finished" podID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerID="0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e" exitCode=0 Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.825976 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" event={"ID":"c4c4d14b-81e6-4949-a22c-ebfaea862b78","Type":"ContainerDied","Data":"0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.830905 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerID="d89ad58d84afea12dab69a708ae9ca36d50123c272f0d4bce2170ad3120a5050" exitCode=0 Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.831026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerDied","Data":"d89ad58d84afea12dab69a708ae9ca36d50123c272f0d4bce2170ad3120a5050"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.833571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" event={"ID":"0c38aa3d-b633-4f15-904d-328e49583cf8","Type":"ContainerDied","Data":"758ba710d5566db42034f9df3f5e0f3a327e1017d6afe7f6e2a75163e6730906"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.833715 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.853250 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.856335 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.866239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" event={"ID":"5cf5bc21-928d-47a3-9696-4580afc7bb2e","Type":"ContainerDied","Data":"1846cef3934d0742ec3317b4b362e6f211c49a3de1093dcfb7a2f50e4dbd0539"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.866337 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.868015 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.870452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" event={"ID":"2c36e489-01b1-4370-a5e9-d9794d6fb52d","Type":"ContainerDied","Data":"49ca15dd1917d12a5eb1aad8d3662679bc0050c2723b9fea6817445a0fafedee"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.870497 5030 scope.go:117] "RemoveContainer" containerID="02f945a0fa1726adf3ecffc98fd76fe697ad5c296a834e087d971821259f4355" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.870638 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-ftzgb" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.876141 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.882175 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" event={"ID":"60ea6f78-b45a-4f57-8dc9-114516e29b32","Type":"ContainerDied","Data":"eab055240ea03ca7d3a35f11da07f2e047b099c2f453053ca625bf6c80dbb101"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.882209 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.885414 5030 generic.go:358] "Generic (PLEG): container finished" podID="4851d886-9022-4ea6-90c8-067d86e198df" containerID="2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd" exitCode=0 Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.885504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerDied","Data":"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.885541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" event={"ID":"4851d886-9022-4ea6-90c8-067d86e198df","Type":"ContainerDied","Data":"6ca035cfd8efa72af42e5285d0d6dbcf483ae8e4f45f6564131f44104dc7667b"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.885657 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.893501 5030 status_manager.go:895] "Failed to get status for pod" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.907582 5030 generic.go:358] "Generic (PLEG): container finished" podID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerID="7c4ac03000a557b6ca65c98eee26a52d4cc8d5dbabc00f8ad6656e9f79e2852b" exitCode=0 Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.907678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerDied","Data":"7c4ac03000a557b6ca65c98eee26a52d4cc8d5dbabc00f8ad6656e9f79e2852b"} Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.947734 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.11:8776/healthcheck\": read tcp 10.217.0.2:51664->10.217.1.11:8776: read: connection reset by peer" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.962119 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b2eb18-282d-42e9-9b68-f348caaad8d6" path="/var/lib/kubelet/pods/05b2eb18-282d-42e9-9b68-f348caaad8d6/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.963387 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" path="/var/lib/kubelet/pods/0c84ed78-85e2-4260-ad5b-07b8dccdba58/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.964048 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" path="/var/lib/kubelet/pods/4b5e6f15-6858-49ff-9570-39f56bf0b83b/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.964992 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1a8bd4-ea43-438d-89f4-b4870cbe368a" path="/var/lib/kubelet/pods/5c1a8bd4-ea43-438d-89f4-b4870cbe368a/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.965312 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f732be-2c17-4d8e-8a58-9997a325139a" path="/var/lib/kubelet/pods/b9f732be-2c17-4d8e-8a58-9997a325139a/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.965920 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" path="/var/lib/kubelet/pods/be781d6b-b9fc-40ad-a0b1-ad375d4533e6/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.966881 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" path="/var/lib/kubelet/pods/c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9/volumes" Mar 16 13:33:03 crc kubenswrapper[5030]: I0316 13:33:03.967441 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14a2769-6106-4965-bd88-9feb130a7485" path="/var/lib/kubelet/pods/f14a2769-6106-4965-bd88-9feb130a7485/volumes" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.116187 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.120968 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-a165-account-create-update-4cqvl"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.155864 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.176808 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-c651-account-create-update-cxs7z"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.219754 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.220495 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-762e-account-create-update-zwhkv"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.227591 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.228033 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5f75b49bc-fnqz9"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.232605 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.235391 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-ftzgb"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.308769 5030 scope.go:117] "RemoveContainer" containerID="2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd" Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.400519 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e is running failed: container process not found" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.402164 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e is running failed: container process not found" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.402497 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e is running failed: container process not found" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.402566 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="ovn-northd" probeResult="unknown" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.499976 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.500629 5030 scope.go:117] "RemoveContainer" containerID="d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.522231 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_61cc2bed-6ab0-42bd-af61-35d6909e80d8/ovn-northd/0.log" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.522357 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.532070 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.535663 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.541956 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.548713 5030 scope.go:117] "RemoveContainer" containerID="2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd" Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.549991 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd\": container with ID starting with 2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd not found: ID does not exist" containerID="2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.550071 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd"} err="failed to get container status \"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd\": rpc error: code = NotFound desc = could not find container \"2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd\": container with ID starting with 2cbde76740dde8d31908a85606975434a1b4b40b34bd3145529983c211c991fd not found: ID does not exist" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.550117 5030 scope.go:117] "RemoveContainer" containerID="d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea" Mar 16 13:33:04 crc kubenswrapper[5030]: E0316 13:33:04.551540 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea\": container with ID starting with d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea not found: ID does not exist" containerID="d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.551635 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea"} err="failed to get container status \"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea\": rpc error: code = NotFound desc = could not find container \"d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea\": container with ID starting with d0610dbbb420db7a6bcc92577735ea328c632cbfaf4b9cc95e6ac51dfae3a2ea not found: ID does not exist" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.566437 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.610868 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677286 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fph9x\" (UniqueName: \"kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677355 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcqnm\" (UniqueName: \"kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677387 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677409 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzhjg\" (UniqueName: \"kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677466 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677595 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677625 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677672 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom\") pod \"ac7780d2-4432-4598-9894-1d08e2aa1133\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677689 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data\") pod \"ac7780d2-4432-4598-9894-1d08e2aa1133\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677729 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677759 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677788 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677825 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677857 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677895 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj74j\" (UniqueName: \"kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677926 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677947 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prjcz\" (UniqueName: \"kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.677978 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678005 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678022 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678099 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678122 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle\") pod \"ac7780d2-4432-4598-9894-1d08e2aa1133\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678179 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7vs6\" (UniqueName: \"kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6\") pod \"ac7780d2-4432-4598-9894-1d08e2aa1133\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678217 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678287 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs\") pod \"ac7780d2-4432-4598-9894-1d08e2aa1133\" (UID: \"ac7780d2-4432-4598-9894-1d08e2aa1133\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678307 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678364 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678388 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678407 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs\") pod \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\" (UID: \"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678463 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678489 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678511 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs\") pod \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\" (UID: \"61cc2bed-6ab0-42bd-af61-35d6909e80d8\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678747 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data\") pod \"1abced1c-3510-4271-80d8-8ab52bf51a61\" (UID: \"1abced1c-3510-4271-80d8-8ab52bf51a61\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678799 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678887 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts\") pod \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\" (UID: \"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678914 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678934 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run\") pod \"0d503a85-7499-44b6-af0e-4bd9010b5c52\" (UID: \"0d503a85-7499-44b6-af0e-4bd9010b5c52\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.681021 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.678376 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts" (OuterVolumeSpecName: "scripts") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.679590 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.679678 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs" (OuterVolumeSpecName: "logs") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.685232 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ac7780d2-4432-4598-9894-1d08e2aa1133" (UID: "ac7780d2-4432-4598-9894-1d08e2aa1133"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.680829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs" (OuterVolumeSpecName: "logs") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.682524 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs" (OuterVolumeSpecName: "logs") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.682625 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs" (OuterVolumeSpecName: "logs") pod "ac7780d2-4432-4598-9894-1d08e2aa1133" (UID: "ac7780d2-4432-4598-9894-1d08e2aa1133"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.683837 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs" (OuterVolumeSpecName: "logs") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.684569 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config" (OuterVolumeSpecName: "config") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.684606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.685413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.685805 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm" (OuterVolumeSpecName: "kube-api-access-vcqnm") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "kube-api-access-vcqnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.685868 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg" (OuterVolumeSpecName: "kube-api-access-vzhjg") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "kube-api-access-vzhjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689375 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts" (OuterVolumeSpecName: "scripts") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts" (OuterVolumeSpecName: "scripts") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689617 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689647 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6" (OuterVolumeSpecName: "kube-api-access-b7vs6") pod "ac7780d2-4432-4598-9894-1d08e2aa1133" (UID: "ac7780d2-4432-4598-9894-1d08e2aa1133"). InnerVolumeSpecName "kube-api-access-b7vs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689840 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz" (OuterVolumeSpecName: "kube-api-access-prjcz") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "kube-api-access-prjcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.689929 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j" (OuterVolumeSpecName: "kube-api-access-sj74j") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "kube-api-access-sj74j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.690010 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x" (OuterVolumeSpecName: "kube-api-access-fph9x") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "kube-api-access-fph9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.690256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.704198 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts" (OuterVolumeSpecName: "scripts") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.706823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts" (OuterVolumeSpecName: "scripts") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.719688 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.721636 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.722108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac7780d2-4432-4598-9894-1d08e2aa1133" (UID: "ac7780d2-4432-4598-9894-1d08e2aa1133"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.724665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.725053 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.726970 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data" (OuterVolumeSpecName: "config-data") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.733812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.734407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.738241 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data" (OuterVolumeSpecName: "config-data") pod "ac7780d2-4432-4598-9894-1d08e2aa1133" (UID: "ac7780d2-4432-4598-9894-1d08e2aa1133"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.741774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data" (OuterVolumeSpecName: "config-data") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.743158 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.744376 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.752341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data" (OuterVolumeSpecName: "config-data") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.758807 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data" (OuterVolumeSpecName: "config-data") pod "1abced1c-3510-4271-80d8-8ab52bf51a61" (UID: "1abced1c-3510-4271-80d8-8ab52bf51a61"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.760745 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0d503a85-7499-44b6-af0e-4bd9010b5c52" (UID: "0d503a85-7499-44b6-af0e-4bd9010b5c52"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.771208 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "61cc2bed-6ab0-42bd-af61-35d6909e80d8" (UID: "61cc2bed-6ab0-42bd-af61-35d6909e80d8"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.782909 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data\") pod \"db6ddcb0-3f63-467f-92d8-67320056f141\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.783031 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs\") pod \"db6ddcb0-3f63-467f-92d8-67320056f141\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.783096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5wx4\" (UniqueName: \"kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4\") pod \"db6ddcb0-3f63-467f-92d8-67320056f141\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.783138 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs\") pod \"db6ddcb0-3f63-467f-92d8-67320056f141\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.783262 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle\") pod \"db6ddcb0-3f63-467f-92d8-67320056f141\" (UID: \"db6ddcb0-3f63-467f-92d8-67320056f141\") " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.783675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs" (OuterVolumeSpecName: "logs") pod "db6ddcb0-3f63-467f-92d8-67320056f141" (UID: "db6ddcb0-3f63-467f-92d8-67320056f141"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784617 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784644 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/db6ddcb0-3f63-467f-92d8-67320056f141-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784661 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784672 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784682 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784692 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784702 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fph9x\" (UniqueName: \"kubernetes.io/projected/1abced1c-3510-4271-80d8-8ab52bf51a61-kube-api-access-fph9x\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784717 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcqnm\" (UniqueName: \"kubernetes.io/projected/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-kube-api-access-vcqnm\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784728 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784740 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzhjg\" (UniqueName: \"kubernetes.io/projected/61cc2bed-6ab0-42bd-af61-35d6909e80d8-kube-api-access-vzhjg\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784750 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784763 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784772 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784783 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784793 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784803 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784814 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784825 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784836 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784846 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784861 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj74j\" (UniqueName: \"kubernetes.io/projected/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-kube-api-access-sj74j\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784871 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784880 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prjcz\" (UniqueName: \"kubernetes.io/projected/0d503a85-7499-44b6-af0e-4bd9010b5c52-kube-api-access-prjcz\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784915 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784929 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0d503a85-7499-44b6-af0e-4bd9010b5c52-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784946 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1abced1c-3510-4271-80d8-8ab52bf51a61-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784958 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784971 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac7780d2-4432-4598-9894-1d08e2aa1133-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.784991 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785002 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7vs6\" (UniqueName: \"kubernetes.io/projected/ac7780d2-4432-4598-9894-1d08e2aa1133-kube-api-access-b7vs6\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785012 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785022 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d503a85-7499-44b6-af0e-4bd9010b5c52-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785033 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac7780d2-4432-4598-9894-1d08e2aa1133-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785042 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785049 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785058 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785066 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61cc2bed-6ab0-42bd-af61-35d6909e80d8-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785091 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785099 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785113 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/61cc2bed-6ab0-42bd-af61-35d6909e80d8-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.785122 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1abced1c-3510-4271-80d8-8ab52bf51a61-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.786050 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.794566 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" (UID: "6cfc409f-2388-40f5-9b7e-c9c6d8064c1f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.802618 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4" (OuterVolumeSpecName: "kube-api-access-t5wx4") pod "db6ddcb0-3f63-467f-92d8-67320056f141" (UID: "db6ddcb0-3f63-467f-92d8-67320056f141"). InnerVolumeSpecName "kube-api-access-t5wx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.804732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" (UID: "b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.808911 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.810148 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.812039 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.16:9311/healthcheck\": read tcp 10.217.0.2:40598->10.217.1.16:9311: read: connection reset by peer" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.814775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data" (OuterVolumeSpecName: "config-data") pod "db6ddcb0-3f63-467f-92d8-67320056f141" (UID: "db6ddcb0-3f63-467f-92d8-67320056f141"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.815279 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "db6ddcb0-3f63-467f-92d8-67320056f141" (UID: "db6ddcb0-3f63-467f-92d8-67320056f141"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.838958 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "db6ddcb0-3f63-467f-92d8-67320056f141" (UID: "db6ddcb0-3f63-467f-92d8-67320056f141"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887619 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887655 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887673 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5wx4\" (UniqueName: \"kubernetes.io/projected/db6ddcb0-3f63-467f-92d8-67320056f141-kube-api-access-t5wx4\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887684 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887694 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/db6ddcb0-3f63-467f-92d8-67320056f141-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887703 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887714 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887724 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.887733 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.923323 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" event={"ID":"c4c4d14b-81e6-4949-a22c-ebfaea862b78","Type":"ContainerStarted","Data":"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.923841 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.928673 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.928670 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952" event={"ID":"ac7780d2-4432-4598-9894-1d08e2aa1133","Type":"ContainerDied","Data":"aeecbeddeeab6ce864d6a33de452c480d8d6a8aa217823ee7a20fa00e3fe33af"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.928866 5030 scope.go:117] "RemoveContainer" containerID="d89ad58d84afea12dab69a708ae9ca36d50123c272f0d4bce2170ad3120a5050" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.933197 5030 generic.go:358] "Generic (PLEG): container finished" podID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerID="b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03" exitCode=0 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.933330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerDied","Data":"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.933368 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0d503a85-7499-44b6-af0e-4bd9010b5c52","Type":"ContainerDied","Data":"f4dce32474a23025eecf747ed4a39b41cdd9cbd3e599174ddfd4ab5bc06d5adf"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.933460 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.947902 5030 generic.go:358] "Generic (PLEG): container finished" podID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerID="1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800" exitCode=0 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.948010 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerDied","Data":"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.948054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" event={"ID":"b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e","Type":"ContainerDied","Data":"b399b105c2e6e62ed1c6bd1df049454c3e414ac3847390537185a6240737ba1a"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.948028 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7bdbcdc58-mbp44" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.951095 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" podStartSLOduration=4.951074354 podStartE2EDuration="4.951074354s" podCreationTimestamp="2026-03-16 13:33:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:04.941260618 +0000 UTC m=+1629.340573165" watchObservedRunningTime="2026-03-16 13:33:04.951074354 +0000 UTC m=+1629.350386901" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.951822 5030 generic.go:358] "Generic (PLEG): container finished" podID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerID="00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104" exitCode=0 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.951908 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerDied","Data":"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.951925 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"6cfc409f-2388-40f5-9b7e-c9c6d8064c1f","Type":"ContainerDied","Data":"234b10f5c2cd31a37bd42ad4d6a1b6eded8595a7fd0b436ada813abf83c9d538"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.951930 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.957225 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_61cc2bed-6ab0-42bd-af61-35d6909e80d8/ovn-northd/0.log" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.957272 5030 generic.go:358] "Generic (PLEG): container finished" podID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" exitCode=139 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.957384 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerDied","Data":"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.957421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"61cc2bed-6ab0-42bd-af61-35d6909e80d8","Type":"ContainerDied","Data":"06d5a3b84b9b8d691ed8a5eb595dcd5772d9008f25a74f03fd67b54278610f7e"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.957497 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.962887 5030 generic.go:358] "Generic (PLEG): container finished" podID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerID="d55195694cad34a2cc8da2bd114e7f31ad1129b25da6cb15dd183c6a849560ac" exitCode=0 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.962969 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerDied","Data":"d55195694cad34a2cc8da2bd114e7f31ad1129b25da6cb15dd183c6a849560ac"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.976597 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.976604 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"1abced1c-3510-4271-80d8-8ab52bf51a61","Type":"ContainerDied","Data":"553bc2a05eaa52fe9b18b4c57b12887b056a560b4e7bdd2c996f18b8a9dee7ef"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.979344 5030 scope.go:117] "RemoveContainer" containerID="565353abde25898aae519ab0e9ddc9e456d7210808177fc023f7dc8cf4679106" Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.980163 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.988239 5030 generic.go:358] "Generic (PLEG): container finished" podID="db6ddcb0-3f63-467f-92d8-67320056f141" containerID="75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f" exitCode=0 Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.988311 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerDied","Data":"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.988337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"db6ddcb0-3f63-467f-92d8-67320056f141","Type":"ContainerDied","Data":"eaa8ff12eaac4af5f1b75ae0f44508e2263ff85dc93030e3fa125e05ddb1221f"} Mar 16 13:33:04 crc kubenswrapper[5030]: I0316 13:33:04.988520 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.002864 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5b8b9dfb-gs952"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.011707 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.022277 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.027910 5030 scope.go:117] "RemoveContainer" containerID="b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.031373 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.043706 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.046579 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.050061 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7bdbcdc58-mbp44"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.058247 5030 scope.go:117] "RemoveContainer" containerID="5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.061093 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.069042 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.076623 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.081101 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.082937 5030 scope.go:117] "RemoveContainer" containerID="b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.084072 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03\": container with ID starting with b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03 not found: ID does not exist" containerID="b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.084155 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03"} err="failed to get container status \"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03\": rpc error: code = NotFound desc = could not find container \"b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03\": container with ID starting with b9a18ef702a0c834a6605ee319a26bdbfc2ecd9cf0a005ac7c8918b89f6a6f03 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.084183 5030 scope.go:117] "RemoveContainer" containerID="5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.085332 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.087794 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595\": container with ID starting with 5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595 not found: ID does not exist" containerID="5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.087832 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595"} err="failed to get container status \"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595\": rpc error: code = NotFound desc = could not find container \"5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595\": container with ID starting with 5cfda765bbfa9d7c5d0240cfd662d14e5b82b75c289b9ad38976d0f5c9fb6595 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.087859 5030 scope.go:117] "RemoveContainer" containerID="1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.089171 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.106382 5030 scope.go:117] "RemoveContainer" containerID="5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.142618 5030 scope.go:117] "RemoveContainer" containerID="1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.156956 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800\": container with ID starting with 1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800 not found: ID does not exist" containerID="1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.156999 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800"} err="failed to get container status \"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800\": rpc error: code = NotFound desc = could not find container \"1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800\": container with ID starting with 1bf8fc88c7d88ccde39168fc0b6f0cf2ad67401bde8113715ee44f9325847800 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.157028 5030 scope.go:117] "RemoveContainer" containerID="5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.158401 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37\": container with ID starting with 5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37 not found: ID does not exist" containerID="5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.158436 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37"} err="failed to get container status \"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37\": rpc error: code = NotFound desc = could not find container \"5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37\": container with ID starting with 5632890e0e7dec8c452a22208a6c08f1493495165761ecfed934a34929532d37 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.158487 5030 scope.go:117] "RemoveContainer" containerID="00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.196021 5030 scope.go:117] "RemoveContainer" containerID="576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.200192 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.220915 5030 scope.go:117] "RemoveContainer" containerID="00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.221224 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104\": container with ID starting with 00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104 not found: ID does not exist" containerID="00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.221265 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104"} err="failed to get container status \"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104\": rpc error: code = NotFound desc = could not find container \"00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104\": container with ID starting with 00d76cd3531656412013bce6f45e828f0a135d689725dc5cf8f99e17c97a2104 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.221295 5030 scope.go:117] "RemoveContainer" containerID="576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.221482 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952\": container with ID starting with 576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952 not found: ID does not exist" containerID="576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.221504 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952"} err="failed to get container status \"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952\": rpc error: code = NotFound desc = could not find container \"576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952\": container with ID starting with 576708697ec287a12b2431f00a1aebcf2759cc2e6f78156807185e918b6fa952 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.221519 5030 scope.go:117] "RemoveContainer" containerID="da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.296156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.296479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9kwb\" (UniqueName: \"kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.296617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.296869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.297011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.297184 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.297610 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data\") pod \"43abd798-ae7e-4ece-832d-6fdaa98b2964\" (UID: \"43abd798-ae7e-4ece-832d-6fdaa98b2964\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.298934 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs" (OuterVolumeSpecName: "logs") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.301313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.301935 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb" (OuterVolumeSpecName: "kube-api-access-b9kwb") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "kube-api-access-b9kwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.319606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.335818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data" (OuterVolumeSpecName: "config-data") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.335860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.336060 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "43abd798-ae7e-4ece-832d-6fdaa98b2964" (UID: "43abd798-ae7e-4ece-832d-6fdaa98b2964"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.397416 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.398859 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.398953 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.399015 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.399074 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.399153 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9kwb\" (UniqueName: \"kubernetes.io/projected/43abd798-ae7e-4ece-832d-6fdaa98b2964-kube-api-access-b9kwb\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.399211 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/43abd798-ae7e-4ece-832d-6fdaa98b2964-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.399257 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43abd798-ae7e-4ece-832d-6fdaa98b2964-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.406506 5030 scope.go:117] "RemoveContainer" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.433924 5030 scope.go:117] "RemoveContainer" containerID="da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.434434 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570\": container with ID starting with da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570 not found: ID does not exist" containerID="da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.434536 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570"} err="failed to get container status \"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570\": rpc error: code = NotFound desc = could not find container \"da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570\": container with ID starting with da7233d390e626d190df0cac1d1421183c13d7eb8a698cf1b8ff54186be92570 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.434651 5030 scope.go:117] "RemoveContainer" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.434990 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e\": container with ID starting with 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e not found: ID does not exist" containerID="708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.435095 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e"} err="failed to get container status \"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e\": rpc error: code = NotFound desc = could not find container \"708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e\": container with ID starting with 708fe449e1bc65c02d8e214b3d18ae7e43c7b3bc4ef1f5a2113fe7f352e2349e not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.435171 5030 scope.go:117] "RemoveContainer" containerID="7c4ac03000a557b6ca65c98eee26a52d4cc8d5dbabc00f8ad6656e9f79e2852b" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.456701 5030 scope.go:117] "RemoveContainer" containerID="d783b170b26f0401eb296e7f0305718beb7face59f74c18d6d21d96c3a5eb405" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.473045 5030 scope.go:117] "RemoveContainer" containerID="75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.491675 5030 scope.go:117] "RemoveContainer" containerID="e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501056 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clw6n\" (UniqueName: \"kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501322 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501408 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.501762 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys\") pod \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\" (UID: \"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480\") " Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.504874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.505520 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n" (OuterVolumeSpecName: "kube-api-access-clw6n") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "kube-api-access-clw6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.506184 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.506293 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts" (OuterVolumeSpecName: "scripts") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.510855 5030 scope.go:117] "RemoveContainer" containerID="75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.511124 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f\": container with ID starting with 75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f not found: ID does not exist" containerID="75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.511153 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f"} err="failed to get container status \"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f\": rpc error: code = NotFound desc = could not find container \"75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f\": container with ID starting with 75fcc812031dfb7a39ffddb733df6899254729c5a9a8ee8cb3f4a819ceb7cb1f not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.511179 5030 scope.go:117] "RemoveContainer" containerID="e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497" Mar 16 13:33:05 crc kubenswrapper[5030]: E0316 13:33:05.511480 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497\": container with ID starting with e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497 not found: ID does not exist" containerID="e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.511522 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497"} err="failed to get container status \"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497\": rpc error: code = NotFound desc = could not find container \"e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497\": container with ID starting with e92935d435725c6990f738d106df0501cf86263cb9761646379629327aa89497 not found: ID does not exist" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.522227 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data" (OuterVolumeSpecName: "config-data") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.532717 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.535333 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.546159 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" (UID: "7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605011 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605397 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605409 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605419 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605430 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605439 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clw6n\" (UniqueName: \"kubernetes.io/projected/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-kube-api-access-clw6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605450 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.605460 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.957613 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c38aa3d-b633-4f15-904d-328e49583cf8" path="/var/lib/kubelet/pods/0c38aa3d-b633-4f15-904d-328e49583cf8/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.958156 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" path="/var/lib/kubelet/pods/0d503a85-7499-44b6-af0e-4bd9010b5c52/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.958823 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" path="/var/lib/kubelet/pods/1abced1c-3510-4271-80d8-8ab52bf51a61/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.959950 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" path="/var/lib/kubelet/pods/2c36e489-01b1-4370-a5e9-d9794d6fb52d/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.960491 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4851d886-9022-4ea6-90c8-067d86e198df" path="/var/lib/kubelet/pods/4851d886-9022-4ea6-90c8-067d86e198df/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.961066 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cf5bc21-928d-47a3-9696-4580afc7bb2e" path="/var/lib/kubelet/pods/5cf5bc21-928d-47a3-9696-4580afc7bb2e/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.961472 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60ea6f78-b45a-4f57-8dc9-114516e29b32" path="/var/lib/kubelet/pods/60ea6f78-b45a-4f57-8dc9-114516e29b32/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.962522 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" path="/var/lib/kubelet/pods/61cc2bed-6ab0-42bd-af61-35d6909e80d8/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.963191 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" path="/var/lib/kubelet/pods/6cfc409f-2388-40f5-9b7e-c9c6d8064c1f/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.964165 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" path="/var/lib/kubelet/pods/ac7780d2-4432-4598-9894-1d08e2aa1133/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.965398 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" path="/var/lib/kubelet/pods/b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e/volumes" Mar 16 13:33:05 crc kubenswrapper[5030]: I0316 13:33:05.966017 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" path="/var/lib/kubelet/pods/db6ddcb0-3f63-467f-92d8-67320056f141/volumes" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.007271 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" containerID="9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319" exitCode=0 Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.007371 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" event={"ID":"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480","Type":"ContainerDied","Data":"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319"} Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.007401 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" event={"ID":"7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480","Type":"ContainerDied","Data":"07628f0810624dee2786623e0ea239fe35939e1541ff02ddbaa79069de940503"} Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.007430 5030 scope.go:117] "RemoveContainer" containerID="9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.007568 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-68545f5864-422wp" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.015720 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.015972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-849d469cc6-28g6b" event={"ID":"43abd798-ae7e-4ece-832d-6fdaa98b2964","Type":"ContainerDied","Data":"c43e8e79ce69b81922a4932fe123cfad31199b2f69699b5d01cdae54012fd37d"} Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.047342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.065970 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-68545f5864-422wp"] Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.065994 5030 scope.go:117] "RemoveContainer" containerID="9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319" Mar 16 13:33:06 crc kubenswrapper[5030]: E0316 13:33:06.069197 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319\": container with ID starting with 9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319 not found: ID does not exist" containerID="9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.069503 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319"} err="failed to get container status \"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319\": rpc error: code = NotFound desc = could not find container \"9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319\": container with ID starting with 9bc7a872922295d1e18ccbc07a33bada2917eb9ce641b855931023e9c9e52319 not found: ID does not exist" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.069573 5030 scope.go:117] "RemoveContainer" containerID="d55195694cad34a2cc8da2bd114e7f31ad1129b25da6cb15dd183c6a849560ac" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.070337 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.082801 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-849d469cc6-28g6b"] Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.092686 5030 scope.go:117] "RemoveContainer" containerID="3fb2ce245e24c48262e813f03a90e12d65a1defd05e5c7aedab7328f27348c56" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.602921 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.216:5671: connect: connection refused" Mar 16 13:33:06 crc kubenswrapper[5030]: I0316 13:33:06.607401 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.217:5671: connect: connection refused" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.305519 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.22:8080/healthcheck\": context deadline exceeded" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.314189 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-599cdf5ccd-t7fmv" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.1.22:8080/healthcheck\": context deadline exceeded" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.612902 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642531 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642577 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxdd2\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642734 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642811 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642833 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642865 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642917 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.642956 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret\") pod \"0058e628-e03b-4086-806e-da6878e1539f\" (UID: \"0058e628-e03b-4086-806e-da6878e1539f\") " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.647480 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.647699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.647788 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.650692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.651328 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage18-crc" (OuterVolumeSpecName: "persistence") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "local-storage18-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.651523 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2" (OuterVolumeSpecName: "kube-api-access-wxdd2") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "kube-api-access-wxdd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.651529 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info" (OuterVolumeSpecName: "pod-info") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.665988 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.666355 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data" (OuterVolumeSpecName: "config-data") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.681597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf" (OuterVolumeSpecName: "server-conf") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.707856 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "0058e628-e03b-4086-806e-da6878e1539f" (UID: "0058e628-e03b-4086-806e-da6878e1539f"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.745840 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746042 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746132 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxdd2\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-kube-api-access-wxdd2\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: E0316 13:33:07.745933 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:07 crc kubenswrapper[5030]: E0316 13:33:07.746289 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data podName:e8553f68-b65a-4220-8445-7fb5e36ba36b nodeName:}" failed. No retries permitted until 2026-03-16 13:33:15.746261749 +0000 UTC m=+1640.145574296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data") pod "rabbitmq-cell1-server-0" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746195 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746341 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0058e628-e03b-4086-806e-da6878e1539f-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746369 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" " Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746381 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746391 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746401 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0058e628-e03b-4086-806e-da6878e1539f-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746412 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0058e628-e03b-4086-806e-da6878e1539f-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.746421 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0058e628-e03b-4086-806e-da6878e1539f-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.757446 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage18-crc" (UniqueName: "kubernetes.io/local-volume/local-storage18-crc") on node "crc" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.848741 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage18-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage18-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.961641 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" path="/var/lib/kubelet/pods/43abd798-ae7e-4ece-832d-6fdaa98b2964/volumes" Mar 16 13:33:07 crc kubenswrapper[5030]: I0316 13:33:07.962234 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" path="/var/lib/kubelet/pods/7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480/volumes" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.041110 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.086114 5030 generic.go:358] "Generic (PLEG): container finished" podID="0058e628-e03b-4086-806e-da6878e1539f" containerID="8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463" exitCode=0 Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.086484 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerDied","Data":"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463"} Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.086521 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0058e628-e03b-4086-806e-da6878e1539f","Type":"ContainerDied","Data":"f82c2e403d84fff0b90ea40d3e548e144aae168888c72897cefaab7fea4a0930"} Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.086563 5030 scope.go:117] "RemoveContainer" containerID="8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.086733 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.092400 5030 generic.go:358] "Generic (PLEG): container finished" podID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerID="8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737" exitCode=0 Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.092587 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerDied","Data":"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737"} Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.092611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"e8553f68-b65a-4220-8445-7fb5e36ba36b","Type":"ContainerDied","Data":"2c15cf6d3de37e6b1f423eeb64ba91287bbc9f17548b1a91ef5138853a44240c"} Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.092789 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.111962 5030 scope.go:117] "RemoveContainer" containerID="dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.111964 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.115182 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.128751 5030 scope.go:117] "RemoveContainer" containerID="8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463" Mar 16 13:33:08 crc kubenswrapper[5030]: E0316 13:33:08.129208 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463\": container with ID starting with 8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463 not found: ID does not exist" containerID="8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.129259 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463"} err="failed to get container status \"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463\": rpc error: code = NotFound desc = could not find container \"8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463\": container with ID starting with 8333c2cc0bbc237649c2f2025bccfca18ba27951d8f443f7615c0b50616a4463 not found: ID does not exist" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.129288 5030 scope.go:117] "RemoveContainer" containerID="dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4" Mar 16 13:33:08 crc kubenswrapper[5030]: E0316 13:33:08.129596 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4\": container with ID starting with dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4 not found: ID does not exist" containerID="dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.129626 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4"} err="failed to get container status \"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4\": rpc error: code = NotFound desc = could not find container \"dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4\": container with ID starting with dc8ef16284a2fe5c416f4c98d2f132107fa754b570b21676be69fe8f2f371cd4 not found: ID does not exist" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.129641 5030 scope.go:117] "RemoveContainer" containerID="8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.151881 5030 scope.go:117] "RemoveContainer" containerID="5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.152985 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153094 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153213 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153237 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153274 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153294 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwqtj\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.153334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154187 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154681 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.154785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd\") pod \"e8553f68-b65a-4220-8445-7fb5e36ba36b\" (UID: \"e8553f68-b65a-4220-8445-7fb5e36ba36b\") " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.155437 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.155456 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.155464 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.156751 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.157784 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj" (OuterVolumeSpecName: "kube-api-access-mwqtj") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "kube-api-access-mwqtj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.158064 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.158529 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "persistence") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.160367 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info" (OuterVolumeSpecName: "pod-info") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.173326 5030 scope.go:117] "RemoveContainer" containerID="8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737" Mar 16 13:33:08 crc kubenswrapper[5030]: E0316 13:33:08.173756 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737\": container with ID starting with 8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737 not found: ID does not exist" containerID="8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.173795 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737"} err="failed to get container status \"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737\": rpc error: code = NotFound desc = could not find container \"8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737\": container with ID starting with 8a40d23987ae8c736e58ccc84e88372893af8188eeb9691bd8d278dd11902737 not found: ID does not exist" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.173815 5030 scope.go:117] "RemoveContainer" containerID="5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46" Mar 16 13:33:08 crc kubenswrapper[5030]: E0316 13:33:08.174214 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46\": container with ID starting with 5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46 not found: ID does not exist" containerID="5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.174252 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46"} err="failed to get container status \"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46\": rpc error: code = NotFound desc = could not find container \"5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46\": container with ID starting with 5743dfd4889da34ef15eff442c90127a3df5379cce59708042706d7a099f6c46 not found: ID does not exist" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.175575 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data" (OuterVolumeSpecName: "config-data") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.181355 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf" (OuterVolumeSpecName: "server-conf") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.209849 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "e8553f68-b65a-4220-8445-7fb5e36ba36b" (UID: "e8553f68-b65a-4220-8445-7fb5e36ba36b"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257739 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/e8553f68-b65a-4220-8445-7fb5e36ba36b-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257770 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257782 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwqtj\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-kube-api-access-mwqtj\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257798 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/e8553f68-b65a-4220-8445-7fb5e36ba36b-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257826 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257834 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/e8553f68-b65a-4220-8445-7fb5e36ba36b-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257846 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.257857 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/e8553f68-b65a-4220-8445-7fb5e36ba36b-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.273689 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.359672 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.433703 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:08 crc kubenswrapper[5030]: I0316 13:33:08.440155 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:09 crc kubenswrapper[5030]: I0316 13:33:09.955938 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0058e628-e03b-4086-806e-da6878e1539f" path="/var/lib/kubelet/pods/0058e628-e03b-4086-806e-da6878e1539f/volumes" Mar 16 13:33:09 crc kubenswrapper[5030]: I0316 13:33:09.957107 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" path="/var/lib/kubelet/pods/e8553f68-b65a-4220-8445-7fb5e36ba36b/volumes" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.170336 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.177514 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.177951 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" containerID="cri-o://bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" gracePeriod=30 Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.184774 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-rrzj6"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.193056 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.198686 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.198928 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" containerID="cri-o://acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" gracePeriod=30 Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.203148 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-httfh"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.207016 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.207200 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" containerID="cri-o://f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" gracePeriod=30 Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.211009 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.212076 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="a7890951-cd05-4236-a0db-e6f9063aacdb" containerName="memcached" containerID="cri-o://9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9" gracePeriod=30 Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.798994 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.906651 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs\") pod \"a7890951-cd05-4236-a0db-e6f9063aacdb\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.906773 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle\") pod \"a7890951-cd05-4236-a0db-e6f9063aacdb\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.906823 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config\") pod \"a7890951-cd05-4236-a0db-e6f9063aacdb\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.906892 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cklm\" (UniqueName: \"kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm\") pod \"a7890951-cd05-4236-a0db-e6f9063aacdb\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.906972 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data\") pod \"a7890951-cd05-4236-a0db-e6f9063aacdb\" (UID: \"a7890951-cd05-4236-a0db-e6f9063aacdb\") " Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.908030 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "a7890951-cd05-4236-a0db-e6f9063aacdb" (UID: "a7890951-cd05-4236-a0db-e6f9063aacdb"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.908103 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data" (OuterVolumeSpecName: "config-data") pod "a7890951-cd05-4236-a0db-e6f9063aacdb" (UID: "a7890951-cd05-4236-a0db-e6f9063aacdb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.925021 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm" (OuterVolumeSpecName: "kube-api-access-8cklm") pod "a7890951-cd05-4236-a0db-e6f9063aacdb" (UID: "a7890951-cd05-4236-a0db-e6f9063aacdb"). InnerVolumeSpecName "kube-api-access-8cklm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.928107 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7890951-cd05-4236-a0db-e6f9063aacdb" (UID: "a7890951-cd05-4236-a0db-e6f9063aacdb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:10 crc kubenswrapper[5030]: I0316 13:33:10.940277 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "a7890951-cd05-4236-a0db-e6f9063aacdb" (UID: "a7890951-cd05-4236-a0db-e6f9063aacdb"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.008950 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cklm\" (UniqueName: \"kubernetes.io/projected/a7890951-cd05-4236-a0db-e6f9063aacdb-kube-api-access-8cklm\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.008981 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.008992 5030 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.009005 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7890951-cd05-4236-a0db-e6f9063aacdb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.009014 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/a7890951-cd05-4236-a0db-e6f9063aacdb-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.042751 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.102806 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.103229 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="dnsmasq-dns" containerID="cri-o://6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900" gracePeriod=10 Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.167275 5030 generic.go:358] "Generic (PLEG): container finished" podID="a7890951-cd05-4236-a0db-e6f9063aacdb" containerID="9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9" exitCode=0 Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.167370 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a7890951-cd05-4236-a0db-e6f9063aacdb","Type":"ContainerDied","Data":"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9"} Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.167455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"a7890951-cd05-4236-a0db-e6f9063aacdb","Type":"ContainerDied","Data":"28a292647f74e78706c9254ceb9316a0ebe9e2b9b69a4cbdb98cdcb3ca921487"} Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.167400 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.167485 5030 scope.go:117] "RemoveContainer" containerID="9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.194611 5030 scope.go:117] "RemoveContainer" containerID="9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9" Mar 16 13:33:11 crc kubenswrapper[5030]: E0316 13:33:11.194969 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9\": container with ID starting with 9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9 not found: ID does not exist" containerID="9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.195002 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9"} err="failed to get container status \"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9\": rpc error: code = NotFound desc = could not find container \"9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9\": container with ID starting with 9ffa55c13c1067c2a880ee1d6b94be9bdfed985cb8aa168ccc5bc734b95caaf9 not found: ID does not exist" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.205382 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.211105 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.544653 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.626239 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9l6\" (UniqueName: \"kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6\") pod \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.626458 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config\") pod \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.626530 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0\") pod \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.626674 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc\") pod \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\" (UID: \"fc10a42d-e0a1-473e-9a6e-aad88b2d8502\") " Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.633008 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6" (OuterVolumeSpecName: "kube-api-access-mv9l6") pod "fc10a42d-e0a1-473e-9a6e-aad88b2d8502" (UID: "fc10a42d-e0a1-473e-9a6e-aad88b2d8502"). InnerVolumeSpecName "kube-api-access-mv9l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.660389 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config" (OuterVolumeSpecName: "config") pod "fc10a42d-e0a1-473e-9a6e-aad88b2d8502" (UID: "fc10a42d-e0a1-473e-9a6e-aad88b2d8502"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.660832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "fc10a42d-e0a1-473e-9a6e-aad88b2d8502" (UID: "fc10a42d-e0a1-473e-9a6e-aad88b2d8502"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.671205 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "fc10a42d-e0a1-473e-9a6e-aad88b2d8502" (UID: "fc10a42d-e0a1-473e-9a6e-aad88b2d8502"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.728617 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.728642 5030 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.728654 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.728664 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9l6\" (UniqueName: \"kubernetes.io/projected/fc10a42d-e0a1-473e-9a6e-aad88b2d8502-kube-api-access-mv9l6\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.957540 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc340be-9e7c-4e8c-82ce-c69304641291" path="/var/lib/kubelet/pods/1cc340be-9e7c-4e8c-82ce-c69304641291/volumes" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.958282 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7890951-cd05-4236-a0db-e6f9063aacdb" path="/var/lib/kubelet/pods/a7890951-cd05-4236-a0db-e6f9063aacdb/volumes" Mar 16 13:33:11 crc kubenswrapper[5030]: I0316 13:33:11.958836 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1762a7e-1637-45a8-923c-bc0514d708d4" path="/var/lib/kubelet/pods/d1762a7e-1637-45a8-923c-bc0514d708d4/volumes" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.181806 5030 generic.go:358] "Generic (PLEG): container finished" podID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerID="6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900" exitCode=0 Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.182112 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.182110 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" event={"ID":"fc10a42d-e0a1-473e-9a6e-aad88b2d8502","Type":"ContainerDied","Data":"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900"} Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.182288 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g" event={"ID":"fc10a42d-e0a1-473e-9a6e-aad88b2d8502","Type":"ContainerDied","Data":"3a348039a73bd1474791f577dd6e6601508e1c148a6dff29807300ef2f997b4b"} Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.182343 5030 scope.go:117] "RemoveContainer" containerID="6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.207424 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.210567 5030 scope.go:117] "RemoveContainer" containerID="2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.211380 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-58df95f9c7-kbs5g"] Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.229244 5030 scope.go:117] "RemoveContainer" containerID="6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900" Mar 16 13:33:12 crc kubenswrapper[5030]: E0316 13:33:12.229721 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900\": container with ID starting with 6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900 not found: ID does not exist" containerID="6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.229771 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900"} err="failed to get container status \"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900\": rpc error: code = NotFound desc = could not find container \"6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900\": container with ID starting with 6f888755225a5fb479605c1ab8c62929af9052f157a3716493ecad3a4b71a900 not found: ID does not exist" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.229802 5030 scope.go:117] "RemoveContainer" containerID="2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750" Mar 16 13:33:12 crc kubenswrapper[5030]: E0316 13:33:12.230275 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750\": container with ID starting with 2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750 not found: ID does not exist" containerID="2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750" Mar 16 13:33:12 crc kubenswrapper[5030]: I0316 13:33:12.230330 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750"} err="failed to get container status \"2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750\": rpc error: code = NotFound desc = could not find container \"2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750\": container with ID starting with 2042482843a2bdc1f95d0391282c1808f6570ad7b7664919e25e7c90a64a3750 not found: ID does not exist" Mar 16 13:33:13 crc kubenswrapper[5030]: E0316 13:33:13.093316 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:13 crc kubenswrapper[5030]: E0316 13:33:13.096156 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:13 crc kubenswrapper[5030]: E0316 13:33:13.098111 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:13 crc kubenswrapper[5030]: E0316 13:33:13.098195 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:13 crc kubenswrapper[5030]: I0316 13:33:13.947571 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:33:13 crc kubenswrapper[5030]: E0316 13:33:13.947818 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:33:13 crc kubenswrapper[5030]: I0316 13:33:13.960181 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" path="/var/lib/kubelet/pods/fc10a42d-e0a1-473e-9a6e-aad88b2d8502/volumes" Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.306301 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.308387 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.310155 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.310187 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.416260 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.61:8774/\": read tcp 10.217.0.2:56792->10.217.1.61:8774: read: connection reset by peer" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.416598 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.61:8774/\": read tcp 10.217.0.2:56808->10.217.1.61:8774: read: connection reset by peer" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.487879 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.62:3000/\": dial tcp 10.217.1.62:3000: connect: connection refused" Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.630680 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.632935 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.634288 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.634332 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.700913 5030 scope.go:117] "RemoveContainer" containerID="1654ea9fb2ca753ee24b020c3fce08cd54c83140b9de3b532d2776ed18c83032" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.744376 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.762324 5030 scope.go:117] "RemoveContainer" containerID="91776bb4f4d8bc3fefd4dcd524cf5a83d8dc26164894a583075c5f1fd6befffd" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.876442 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.876545 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.876637 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.876711 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npvmd\" (UniqueName: \"kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.876880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.877076 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.877197 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs" (OuterVolumeSpecName: "logs") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.877488 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.883432 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd" (OuterVolumeSpecName: "kube-api-access-npvmd") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "kube-api-access-npvmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.910129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.913067 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:14 crc kubenswrapper[5030]: E0316 13:33:14.913926 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs podName:69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f nodeName:}" failed. No retries permitted until 2026-03-16 13:33:15.413887058 +0000 UTC m=+1639.813199605 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f") : error deleting /var/lib/kubelet/pods/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f/volume-subpaths: remove /var/lib/kubelet/pods/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f/volume-subpaths: no such file or directory Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.916968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data" (OuterVolumeSpecName: "config-data") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.980247 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.980301 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.980318 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npvmd\" (UniqueName: \"kubernetes.io/projected/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-kube-api-access-npvmd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:14 crc kubenswrapper[5030]: I0316 13:33:14.980342 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.222644 5030 generic.go:358] "Generic (PLEG): container finished" podID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerID="2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a" exitCode=0 Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.222730 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.222728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerDied","Data":"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a"} Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.222769 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f","Type":"ContainerDied","Data":"961efe0edf994537f6ac0cde21d708950738004824b6283a115ea16090296ef9"} Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.222794 5030 scope.go:117] "RemoveContainer" containerID="2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a" Mar 16 13:33:15 crc kubenswrapper[5030]: E0316 13:33:15.228697 5030 kuberuntime_gc.go:389] "Failed to remove container log dead symlink" err="remove /var/log/containers/nova-api-0_openstack-kuttl-tests_nova-api-api-2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a.log: no such file or directory" path="/var/log/containers/nova-api-0_openstack-kuttl-tests_nova-api-api-2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a.log" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.242069 5030 scope.go:117] "RemoveContainer" containerID="19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.255476 5030 scope.go:117] "RemoveContainer" containerID="2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a" Mar 16 13:33:15 crc kubenswrapper[5030]: E0316 13:33:15.255744 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a\": container with ID starting with 2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a not found: ID does not exist" containerID="2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.255791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a"} err="failed to get container status \"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a\": rpc error: code = NotFound desc = could not find container \"2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a\": container with ID starting with 2374b2fd2c56719e68fb25e00c6cca82653641e9edbece3ef1d8acd19874aa5a not found: ID does not exist" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.255814 5030 scope.go:117] "RemoveContainer" containerID="19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755" Mar 16 13:33:15 crc kubenswrapper[5030]: E0316 13:33:15.256151 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755\": container with ID starting with 19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755 not found: ID does not exist" containerID="19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.256185 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755"} err="failed to get container status \"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755\": rpc error: code = NotFound desc = could not find container \"19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755\": container with ID starting with 19e12dada317a47b617e732324a3357fb21c1d0203feb216a5afb8e48ecab755 not found: ID does not exist" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.491752 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") pod \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\" (UID: \"69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f\") " Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.495134 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" (UID: "69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.558294 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.562581 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.593972 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:15 crc kubenswrapper[5030]: I0316 13:33:15.960677 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" path="/var/lib/kubelet/pods/69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f/volumes" Mar 16 13:33:18 crc kubenswrapper[5030]: E0316 13:33:18.091763 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:18 crc kubenswrapper[5030]: E0316 13:33:18.093585 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:18 crc kubenswrapper[5030]: E0316 13:33:18.095578 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:18 crc kubenswrapper[5030]: E0316 13:33:18.095613 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.305785 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.307581 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.308672 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.308721 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.629382 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.631162 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.632932 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:19 crc kubenswrapper[5030]: E0316 13:33:19.633044 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:23 crc kubenswrapper[5030]: E0316 13:33:23.092511 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:23 crc kubenswrapper[5030]: E0316 13:33:23.094094 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:23 crc kubenswrapper[5030]: E0316 13:33:23.095779 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:23 crc kubenswrapper[5030]: E0316 13:33:23.095878 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:23 crc kubenswrapper[5030]: I0316 13:33:23.543829 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.12:9696/\": dial tcp 10.217.1.12:9696: connect: connection refused" Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.306540 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.308247 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.311768 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.311813 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.629757 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.631233 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.634366 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.634442 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:24 crc kubenswrapper[5030]: I0316 13:33:24.946480 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:33:24 crc kubenswrapper[5030]: E0316 13:33:24.947284 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:33:28 crc kubenswrapper[5030]: E0316 13:33:28.091816 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:28 crc kubenswrapper[5030]: E0316 13:33:28.093532 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:28 crc kubenswrapper[5030]: E0316 13:33:28.095171 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:28 crc kubenswrapper[5030]: E0316 13:33:28.095217 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.307239 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.308946 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.310231 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.310316 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.629507 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.631409 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.634944 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:29 crc kubenswrapper[5030]: E0316 13:33:29.634994 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.383795 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-95d576b6b-prbcl_35df6249-dce2-4828-b469-2fda1b340a1b/neutron-api/0.log" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.384193 5030 generic.go:358] "Generic (PLEG): container finished" podID="35df6249-dce2-4828-b469-2fda1b340a1b" containerID="0bb81a06629fb460fc5c38fad0e1818a7859f49a12fe3dd72b3fa1175317dcbe" exitCode=137 Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.384301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerDied","Data":"0bb81a06629fb460fc5c38fad0e1818a7859f49a12fe3dd72b3fa1175317dcbe"} Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.523448 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-95d576b6b-prbcl_35df6249-dce2-4828-b469-2fda1b340a1b/neutron-api/0.log" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.523809 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.632951 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm5dv\" (UniqueName: \"kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633051 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633186 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633308 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633368 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.633394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config\") pod \"35df6249-dce2-4828-b469-2fda1b340a1b\" (UID: \"35df6249-dce2-4828-b469-2fda1b340a1b\") " Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.640158 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.640589 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv" (OuterVolumeSpecName: "kube-api-access-pm5dv") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "kube-api-access-pm5dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.669160 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.669544 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.671128 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.674419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config" (OuterVolumeSpecName: "config") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.680905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "35df6249-dce2-4828-b469-2fda1b340a1b" (UID: "35df6249-dce2-4828-b469-2fda1b340a1b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737067 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm5dv\" (UniqueName: \"kubernetes.io/projected/35df6249-dce2-4828-b469-2fda1b340a1b-kube-api-access-pm5dv\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737403 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737414 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737423 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737433 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737445 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:30 crc kubenswrapper[5030]: I0316 13:33:30.737459 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/35df6249-dce2-4828-b469-2fda1b340a1b-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.011936 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.144849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.145076 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.145144 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.145180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gwl\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.145222 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.145359 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle\") pod \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\" (UID: \"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.147735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache" (OuterVolumeSpecName: "cache") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.147748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock" (OuterVolumeSpecName: "lock") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.150534 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "swift") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.150829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.151351 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl" (OuterVolumeSpecName: "kube-api-access-q2gwl") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "kube-api-access-q2gwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.247720 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.247748 5030 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-cache\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.247758 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2gwl\" (UniqueName: \"kubernetes.io/projected/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-kube-api-access-q2gwl\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.247791 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.247801 5030 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.257979 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.347519 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" (UID: "7a6edfca-35e3-4b2d-8b5d-2c8e8818360f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.350126 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.350148 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.358210 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.360577 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.404028 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb22a037-ccd0-4346-b587-e41a671f1535" containerID="1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2" exitCode=137 Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.404429 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerDied","Data":"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.404467 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eb22a037-ccd0-4346-b587-e41a671f1535","Type":"ContainerDied","Data":"03c023bf5e091270d1a4ebf9457d0a14a809a2ed3e7c07ecbbab2ded5025ec66"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.404489 5030 scope.go:117] "RemoveContainer" containerID="fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.404695 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.411871 5030 generic.go:358] "Generic (PLEG): container finished" podID="66b587a8-6b3d-4814-944c-60b475063c0e" containerID="2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e" exitCode=137 Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.412069 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerDied","Data":"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.412085 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"66b587a8-6b3d-4814-944c-60b475063c0e","Type":"ContainerDied","Data":"432e8a6c49df5022a065732fec6d3f98c81f1f3c2a48144fa09de7706b044410"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.412158 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.423143 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-95d576b6b-prbcl_35df6249-dce2-4828-b469-2fda1b340a1b/neutron-api/0.log" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.423345 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" event={"ID":"35df6249-dce2-4828-b469-2fda1b340a1b","Type":"ContainerDied","Data":"49fcccec27bee7cbab30f78fc2c78091405f1c57a8911ad6bee79abb0caf758d"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.423508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-95d576b6b-prbcl" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.443334 5030 scope.go:117] "RemoveContainer" containerID="1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.453608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.453658 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.453880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.453995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454131 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454213 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454388 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454492 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454634 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpmjw\" (UniqueName: \"kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454860 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.454958 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.455056 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data\") pod \"eb22a037-ccd0-4346-b587-e41a671f1535\" (UID: \"eb22a037-ccd0-4346-b587-e41a671f1535\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.455193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jcw4\" (UniqueName: \"kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4\") pod \"66b587a8-6b3d-4814-944c-60b475063c0e\" (UID: \"66b587a8-6b3d-4814-944c-60b475063c0e\") " Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.455263 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.455902 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eb22a037-ccd0-4346-b587-e41a671f1535-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.455978 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.457083 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.458412 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.459660 5030 generic.go:358] "Generic (PLEG): container finished" podID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerID="1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58" exitCode=137 Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.459752 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.459819 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"7a6edfca-35e3-4b2d-8b5d-2c8e8818360f","Type":"ContainerDied","Data":"3ddc1346770bc82396349a4f9a2677f8bcdb36122c663d242a47f1a78bb4e8ca"} Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.459851 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.463447 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts" (OuterVolumeSpecName: "scripts") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.463919 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.464868 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw" (OuterVolumeSpecName: "kube-api-access-lpmjw") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "kube-api-access-lpmjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.467280 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4" (OuterVolumeSpecName: "kube-api-access-9jcw4") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "kube-api-access-9jcw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.468211 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts" (OuterVolumeSpecName: "scripts") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.468229 5030 scope.go:117] "RemoveContainer" containerID="fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.468734 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea\": container with ID starting with fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea not found: ID does not exist" containerID="fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.468830 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea"} err="failed to get container status \"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea\": rpc error: code = NotFound desc = could not find container \"fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea\": container with ID starting with fd055b74900c2f53504c5cb6f52c0259efd7996369a6c15e42bbfe3668cf0cea not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.468910 5030 scope.go:117] "RemoveContainer" containerID="1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.469484 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2\": container with ID starting with 1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2 not found: ID does not exist" containerID="1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.469593 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2"} err="failed to get container status \"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2\": rpc error: code = NotFound desc = could not find container \"1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2\": container with ID starting with 1abccdd2a55535514de3b30b3aedde864469b429e080aa7dbd9de62ae9c6d8e2 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.469674 5030 scope.go:117] "RemoveContainer" containerID="55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.473340 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-95d576b6b-prbcl"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.476369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.492675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.493732 5030 scope.go:117] "RemoveContainer" containerID="5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.495940 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.497240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.502701 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.511250 5030 scope.go:117] "RemoveContainer" containerID="2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.512276 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.516968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data" (OuterVolumeSpecName: "config-data") pod "66b587a8-6b3d-4814-944c-60b475063c0e" (UID: "66b587a8-6b3d-4814-944c-60b475063c0e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.519680 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data" (OuterVolumeSpecName: "config-data") pod "eb22a037-ccd0-4346-b587-e41a671f1535" (UID: "eb22a037-ccd0-4346-b587-e41a671f1535"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.529346 5030 scope.go:117] "RemoveContainer" containerID="c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.543670 5030 scope.go:117] "RemoveContainer" containerID="55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.543962 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff\": container with ID starting with 55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff not found: ID does not exist" containerID="55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544005 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff"} err="failed to get container status \"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff\": rpc error: code = NotFound desc = could not find container \"55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff\": container with ID starting with 55fd9a130c3c936bd35a115e01d2ec50f42f1947c831d97d7373d02f0704f1ff not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544037 5030 scope.go:117] "RemoveContainer" containerID="5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.544432 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f\": container with ID starting with 5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f not found: ID does not exist" containerID="5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544462 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f"} err="failed to get container status \"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f\": rpc error: code = NotFound desc = could not find container \"5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f\": container with ID starting with 5fab03213627be07da1228ce752caf16a9377820cc96c458bb6b98de8d1a551f not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544477 5030 scope.go:117] "RemoveContainer" containerID="2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.544806 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e\": container with ID starting with 2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e not found: ID does not exist" containerID="2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544901 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e"} err="failed to get container status \"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e\": rpc error: code = NotFound desc = could not find container \"2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e\": container with ID starting with 2c3e817af88eec7ce06574baa547e49fc4b709b199c91ab0600678354522b62e not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.544982 5030 scope.go:117] "RemoveContainer" containerID="c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.545424 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502\": container with ID starting with c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502 not found: ID does not exist" containerID="c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.545505 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502"} err="failed to get container status \"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502\": rpc error: code = NotFound desc = could not find container \"c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502\": container with ID starting with c446b774f35472f085af6e9eaee0c0fc700b99f1cbf6cff4470650be07449502 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.545587 5030 scope.go:117] "RemoveContainer" containerID="ad81b0809f607000870416a65320171bc2b3d5f7273f86c77dda2a555b68fd35" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558014 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jcw4\" (UniqueName: \"kubernetes.io/projected/66b587a8-6b3d-4814-944c-60b475063c0e-kube-api-access-9jcw4\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558037 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558047 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558055 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558064 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558072 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558080 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558089 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558102 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpmjw\" (UniqueName: \"kubernetes.io/projected/eb22a037-ccd0-4346-b587-e41a671f1535-kube-api-access-lpmjw\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558111 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/66b587a8-6b3d-4814-944c-60b475063c0e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558120 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/66b587a8-6b3d-4814-944c-60b475063c0e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.558128 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb22a037-ccd0-4346-b587-e41a671f1535-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.562316 5030 scope.go:117] "RemoveContainer" containerID="0bb81a06629fb460fc5c38fad0e1818a7859f49a12fe3dd72b3fa1175317dcbe" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.578263 5030 scope.go:117] "RemoveContainer" containerID="1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.594424 5030 scope.go:117] "RemoveContainer" containerID="ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.614119 5030 scope.go:117] "RemoveContainer" containerID="8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.640970 5030 scope.go:117] "RemoveContainer" containerID="80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.657195 5030 scope.go:117] "RemoveContainer" containerID="ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.674471 5030 scope.go:117] "RemoveContainer" containerID="ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.690678 5030 scope.go:117] "RemoveContainer" containerID="bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.704114 5030 scope.go:117] "RemoveContainer" containerID="f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.720150 5030 scope.go:117] "RemoveContainer" containerID="972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.734585 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.741521 5030 scope.go:117] "RemoveContainer" containerID="a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.745192 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.750628 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.758083 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.759143 5030 scope.go:117] "RemoveContainer" containerID="62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.773830 5030 scope.go:117] "RemoveContainer" containerID="6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.788004 5030 scope.go:117] "RemoveContainer" containerID="56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.806317 5030 scope.go:117] "RemoveContainer" containerID="d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.823080 5030 scope.go:117] "RemoveContainer" containerID="c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.841677 5030 scope.go:117] "RemoveContainer" containerID="1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.842135 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58\": container with ID starting with 1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58 not found: ID does not exist" containerID="1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.842197 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58"} err="failed to get container status \"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58\": rpc error: code = NotFound desc = could not find container \"1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58\": container with ID starting with 1e956193e6cc7d3d7b2da98fc4943187831d96a8c8e6c37aef1611007eaeba58 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.842230 5030 scope.go:117] "RemoveContainer" containerID="ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.842636 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428\": container with ID starting with ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428 not found: ID does not exist" containerID="ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.842680 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428"} err="failed to get container status \"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428\": rpc error: code = NotFound desc = could not find container \"ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428\": container with ID starting with ac585d36bf9ebecea094d837f7cc7b80565cbe0b3c8c9b352aed22a9a81ed428 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.842695 5030 scope.go:117] "RemoveContainer" containerID="8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.843074 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738\": container with ID starting with 8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738 not found: ID does not exist" containerID="8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.843126 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738"} err="failed to get container status \"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738\": rpc error: code = NotFound desc = could not find container \"8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738\": container with ID starting with 8b9f8a460809e09e2217a9a3470de3adbe6414b5e4b8e6af1e0c6686001e4738 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.843143 5030 scope.go:117] "RemoveContainer" containerID="80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.843510 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451\": container with ID starting with 80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451 not found: ID does not exist" containerID="80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.843576 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451"} err="failed to get container status \"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451\": rpc error: code = NotFound desc = could not find container \"80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451\": container with ID starting with 80485ebb4df97eb5476a92c8f35b161c745297f205cf47405d6a88a599d79451 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.843609 5030 scope.go:117] "RemoveContainer" containerID="ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.843973 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba\": container with ID starting with ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba not found: ID does not exist" containerID="ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844017 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba"} err="failed to get container status \"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba\": rpc error: code = NotFound desc = could not find container \"ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba\": container with ID starting with ad47065a62644b7137842c13323628007db4d2e209d13e8551f12843beb135ba not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844042 5030 scope.go:117] "RemoveContainer" containerID="ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.844437 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2\": container with ID starting with ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2 not found: ID does not exist" containerID="ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844501 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2"} err="failed to get container status \"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2\": rpc error: code = NotFound desc = could not find container \"ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2\": container with ID starting with ac799ee8aa72e8a615ad48485ae41c05d3a9c2d71ec4805ecbfed0bac500a5f2 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844586 5030 scope.go:117] "RemoveContainer" containerID="bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.844941 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca\": container with ID starting with bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca not found: ID does not exist" containerID="bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844975 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca"} err="failed to get container status \"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca\": rpc error: code = NotFound desc = could not find container \"bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca\": container with ID starting with bb659fdeec55a42351798f405c8f73542f874c1f9da21f970afcea2ba05917ca not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.844993 5030 scope.go:117] "RemoveContainer" containerID="f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.845358 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa\": container with ID starting with f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa not found: ID does not exist" containerID="f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.845388 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa"} err="failed to get container status \"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa\": rpc error: code = NotFound desc = could not find container \"f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa\": container with ID starting with f7724ac8166dbcefcdea2b3aa98ec91a20d4714ad1e7692c03aab1300ad1d3fa not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.845405 5030 scope.go:117] "RemoveContainer" containerID="972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.845786 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca\": container with ID starting with 972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca not found: ID does not exist" containerID="972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.845849 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca"} err="failed to get container status \"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca\": rpc error: code = NotFound desc = could not find container \"972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca\": container with ID starting with 972ae0be9dcc394d02a7b25dbc70598db2eb1bf0e6437ba0f4f9df61327d29ca not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.845867 5030 scope.go:117] "RemoveContainer" containerID="a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.846249 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63\": container with ID starting with a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63 not found: ID does not exist" containerID="a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.846312 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63"} err="failed to get container status \"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63\": rpc error: code = NotFound desc = could not find container \"a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63\": container with ID starting with a114fb0fe08ba9a7227f14cf37e3bd1a15528f7c2491edcf2ad9a818a08bad63 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.846352 5030 scope.go:117] "RemoveContainer" containerID="62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.846727 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3\": container with ID starting with 62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3 not found: ID does not exist" containerID="62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.846757 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3"} err="failed to get container status \"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3\": rpc error: code = NotFound desc = could not find container \"62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3\": container with ID starting with 62743c1ce18b37739647255d4424f62d43054edc6557adce9971a541f4d60cb3 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.846773 5030 scope.go:117] "RemoveContainer" containerID="6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.847086 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d\": container with ID starting with 6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d not found: ID does not exist" containerID="6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847134 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d"} err="failed to get container status \"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d\": rpc error: code = NotFound desc = could not find container \"6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d\": container with ID starting with 6bdefad039ad62c841441080440b7068f789e235d94e2d877816685c1d12ea2d not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847152 5030 scope.go:117] "RemoveContainer" containerID="56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.847403 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9\": container with ID starting with 56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9 not found: ID does not exist" containerID="56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847435 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9"} err="failed to get container status \"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9\": rpc error: code = NotFound desc = could not find container \"56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9\": container with ID starting with 56a954d2ae0ae0a443a59b7ca18d4ee2b6acd2b2da204d49e9035b55eae021b9 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847451 5030 scope.go:117] "RemoveContainer" containerID="d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.847726 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910\": container with ID starting with d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910 not found: ID does not exist" containerID="d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847760 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910"} err="failed to get container status \"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910\": rpc error: code = NotFound desc = could not find container \"d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910\": container with ID starting with d7abf019c2a24cfb5242e8d463f9b609331a2726b4c1943e114574527818a910 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.847784 5030 scope.go:117] "RemoveContainer" containerID="c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9" Mar 16 13:33:31 crc kubenswrapper[5030]: E0316 13:33:31.848048 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9\": container with ID starting with c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9 not found: ID does not exist" containerID="c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.848076 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9"} err="failed to get container status \"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9\": rpc error: code = NotFound desc = could not find container \"c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9\": container with ID starting with c5c09469414cddf9742ee55b865d32f8f6a6122b74e5787f310df58f90af71d9 not found: ID does not exist" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.957844 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" path="/var/lib/kubelet/pods/35df6249-dce2-4828-b469-2fda1b340a1b/volumes" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.958466 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" path="/var/lib/kubelet/pods/66b587a8-6b3d-4814-944c-60b475063c0e/volumes" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.959726 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" path="/var/lib/kubelet/pods/7a6edfca-35e3-4b2d-8b5d-2c8e8818360f/volumes" Mar 16 13:33:31 crc kubenswrapper[5030]: I0316 13:33:31.961519 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" path="/var/lib/kubelet/pods/eb22a037-ccd0-4346-b587-e41a671f1535/volumes" Mar 16 13:33:33 crc kubenswrapper[5030]: E0316 13:33:33.092773 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:33 crc kubenswrapper[5030]: E0316 13:33:33.094770 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:33 crc kubenswrapper[5030]: E0316 13:33:33.096481 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:33 crc kubenswrapper[5030]: E0316 13:33:33.096523 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.307441 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.310923 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.312875 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.312985 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.630333 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.632608 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.639414 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:34 crc kubenswrapper[5030]: E0316 13:33:34.639474 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:38 crc kubenswrapper[5030]: E0316 13:33:38.092147 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:38 crc kubenswrapper[5030]: E0316 13:33:38.094803 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:38 crc kubenswrapper[5030]: E0316 13:33:38.096011 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:33:38 crc kubenswrapper[5030]: E0316 13:33:38.096063 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.307073 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.316067 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.318404 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.318467 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.629542 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.631430 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.632958 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.633006 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:33:39 crc kubenswrapper[5030]: I0316 13:33:39.946400 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:33:39 crc kubenswrapper[5030]: E0316 13:33:39.947106 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.539414 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.585765 5030 generic.go:358] "Generic (PLEG): container finished" podID="fb916b3f-66ac-4845-9be0-713995168651" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" exitCode=137 Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.585931 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fb916b3f-66ac-4845-9be0-713995168651","Type":"ContainerDied","Data":"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af"} Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.585963 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"fb916b3f-66ac-4845-9be0-713995168651","Type":"ContainerDied","Data":"503e2e0d26dadca02b0e7091033a6acd307b1675957368dd56a39d815b03c548"} Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.586005 5030 scope.go:117] "RemoveContainer" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.586100 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.592285 5030 generic.go:358] "Generic (PLEG): container finished" podID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" exitCode=137 Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.592447 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7f88a0ef-8412-4a16-99f8-df4794c0da80","Type":"ContainerDied","Data":"f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b"} Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.594580 5030 generic.go:358] "Generic (PLEG): container finished" podID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" exitCode=137 Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.594977 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fb73c1c0-4b3e-4378-9919-625b1a3dc75d","Type":"ContainerDied","Data":"acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc"} Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.613091 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data\") pod \"fb916b3f-66ac-4845-9be0-713995168651\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.613155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle\") pod \"fb916b3f-66ac-4845-9be0-713995168651\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.613206 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgrv8\" (UniqueName: \"kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8\") pod \"fb916b3f-66ac-4845-9be0-713995168651\" (UID: \"fb916b3f-66ac-4845-9be0-713995168651\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.628135 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.628502 5030 scope.go:117] "RemoveContainer" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" Mar 16 13:33:40 crc kubenswrapper[5030]: E0316 13:33:40.629070 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af\": container with ID starting with bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af not found: ID does not exist" containerID="bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.629130 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af"} err="failed to get container status \"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af\": rpc error: code = NotFound desc = could not find container \"bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af\": container with ID starting with bfb1de70810bada1935bd7abf3a08276a0917cc1f281bef02ef12280946225af not found: ID does not exist" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.630203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8" (OuterVolumeSpecName: "kube-api-access-xgrv8") pod "fb916b3f-66ac-4845-9be0-713995168651" (UID: "fb916b3f-66ac-4845-9be0-713995168651"). InnerVolumeSpecName "kube-api-access-xgrv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.657830 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb916b3f-66ac-4845-9be0-713995168651" (UID: "fb916b3f-66ac-4845-9be0-713995168651"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.657865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data" (OuterVolumeSpecName: "config-data") pod "fb916b3f-66ac-4845-9be0-713995168651" (UID: "fb916b3f-66ac-4845-9be0-713995168651"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.658159 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.719180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data\") pod \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.719611 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrpq\" (UniqueName: \"kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq\") pod \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.719675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle\") pod \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\" (UID: \"fb73c1c0-4b3e-4378-9919-625b1a3dc75d\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.720200 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.720218 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgrv8\" (UniqueName: \"kubernetes.io/projected/fb916b3f-66ac-4845-9be0-713995168651-kube-api-access-xgrv8\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.720230 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb916b3f-66ac-4845-9be0-713995168651-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.725662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq" (OuterVolumeSpecName: "kube-api-access-wrrpq") pod "fb73c1c0-4b3e-4378-9919-625b1a3dc75d" (UID: "fb73c1c0-4b3e-4378-9919-625b1a3dc75d"). InnerVolumeSpecName "kube-api-access-wrrpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.735878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data" (OuterVolumeSpecName: "config-data") pod "fb73c1c0-4b3e-4378-9919-625b1a3dc75d" (UID: "fb73c1c0-4b3e-4378-9919-625b1a3dc75d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.736794 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb73c1c0-4b3e-4378-9919-625b1a3dc75d" (UID: "fb73c1c0-4b3e-4378-9919-625b1a3dc75d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.821329 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtx8z\" (UniqueName: \"kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z\") pod \"7f88a0ef-8412-4a16-99f8-df4794c0da80\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.821514 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data\") pod \"7f88a0ef-8412-4a16-99f8-df4794c0da80\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.821542 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle\") pod \"7f88a0ef-8412-4a16-99f8-df4794c0da80\" (UID: \"7f88a0ef-8412-4a16-99f8-df4794c0da80\") " Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.822255 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrpq\" (UniqueName: \"kubernetes.io/projected/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-kube-api-access-wrrpq\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.822276 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.822288 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fb73c1c0-4b3e-4378-9919-625b1a3dc75d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.824692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z" (OuterVolumeSpecName: "kube-api-access-dtx8z") pod "7f88a0ef-8412-4a16-99f8-df4794c0da80" (UID: "7f88a0ef-8412-4a16-99f8-df4794c0da80"). InnerVolumeSpecName "kube-api-access-dtx8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.838434 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data" (OuterVolumeSpecName: "config-data") pod "7f88a0ef-8412-4a16-99f8-df4794c0da80" (UID: "7f88a0ef-8412-4a16-99f8-df4794c0da80"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.851461 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f88a0ef-8412-4a16-99f8-df4794c0da80" (UID: "7f88a0ef-8412-4a16-99f8-df4794c0da80"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.916947 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.923026 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.924184 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtx8z\" (UniqueName: \"kubernetes.io/projected/7f88a0ef-8412-4a16-99f8-df4794c0da80-kube-api-access-dtx8z\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.924242 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:40 crc kubenswrapper[5030]: I0316 13:33:40.924256 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f88a0ef-8412-4a16-99f8-df4794c0da80-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.369016 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370133 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b2eb18-282d-42e9-9b68-f348caaad8d6" containerName="kube-state-metrics" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370158 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b2eb18-282d-42e9-9b68-f348caaad8d6" containerName="kube-state-metrics" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370172 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370182 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370200 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370207 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370218 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-reaper" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370225 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-reaper" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370235 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="mysql-bootstrap" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370240 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="mysql-bootstrap" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370246 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370251 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370261 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-central-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370269 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-central-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370280 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="rsync" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370285 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="rsync" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370290 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370296 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370302 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370306 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370312 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-expirer" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370316 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-expirer" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370325 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="dnsmasq-dns" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370331 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="dnsmasq-dns" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370340 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7890951-cd05-4236-a0db-e6f9063aacdb" containerName="memcached" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370345 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7890951-cd05-4236-a0db-e6f9063aacdb" containerName="memcached" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370352 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370357 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370368 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370373 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370378 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="sg-core" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370383 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="sg-core" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370389 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370393 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370399 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370405 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370411 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="cinder-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370416 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="cinder-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370424 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="setup-container" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370430 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="setup-container" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370438 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370444 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370451 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370455 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370462 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370466 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370474 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" containerName="keystone-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370478 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" containerName="keystone-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370489 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370493 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370498 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370503 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370509 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="ovsdbserver-sb" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370513 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="ovsdbserver-sb" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370522 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-notification-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370529 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-notification-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370540 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370560 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370570 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370576 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370585 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370592 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370599 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370607 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370617 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370621 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370630 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370635 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370642 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="ovn-northd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370647 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="ovn-northd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370652 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370657 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370668 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370676 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370681 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370688 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370693 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370699 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370704 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370710 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370715 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370721 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370726 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370737 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370741 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370748 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="init" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370753 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="init" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370761 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370766 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370775 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="probe" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370780 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="probe" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370788 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370793 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370800 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370806 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370818 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="swift-recon-cron" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370824 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="swift-recon-cron" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370830 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370835 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370842 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370846 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370853 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370858 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370865 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370871 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370876 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="setup-container" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370881 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="setup-container" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370888 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="mysql-bootstrap" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370894 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="mysql-bootstrap" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370900 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370906 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370913 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370918 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370925 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370930 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370936 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370941 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370948 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370954 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370960 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370966 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370972 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370978 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370984 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370991 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.370997 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-metadata" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371001 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-metadata" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371008 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371013 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371176 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371183 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371191 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371197 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371206 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="probe" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371213 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371218 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371224 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8553f68-b65a-4220-8445-7fb5e36ba36b" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371230 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" containerName="nova-scheduler-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371236 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371242 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-notification-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371248 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="sg-core" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371256 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371262 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371270 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e8bc6b9-aee5-417e-aa2b-24ce6ac1a480" containerName="keystone-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371276 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="66b587a8-6b3d-4814-944c-60b475063c0e" containerName="ceilometer-central-agent" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371281 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b5e6f15-6858-49ff-9570-39f56bf0b83b" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371290 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371296 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371304 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c84ed78-85e2-4260-ad5b-07b8dccdba58" containerName="proxy-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371310 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="ovsdbserver-sb" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371317 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-expirer" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371325 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb916b3f-66ac-4845-9be0-713995168651" containerName="nova-cell1-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371331 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371336 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371344 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-replicator" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371351 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4851d886-9022-4ea6-90c8-067d86e198df" containerName="barbican-worker-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371358 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371365 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371372 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371380 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb22a037-ccd0-4346-b587-e41a671f1535" containerName="cinder-scheduler" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371387 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-server" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371395 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61cc2bed-6ab0-42bd-af61-35d6909e80d8" containerName="ovn-northd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371400 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc10a42d-e0a1-473e-9a6e-aad88b2d8502" containerName="dnsmasq-dns" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371406 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7890951-cd05-4236-a0db-e6f9063aacdb" containerName="memcached" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371414 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371419 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cfc409f-2388-40f5-9b7e-c9c6d8064c1f" containerName="cinder-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371427 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" containerName="nova-cell0-conductor-conductor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371433 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1abced1c-3510-4271-80d8-8ab52bf51a61" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371439 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="container-updater" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371445 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0058e628-e03b-4086-806e-da6878e1539f" containerName="rabbitmq" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371453 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="43abd798-ae7e-4ece-832d-6fdaa98b2964" containerName="barbican-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371460 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="swift-recon-cron" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371467 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b712c4b1-f0a7-463d-b8d4-52ff8df7ee2e" containerName="placement-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371472 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="account-reaper" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371478 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371485 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="05b2eb18-282d-42e9-9b68-f348caaad8d6" containerName="kube-state-metrics" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371492 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0545996-15bd-4f02-9fcf-ca5a6ac6a4b9" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371498 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="35df6249-dce2-4828-b469-2fda1b340a1b" containerName="neutron-api" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371505 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-metadata" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371512 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="be781d6b-b9fc-40ad-a0b1-ad375d4533e6" containerName="galera" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371518 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="object-auditor" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371525 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371531 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac7780d2-4432-4598-9894-1d08e2aa1133" containerName="barbican-keystone-listener" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371537 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f14a2769-6106-4965-bd88-9feb130a7485" containerName="openstack-network-exporter" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371545 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="69e8aec9-7dc6-4c90-8d57-7b12f71cbf0f" containerName="nova-api-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371701 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-httpd" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371707 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="db6ddcb0-3f63-467f-92d8-67320056f141" containerName="nova-metadata-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371714 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a6edfca-35e3-4b2d-8b5d-2c8e8818360f" containerName="rsync" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371720 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d503a85-7499-44b6-af0e-4bd9010b5c52" containerName="glance-log" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371885 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.371895 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.372066 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c36e489-01b1-4370-a5e9-d9794d6fb52d" containerName="mariadb-account-create-update" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.377262 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.379107 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.379632 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.379918 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.379993 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-94gfb\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.380127 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.380319 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.380325 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.389824 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531258 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531823 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531849 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhns\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531948 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.531982 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.532001 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.532020 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.532055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.606949 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.614652 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.617662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7f88a0ef-8412-4a16-99f8-df4794c0da80","Type":"ContainerDied","Data":"87a0a974ac4fdb0caafdc2e01c3a4a5719f97aaa3f10e1357b1627cbad748997"} Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.617702 5030 scope.go:117] "RemoveContainer" containerID="f933f9ccd26dcd4597fa90ce2646940893c2abf3638c7c040e96d05209d9bd8b" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.617779 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.617818 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.618913 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.619920 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.620170 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.620371 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-j9qdp\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.620428 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.620575 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"fb73c1c0-4b3e-4378-9919-625b1a3dc75d","Type":"ContainerDied","Data":"fb384a57573f0a5b0ee9e367579e09ca439c3b7a6b0080ec05077c9770c79c9e"} Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.620753 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.621869 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.622806 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.634924 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.638682 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.638735 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.638761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.638929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.638975 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639003 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639856 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639931 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.639961 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhns\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.640856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.641089 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.641174 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") device mount path \"/mnt/openstack/pv20\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.642121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.646001 5030 scope.go:117] "RemoveContainer" containerID="acda65382b715355e5d7f1f595ca8ab0e025b52400d1d2db0fccf93f59572cbc" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.646738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.647125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.656298 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhns\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.657251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.658954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.660862 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"rabbitmq-server-0\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.666372 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.674620 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.680422 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.684560 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.696637 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.741989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742073 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742138 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742159 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742228 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742270 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742307 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhqcw\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.742432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843690 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843714 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843737 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843757 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843788 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhqcw\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843842 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843868 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.843913 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.844775 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.844791 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.845407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.845694 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.846003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.846136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.852132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.852688 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.852842 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.853474 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.861192 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhqcw\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.872643 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.933396 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.966634 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f88a0ef-8412-4a16-99f8-df4794c0da80" path="/var/lib/kubelet/pods/7f88a0ef-8412-4a16-99f8-df4794c0da80/volumes" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.967432 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb73c1c0-4b3e-4378-9919-625b1a3dc75d" path="/var/lib/kubelet/pods/fb73c1c0-4b3e-4378-9919-625b1a3dc75d/volumes" Mar 16 13:33:41 crc kubenswrapper[5030]: I0316 13:33:41.968263 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb916b3f-66ac-4845-9be0-713995168651" path="/var/lib/kubelet/pods/fb916b3f-66ac-4845-9be0-713995168651/volumes" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.094524 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.135667 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.139521 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.141839 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.142869 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.143014 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-2jslm\"" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.143272 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.147792 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.150075 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.250426 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.250481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.250508 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.250610 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.251007 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.251163 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.251209 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.251237 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scwgz\" (UniqueName: \"kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.352854 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355124 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355341 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355379 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scwgz\" (UniqueName: \"kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355439 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355620 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355685 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.355854 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.356465 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.356640 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.356875 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.356918 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.357347 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.360666 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.366076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.371890 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scwgz\" (UniqueName: \"kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.408030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-galera-0\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.459921 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.634162 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerStarted","Data":"ee62143cc84d1c33077c4c7c4b63e7f0c8a05630ed1a5ab0cb8577026412e13f"} Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.636192 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerStarted","Data":"28ed19b56cfae4e697f28ebf3cbcbd58ae19c0395535480f2263ba29fb215070"} Mar 16 13:33:42 crc kubenswrapper[5030]: I0316 13:33:42.858223 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:33:42 crc kubenswrapper[5030]: W0316 13:33:42.858622 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe778f00_60cf_413b_97d8_cd9a392fba6d.slice/crio-2d753b96382973673f6a8452c7220c3ec1bdfe6fb28b146055653365e72d9fbd WatchSource:0}: Error finding container 2d753b96382973673f6a8452c7220c3ec1bdfe6fb28b146055653365e72d9fbd: Status 404 returned error can't find the container with id 2d753b96382973673f6a8452c7220c3ec1bdfe6fb28b146055653365e72d9fbd Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.410804 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.415019 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.425603 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.425990 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-p9j5x\"" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.426420 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.426883 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.428428 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.576749 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.576885 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.576919 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.577184 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5mn\" (UniqueName: \"kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.577250 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.577285 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.577434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.577671 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.653827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerStarted","Data":"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd"} Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.657509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerStarted","Data":"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74"} Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.659771 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerStarted","Data":"81ee2f14a946a44c5d890a808c954079719d6a07c936f19544e5949bbcbbcf63"} Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.659807 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerStarted","Data":"2d753b96382973673f6a8452c7220c3ec1bdfe6fb28b146055653365e72d9fbd"} Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5mn\" (UniqueName: \"kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679448 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679532 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679686 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.679978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.680072 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.680081 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.680208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.680423 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") device mount path \"/mnt/openstack/pv07\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.681129 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.681578 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.681617 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.691276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.706778 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.711486 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5mn\" (UniqueName: \"kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.717790 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:43 crc kubenswrapper[5030]: I0316 13:33:43.742222 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.135378 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:33:44 crc kubenswrapper[5030]: W0316 13:33:44.137968 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf88d14c0_1c53_416d_a0bb_31c9cf2411a7.slice/crio-9b4a459854731b0f311064aaead1c533188a68569948d3835e17a3cbd0ffc7e8 WatchSource:0}: Error finding container 9b4a459854731b0f311064aaead1c533188a68569948d3835e17a3cbd0ffc7e8: Status 404 returned error can't find the container with id 9b4a459854731b0f311064aaead1c533188a68569948d3835e17a3cbd0ffc7e8 Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.670085 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerStarted","Data":"9dfed78faeaedbb4b0c30fdeb1c0c0c0a3e6a1d8527462b8ca622c76c463b9cc"} Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.670423 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerStarted","Data":"9b4a459854731b0f311064aaead1c533188a68569948d3835e17a3cbd0ffc7e8"} Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.959572 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.963950 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.966267 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-wdh5s\"" Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.967324 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.968138 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 13:33:44 crc kubenswrapper[5030]: I0316 13:33:44.980045 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.110609 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.110784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.110915 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.111368 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lq9\" (UniqueName: \"kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.111421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.213848 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.213937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.214005 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.214205 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42lq9\" (UniqueName: \"kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.214245 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.215392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.215601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.222271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.222407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.232796 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lq9\" (UniqueName: \"kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9\") pod \"memcached-0\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.281213 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.680382 5030 generic.go:358] "Generic (PLEG): container finished" podID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerID="81ee2f14a946a44c5d890a808c954079719d6a07c936f19544e5949bbcbbcf63" exitCode=0 Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.680478 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerDied","Data":"81ee2f14a946a44c5d890a808c954079719d6a07c936f19544e5949bbcbbcf63"} Mar 16 13:33:45 crc kubenswrapper[5030]: I0316 13:33:45.719957 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.647422 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.658527 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.658686 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.660388 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-d9tkl\"" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.693237 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f0791789-3d38-4e71-9a25-71e7dc03962a","Type":"ContainerStarted","Data":"594463b0fd26e0fe6288a169c53eb853c3467ebbe897c1026505aa10d2654049"} Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.693273 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f0791789-3d38-4e71-9a25-71e7dc03962a","Type":"ContainerStarted","Data":"892873971e77e095b21ebbb78b1727e784cbfac09b3b7ca6ababfe7cf35c96fb"} Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.694200 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.697421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerStarted","Data":"a5c37aa82cf27783f9d970554f97e701f281c08601787f57b4961c49be248480"} Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.699683 5030 generic.go:358] "Generic (PLEG): container finished" podID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerID="9dfed78faeaedbb4b0c30fdeb1c0c0c0a3e6a1d8527462b8ca622c76c463b9cc" exitCode=0 Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.699889 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerDied","Data":"9dfed78faeaedbb4b0c30fdeb1c0c0c0a3e6a1d8527462b8ca622c76c463b9cc"} Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.721509 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.721489558 podStartE2EDuration="2.721489558s" podCreationTimestamp="2026-03-16 13:33:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:46.713404272 +0000 UTC m=+1671.112716819" watchObservedRunningTime="2026-03-16 13:33:46.721489558 +0000 UTC m=+1671.120802105" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.736853 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=4.736835116 podStartE2EDuration="4.736835116s" podCreationTimestamp="2026-03-16 13:33:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:46.729921745 +0000 UTC m=+1671.129234293" watchObservedRunningTime="2026-03-16 13:33:46.736835116 +0000 UTC m=+1671.136147654" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.747887 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98glk\" (UniqueName: \"kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk\") pod \"kube-state-metrics-0\" (UID: \"edb25875-7f99-4dad-b544-226a0bb6c20e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.850263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98glk\" (UniqueName: \"kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk\") pod \"kube-state-metrics-0\" (UID: \"edb25875-7f99-4dad-b544-226a0bb6c20e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.872040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98glk\" (UniqueName: \"kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk\") pod \"kube-state-metrics-0\" (UID: \"edb25875-7f99-4dad-b544-226a0bb6c20e\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:46 crc kubenswrapper[5030]: I0316 13:33:46.979212 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:47 crc kubenswrapper[5030]: I0316 13:33:47.404354 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:33:47 crc kubenswrapper[5030]: I0316 13:33:47.710006 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerStarted","Data":"3a29f8a9390772b73127d61489b0831685b6af7e0ccc195eedd81fbae96ee3c0"} Mar 16 13:33:47 crc kubenswrapper[5030]: I0316 13:33:47.711780 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"edb25875-7f99-4dad-b544-226a0bb6c20e","Type":"ContainerStarted","Data":"a9484d333bc5380c68003d91d10ccecf217f4ef971db50c2da165b9c7a2a6519"} Mar 16 13:33:47 crc kubenswrapper[5030]: I0316 13:33:47.733041 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=4.733026729 podStartE2EDuration="4.733026729s" podCreationTimestamp="2026-03-16 13:33:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:47.727976451 +0000 UTC m=+1672.127288999" watchObservedRunningTime="2026-03-16 13:33:47.733026729 +0000 UTC m=+1672.132339276" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.396423 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.400522 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.402969 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.403217 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-2h2wk\"" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.403508 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.403685 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.404024 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.407111 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwrf8\" (UniqueName: \"kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481482 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481771 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481841 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.481907 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.582658 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.582703 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwrf8\" (UniqueName: \"kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.582731 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.582799 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.582826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.583569 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.583920 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.583994 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.583998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.584110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.584206 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.584638 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.590271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.590269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.592025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.619311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwrf8\" (UniqueName: \"kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.627991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"ovsdbserver-nb-0\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.718064 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.727462 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"edb25875-7f99-4dad-b544-226a0bb6c20e","Type":"ContainerStarted","Data":"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b"} Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.727782 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:33:48 crc kubenswrapper[5030]: I0316 13:33:48.749274 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.463604276 podStartE2EDuration="2.749258049s" podCreationTimestamp="2026-03-16 13:33:46 +0000 UTC" firstStartedPulling="2026-03-16 13:33:47.410399503 +0000 UTC m=+1671.809712049" lastFinishedPulling="2026-03-16 13:33:47.696053276 +0000 UTC m=+1672.095365822" observedRunningTime="2026-03-16 13:33:48.749087349 +0000 UTC m=+1673.148399896" watchObservedRunningTime="2026-03-16 13:33:48.749258049 +0000 UTC m=+1673.148570597" Mar 16 13:33:49 crc kubenswrapper[5030]: I0316 13:33:49.154677 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:33:49 crc kubenswrapper[5030]: W0316 13:33:49.155281 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ae9bce_4f3a_4540_ac99_b763e21a7c07.slice/crio-d38133c1400a3d9d6c1850f899c0f93e623e0ca107f3a625bfbfff9db7da96fb WatchSource:0}: Error finding container d38133c1400a3d9d6c1850f899c0f93e623e0ca107f3a625bfbfff9db7da96fb: Status 404 returned error can't find the container with id d38133c1400a3d9d6c1850f899c0f93e623e0ca107f3a625bfbfff9db7da96fb Mar 16 13:33:49 crc kubenswrapper[5030]: I0316 13:33:49.736618 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerStarted","Data":"43bd0c72c69ffa1704b2cb1e04e0c0230d50bfd2783783c97a1a8cd59d88b278"} Mar 16 13:33:49 crc kubenswrapper[5030]: I0316 13:33:49.737088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerStarted","Data":"3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980"} Mar 16 13:33:49 crc kubenswrapper[5030]: I0316 13:33:49.737114 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerStarted","Data":"d38133c1400a3d9d6c1850f899c0f93e623e0ca107f3a625bfbfff9db7da96fb"} Mar 16 13:33:49 crc kubenswrapper[5030]: I0316 13:33:49.754821 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=1.7547929039999999 podStartE2EDuration="1.754792904s" podCreationTimestamp="2026-03-16 13:33:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:49.752813472 +0000 UTC m=+1674.152126019" watchObservedRunningTime="2026-03-16 13:33:49.754792904 +0000 UTC m=+1674.154105451" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.447698 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.452080 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.457500 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-2s5zl\"" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.457531 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.457627 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.457729 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.464168 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.543950 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544022 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544364 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544539 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544675 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544742 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.544804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpg2\" (UniqueName: \"kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646069 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpg2\" (UniqueName: \"kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646241 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646290 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646485 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.646726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.647190 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.647293 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.647723 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.647739 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.654357 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.654414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.654885 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.662741 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpg2\" (UniqueName: \"kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.667755 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"ovsdbserver-sb-0\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.718922 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:51 crc kubenswrapper[5030]: I0316 13:33:51.780328 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.201484 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.461622 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.461918 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.524442 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.768925 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerStarted","Data":"67f7f23afc348f233a93cd0b1dd1da1cddfaebd7b11bcb9aad5e09f2260dd4db"} Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.769015 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerStarted","Data":"0e089bc213a84f45cb151137664b99776b4a0316ddfcdf2e444885ae7555b0e3"} Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.769030 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerStarted","Data":"268f347aa8513bce94e31838d9e44072f501a023536113260a53c29422d892d5"} Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.792869 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=1.7928295319999998 podStartE2EDuration="1.792829532s" podCreationTimestamp="2026-03-16 13:33:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:52.78558085 +0000 UTC m=+1677.184893397" watchObservedRunningTime="2026-03-16 13:33:52.792829532 +0000 UTC m=+1677.192142079" Mar 16 13:33:52 crc kubenswrapper[5030]: I0316 13:33:52.852801 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:33:53 crc kubenswrapper[5030]: E0316 13:33:53.700879 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1327799 actualBytes=10240 Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.719465 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.728507 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.742930 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.742979 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.821266 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.909244 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.910043 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-mkprr"] Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.914113 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.916800 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mkprr"] Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.990944 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:53 crc kubenswrapper[5030]: I0316 13:33:53.991301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcdc\" (UniqueName: \"kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.008122 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg"] Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.012201 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.014045 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.016957 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg"] Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.092926 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2sg\" (UniqueName: \"kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.093029 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.093063 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcdc\" (UniqueName: \"kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.093507 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.094255 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.112125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcdc\" (UniqueName: \"kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc\") pod \"glance-db-create-mkprr\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.194792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.194862 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2sg\" (UniqueName: \"kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.195470 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.211925 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2sg\" (UniqueName: \"kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg\") pod \"glance-8b49-account-create-update-9jkqg\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.244967 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.327857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.659630 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mkprr"] Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.754188 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg"] Mar 16 13:33:54 crc kubenswrapper[5030]: W0316 13:33:54.767178 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7bc589c_f459_4baa_89df_6dc22ed935ef.slice/crio-36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6 WatchSource:0}: Error finding container 36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6: Status 404 returned error can't find the container with id 36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6 Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.769130 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.781423 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.785035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mkprr" event={"ID":"c5063ed4-1f74-4636-b93e-05d8abb806bd","Type":"ContainerStarted","Data":"040a689c58cd405c84c91ceb96755a93f9dbcc038e6b2634985d8dc0f81afde7"} Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.786929 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" event={"ID":"d7bc589c-f459-4baa-89df-6dc22ed935ef","Type":"ContainerStarted","Data":"36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6"} Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.801882 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:33:54 crc kubenswrapper[5030]: I0316 13:33:54.946723 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:33:54 crc kubenswrapper[5030]: E0316 13:33:54.947034 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.802014 5030 generic.go:358] "Generic (PLEG): container finished" podID="d7bc589c-f459-4baa-89df-6dc22ed935ef" containerID="0e5f5078a310bbb0a0a32571573622e198c6023b68b9f89e20a70ca12bc2517c" exitCode=0 Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.802138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" event={"ID":"d7bc589c-f459-4baa-89df-6dc22ed935ef","Type":"ContainerDied","Data":"0e5f5078a310bbb0a0a32571573622e198c6023b68b9f89e20a70ca12bc2517c"} Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.805196 5030 generic.go:358] "Generic (PLEG): container finished" podID="c5063ed4-1f74-4636-b93e-05d8abb806bd" containerID="c928eef8ad4f79b54e99525b4b7f412bbd972206c19668939b49928c41ee6d04" exitCode=0 Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.805256 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mkprr" event={"ID":"c5063ed4-1f74-4636-b93e-05d8abb806bd","Type":"ContainerDied","Data":"c928eef8ad4f79b54e99525b4b7f412bbd972206c19668939b49928c41ee6d04"} Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.956913 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-mwgnm"] Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.961118 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:55 crc kubenswrapper[5030]: I0316 13:33:55.962238 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-mwgnm"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.032403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9r2\" (UniqueName: \"kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.032612 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.081807 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-274jm"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.086936 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.087693 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-274jm"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.088912 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.134483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.134671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9r2\" (UniqueName: \"kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.134743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.134881 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7d6n\" (UniqueName: \"kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.135497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.153071 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9r2\" (UniqueName: \"kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2\") pod \"keystone-db-create-mwgnm\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.190878 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkglk"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.194464 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.204048 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkglk"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.236858 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.237168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7d6n\" (UniqueName: \"kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.237603 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.252281 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7d6n\" (UniqueName: \"kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n\") pod \"keystone-078a-account-create-update-274jm\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.278565 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.279343 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.283941 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.286757 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.294912 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg"] Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.338481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.338818 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcp4k\" (UniqueName: \"kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.338909 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4g5\" (UniqueName: \"kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.338943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.402798 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.440990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4g5\" (UniqueName: \"kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.441094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.441286 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.441328 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcp4k\" (UniqueName: \"kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.441697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.442015 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.457862 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcp4k\" (UniqueName: \"kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k\") pod \"placement-bc4b-account-create-update-kv4gg\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.457898 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4g5\" (UniqueName: \"kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5\") pod \"placement-db-create-qkglk\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.515386 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.602384 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.704048 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-mwgnm"] Mar 16 13:33:56 crc kubenswrapper[5030]: W0316 13:33:56.712212 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51ec227f_89bb_4eb3_8b2c_4b8138881432.slice/crio-c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a WatchSource:0}: Error finding container c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a: Status 404 returned error can't find the container with id c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.780523 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.792187 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-274jm"] Mar 16 13:33:56 crc kubenswrapper[5030]: W0316 13:33:56.799448 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4c65424_97bc_427a_8fd4_5956f881ce2c.slice/crio-4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9 WatchSource:0}: Error finding container 4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9: Status 404 returned error can't find the container with id 4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9 Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.822973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" event={"ID":"51ec227f-89bb-4eb3-8b2c-4b8138881432","Type":"ContainerStarted","Data":"c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a"} Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.824777 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" event={"ID":"a4c65424-97bc-427a-8fd4-5956f881ce2c","Type":"ContainerStarted","Data":"4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9"} Mar 16 13:33:56 crc kubenswrapper[5030]: I0316 13:33:56.938402 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkglk"] Mar 16 13:33:56 crc kubenswrapper[5030]: W0316 13:33:56.965186 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fbf1f84_046a_4a5b_8010_fb91e643732f.slice/crio-0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078 WatchSource:0}: Error finding container 0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078: Status 404 returned error can't find the container with id 0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.028883 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg"] Mar 16 13:33:57 crc kubenswrapper[5030]: W0316 13:33:57.035575 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d40483b_2134_4599_b62e_db175eb4992d.slice/crio-ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618 WatchSource:0}: Error finding container ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618: Status 404 returned error can't find the container with id ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.125827 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.142870 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.185084 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.186697 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.187678 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-hq22m\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.187953 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.217635 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264474 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llcdz\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.264707 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.366722 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.366999 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llcdz\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367078 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367264 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367311 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367315 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367634 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.367776 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.367900 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.367914 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.367975 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift podName:93f3c38d-e63e-45e8-af66-a42cd159d7bb nodeName:}" failed. No retries permitted until 2026-03-16 13:33:57.867955621 +0000 UTC m=+1682.267268168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift") pod "swift-storage-0" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb") : configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.375045 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.385505 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llcdz\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.392941 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.502843 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.511347 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.570940 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jcdc\" (UniqueName: \"kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc\") pod \"c5063ed4-1f74-4636-b93e-05d8abb806bd\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.571336 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts\") pod \"c5063ed4-1f74-4636-b93e-05d8abb806bd\" (UID: \"c5063ed4-1f74-4636-b93e-05d8abb806bd\") " Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.571392 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk2sg\" (UniqueName: \"kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg\") pod \"d7bc589c-f459-4baa-89df-6dc22ed935ef\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.571580 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts\") pod \"d7bc589c-f459-4baa-89df-6dc22ed935ef\" (UID: \"d7bc589c-f459-4baa-89df-6dc22ed935ef\") " Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.572473 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "d7bc589c-f459-4baa-89df-6dc22ed935ef" (UID: "d7bc589c-f459-4baa-89df-6dc22ed935ef"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.573082 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c5063ed4-1f74-4636-b93e-05d8abb806bd" (UID: "c5063ed4-1f74-4636-b93e-05d8abb806bd"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.575832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc" (OuterVolumeSpecName: "kube-api-access-2jcdc") pod "c5063ed4-1f74-4636-b93e-05d8abb806bd" (UID: "c5063ed4-1f74-4636-b93e-05d8abb806bd"). InnerVolumeSpecName "kube-api-access-2jcdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.576523 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg" (OuterVolumeSpecName: "kube-api-access-fk2sg") pod "d7bc589c-f459-4baa-89df-6dc22ed935ef" (UID: "d7bc589c-f459-4baa-89df-6dc22ed935ef"). InnerVolumeSpecName "kube-api-access-fk2sg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.674419 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c5063ed4-1f74-4636-b93e-05d8abb806bd-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.674457 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk2sg\" (UniqueName: \"kubernetes.io/projected/d7bc589c-f459-4baa-89df-6dc22ed935ef-kube-api-access-fk2sg\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.674474 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/d7bc589c-f459-4baa-89df-6dc22ed935ef-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.674486 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jcdc\" (UniqueName: \"kubernetes.io/projected/c5063ed4-1f74-4636-b93e-05d8abb806bd-kube-api-access-2jcdc\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.781296 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-w589s"] Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782452 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5063ed4-1f74-4636-b93e-05d8abb806bd" containerName="mariadb-database-create" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782474 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5063ed4-1f74-4636-b93e-05d8abb806bd" containerName="mariadb-database-create" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782504 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bc589c-f459-4baa-89df-6dc22ed935ef" containerName="mariadb-account-create-update" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782510 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bc589c-f459-4baa-89df-6dc22ed935ef" containerName="mariadb-account-create-update" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782674 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d7bc589c-f459-4baa-89df-6dc22ed935ef" containerName="mariadb-account-create-update" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.782695 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5063ed4-1f74-4636-b93e-05d8abb806bd" containerName="mariadb-database-create" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.785408 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.789096 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.789365 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.792906 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.799190 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-w589s"] Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.817414 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.844770 5030 generic.go:358] "Generic (PLEG): container finished" podID="a4c65424-97bc-427a-8fd4-5956f881ce2c" containerID="be58854d27f3f095f34ea4123d7ac19b5198d7b0501b0fe6019f29f6109a5e02" exitCode=0 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.844809 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" event={"ID":"a4c65424-97bc-427a-8fd4-5956f881ce2c","Type":"ContainerDied","Data":"be58854d27f3f095f34ea4123d7ac19b5198d7b0501b0fe6019f29f6109a5e02"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.847240 5030 generic.go:358] "Generic (PLEG): container finished" podID="7d40483b-2134-4599-b62e-db175eb4992d" containerID="646df5274c6f3a348769458c49269411688195a9eae5b5f84ffec2fd9d4199e2" exitCode=0 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.847359 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" event={"ID":"7d40483b-2134-4599-b62e-db175eb4992d","Type":"ContainerDied","Data":"646df5274c6f3a348769458c49269411688195a9eae5b5f84ffec2fd9d4199e2"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.847389 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" event={"ID":"7d40483b-2134-4599-b62e-db175eb4992d","Type":"ContainerStarted","Data":"ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.849206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" event={"ID":"d7bc589c-f459-4baa-89df-6dc22ed935ef","Type":"ContainerDied","Data":"36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.849235 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36b86a8d19fe8c6563a99d7d4ea29fd528184603eb54d2baf2268e709c1569e6" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.849290 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.853622 5030 generic.go:358] "Generic (PLEG): container finished" podID="51ec227f-89bb-4eb3-8b2c-4b8138881432" containerID="dcac50c93122f2d6a571f3b1f0522bc5c4633613b37446928cee916b94be5dc6" exitCode=0 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.853814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" event={"ID":"51ec227f-89bb-4eb3-8b2c-4b8138881432","Type":"ContainerDied","Data":"dcac50c93122f2d6a571f3b1f0522bc5c4633613b37446928cee916b94be5dc6"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.859299 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.860900 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-mkprr" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.860989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-mkprr" event={"ID":"c5063ed4-1f74-4636-b93e-05d8abb806bd","Type":"ContainerDied","Data":"040a689c58cd405c84c91ceb96755a93f9dbcc038e6b2634985d8dc0f81afde7"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.861027 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="040a689c58cd405c84c91ceb96755a93f9dbcc038e6b2634985d8dc0f81afde7" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.873083 5030 generic.go:358] "Generic (PLEG): container finished" podID="4fbf1f84-046a-4a5b-8010-fb91e643732f" containerID="3a2c603fb083354ec328e7101816b0e7e3d0429d6c89aacdf057b135fc635f63" exitCode=0 Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.873136 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkglk" event={"ID":"4fbf1f84-046a-4a5b-8010-fb91e643732f","Type":"ContainerDied","Data":"3a2c603fb083354ec328e7101816b0e7e3d0429d6c89aacdf057b135fc635f63"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.873187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkglk" event={"ID":"4fbf1f84-046a-4a5b-8010-fb91e643732f","Type":"ContainerStarted","Data":"0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078"} Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878400 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878460 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878486 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878536 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tts4s\" (UniqueName: \"kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.878844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.879078 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.879092 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.879121 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: E0316 13:33:57.879197 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift podName:93f3c38d-e63e-45e8-af66-a42cd159d7bb nodeName:}" failed. No retries permitted until 2026-03-16 13:33:58.879180513 +0000 UTC m=+1683.278493060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift") pod "swift-storage-0" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb") : configmap "swift-ring-files" not found Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.879453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.981610 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982291 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982390 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982477 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tts4s\" (UniqueName: \"kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982800 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.982868 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.984022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.984407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.987908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.987943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.988911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:57 crc kubenswrapper[5030]: I0316 13:33:57.996328 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tts4s\" (UniqueName: \"kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s\") pod \"swift-ring-rebalance-w589s\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.092627 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.099509 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.099678 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.102501 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.102616 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-xhklh\"" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.102878 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.104601 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.106902 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.186920 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187120 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187323 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187418 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4fs\" (UniqueName: \"kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.187656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290004 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290446 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4fs\" (UniqueName: \"kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290626 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290685 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.290789 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.291462 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.292214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.292740 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.312403 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.312409 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.313288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.326803 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4fs\" (UniqueName: \"kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs\") pod \"ovn-northd-0\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.426143 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.529037 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-w589s"] Mar 16 13:33:58 crc kubenswrapper[5030]: W0316 13:33:58.531079 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb44689a_fb82_41f8_af64_f82888a8c1ee.slice/crio-92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b WatchSource:0}: Error finding container 92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b: Status 404 returned error can't find the container with id 92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.844199 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.897041 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerStarted","Data":"547771254a5f9687877ef15065531984da3d16c38abd9b87cbbc7552d73932a7"} Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.901729 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" event={"ID":"cb44689a-fb82-41f8-af64-f82888a8c1ee","Type":"ContainerStarted","Data":"b003aa9c236de7b95d92c63911a3ff69346f244065bf038f6eddc931f8ee36bb"} Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.901766 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" event={"ID":"cb44689a-fb82-41f8-af64-f82888a8c1ee","Type":"ContainerStarted","Data":"92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b"} Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.909360 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:33:58 crc kubenswrapper[5030]: E0316 13:33:58.909610 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:33:58 crc kubenswrapper[5030]: E0316 13:33:58.909628 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:33:58 crc kubenswrapper[5030]: E0316 13:33:58.909690 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift podName:93f3c38d-e63e-45e8-af66-a42cd159d7bb nodeName:}" failed. No retries permitted until 2026-03-16 13:34:00.909670549 +0000 UTC m=+1685.308983096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift") pod "swift-storage-0" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb") : configmap "swift-ring-files" not found Mar 16 13:33:58 crc kubenswrapper[5030]: I0316 13:33:58.940299 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" podStartSLOduration=1.9402791019999999 podStartE2EDuration="1.940279102s" podCreationTimestamp="2026-03-16 13:33:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:58.926632107 +0000 UTC m=+1683.325944655" watchObservedRunningTime="2026-03-16 13:33:58.940279102 +0000 UTC m=+1683.339591650" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.155824 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-ts9gv"] Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.160573 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.161824 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-ts9gv"] Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.165070 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-vb2g5\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.165337 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.220611 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.220677 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.220703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btnn\" (UniqueName: \"kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.220796 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.324219 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.324576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.324625 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.324655 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4btnn\" (UniqueName: \"kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.341262 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.344256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.352674 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.352847 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.364913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btnn\" (UniqueName: \"kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn\") pod \"glance-db-sync-ts9gv\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.426358 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4g5\" (UniqueName: \"kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5\") pod \"4fbf1f84-046a-4a5b-8010-fb91e643732f\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.426694 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts\") pod \"4fbf1f84-046a-4a5b-8010-fb91e643732f\" (UID: \"4fbf1f84-046a-4a5b-8010-fb91e643732f\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.427670 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4fbf1f84-046a-4a5b-8010-fb91e643732f" (UID: "4fbf1f84-046a-4a5b-8010-fb91e643732f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.427699 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.431221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5" (OuterVolumeSpecName: "kube-api-access-jp4g5") pod "4fbf1f84-046a-4a5b-8010-fb91e643732f" (UID: "4fbf1f84-046a-4a5b-8010-fb91e643732f"). InnerVolumeSpecName "kube-api-access-jp4g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.434561 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.471472 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.523452 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.528501 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7d6n\" (UniqueName: \"kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n\") pod \"a4c65424-97bc-427a-8fd4-5956f881ce2c\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.528539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9r2\" (UniqueName: \"kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2\") pod \"51ec227f-89bb-4eb3-8b2c-4b8138881432\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.528807 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts\") pod \"a4c65424-97bc-427a-8fd4-5956f881ce2c\" (UID: \"a4c65424-97bc-427a-8fd4-5956f881ce2c\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.528910 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts\") pod \"51ec227f-89bb-4eb3-8b2c-4b8138881432\" (UID: \"51ec227f-89bb-4eb3-8b2c-4b8138881432\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.529376 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp4g5\" (UniqueName: \"kubernetes.io/projected/4fbf1f84-046a-4a5b-8010-fb91e643732f-kube-api-access-jp4g5\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.529400 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4fbf1f84-046a-4a5b-8010-fb91e643732f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.529795 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51ec227f-89bb-4eb3-8b2c-4b8138881432" (UID: "51ec227f-89bb-4eb3-8b2c-4b8138881432"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.532481 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2" (OuterVolumeSpecName: "kube-api-access-nk9r2") pod "51ec227f-89bb-4eb3-8b2c-4b8138881432" (UID: "51ec227f-89bb-4eb3-8b2c-4b8138881432"). InnerVolumeSpecName "kube-api-access-nk9r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.532698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a4c65424-97bc-427a-8fd4-5956f881ce2c" (UID: "a4c65424-97bc-427a-8fd4-5956f881ce2c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.533365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n" (OuterVolumeSpecName: "kube-api-access-r7d6n") pod "a4c65424-97bc-427a-8fd4-5956f881ce2c" (UID: "a4c65424-97bc-427a-8fd4-5956f881ce2c"). InnerVolumeSpecName "kube-api-access-r7d6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.633196 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts\") pod \"7d40483b-2134-4599-b62e-db175eb4992d\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.633347 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcp4k\" (UniqueName: \"kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k\") pod \"7d40483b-2134-4599-b62e-db175eb4992d\" (UID: \"7d40483b-2134-4599-b62e-db175eb4992d\") " Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.633564 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7d40483b-2134-4599-b62e-db175eb4992d" (UID: "7d40483b-2134-4599-b62e-db175eb4992d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.634134 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7d6n\" (UniqueName: \"kubernetes.io/projected/a4c65424-97bc-427a-8fd4-5956f881ce2c-kube-api-access-r7d6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.634169 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9r2\" (UniqueName: \"kubernetes.io/projected/51ec227f-89bb-4eb3-8b2c-4b8138881432-kube-api-access-nk9r2\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.634181 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7d40483b-2134-4599-b62e-db175eb4992d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.634206 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a4c65424-97bc-427a-8fd4-5956f881ce2c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.634217 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51ec227f-89bb-4eb3-8b2c-4b8138881432-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.638853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k" (OuterVolumeSpecName: "kube-api-access-pcp4k") pod "7d40483b-2134-4599-b62e-db175eb4992d" (UID: "7d40483b-2134-4599-b62e-db175eb4992d"). InnerVolumeSpecName "kube-api-access-pcp4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.735261 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcp4k\" (UniqueName: \"kubernetes.io/projected/7d40483b-2134-4599-b62e-db175eb4992d-kube-api-access-pcp4k\") on node \"crc\" DevicePath \"\"" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.919757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerStarted","Data":"700d22618664a8bae5687619c1f217e02d60020371c0a5168d4e7ce5c96274a2"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.919830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerStarted","Data":"53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.919913 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.921488 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" event={"ID":"51ec227f-89bb-4eb3-8b2c-4b8138881432","Type":"ContainerDied","Data":"c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.921539 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9ac1e241a2dd15d5521e953090bb672e43d6b39c2f21a99c66b71eb23f1612a" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.921629 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-mwgnm" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.924821 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-qkglk" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.924820 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-qkglk" event={"ID":"4fbf1f84-046a-4a5b-8010-fb91e643732f","Type":"ContainerDied","Data":"0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.924946 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ad96b2747114d8949a01c295e282e179a3bcb50096f08b33149a231ba9f4078" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.926304 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" event={"ID":"a4c65424-97bc-427a-8fd4-5956f881ce2c","Type":"ContainerDied","Data":"4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.926329 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f2d4024cfabbe3c60b81b46f230de0f17c3250e58a842adcd87b919994aeeb9" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.926411 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-274jm" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.929973 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.931743 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg" event={"ID":"7d40483b-2134-4599-b62e-db175eb4992d","Type":"ContainerDied","Data":"ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618"} Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.931767 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa98e3991d2d3169962f0f4e162311cc3edb9f7f410093c3fb44e13dca7f618" Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.955881 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=1.955859419 podStartE2EDuration="1.955859419s" podCreationTimestamp="2026-03-16 13:33:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:33:59.944327421 +0000 UTC m=+1684.343639969" watchObservedRunningTime="2026-03-16 13:33:59.955859419 +0000 UTC m=+1684.355171965" Mar 16 13:33:59 crc kubenswrapper[5030]: W0316 13:33:59.956447 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod236ac437_b3b4_44cf_a66e_26ff35541544.slice/crio-926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed WatchSource:0}: Error finding container 926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed: Status 404 returned error can't find the container with id 926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed Mar 16 13:33:59 crc kubenswrapper[5030]: I0316 13:33:59.962327 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-ts9gv"] Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.130798 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561134-cphvg"] Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131777 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d40483b-2134-4599-b62e-db175eb4992d" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131798 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d40483b-2134-4599-b62e-db175eb4992d" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131820 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ec227f-89bb-4eb3-8b2c-4b8138881432" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131828 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ec227f-89bb-4eb3-8b2c-4b8138881432" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131838 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c65424-97bc-427a-8fd4-5956f881ce2c" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131843 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c65424-97bc-427a-8fd4-5956f881ce2c" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131862 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbf1f84-046a-4a5b-8010-fb91e643732f" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.131867 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbf1f84-046a-4a5b-8010-fb91e643732f" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.132018 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d40483b-2134-4599-b62e-db175eb4992d" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.132031 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a4c65424-97bc-427a-8fd4-5956f881ce2c" containerName="mariadb-account-create-update" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.132040 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fbf1f84-046a-4a5b-8010-fb91e643732f" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.132049 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="51ec227f-89bb-4eb3-8b2c-4b8138881432" containerName="mariadb-database-create" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.135139 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.137704 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.137830 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561134-cphvg"] Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.137935 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.138298 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.245635 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2l52\" (UniqueName: \"kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52\") pod \"auto-csr-approver-29561134-cphvg\" (UID: \"063c2a0a-7162-4a05-8e4c-bd62892d96fa\") " pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.347795 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2l52\" (UniqueName: \"kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52\") pod \"auto-csr-approver-29561134-cphvg\" (UID: \"063c2a0a-7162-4a05-8e4c-bd62892d96fa\") " pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.370798 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2l52\" (UniqueName: \"kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52\") pod \"auto-csr-approver-29561134-cphvg\" (UID: \"063c2a0a-7162-4a05-8e4c-bd62892d96fa\") " pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.455270 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.748122 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.882856 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561134-cphvg"] Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.939677 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561134-cphvg" event={"ID":"063c2a0a-7162-4a05-8e4c-bd62892d96fa","Type":"ContainerStarted","Data":"ba0d0428415954a6fa8adbe4726050933491fa683df22a52f183ffb914b42f3e"} Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.942621 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" event={"ID":"236ac437-b3b4-44cf-a66e-26ff35541544","Type":"ContainerStarted","Data":"ea7b98efea152e56043bb66d8872319250d9519e67d9665d3840beb53a60cc87"} Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.942677 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" event={"ID":"236ac437-b3b4-44cf-a66e-26ff35541544","Type":"ContainerStarted","Data":"926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed"} Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.959782 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:34:00 crc kubenswrapper[5030]: E0316 13:34:00.960050 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:34:00 crc kubenswrapper[5030]: E0316 13:34:00.960130 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:34:00 crc kubenswrapper[5030]: E0316 13:34:00.960241 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift podName:93f3c38d-e63e-45e8-af66-a42cd159d7bb nodeName:}" failed. No retries permitted until 2026-03-16 13:34:04.960220235 +0000 UTC m=+1689.359532782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift") pod "swift-storage-0" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb") : configmap "swift-ring-files" not found Mar 16 13:34:00 crc kubenswrapper[5030]: I0316 13:34:00.961104 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" podStartSLOduration=1.961089841 podStartE2EDuration="1.961089841s" podCreationTimestamp="2026-03-16 13:33:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:00.957208741 +0000 UTC m=+1685.356521288" watchObservedRunningTime="2026-03-16 13:34:00.961089841 +0000 UTC m=+1685.360402388" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.100685 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-lvmw2"] Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.107851 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.110696 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.112442 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-lvmw2"] Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.188422 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhsz\" (UniqueName: \"kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.188479 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.292391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhsz\" (UniqueName: \"kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.292886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.294211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.314293 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhsz\" (UniqueName: \"kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz\") pod \"root-account-create-update-lvmw2\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.454635 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.859812 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-lvmw2"] Mar 16 13:34:02 crc kubenswrapper[5030]: W0316 13:34:02.872155 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod961c6dc1_465b_486b_bf13_464ea9e2ed3c.slice/crio-aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8 WatchSource:0}: Error finding container aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8: Status 404 returned error can't find the container with id aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8 Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.971344 5030 generic.go:358] "Generic (PLEG): container finished" podID="063c2a0a-7162-4a05-8e4c-bd62892d96fa" containerID="41c528453be256884b824b1cc5b27ac96e4e76e07fd1cb6d97211af13ea7b9cf" exitCode=0 Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.971868 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561134-cphvg" event={"ID":"063c2a0a-7162-4a05-8e4c-bd62892d96fa","Type":"ContainerDied","Data":"41c528453be256884b824b1cc5b27ac96e4e76e07fd1cb6d97211af13ea7b9cf"} Mar 16 13:34:02 crc kubenswrapper[5030]: I0316 13:34:02.974165 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" event={"ID":"961c6dc1-465b-486b-bf13-464ea9e2ed3c","Type":"ContainerStarted","Data":"aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8"} Mar 16 13:34:03 crc kubenswrapper[5030]: I0316 13:34:03.983319 5030 generic.go:358] "Generic (PLEG): container finished" podID="236ac437-b3b4-44cf-a66e-26ff35541544" containerID="ea7b98efea152e56043bb66d8872319250d9519e67d9665d3840beb53a60cc87" exitCode=0 Mar 16 13:34:03 crc kubenswrapper[5030]: I0316 13:34:03.983358 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" event={"ID":"236ac437-b3b4-44cf-a66e-26ff35541544","Type":"ContainerDied","Data":"ea7b98efea152e56043bb66d8872319250d9519e67d9665d3840beb53a60cc87"} Mar 16 13:34:03 crc kubenswrapper[5030]: I0316 13:34:03.985515 5030 generic.go:358] "Generic (PLEG): container finished" podID="961c6dc1-465b-486b-bf13-464ea9e2ed3c" containerID="5fffd0cb79b4311e513afc4aa4747120c11bfb60b458083ca162a254ffcabdf3" exitCode=0 Mar 16 13:34:03 crc kubenswrapper[5030]: I0316 13:34:03.985579 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" event={"ID":"961c6dc1-465b-486b-bf13-464ea9e2ed3c","Type":"ContainerDied","Data":"5fffd0cb79b4311e513afc4aa4747120c11bfb60b458083ca162a254ffcabdf3"} Mar 16 13:34:04 crc kubenswrapper[5030]: I0316 13:34:04.327620 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:04 crc kubenswrapper[5030]: I0316 13:34:04.444282 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2l52\" (UniqueName: \"kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52\") pod \"063c2a0a-7162-4a05-8e4c-bd62892d96fa\" (UID: \"063c2a0a-7162-4a05-8e4c-bd62892d96fa\") " Mar 16 13:34:04 crc kubenswrapper[5030]: I0316 13:34:04.450993 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52" (OuterVolumeSpecName: "kube-api-access-p2l52") pod "063c2a0a-7162-4a05-8e4c-bd62892d96fa" (UID: "063c2a0a-7162-4a05-8e4c-bd62892d96fa"). InnerVolumeSpecName "kube-api-access-p2l52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:04 crc kubenswrapper[5030]: I0316 13:34:04.547889 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2l52\" (UniqueName: \"kubernetes.io/projected/063c2a0a-7162-4a05-8e4c-bd62892d96fa-kube-api-access-p2l52\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:04.999945 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561134-cphvg" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:04.999982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561134-cphvg" event={"ID":"063c2a0a-7162-4a05-8e4c-bd62892d96fa","Type":"ContainerDied","Data":"ba0d0428415954a6fa8adbe4726050933491fa683df22a52f183ffb914b42f3e"} Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.000018 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba0d0428415954a6fa8adbe4726050933491fa683df22a52f183ffb914b42f3e" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.003054 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb44689a-fb82-41f8-af64-f82888a8c1ee" containerID="b003aa9c236de7b95d92c63911a3ff69346f244065bf038f6eddc931f8ee36bb" exitCode=0 Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.003141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" event={"ID":"cb44689a-fb82-41f8-af64-f82888a8c1ee","Type":"ContainerDied","Data":"b003aa9c236de7b95d92c63911a3ff69346f244065bf038f6eddc931f8ee36bb"} Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.058691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.063912 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"swift-storage-0\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.315812 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.390904 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561128-bml8c"] Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.397057 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561128-bml8c"] Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.420292 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.422605 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.467721 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4btnn\" (UniqueName: \"kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn\") pod \"236ac437-b3b4-44cf-a66e-26ff35541544\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.467837 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data\") pod \"236ac437-b3b4-44cf-a66e-26ff35541544\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.467870 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data\") pod \"236ac437-b3b4-44cf-a66e-26ff35541544\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.467899 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fhsz\" (UniqueName: \"kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz\") pod \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.468081 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts\") pod \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\" (UID: \"961c6dc1-465b-486b-bf13-464ea9e2ed3c\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.468156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle\") pod \"236ac437-b3b4-44cf-a66e-26ff35541544\" (UID: \"236ac437-b3b4-44cf-a66e-26ff35541544\") " Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.469879 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "961c6dc1-465b-486b-bf13-464ea9e2ed3c" (UID: "961c6dc1-465b-486b-bf13-464ea9e2ed3c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.474419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz" (OuterVolumeSpecName: "kube-api-access-7fhsz") pod "961c6dc1-465b-486b-bf13-464ea9e2ed3c" (UID: "961c6dc1-465b-486b-bf13-464ea9e2ed3c"). InnerVolumeSpecName "kube-api-access-7fhsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.475350 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn" (OuterVolumeSpecName: "kube-api-access-4btnn") pod "236ac437-b3b4-44cf-a66e-26ff35541544" (UID: "236ac437-b3b4-44cf-a66e-26ff35541544"). InnerVolumeSpecName "kube-api-access-4btnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.487359 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "236ac437-b3b4-44cf-a66e-26ff35541544" (UID: "236ac437-b3b4-44cf-a66e-26ff35541544"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.492336 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "236ac437-b3b4-44cf-a66e-26ff35541544" (UID: "236ac437-b3b4-44cf-a66e-26ff35541544"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.506108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data" (OuterVolumeSpecName: "config-data") pod "236ac437-b3b4-44cf-a66e-26ff35541544" (UID: "236ac437-b3b4-44cf-a66e-26ff35541544"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571048 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4btnn\" (UniqueName: \"kubernetes.io/projected/236ac437-b3b4-44cf-a66e-26ff35541544-kube-api-access-4btnn\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571079 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571090 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571101 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fhsz\" (UniqueName: \"kubernetes.io/projected/961c6dc1-465b-486b-bf13-464ea9e2ed3c-kube-api-access-7fhsz\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571118 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/961c6dc1-465b-486b-bf13-464ea9e2ed3c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.571129 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/236ac437-b3b4-44cf-a66e-26ff35541544-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.769567 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:34:05 crc kubenswrapper[5030]: I0316 13:34:05.961462 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212c1a97-8a01-4ba7-94e7-46ba954a9385" path="/var/lib/kubelet/pods/212c1a97-8a01-4ba7-94e7-46ba954a9385/volumes" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.022322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" event={"ID":"236ac437-b3b4-44cf-a66e-26ff35541544","Type":"ContainerDied","Data":"926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed"} Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.022373 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="926c98d96167f8d09fac67ccb7c60eeadc6055ea17f8361926794d07ca5a3bed" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.022471 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-ts9gv" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.031769 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" event={"ID":"961c6dc1-465b-486b-bf13-464ea9e2ed3c","Type":"ContainerDied","Data":"aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8"} Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.031836 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-lvmw2" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.031952 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa7dec832410ddfb5281ea5e769f0f50c71255870cbf9c7ab460682e037d55e8" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.036365 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6"} Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.036414 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"4c6c0fe51f233f77748a886a1a387d7ef46429c944458f462359d68f5ebb0806"} Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.569636 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.631241 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tts4s\" (UniqueName: \"kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.631894 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.631956 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.632154 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.632194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.632297 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.632341 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle\") pod \"cb44689a-fb82-41f8-af64-f82888a8c1ee\" (UID: \"cb44689a-fb82-41f8-af64-f82888a8c1ee\") " Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.639861 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s" (OuterVolumeSpecName: "kube-api-access-tts4s") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "kube-api-access-tts4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.640985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.643793 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.650821 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.663268 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts" (OuterVolumeSpecName: "scripts") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.705777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737479 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737625 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/cb44689a-fb82-41f8-af64-f82888a8c1ee-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737638 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737650 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tts4s\" (UniqueName: \"kubernetes.io/projected/cb44689a-fb82-41f8-af64-f82888a8c1ee-kube-api-access-tts4s\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737665 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.737681 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/cb44689a-fb82-41f8-af64-f82888a8c1ee-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.741776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "cb44689a-fb82-41f8-af64-f82888a8c1ee" (UID: "cb44689a-fb82-41f8-af64-f82888a8c1ee"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:06 crc kubenswrapper[5030]: I0316 13:34:06.841286 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/cb44689a-fb82-41f8-af64-f82888a8c1ee-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.066747 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.066795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.066809 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.066819 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.066826 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.069877 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" event={"ID":"cb44689a-fb82-41f8-af64-f82888a8c1ee","Type":"ContainerDied","Data":"92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b"} Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.069944 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92d93ae275bfd0f90d50b44e2e4aa128bdcf5b8edffdc033c80b4e05dbd5029b" Mar 16 13:34:07 crc kubenswrapper[5030]: I0316 13:34:07.069894 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-w589s" Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.081944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082575 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082584 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082593 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.082608 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3"} Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.400863 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-lvmw2"] Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.406723 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-lvmw2"] Mar 16 13:34:08 crc kubenswrapper[5030]: I0316 13:34:08.945958 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:34:08 crc kubenswrapper[5030]: E0316 13:34:08.946421 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.102907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0"} Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.102957 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerStarted","Data":"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9"} Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.138381 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=12.13836361 podStartE2EDuration="12.13836361s" podCreationTimestamp="2026-03-16 13:33:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:09.129184838 +0000 UTC m=+1693.528497385" watchObservedRunningTime="2026-03-16 13:34:09.13836361 +0000 UTC m=+1693.537676156" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.254176 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255588 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961c6dc1-465b-486b-bf13-464ea9e2ed3c" containerName="mariadb-account-create-update" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255610 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="961c6dc1-465b-486b-bf13-464ea9e2ed3c" containerName="mariadb-account-create-update" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255643 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="063c2a0a-7162-4a05-8e4c-bd62892d96fa" containerName="oc" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255650 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="063c2a0a-7162-4a05-8e4c-bd62892d96fa" containerName="oc" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255664 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb44689a-fb82-41f8-af64-f82888a8c1ee" containerName="swift-ring-rebalance" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255670 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb44689a-fb82-41f8-af64-f82888a8c1ee" containerName="swift-ring-rebalance" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255691 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236ac437-b3b4-44cf-a66e-26ff35541544" containerName="glance-db-sync" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255696 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="236ac437-b3b4-44cf-a66e-26ff35541544" containerName="glance-db-sync" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255867 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb44689a-fb82-41f8-af64-f82888a8c1ee" containerName="swift-ring-rebalance" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255877 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="236ac437-b3b4-44cf-a66e-26ff35541544" containerName="glance-db-sync" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255891 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="961c6dc1-465b-486b-bf13-464ea9e2ed3c" containerName="mariadb-account-create-update" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.255899 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="063c2a0a-7162-4a05-8e4c-bd62892d96fa" containerName="oc" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.259470 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.261468 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.263634 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.395338 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.395423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.395696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.395799 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsls\" (UniqueName: \"kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.497581 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.497657 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.497695 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.497728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsls\" (UniqueName: \"kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.498914 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.498953 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.498930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.516721 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsls\" (UniqueName: \"kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls\") pod \"dnsmasq-dnsmasq-5f5844fc89-txfls\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.586522 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.954661 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961c6dc1-465b-486b-bf13-464ea9e2ed3c" path="/var/lib/kubelet/pods/961c6dc1-465b-486b-bf13-464ea9e2ed3c/volumes" Mar 16 13:34:09 crc kubenswrapper[5030]: I0316 13:34:09.978046 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:34:09 crc kubenswrapper[5030]: W0316 13:34:09.985634 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb59dd8c8_d9e0_4210_8b44_04c130f53110.slice/crio-fa355e031b66020dc1cd2754a5c58388e2447c0a0dcc8757a0ac889df9a655cc WatchSource:0}: Error finding container fa355e031b66020dc1cd2754a5c58388e2447c0a0dcc8757a0ac889df9a655cc: Status 404 returned error can't find the container with id fa355e031b66020dc1cd2754a5c58388e2447c0a0dcc8757a0ac889df9a655cc Mar 16 13:34:10 crc kubenswrapper[5030]: I0316 13:34:10.117261 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" event={"ID":"b59dd8c8-d9e0-4210-8b44-04c130f53110","Type":"ContainerStarted","Data":"fa355e031b66020dc1cd2754a5c58388e2447c0a0dcc8757a0ac889df9a655cc"} Mar 16 13:34:10 crc kubenswrapper[5030]: I0316 13:34:10.990703 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:34:11 crc kubenswrapper[5030]: I0316 13:34:11.138762 5030 generic.go:358] "Generic (PLEG): container finished" podID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerID="0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47" exitCode=0 Mar 16 13:34:11 crc kubenswrapper[5030]: I0316 13:34:11.139025 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" event={"ID":"b59dd8c8-d9e0-4210-8b44-04c130f53110","Type":"ContainerDied","Data":"0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47"} Mar 16 13:34:12 crc kubenswrapper[5030]: I0316 13:34:12.152330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" event={"ID":"b59dd8c8-d9e0-4210-8b44-04c130f53110","Type":"ContainerStarted","Data":"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006"} Mar 16 13:34:12 crc kubenswrapper[5030]: I0316 13:34:12.152872 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:12 crc kubenswrapper[5030]: I0316 13:34:12.172818 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" podStartSLOduration=3.172804036 podStartE2EDuration="3.172804036s" podCreationTimestamp="2026-03-16 13:34:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:12.166779265 +0000 UTC m=+1696.566091811" watchObservedRunningTime="2026-03-16 13:34:12.172804036 +0000 UTC m=+1696.572116582" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.421956 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rk4df"] Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.426956 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.428265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rk4df"] Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.428969 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.576097 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.576360 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2bs\" (UniqueName: \"kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.679369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.679524 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2bs\" (UniqueName: \"kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.680096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.698058 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2bs\" (UniqueName: \"kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs\") pod \"root-account-create-update-rk4df\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:13 crc kubenswrapper[5030]: I0316 13:34:13.742603 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:14 crc kubenswrapper[5030]: I0316 13:34:14.132947 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rk4df"] Mar 16 13:34:14 crc kubenswrapper[5030]: W0316 13:34:14.134872 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf33cbc87_407d_414e_a969_bd04d3531105.slice/crio-71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576 WatchSource:0}: Error finding container 71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576: Status 404 returned error can't find the container with id 71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576 Mar 16 13:34:14 crc kubenswrapper[5030]: I0316 13:34:14.170625 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rk4df" event={"ID":"f33cbc87-407d-414e-a969-bd04d3531105","Type":"ContainerStarted","Data":"71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576"} Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.179829 5030 generic.go:358] "Generic (PLEG): container finished" podID="54074f93-8762-4822-b3df-761133496584" containerID="05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd" exitCode=0 Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.179917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerDied","Data":"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd"} Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.181745 5030 generic.go:358] "Generic (PLEG): container finished" podID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerID="5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74" exitCode=0 Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.181783 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerDied","Data":"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74"} Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.185151 5030 generic.go:358] "Generic (PLEG): container finished" podID="f33cbc87-407d-414e-a969-bd04d3531105" containerID="ec990e040afe2891145524ddf9eca283d5e045d567c5c60df75a51c46d82e1d0" exitCode=0 Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.185192 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rk4df" event={"ID":"f33cbc87-407d-414e-a969-bd04d3531105","Type":"ContainerDied","Data":"ec990e040afe2891145524ddf9eca283d5e045d567c5c60df75a51c46d82e1d0"} Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.241079 5030 scope.go:117] "RemoveContainer" containerID="516b88bcb8c32c350cfdaa316e3b310ba08cd193f8921852de8fac9f21b33008" Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.385737 5030 scope.go:117] "RemoveContainer" containerID="2407f944af51167292d77fc022cd49c4dee65d1006160a4d1fb5a556772f0318" Mar 16 13:34:15 crc kubenswrapper[5030]: I0316 13:34:15.407435 5030 scope.go:117] "RemoveContainer" containerID="27807b24204415c8edd0371c056be4ef733a0acf6836c2d6671ca47c8483add1" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.206255 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerStarted","Data":"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8"} Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.206932 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.210049 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerStarted","Data":"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad"} Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.210360 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.226145 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.226126757 podStartE2EDuration="36.226126757s" podCreationTimestamp="2026-03-16 13:33:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:16.223762671 +0000 UTC m=+1700.623075219" watchObservedRunningTime="2026-03-16 13:34:16.226126757 +0000 UTC m=+1700.625439304" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.245451 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.245437864 podStartE2EDuration="36.245437864s" podCreationTimestamp="2026-03-16 13:33:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:16.245049975 +0000 UTC m=+1700.644362522" watchObservedRunningTime="2026-03-16 13:34:16.245437864 +0000 UTC m=+1700.644750412" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.533473 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.634937 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs2bs\" (UniqueName: \"kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs\") pod \"f33cbc87-407d-414e-a969-bd04d3531105\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.635010 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts\") pod \"f33cbc87-407d-414e-a969-bd04d3531105\" (UID: \"f33cbc87-407d-414e-a969-bd04d3531105\") " Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.635588 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f33cbc87-407d-414e-a969-bd04d3531105" (UID: "f33cbc87-407d-414e-a969-bd04d3531105"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.643366 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs" (OuterVolumeSpecName: "kube-api-access-fs2bs") pod "f33cbc87-407d-414e-a969-bd04d3531105" (UID: "f33cbc87-407d-414e-a969-bd04d3531105"). InnerVolumeSpecName "kube-api-access-fs2bs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.737228 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f33cbc87-407d-414e-a969-bd04d3531105-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:16 crc kubenswrapper[5030]: I0316 13:34:16.737259 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs2bs\" (UniqueName: \"kubernetes.io/projected/f33cbc87-407d-414e-a969-bd04d3531105-kube-api-access-fs2bs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:17 crc kubenswrapper[5030]: I0316 13:34:17.223563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-rk4df" event={"ID":"f33cbc87-407d-414e-a969-bd04d3531105","Type":"ContainerDied","Data":"71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576"} Mar 16 13:34:17 crc kubenswrapper[5030]: I0316 13:34:17.223630 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71ceace4e2fac9ede6db3f9c0f69cc6ba76ed5f060c218766b0044eefb7a3576" Mar 16 13:34:17 crc kubenswrapper[5030]: I0316 13:34:17.223588 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-rk4df" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.173062 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.227348 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.227577 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="dnsmasq-dns" containerID="cri-o://08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee" gracePeriod=10 Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.636171 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.789876 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config\") pod \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.790009 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc\") pod \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.790098 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rl78\" (UniqueName: \"kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78\") pod \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\" (UID: \"c4c4d14b-81e6-4949-a22c-ebfaea862b78\") " Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.796891 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78" (OuterVolumeSpecName: "kube-api-access-8rl78") pod "c4c4d14b-81e6-4949-a22c-ebfaea862b78" (UID: "c4c4d14b-81e6-4949-a22c-ebfaea862b78"). InnerVolumeSpecName "kube-api-access-8rl78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.824358 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config" (OuterVolumeSpecName: "config") pod "c4c4d14b-81e6-4949-a22c-ebfaea862b78" (UID: "c4c4d14b-81e6-4949-a22c-ebfaea862b78"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.826732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "c4c4d14b-81e6-4949-a22c-ebfaea862b78" (UID: "c4c4d14b-81e6-4949-a22c-ebfaea862b78"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.891365 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rl78\" (UniqueName: \"kubernetes.io/projected/c4c4d14b-81e6-4949-a22c-ebfaea862b78-kube-api-access-8rl78\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.891393 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:19 crc kubenswrapper[5030]: I0316 13:34:19.891404 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/c4c4d14b-81e6-4949-a22c-ebfaea862b78-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.252154 5030 generic.go:358] "Generic (PLEG): container finished" podID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerID="08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee" exitCode=0 Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.252269 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.252267 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" event={"ID":"c4c4d14b-81e6-4949-a22c-ebfaea862b78","Type":"ContainerDied","Data":"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee"} Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.252723 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc" event={"ID":"c4c4d14b-81e6-4949-a22c-ebfaea862b78","Type":"ContainerDied","Data":"9dd9f8437d9a30bfdfe36bd77a1af3091294a0ea03aae065323d0a9c45c707fd"} Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.252769 5030 scope.go:117] "RemoveContainer" containerID="08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.276748 5030 scope.go:117] "RemoveContainer" containerID="0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.276935 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.281568 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-2l7rc"] Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.292739 5030 scope.go:117] "RemoveContainer" containerID="08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee" Mar 16 13:34:20 crc kubenswrapper[5030]: E0316 13:34:20.293047 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee\": container with ID starting with 08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee not found: ID does not exist" containerID="08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.293085 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee"} err="failed to get container status \"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee\": rpc error: code = NotFound desc = could not find container \"08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee\": container with ID starting with 08052dfdd9141b4a25fbe4a354e43ef0d0813c27c4c35348d5787ee5beff0bee not found: ID does not exist" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.293105 5030 scope.go:117] "RemoveContainer" containerID="0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e" Mar 16 13:34:20 crc kubenswrapper[5030]: E0316 13:34:20.293441 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e\": container with ID starting with 0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e not found: ID does not exist" containerID="0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e" Mar 16 13:34:20 crc kubenswrapper[5030]: I0316 13:34:20.293470 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e"} err="failed to get container status \"0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e\": rpc error: code = NotFound desc = could not find container \"0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e\": container with ID starting with 0d08ce57e5ff3b16d0ef383e9b8428dea78808edc2c2ccb09dcf4294c00f116e not found: ID does not exist" Mar 16 13:34:21 crc kubenswrapper[5030]: I0316 13:34:21.946921 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:34:21 crc kubenswrapper[5030]: E0316 13:34:21.947491 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:34:21 crc kubenswrapper[5030]: I0316 13:34:21.958503 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" path="/var/lib/kubelet/pods/c4c4d14b-81e6-4949-a22c-ebfaea862b78/volumes" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.226804 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.227921 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.417079 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-4k4zb"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.417954 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="init" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.417975 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="init" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418013 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="dnsmasq-dns" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418019 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="dnsmasq-dns" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418028 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33cbc87-407d-414e-a969-bd04d3531105" containerName="mariadb-account-create-update" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418034 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33cbc87-407d-414e-a969-bd04d3531105" containerName="mariadb-account-create-update" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418220 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4c4d14b-81e6-4949-a22c-ebfaea862b78" containerName="dnsmasq-dns" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.418249 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f33cbc87-407d-414e-a969-bd04d3531105" containerName="mariadb-account-create-update" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.422700 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.428051 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-4k4zb"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.525523 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.525591 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdz8c\" (UniqueName: \"kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.529592 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.533523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.535912 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.575775 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.621012 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-slwbl"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.625618 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.627022 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwhf\" (UniqueName: \"kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.627194 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.627237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdz8c\" (UniqueName: \"kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.627374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.628207 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.630833 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-slwbl"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.664248 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdz8c\" (UniqueName: \"kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c\") pod \"cinder-db-create-4k4zb\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.730463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zt8k\" (UniqueName: \"kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.730619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.730676 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.730750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwhf\" (UniqueName: \"kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.731763 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.731815 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-mdxq5"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.740239 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.740868 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.748530 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.750041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwhf\" (UniqueName: \"kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf\") pod \"cinder-3837-account-create-update-dn7f7\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.753801 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.766047 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.779784 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-mdxq5"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.786169 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832576 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832605 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrkx\" (UniqueName: \"kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqkg\" (UniqueName: \"kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832660 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.832762 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zt8k\" (UniqueName: \"kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.833626 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.840611 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pqqjb"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.849130 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.850163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zt8k\" (UniqueName: \"kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k\") pod \"neutron-db-create-slwbl\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.852265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pqqjb"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.852387 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.854875 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.856809 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.856896 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.856946 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-2bqg2\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.856895 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.858170 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.859286 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.862081 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6"] Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.934709 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.935601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.936745 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.936928 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.936991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrkx\" (UniqueName: \"kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqkg\" (UniqueName: \"kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937168 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8t8r\" (UniqueName: \"kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937375 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b4l9\" (UniqueName: \"kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.937956 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.949338 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.956680 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrkx\" (UniqueName: \"kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx\") pod \"barbican-db-create-mdxq5\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:27 crc kubenswrapper[5030]: I0316 13:34:27.956944 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqkg\" (UniqueName: \"kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg\") pod \"barbican-fcb6-account-create-update-qk2tp\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.039178 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.041005 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.041066 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8t8r\" (UniqueName: \"kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.043075 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.050873 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.041118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b4l9\" (UniqueName: \"kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.051076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.054621 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.058135 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8t8r\" (UniqueName: \"kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r\") pod \"neutron-8f68-account-create-update-24ck6\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.059392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b4l9\" (UniqueName: \"kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9\") pod \"keystone-db-sync-pqqjb\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.118068 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.126228 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.233994 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.234928 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-4k4zb"] Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.237675 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.338846 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7"] Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.350699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" event={"ID":"29ead796-035d-4350-83da-1fbb1fbbe0a8","Type":"ContainerStarted","Data":"f19aa858bf3d291aa9494c259568f8dcf8e2c9bc9b7ed5f47e259ea33d091763"} Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.406790 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-slwbl"] Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.566469 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp"] Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.626317 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-mdxq5"] Mar 16 13:34:28 crc kubenswrapper[5030]: W0316 13:34:28.631478 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee738805_96da_4590_91dc_d7551be1ca27.slice/crio-bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab WatchSource:0}: Error finding container bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab: Status 404 returned error can't find the container with id bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.750165 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6"] Mar 16 13:34:28 crc kubenswrapper[5030]: W0316 13:34:28.756844 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9759eec8_29cb_4b9e_a2a2_c43041da8886.slice/crio-6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd WatchSource:0}: Error finding container 6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd: Status 404 returned error can't find the container with id 6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd Mar 16 13:34:28 crc kubenswrapper[5030]: I0316 13:34:28.800396 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pqqjb"] Mar 16 13:34:28 crc kubenswrapper[5030]: W0316 13:34:28.909646 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92ba657c_622d_4ca5_8b0b_cd1a2dd20547.slice/crio-90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a WatchSource:0}: Error finding container 90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a: Status 404 returned error can't find the container with id 90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.361910 5030 generic.go:358] "Generic (PLEG): container finished" podID="fcda8593-4966-4d87-afc7-3566e38aa6b0" containerID="f2951f0345102481a378938a76fc53caece79aef9756f23ad2e3b89641e1a111" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.362032 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" event={"ID":"fcda8593-4966-4d87-afc7-3566e38aa6b0","Type":"ContainerDied","Data":"f2951f0345102481a378938a76fc53caece79aef9756f23ad2e3b89641e1a111"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.362365 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" event={"ID":"fcda8593-4966-4d87-afc7-3566e38aa6b0","Type":"ContainerStarted","Data":"dabbab6560ca7d565bee2d77e46cf5e1d659b780bb59bd37aef5e6d8a1665eee"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.365048 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac542008-cc3c-42cd-83f2-633a1f284240" containerID="158d2dd6af6cb24e0bc5c70cbfd55d2599a204b9434109ef4c8391212d24067b" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.365278 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-slwbl" event={"ID":"ac542008-cc3c-42cd-83f2-633a1f284240","Type":"ContainerDied","Data":"158d2dd6af6cb24e0bc5c70cbfd55d2599a204b9434109ef4c8391212d24067b"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.365325 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-slwbl" event={"ID":"ac542008-cc3c-42cd-83f2-633a1f284240","Type":"ContainerStarted","Data":"0dc14c86e20c5425c296a11407ef52ec89a7ed0aac32c2161a6a59d1bd5ec844"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.367594 5030 generic.go:358] "Generic (PLEG): container finished" podID="ee738805-96da-4590-91dc-d7551be1ca27" containerID="689ffd899b833c3e1a18d2bfa3c7f65e0a084e3316d81885ba75da2c57cc68fa" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.367633 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" event={"ID":"ee738805-96da-4590-91dc-d7551be1ca27","Type":"ContainerDied","Data":"689ffd899b833c3e1a18d2bfa3c7f65e0a084e3316d81885ba75da2c57cc68fa"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.367671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" event={"ID":"ee738805-96da-4590-91dc-d7551be1ca27","Type":"ContainerStarted","Data":"bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.370363 5030 generic.go:358] "Generic (PLEG): container finished" podID="9759eec8-29cb-4b9e-a2a2-c43041da8886" containerID="3c167378963bc5d64c47a85b0ddce3f4da963ac996c490adb963b53169efcc9c" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.370459 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" event={"ID":"9759eec8-29cb-4b9e-a2a2-c43041da8886","Type":"ContainerDied","Data":"3c167378963bc5d64c47a85b0ddce3f4da963ac996c490adb963b53169efcc9c"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.370515 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" event={"ID":"9759eec8-29cb-4b9e-a2a2-c43041da8886","Type":"ContainerStarted","Data":"6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.372812 5030 generic.go:358] "Generic (PLEG): container finished" podID="35b96b94-ac0d-403c-bcd4-71844e15123c" containerID="eda2cec29dad1a9a631748aa79aa2280974f7949e0ccd6e7e002ab4e21d9a299" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.372958 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" event={"ID":"35b96b94-ac0d-403c-bcd4-71844e15123c","Type":"ContainerDied","Data":"eda2cec29dad1a9a631748aa79aa2280974f7949e0ccd6e7e002ab4e21d9a299"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.373011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" event={"ID":"35b96b94-ac0d-403c-bcd4-71844e15123c","Type":"ContainerStarted","Data":"1b0bd2b118e11a5886c7ba0b6cae67ff238bb60b98681871cddf331b7090c8d4"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.375485 5030 generic.go:358] "Generic (PLEG): container finished" podID="29ead796-035d-4350-83da-1fbb1fbbe0a8" containerID="94e0f8580411d1f3d0d78190ef975b2cbea4caccf5391b4ca612264e09405711" exitCode=0 Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.375597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" event={"ID":"29ead796-035d-4350-83da-1fbb1fbbe0a8","Type":"ContainerDied","Data":"94e0f8580411d1f3d0d78190ef975b2cbea4caccf5391b4ca612264e09405711"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.377576 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" event={"ID":"92ba657c-622d-4ca5-8b0b-cd1a2dd20547","Type":"ContainerStarted","Data":"197e8faf7f86168cc775f335574cef1b41469e1149f9f1ab8c7fb9d88670df25"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.377610 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" event={"ID":"92ba657c-622d-4ca5-8b0b-cd1a2dd20547","Type":"ContainerStarted","Data":"90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a"} Mar 16 13:34:29 crc kubenswrapper[5030]: I0316 13:34:29.450953 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" podStartSLOduration=2.450932812 podStartE2EDuration="2.450932812s" podCreationTimestamp="2026-03-16 13:34:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:29.443326278 +0000 UTC m=+1713.842638824" watchObservedRunningTime="2026-03-16 13:34:29.450932812 +0000 UTC m=+1713.850245360" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.650344 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.717862 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwrkx\" (UniqueName: \"kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx\") pod \"ee738805-96da-4590-91dc-d7551be1ca27\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.718596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts\") pod \"ee738805-96da-4590-91dc-d7551be1ca27\" (UID: \"ee738805-96da-4590-91dc-d7551be1ca27\") " Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.719820 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee738805-96da-4590-91dc-d7551be1ca27" (UID: "ee738805-96da-4590-91dc-d7551be1ca27"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.720033 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee738805-96da-4590-91dc-d7551be1ca27-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.726660 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx" (OuterVolumeSpecName: "kube-api-access-kwrkx") pod "ee738805-96da-4590-91dc-d7551be1ca27" (UID: "ee738805-96da-4590-91dc-d7551be1ca27"). InnerVolumeSpecName "kube-api-access-kwrkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.779634 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.824036 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwrkx\" (UniqueName: \"kubernetes.io/projected/ee738805-96da-4590-91dc-d7551be1ca27-kube-api-access-kwrkx\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.871328 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.878285 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.887422 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.891026 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.927995 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9759eec8-29cb-4b9e-a2a2-c43041da8886" (UID: "9759eec8-29cb-4b9e-a2a2-c43041da8886"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.927536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts\") pod \"9759eec8-29cb-4b9e-a2a2-c43041da8886\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.928324 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8t8r\" (UniqueName: \"kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r\") pod \"9759eec8-29cb-4b9e-a2a2-c43041da8886\" (UID: \"9759eec8-29cb-4b9e-a2a2-c43041da8886\") " Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.930350 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9759eec8-29cb-4b9e-a2a2-c43041da8886-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:30 crc kubenswrapper[5030]: I0316 13:34:30.931634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r" (OuterVolumeSpecName: "kube-api-access-p8t8r") pod "9759eec8-29cb-4b9e-a2a2-c43041da8886" (UID: "9759eec8-29cb-4b9e-a2a2-c43041da8886"). InnerVolumeSpecName "kube-api-access-p8t8r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031346 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts\") pod \"35b96b94-ac0d-403c-bcd4-71844e15123c\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031434 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts\") pod \"fcda8593-4966-4d87-afc7-3566e38aa6b0\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031669 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts\") pod \"ac542008-cc3c-42cd-83f2-633a1f284240\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bwhf\" (UniqueName: \"kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf\") pod \"35b96b94-ac0d-403c-bcd4-71844e15123c\" (UID: \"35b96b94-ac0d-403c-bcd4-71844e15123c\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdz8c\" (UniqueName: \"kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c\") pod \"29ead796-035d-4350-83da-1fbb1fbbe0a8\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "35b96b94-ac0d-403c-bcd4-71844e15123c" (UID: "35b96b94-ac0d-403c-bcd4-71844e15123c"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.031964 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zt8k\" (UniqueName: \"kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k\") pod \"ac542008-cc3c-42cd-83f2-633a1f284240\" (UID: \"ac542008-cc3c-42cd-83f2-633a1f284240\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.032010 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnqkg\" (UniqueName: \"kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg\") pod \"fcda8593-4966-4d87-afc7-3566e38aa6b0\" (UID: \"fcda8593-4966-4d87-afc7-3566e38aa6b0\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.032137 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts\") pod \"29ead796-035d-4350-83da-1fbb1fbbe0a8\" (UID: \"29ead796-035d-4350-83da-1fbb1fbbe0a8\") " Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.032179 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "fcda8593-4966-4d87-afc7-3566e38aa6b0" (UID: "fcda8593-4966-4d87-afc7-3566e38aa6b0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.032733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ac542008-cc3c-42cd-83f2-633a1f284240" (UID: "ac542008-cc3c-42cd-83f2-633a1f284240"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.032957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "29ead796-035d-4350-83da-1fbb1fbbe0a8" (UID: "29ead796-035d-4350-83da-1fbb1fbbe0a8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.033449 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/35b96b94-ac0d-403c-bcd4-71844e15123c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.033466 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/fcda8593-4966-4d87-afc7-3566e38aa6b0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.033476 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac542008-cc3c-42cd-83f2-633a1f284240-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.033486 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8t8r\" (UniqueName: \"kubernetes.io/projected/9759eec8-29cb-4b9e-a2a2-c43041da8886-kube-api-access-p8t8r\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.033499 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/29ead796-035d-4350-83da-1fbb1fbbe0a8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.035736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c" (OuterVolumeSpecName: "kube-api-access-hdz8c") pod "29ead796-035d-4350-83da-1fbb1fbbe0a8" (UID: "29ead796-035d-4350-83da-1fbb1fbbe0a8"). InnerVolumeSpecName "kube-api-access-hdz8c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.036330 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg" (OuterVolumeSpecName: "kube-api-access-dnqkg") pod "fcda8593-4966-4d87-afc7-3566e38aa6b0" (UID: "fcda8593-4966-4d87-afc7-3566e38aa6b0"). InnerVolumeSpecName "kube-api-access-dnqkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.036371 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf" (OuterVolumeSpecName: "kube-api-access-5bwhf") pod "35b96b94-ac0d-403c-bcd4-71844e15123c" (UID: "35b96b94-ac0d-403c-bcd4-71844e15123c"). InnerVolumeSpecName "kube-api-access-5bwhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.036834 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k" (OuterVolumeSpecName: "kube-api-access-5zt8k") pod "ac542008-cc3c-42cd-83f2-633a1f284240" (UID: "ac542008-cc3c-42cd-83f2-633a1f284240"). InnerVolumeSpecName "kube-api-access-5zt8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.135805 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bwhf\" (UniqueName: \"kubernetes.io/projected/35b96b94-ac0d-403c-bcd4-71844e15123c-kube-api-access-5bwhf\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.135989 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdz8c\" (UniqueName: \"kubernetes.io/projected/29ead796-035d-4350-83da-1fbb1fbbe0a8-kube-api-access-hdz8c\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.136061 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zt8k\" (UniqueName: \"kubernetes.io/projected/ac542008-cc3c-42cd-83f2-633a1f284240-kube-api-access-5zt8k\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.136143 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnqkg\" (UniqueName: \"kubernetes.io/projected/fcda8593-4966-4d87-afc7-3566e38aa6b0-kube-api-access-dnqkg\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.399977 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.399997 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp" event={"ID":"fcda8593-4966-4d87-afc7-3566e38aa6b0","Type":"ContainerDied","Data":"dabbab6560ca7d565bee2d77e46cf5e1d659b780bb59bd37aef5e6d8a1665eee"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.400067 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dabbab6560ca7d565bee2d77e46cf5e1d659b780bb59bd37aef5e6d8a1665eee" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.402437 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-slwbl" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.402430 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-slwbl" event={"ID":"ac542008-cc3c-42cd-83f2-633a1f284240","Type":"ContainerDied","Data":"0dc14c86e20c5425c296a11407ef52ec89a7ed0aac32c2161a6a59d1bd5ec844"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.402591 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dc14c86e20c5425c296a11407ef52ec89a7ed0aac32c2161a6a59d1bd5ec844" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.404160 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.404213 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-mdxq5" event={"ID":"ee738805-96da-4590-91dc-d7551be1ca27","Type":"ContainerDied","Data":"bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.404272 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf514e2febc2deaec0d06f03dc085895a962c4d0c2fa9e48ca1bbbe07b88c8ab" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.406261 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.406279 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6" event={"ID":"9759eec8-29cb-4b9e-a2a2-c43041da8886","Type":"ContainerDied","Data":"6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.406324 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aca070a31a7487204632f6d31d5d2030d0a7f7485843302e5369d78c46ce8fd" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.410133 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.410142 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7" event={"ID":"35b96b94-ac0d-403c-bcd4-71844e15123c","Type":"ContainerDied","Data":"1b0bd2b118e11a5886c7ba0b6cae67ff238bb60b98681871cddf331b7090c8d4"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.410260 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b0bd2b118e11a5886c7ba0b6cae67ff238bb60b98681871cddf331b7090c8d4" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.412271 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.412297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-4k4zb" event={"ID":"29ead796-035d-4350-83da-1fbb1fbbe0a8","Type":"ContainerDied","Data":"f19aa858bf3d291aa9494c259568f8dcf8e2c9bc9b7ed5f47e259ea33d091763"} Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.412335 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f19aa858bf3d291aa9494c259568f8dcf8e2c9bc9b7ed5f47e259ea33d091763" Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.415029 5030 generic.go:358] "Generic (PLEG): container finished" podID="92ba657c-622d-4ca5-8b0b-cd1a2dd20547" containerID="197e8faf7f86168cc775f335574cef1b41469e1149f9f1ab8c7fb9d88670df25" exitCode=0 Mar 16 13:34:31 crc kubenswrapper[5030]: I0316 13:34:31.415134 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" event={"ID":"92ba657c-622d-4ca5-8b0b-cd1a2dd20547","Type":"ContainerDied","Data":"197e8faf7f86168cc775f335574cef1b41469e1149f9f1ab8c7fb9d88670df25"} Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.716848 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.872395 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle\") pod \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.872962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b4l9\" (UniqueName: \"kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9\") pod \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.873269 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data\") pod \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\" (UID: \"92ba657c-622d-4ca5-8b0b-cd1a2dd20547\") " Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.880672 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9" (OuterVolumeSpecName: "kube-api-access-6b4l9") pod "92ba657c-622d-4ca5-8b0b-cd1a2dd20547" (UID: "92ba657c-622d-4ca5-8b0b-cd1a2dd20547"). InnerVolumeSpecName "kube-api-access-6b4l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.897411 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92ba657c-622d-4ca5-8b0b-cd1a2dd20547" (UID: "92ba657c-622d-4ca5-8b0b-cd1a2dd20547"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.911841 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data" (OuterVolumeSpecName: "config-data") pod "92ba657c-622d-4ca5-8b0b-cd1a2dd20547" (UID: "92ba657c-622d-4ca5-8b0b-cd1a2dd20547"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.946252 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:34:32 crc kubenswrapper[5030]: E0316 13:34:32.946788 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.974842 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b4l9\" (UniqueName: \"kubernetes.io/projected/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-kube-api-access-6b4l9\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.975069 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:32 crc kubenswrapper[5030]: I0316 13:34:32.975081 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92ba657c-622d-4ca5-8b0b-cd1a2dd20547-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.443859 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.443860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-pqqjb" event={"ID":"92ba657c-622d-4ca5-8b0b-cd1a2dd20547","Type":"ContainerDied","Data":"90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a"} Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.443934 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a2d8ccc6dcf75a383c5ca260d4a9013eea370a5e47bc1ae6e6b47ab555b68a" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.816338 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-mvwf7"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821182 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9759eec8-29cb-4b9e-a2a2-c43041da8886" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821208 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9759eec8-29cb-4b9e-a2a2-c43041da8886" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821226 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee738805-96da-4590-91dc-d7551be1ca27" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821233 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee738805-96da-4590-91dc-d7551be1ca27" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821246 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ead796-035d-4350-83da-1fbb1fbbe0a8" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821251 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ead796-035d-4350-83da-1fbb1fbbe0a8" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821261 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcda8593-4966-4d87-afc7-3566e38aa6b0" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821268 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcda8593-4966-4d87-afc7-3566e38aa6b0" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821291 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b96b94-ac0d-403c-bcd4-71844e15123c" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821295 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b96b94-ac0d-403c-bcd4-71844e15123c" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821310 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac542008-cc3c-42cd-83f2-633a1f284240" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821315 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac542008-cc3c-42cd-83f2-633a1f284240" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821326 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92ba657c-622d-4ca5-8b0b-cd1a2dd20547" containerName="keystone-db-sync" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821332 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92ba657c-622d-4ca5-8b0b-cd1a2dd20547" containerName="keystone-db-sync" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821459 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac542008-cc3c-42cd-83f2-633a1f284240" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821471 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92ba657c-622d-4ca5-8b0b-cd1a2dd20547" containerName="keystone-db-sync" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821483 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcda8593-4966-4d87-afc7-3566e38aa6b0" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821492 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee738805-96da-4590-91dc-d7551be1ca27" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821500 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29ead796-035d-4350-83da-1fbb1fbbe0a8" containerName="mariadb-database-create" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821510 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="35b96b94-ac0d-403c-bcd4-71844e15123c" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.821516 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9759eec8-29cb-4b9e-a2a2-c43041da8886" containerName="mariadb-account-create-update" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.840075 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-mvwf7"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.840196 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.846280 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.846506 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.846586 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.846630 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-2bqg2\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.846508 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.919626 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.925813 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.926283 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.935592 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.936025 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.936336 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.936533 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-vb2g5\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.971659 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.979016 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.985092 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.985166 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.989032 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-c7tv2"] Mar 16 13:34:33 crc kubenswrapper[5030]: I0316 13:34:33.996195 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.002152 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.002578 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.003803 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.003955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6zv2\" (UniqueName: \"kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.004044 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.004087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.004301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.004450 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.004601 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2tjn6"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.005911 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-2lntc\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.027454 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.027489 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-c7tv2"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.027642 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.032865 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.033439 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.033718 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-24jz9\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.033863 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.041670 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.048606 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.048788 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.051666 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.072436 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2tjn6"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106098 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106158 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106183 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106217 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6zv2\" (UniqueName: \"kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106248 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106272 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106327 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106359 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106400 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l26hq\" (UniqueName: \"kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106481 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwdz\" (UniqueName: \"kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106516 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106598 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106726 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106742 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106763 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106787 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106829 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106858 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106883 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.106947 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.107017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9gm\" (UniqueName: \"kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.107034 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm2xk\" (UniqueName: \"kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.121018 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.125502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.126085 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-spqtz"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.126080 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.131242 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.133573 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6zv2\" (UniqueName: \"kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.134249 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-mxh7l\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.134379 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.136821 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-spqtz"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.139495 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.141462 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys\") pod \"keystone-bootstrap-mvwf7\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.161889 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-rw8zp"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.168478 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.172363 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-rw8zp"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.172479 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.176378 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.178256 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-twz6k\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.178489 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.208491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.208528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.208566 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.208590 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209404 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209586 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209765 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9gm\" (UniqueName: \"kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xm2xk\" (UniqueName: \"kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209812 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhcm\" (UniqueName: \"kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209850 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209867 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrnz\" (UniqueName: \"kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209925 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209969 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.209998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210051 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210078 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210163 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210191 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l26hq\" (UniqueName: \"kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210239 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210290 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwdz\" (UniqueName: \"kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210306 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210388 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210473 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.210496 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.213328 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.213812 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.214366 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.214437 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.214437 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.214600 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.215372 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.218387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.219408 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.219482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.223011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.224887 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.227600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.227710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.227760 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.228690 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.229765 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.232370 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm2xk\" (UniqueName: \"kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.232437 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.232608 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.232907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l26hq\" (UniqueName: \"kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.234710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwdz\" (UniqueName: \"kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz\") pod \"neutron-db-sync-c7tv2\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.235450 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9gm\" (UniqueName: \"kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.237104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data\") pod \"cinder-db-sync-2tjn6\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.239066 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.264771 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313481 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313504 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313542 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kwjt\" (UniqueName: \"kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313611 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313629 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313655 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.313688 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.314419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.314483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.314523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.314544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.316123 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhcm\" (UniqueName: \"kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.316181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.316202 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrnz\" (UniqueName: \"kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.316376 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.326195 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.326482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.330178 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.333949 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrnz\" (UniqueName: \"kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.334688 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.334780 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.335291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.336575 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.337375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.340645 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.342538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle\") pod \"barbican-db-sync-spqtz\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.344972 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhcm\" (UniqueName: \"kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm\") pod \"ceilometer-0\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.379348 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.418315 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.418817 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.418869 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kwjt\" (UniqueName: \"kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.418937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.419002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.419430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.441441 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.441643 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.444411 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.445730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kwjt\" (UniqueName: \"kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt\") pod \"placement-db-sync-rw8zp\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.495352 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.502370 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.553248 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.598147 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.653665 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-mvwf7"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.804403 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2tjn6"] Mar 16 13:34:34 crc kubenswrapper[5030]: W0316 13:34:34.805990 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20694ac7_1dc1_452c_9fe4_5c321678f70a.slice/crio-16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c WatchSource:0}: Error finding container 16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c: Status 404 returned error can't find the container with id 16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.861221 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-c7tv2"] Mar 16 13:34:34 crc kubenswrapper[5030]: I0316 13:34:34.956177 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:34 crc kubenswrapper[5030]: W0316 13:34:34.957964 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd526a6f1_5f99_4e78_a4b2_bf9e85ae7951.slice/crio-d531e63393a180e59fb804ce12a87f3c016354750290ba279255f6a4f76de96f WatchSource:0}: Error finding container d531e63393a180e59fb804ce12a87f3c016354750290ba279255f6a4f76de96f: Status 404 returned error can't find the container with id d531e63393a180e59fb804ce12a87f3c016354750290ba279255f6a4f76de96f Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.041560 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.049131 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-spqtz"] Mar 16 13:34:35 crc kubenswrapper[5030]: W0316 13:34:35.053416 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83628fc8_9c43_4379_bd29_1aad122da53a.slice/crio-7ce87ebb282582a70e0d254f96e945de315af7f4d80ab152a5c45e8b5a634188 WatchSource:0}: Error finding container 7ce87ebb282582a70e0d254f96e945de315af7f4d80ab152a5c45e8b5a634188: Status 404 returned error can't find the container with id 7ce87ebb282582a70e0d254f96e945de315af7f4d80ab152a5c45e8b5a634188 Mar 16 13:34:35 crc kubenswrapper[5030]: W0316 13:34:35.059708 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c4e3703_ac33_43e2_b5c9_a6900c94daf9.slice/crio-6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71 WatchSource:0}: Error finding container 6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71: Status 404 returned error can't find the container with id 6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71 Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.061695 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-rw8zp"] Mar 16 13:34:35 crc kubenswrapper[5030]: W0316 13:34:35.061826 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8ffd7b9_ce16_4fb0_b1c2_b83117629c7f.slice/crio-ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59 WatchSource:0}: Error finding container ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59: Status 404 returned error can't find the container with id ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59 Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.153210 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.473938 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" event={"ID":"0c4e3703-ac33-43e2-b5c9-a6900c94daf9","Type":"ContainerStarted","Data":"66ba65522f5cf621267b57572390623b11f761c696d38be53c87d8d37e2f2cfd"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.473990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" event={"ID":"0c4e3703-ac33-43e2-b5c9-a6900c94daf9","Type":"ContainerStarted","Data":"6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.482288 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" event={"ID":"a1786247-15e8-44c8-9a08-cfe244232583","Type":"ContainerStarted","Data":"93967d80c7960c65591e9135e5799b21ffdc065d8c37f6283002184a0f414493"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.482329 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" event={"ID":"a1786247-15e8-44c8-9a08-cfe244232583","Type":"ContainerStarted","Data":"ab150ef5428da313633b54205716dc8a1e254a6604faf45c6afe3ae96fcae1e9"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.490250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerStarted","Data":"d531e63393a180e59fb804ce12a87f3c016354750290ba279255f6a4f76de96f"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.492979 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerStarted","Data":"f01451f4505e88cd23d15f8c57bf093c639e86b99764281e65d7da75374c62b8"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.493160 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" podStartSLOduration=1.493150169 podStartE2EDuration="1.493150169s" podCreationTimestamp="2026-03-16 13:34:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:35.487082958 +0000 UTC m=+1719.886395505" watchObservedRunningTime="2026-03-16 13:34:35.493150169 +0000 UTC m=+1719.892462715" Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.494914 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" event={"ID":"20694ac7-1dc1-452c-9fe4-5c321678f70a","Type":"ContainerStarted","Data":"16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.510764 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" podStartSLOduration=2.510756179 podStartE2EDuration="2.510756179s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:35.507304297 +0000 UTC m=+1719.906616845" watchObservedRunningTime="2026-03-16 13:34:35.510756179 +0000 UTC m=+1719.910068726" Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.525158 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" event={"ID":"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f","Type":"ContainerStarted","Data":"f298e04471cffc32253883ebff460585bcff82a2e83c62dd409f0fa9199f3b5a"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.525205 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" event={"ID":"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f","Type":"ContainerStarted","Data":"ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.545528 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" podStartSLOduration=1.54551077 podStartE2EDuration="1.54551077s" podCreationTimestamp="2026-03-16 13:34:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:35.538912962 +0000 UTC m=+1719.938225509" watchObservedRunningTime="2026-03-16 13:34:35.54551077 +0000 UTC m=+1719.944823307" Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.547304 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" event={"ID":"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14","Type":"ContainerStarted","Data":"1806450d29c48e0911874aee0f879139c7367e0bdf5b4c2a7f18f75cab3ca0d5"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.547338 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" event={"ID":"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14","Type":"ContainerStarted","Data":"ceeb170650c30ce65faae9c4007d22032ab1a1b7a9207b310ef4cf2cb9be87a4"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.552755 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerStarted","Data":"7ce87ebb282582a70e0d254f96e945de315af7f4d80ab152a5c45e8b5a634188"} Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.798053 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" podStartSLOduration=2.798029839 podStartE2EDuration="2.798029839s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:35.563957602 +0000 UTC m=+1719.963270149" watchObservedRunningTime="2026-03-16 13:34:35.798029839 +0000 UTC m=+1720.197342386" Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.813239 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.856080 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:35 crc kubenswrapper[5030]: I0316 13:34:35.901909 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.610157 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c4e3703-ac33-43e2-b5c9-a6900c94daf9" containerID="66ba65522f5cf621267b57572390623b11f761c696d38be53c87d8d37e2f2cfd" exitCode=0 Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.611024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" event={"ID":"0c4e3703-ac33-43e2-b5c9-a6900c94daf9","Type":"ContainerDied","Data":"66ba65522f5cf621267b57572390623b11f761c696d38be53c87d8d37e2f2cfd"} Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.616367 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerStarted","Data":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.633418 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerStarted","Data":"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b"} Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.636483 5030 generic.go:358] "Generic (PLEG): container finished" podID="a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" containerID="f298e04471cffc32253883ebff460585bcff82a2e83c62dd409f0fa9199f3b5a" exitCode=0 Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.636767 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" event={"ID":"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f","Type":"ContainerDied","Data":"f298e04471cffc32253883ebff460585bcff82a2e83c62dd409f0fa9199f3b5a"} Mar 16 13:34:36 crc kubenswrapper[5030]: I0316 13:34:36.651739 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerStarted","Data":"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.662855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerStarted","Data":"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.662900 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-log" containerID="cri-o://bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" gracePeriod=30 Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.663024 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-httpd" containerID="cri-o://53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" gracePeriod=30 Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.668023 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerStarted","Data":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.668070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerStarted","Data":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.670428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerStarted","Data":"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.670629 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-log" containerID="cri-o://0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" gracePeriod=30 Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.670898 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-httpd" containerID="cri-o://5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" gracePeriod=30 Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.673886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" event={"ID":"20694ac7-1dc1-452c-9fe4-5c321678f70a","Type":"ContainerStarted","Data":"d58ff4a8695cc38f391c0c2a69464858345aeff2447a9f3141702f54b01fff5b"} Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.693509 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.693492752 podStartE2EDuration="4.693492752s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:37.687495192 +0000 UTC m=+1722.086807739" watchObservedRunningTime="2026-03-16 13:34:37.693492752 +0000 UTC m=+1722.092805299" Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.732416 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.732397337 podStartE2EDuration="4.732397337s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:37.716086792 +0000 UTC m=+1722.115399340" watchObservedRunningTime="2026-03-16 13:34:37.732397337 +0000 UTC m=+1722.131709885" Mar 16 13:34:37 crc kubenswrapper[5030]: I0316 13:34:37.732540 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" podStartSLOduration=4.732536048 podStartE2EDuration="4.732536048s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:37.729242364 +0000 UTC m=+1722.128554901" watchObservedRunningTime="2026-03-16 13:34:37.732536048 +0000 UTC m=+1722.131848586" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.446018 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.460463 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515467 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts\") pod \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515516 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data\") pod \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515624 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxrnz\" (UniqueName: \"kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz\") pod \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515779 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle\") pod \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kwjt\" (UniqueName: \"kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt\") pod \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs\") pod \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.515995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data\") pod \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\" (UID: \"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.516040 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle\") pod \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\" (UID: \"0c4e3703-ac33-43e2-b5c9-a6900c94daf9\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.518163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs" (OuterVolumeSpecName: "logs") pod "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" (UID: "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.518334 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.524825 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts" (OuterVolumeSpecName: "scripts") pod "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" (UID: "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.525432 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "0c4e3703-ac33-43e2-b5c9-a6900c94daf9" (UID: "0c4e3703-ac33-43e2-b5c9-a6900c94daf9"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.529025 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz" (OuterVolumeSpecName: "kube-api-access-sxrnz") pod "0c4e3703-ac33-43e2-b5c9-a6900c94daf9" (UID: "0c4e3703-ac33-43e2-b5c9-a6900c94daf9"). InnerVolumeSpecName "kube-api-access-sxrnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.532843 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt" (OuterVolumeSpecName: "kube-api-access-8kwjt") pod "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" (UID: "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f"). InnerVolumeSpecName "kube-api-access-8kwjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.553046 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" (UID: "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.565950 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c4e3703-ac33-43e2-b5c9-a6900c94daf9" (UID: "0c4e3703-ac33-43e2-b5c9-a6900c94daf9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.584298 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data" (OuterVolumeSpecName: "config-data") pod "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" (UID: "a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617698 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617821 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617837 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617861 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.617916 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm2xk\" (UniqueName: \"kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618254 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\" (UID: \"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618945 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618964 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618987 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxrnz\" (UniqueName: \"kubernetes.io/projected/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-kube-api-access-sxrnz\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.618997 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.619008 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kwjt\" (UniqueName: \"kubernetes.io/projected/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-kube-api-access-8kwjt\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.619017 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.619024 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.619033 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c4e3703-ac33-43e2-b5c9-a6900c94daf9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.619980 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs" (OuterVolumeSpecName: "logs") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.620668 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.625819 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.634716 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk" (OuterVolumeSpecName: "kube-api-access-xm2xk") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "kube-api-access-xm2xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.642688 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts" (OuterVolumeSpecName: "scripts") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.683380 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.697840 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700048 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700072 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700087 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" containerName="placement-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700093 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" containerName="placement-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700146 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4e3703-ac33-43e2-b5c9-a6900c94daf9" containerName="barbican-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700152 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4e3703-ac33-43e2-b5c9-a6900c94daf9" containerName="barbican-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700163 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700169 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.700996 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.701017 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c4e3703-ac33-43e2-b5c9-a6900c94daf9" containerName="barbican-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.701032 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" containerName="placement-db-sync" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.701039 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722324 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722361 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722373 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722385 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm2xk\" (UniqueName: \"kubernetes.io/projected/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-kube-api-access-xm2xk\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722394 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.722445 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.738649 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.738816 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.742287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data" (OuterVolumeSpecName: "config-data") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.742596 5030 generic.go:358] "Generic (PLEG): container finished" podID="a1786247-15e8-44c8-9a08-cfe244232583" containerID="93967d80c7960c65591e9135e5799b21ffdc065d8c37f6283002184a0f414493" exitCode=0 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.742760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" event={"ID":"a1786247-15e8-44c8-9a08-cfe244232583","Type":"ContainerDied","Data":"93967d80c7960c65591e9135e5799b21ffdc065d8c37f6283002184a0f414493"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.748011 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.756949 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758154 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758172 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758184 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758190 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758391 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-log" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.758407 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" containerName="glance-httpd" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.770359 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.771485 5030 generic.go:358] "Generic (PLEG): container finished" podID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerID="5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" exitCode=0 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.771522 5030 generic.go:358] "Generic (PLEG): container finished" podID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" containerID="0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" exitCode=143 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.771897 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerDied","Data":"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.781139 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.773364 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.777148 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.781473 5030 scope.go:117] "RemoveContainer" containerID="5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.782093 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.782659 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.802968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerDied","Data":"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.803013 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21","Type":"ContainerDied","Data":"f01451f4505e88cd23d15f8c57bf093c639e86b99764281e65d7da75374c62b8"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.803032 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-rw8zp" event={"ID":"a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f","Type":"ContainerDied","Data":"ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.803048 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab48102178e3b6ed8b11885c810fb5534bd14547d76497231a038147719d6a59" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.803150 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.803853 5030 generic.go:358] "Generic (PLEG): container finished" podID="e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" containerID="1806450d29c48e0911874aee0f879139c7367e0bdf5b4c2a7f18f75cab3ca0d5" exitCode=0 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.804311 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" event={"ID":"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14","Type":"ContainerDied","Data":"1806450d29c48e0911874aee0f879139c7367e0bdf5b4c2a7f18f75cab3ca0d5"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.809105 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.810455 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" (UID: "f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.826777 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.826831 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.826855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.826883 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.826932 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827038 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827208 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827233 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l9gm\" (UniqueName: \"kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm\") pod \"83628fc8-9c43-4379-bd29-1aad122da53a\" (UID: \"83628fc8-9c43-4379-bd29-1aad122da53a\") " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827489 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827521 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827563 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827593 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t92j\" (UniqueName: \"kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s574s\" (UniqueName: \"kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827654 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827675 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827694 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827712 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827760 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv7ld\" (UniqueName: \"kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827839 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827864 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827879 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827964 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827974 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.827983 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.828647 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.829061 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs" (OuterVolumeSpecName: "logs") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.836159 5030 scope.go:117] "RemoveContainer" containerID="0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.844597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts" (OuterVolumeSpecName: "scripts") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.851731 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.852148 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.853392 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm" (OuterVolumeSpecName: "kube-api-access-6l9gm") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "kube-api-access-6l9gm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.864912 5030 generic.go:358] "Generic (PLEG): container finished" podID="83628fc8-9c43-4379-bd29-1aad122da53a" containerID="53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" exitCode=0 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.864942 5030 generic.go:358] "Generic (PLEG): container finished" podID="83628fc8-9c43-4379-bd29-1aad122da53a" containerID="bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" exitCode=143 Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.865230 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.865490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerDied","Data":"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.865519 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerDied","Data":"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.865543 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"83628fc8-9c43-4379-bd29-1aad122da53a","Type":"ContainerDied","Data":"7ce87ebb282582a70e0d254f96e945de315af7f4d80ab152a5c45e8b5a634188"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.867091 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.884106 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.884649 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-spqtz" event={"ID":"0c4e3703-ac33-43e2-b5c9-a6900c94daf9","Type":"ContainerDied","Data":"6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71"} Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.884708 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6424a619c21c6ab76d05a74f97c69873cd42e1340476eb8cef8f4cf4db9d3f71" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.895756 5030 scope.go:117] "RemoveContainer" containerID="5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" Mar 16 13:34:38 crc kubenswrapper[5030]: E0316 13:34:38.896247 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb\": container with ID starting with 5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb not found: ID does not exist" containerID="5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896281 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb"} err="failed to get container status \"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb\": rpc error: code = NotFound desc = could not find container \"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb\": container with ID starting with 5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb not found: ID does not exist" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896305 5030 scope.go:117] "RemoveContainer" containerID="0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" Mar 16 13:34:38 crc kubenswrapper[5030]: E0316 13:34:38.896534 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b\": container with ID starting with 0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b not found: ID does not exist" containerID="0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896572 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b"} err="failed to get container status \"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b\": rpc error: code = NotFound desc = could not find container \"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b\": container with ID starting with 0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b not found: ID does not exist" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896587 5030 scope.go:117] "RemoveContainer" containerID="5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896772 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb"} err="failed to get container status \"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb\": rpc error: code = NotFound desc = could not find container \"5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb\": container with ID starting with 5faceedb79ff503dc1730e596b6453c9f4f5b16e1ca0fed97757060b28fb79fb not found: ID does not exist" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896789 5030 scope.go:117] "RemoveContainer" containerID="0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896965 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b"} err="failed to get container status \"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b\": rpc error: code = NotFound desc = could not find container \"0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b\": container with ID starting with 0b35c0e038aed1235066bd78f296f304f46df7d324fdbbf4c96f32d054cde02b not found: ID does not exist" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.896977 5030 scope.go:117] "RemoveContainer" containerID="53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.900738 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.931948 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932102 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t92j\" (UniqueName: \"kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932330 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s574s\" (UniqueName: \"kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932431 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932580 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.932945 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933195 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv7ld\" (UniqueName: \"kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933616 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933751 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.933858 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.934059 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.934795 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935015 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935111 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9gm\" (UniqueName: \"kubernetes.io/projected/83628fc8-9c43-4379-bd29-1aad122da53a-kube-api-access-6l9gm\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935208 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935285 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935368 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.935450 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/83628fc8-9c43-4379-bd29-1aad122da53a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.951407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.951486 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.959111 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.973712 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.984018 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.995184 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:38 crc kubenswrapper[5030]: I0316 13:34:38.995347 5030 scope.go:117] "RemoveContainer" containerID="bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.000403 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.027302 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s574s\" (UniqueName: \"kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.028021 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.030908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data\") pod \"barbican-keystone-listener-65dfb6fb9b-zkqb2\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.034351 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.056148 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data" (OuterVolumeSpecName: "config-data") pod "83628fc8-9c43-4379-bd29-1aad122da53a" (UID: "83628fc8-9c43-4379-bd29-1aad122da53a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.056430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.056896 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.061675 5030 scope.go:117] "RemoveContainer" containerID="53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.067875 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.097815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv7ld\" (UniqueName: \"kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.098368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t92j\" (UniqueName: \"kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.098459 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.099113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle\") pod \"placement-76944fdc46-mfr86\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.099191 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data\") pod \"barbican-worker-648b84c88c-z6lnf\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.100198 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:39 crc kubenswrapper[5030]: E0316 13:34:39.120760 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7\": container with ID starting with 53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7 not found: ID does not exist" containerID="53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.120815 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7"} err="failed to get container status \"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7\": rpc error: code = NotFound desc = could not find container \"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7\": container with ID starting with 53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7 not found: ID does not exist" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.120846 5030 scope.go:117] "RemoveContainer" containerID="bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.121388 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.122072 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:39 crc kubenswrapper[5030]: E0316 13:34:39.122892 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10\": container with ID starting with bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10 not found: ID does not exist" containerID="bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.122924 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10"} err="failed to get container status \"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10\": rpc error: code = NotFound desc = could not find container \"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10\": container with ID starting with bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10 not found: ID does not exist" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.122969 5030 scope.go:117] "RemoveContainer" containerID="53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.126593 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.126963 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.137994 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7"} err="failed to get container status \"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7\": rpc error: code = NotFound desc = could not find container \"53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7\": container with ID starting with 53dd1fafb04760fabecc35bbfece6ea3c5752ffbc269c932ce088e9dffb99bf7 not found: ID does not exist" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.138045 5030 scope.go:117] "RemoveContainer" containerID="bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.139467 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10"} err="failed to get container status \"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10\": rpc error: code = NotFound desc = could not find container \"bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10\": container with ID starting with bca958962c9ddadcac4321afc33f03b795739190a101430d53e805892b254c10 not found: ID does not exist" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.148080 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.158980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159030 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159200 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkf7t\" (UniqueName: \"kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159422 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159491 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.159512 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/83628fc8-9c43-4379-bd29-1aad122da53a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.261577 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.261913 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkf7t\" (UniqueName: \"kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.261944 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.261980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.261999 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.263629 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.269192 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.281257 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.281775 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.295909 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkf7t\" (UniqueName: \"kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t\") pod \"barbican-api-57548bcf56-5hlvc\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.356364 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.401655 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.416614 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.424676 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.438641 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.438777 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.438824 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.440380 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.441435 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.441764 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.441839 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.442065 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-vb2g5\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.446718 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.449243 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.449535 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.449645 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.454059 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.468859 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.468899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8fv\" (UniqueName: \"kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.468964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.468987 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.469081 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.469112 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.469208 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.469387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571223 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjf79\" (UniqueName: \"kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571253 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571343 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571489 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571542 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8fv\" (UniqueName: \"kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571623 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571859 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571885 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.571975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.572060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.573162 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.590783 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.590808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.591284 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.591817 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.595199 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8fv\" (UniqueName: \"kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.599543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.650826 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:34:39 crc kubenswrapper[5030]: W0316 13:34:39.668360 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod336632fa_5886_453c_8d8e_53c8d01a6829.slice/crio-bc6b6a305416dcbdd3345144c7d9742a4c68b947de41f4806c9e305423dcad26 WatchSource:0}: Error finding container bc6b6a305416dcbdd3345144c7d9742a4c68b947de41f4806c9e305423dcad26: Status 404 returned error can't find the container with id bc6b6a305416dcbdd3345144c7d9742a4c68b947de41f4806c9e305423dcad26 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673339 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673421 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjf79\" (UniqueName: \"kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673454 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673514 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673608 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673660 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.673687 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.674499 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.674735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.674980 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.677786 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.681492 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.682447 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.683172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.691429 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjf79\" (UniqueName: \"kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.705401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.769960 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.774571 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.788261 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.795067 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:39 crc kubenswrapper[5030]: W0316 13:34:39.799694 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7b253c6_bd02_49ef_9112_a6c28d89a553.slice/crio-af0d82830da9d7fa83d3bc15d0a69af8246b9f48666c036334cf02f2a6625736 WatchSource:0}: Error finding container af0d82830da9d7fa83d3bc15d0a69af8246b9f48666c036334cf02f2a6625736: Status 404 returned error can't find the container with id af0d82830da9d7fa83d3bc15d0a69af8246b9f48666c036334cf02f2a6625736 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.929069 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerStarted","Data":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.929532 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-central-agent" containerID="cri-o://158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" gracePeriod=30 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.929865 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="proxy-httpd" containerID="cri-o://4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" gracePeriod=30 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.929922 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="sg-core" containerID="cri-o://65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" gracePeriod=30 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.929959 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-notification-agent" containerID="cri-o://d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" gracePeriod=30 Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.930736 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:39 crc kubenswrapper[5030]: I0316 13:34:39.984600 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.656513406 podStartE2EDuration="6.984581786s" podCreationTimestamp="2026-03-16 13:34:33 +0000 UTC" firstStartedPulling="2026-03-16 13:34:34.965178471 +0000 UTC m=+1719.364491018" lastFinishedPulling="2026-03-16 13:34:39.293246851 +0000 UTC m=+1723.692559398" observedRunningTime="2026-03-16 13:34:39.953158791 +0000 UTC m=+1724.352471339" watchObservedRunningTime="2026-03-16 13:34:39.984581786 +0000 UTC m=+1724.383894333" Mar 16 13:34:40 crc kubenswrapper[5030]: W0316 13:34:40.003900 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8294e2f4_b688_49c4_9ea6_4511261d1f29.slice/crio-d5a899dece779acebe43ebc57c7f4ecfb82e5e55cd5baba566982c7d954708f5 WatchSource:0}: Error finding container d5a899dece779acebe43ebc57c7f4ecfb82e5e55cd5baba566982c7d954708f5: Status 404 returned error can't find the container with id d5a899dece779acebe43ebc57c7f4ecfb82e5e55cd5baba566982c7d954708f5 Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.006254 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83628fc8-9c43-4379-bd29-1aad122da53a" path="/var/lib/kubelet/pods/83628fc8-9c43-4379-bd29-1aad122da53a/volumes" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.007100 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21" path="/var/lib/kubelet/pods/f48d652f-8a69-4ab9-ad0f-5cb3ee1e0a21/volumes" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.007931 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.023265 5030 generic.go:358] "Generic (PLEG): container finished" podID="20694ac7-1dc1-452c-9fe4-5c321678f70a" containerID="d58ff4a8695cc38f391c0c2a69464858345aeff2447a9f3141702f54b01fff5b" exitCode=0 Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.023407 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" event={"ID":"20694ac7-1dc1-452c-9fe4-5c321678f70a","Type":"ContainerDied","Data":"d58ff4a8695cc38f391c0c2a69464858345aeff2447a9f3141702f54b01fff5b"} Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.043590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerStarted","Data":"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191"} Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.043676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerStarted","Data":"bc6b6a305416dcbdd3345144c7d9742a4c68b947de41f4806c9e305423dcad26"} Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.048847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerStarted","Data":"3567be29174babee823dc80b3c3ae3b40cde022d0c3dfa311ec11c724723d7a9"} Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.052377 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerStarted","Data":"af0d82830da9d7fa83d3bc15d0a69af8246b9f48666c036334cf02f2a6625736"} Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.276515 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.290690 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.295084 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.307708 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.345420 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.356967 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:34:40 crc kubenswrapper[5030]: W0316 13:34:40.367808 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd466f12_cf2d_4f18_8aba_c036fc4a13c0.slice/crio-1d43243c60d47d234b05d4f351c301fe82c976e0d4e1cc751b029d22ed264189 WatchSource:0}: Error finding container 1d43243c60d47d234b05d4f351c301fe82c976e0d4e1cc751b029d22ed264189: Status 404 returned error can't find the container with id 1d43243c60d47d234b05d4f351c301fe82c976e0d4e1cc751b029d22ed264189 Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.398569 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.416838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.416903 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9555\" (UniqueName: \"kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.417002 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.417024 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.417502 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.417608 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.417669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.430189 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.477810 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519115 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519176 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle\") pod \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519311 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6zv2\" (UniqueName: \"kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519373 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519440 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519588 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config\") pod \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztwdz\" (UniqueName: \"kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz\") pod \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\" (UID: \"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys\") pod \"a1786247-15e8-44c8-9a08-cfe244232583\" (UID: \"a1786247-15e8-44c8-9a08-cfe244232583\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519805 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519864 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519902 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9555\" (UniqueName: \"kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519973 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.519991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.520069 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.520410 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.528653 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.529098 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.529311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.529461 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.529634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz" (OuterVolumeSpecName: "kube-api-access-ztwdz") pod "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" (UID: "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14"). InnerVolumeSpecName "kube-api-access-ztwdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.530489 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2" (OuterVolumeSpecName: "kube-api-access-x6zv2") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "kube-api-access-x6zv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.531511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.543254 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.543682 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.546413 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts" (OuterVolumeSpecName: "scripts") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.548161 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9555\" (UniqueName: \"kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555\") pod \"placement-7b7c5575f4-zcbjd\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.559797 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config" (OuterVolumeSpecName: "config") pod "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" (UID: "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.584674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.586762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data" (OuterVolumeSpecName: "config-data") pod "a1786247-15e8-44c8-9a08-cfe244232583" (UID: "a1786247-15e8-44c8-9a08-cfe244232583"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.589374 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" (UID: "e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623778 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623805 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623814 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623824 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6zv2\" (UniqueName: \"kubernetes.io/projected/a1786247-15e8-44c8-9a08-cfe244232583-kube-api-access-x6zv2\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623839 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623847 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623854 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1786247-15e8-44c8-9a08-cfe244232583-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623863 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.623871 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztwdz\" (UniqueName: \"kubernetes.io/projected/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14-kube-api-access-ztwdz\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.729925 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.730542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.828604 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddhcm\" (UniqueName: \"kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.828954 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.829050 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.829861 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.829947 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.830373 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.830411 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.830455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle\") pod \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\" (UID: \"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951\") " Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.831157 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.831719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.838118 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm" (OuterVolumeSpecName: "kube-api-access-ddhcm") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "kube-api-access-ddhcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.841878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts" (OuterVolumeSpecName: "scripts") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.874663 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.921410 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-mvwf7"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932943 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932965 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932974 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932985 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.932994 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddhcm\" (UniqueName: \"kubernetes.io/projected/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-kube-api-access-ddhcm\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.946655 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-mvwf7"] Mar 16 13:34:40 crc kubenswrapper[5030]: I0316 13:34:40.986743 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data" (OuterVolumeSpecName: "config-data") pod "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" (UID: "d526a6f1-5f99-4e78-a4b2-bf9e85ae7951"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.037790 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-crjsm"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038710 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="sg-core" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038729 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="sg-core" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038746 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-notification-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038753 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-notification-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038764 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="proxy-httpd" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038768 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="proxy-httpd" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038784 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1786247-15e8-44c8-9a08-cfe244232583" containerName="keystone-bootstrap" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038790 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1786247-15e8-44c8-9a08-cfe244232583" containerName="keystone-bootstrap" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038802 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" containerName="neutron-db-sync" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038807 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" containerName="neutron-db-sync" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038814 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-central-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038819 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-central-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038961 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" containerName="neutron-db-sync" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038972 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1786247-15e8-44c8-9a08-cfe244232583" containerName="keystone-bootstrap" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038983 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-notification-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038991 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="sg-core" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.038996 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="proxy-httpd" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.039005 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerName="ceilometer-central-agent" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.039395 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.079714 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-crjsm"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.079828 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.092538 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerStarted","Data":"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.095156 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.095335 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.107016 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerStarted","Data":"9dfd445654d062e5644a03221980d36fc4a61e639b0016ffcb7bfa6514561dbf"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.124633 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" podStartSLOduration=3.120647944 podStartE2EDuration="3.120647944s" podCreationTimestamp="2026-03-16 13:34:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:41.119043888 +0000 UTC m=+1725.518356435" watchObservedRunningTime="2026-03-16 13:34:41.120647944 +0000 UTC m=+1725.519960492" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.130960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerStarted","Data":"1d43243c60d47d234b05d4f351c301fe82c976e0d4e1cc751b029d22ed264189"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.142844 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerStarted","Data":"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.142884 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerStarted","Data":"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145504 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145578 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqjz\" (UniqueName: \"kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145664 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.145686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.164068 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" event={"ID":"e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14","Type":"ContainerDied","Data":"ceeb170650c30ce65faae9c4007d22032ab1a1b7a9207b310ef4cf2cb9be87a4"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.164104 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceeb170650c30ce65faae9c4007d22032ab1a1b7a9207b310ef4cf2cb9be87a4" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.164187 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-c7tv2" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.200462 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.208733 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.217730 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.222760 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.222968 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.223114 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-2lntc\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.223725 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.224120 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" podStartSLOduration=3.224104699 podStartE2EDuration="3.224104699s" podCreationTimestamp="2026-03-16 13:34:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:41.163878856 +0000 UTC m=+1725.563191403" watchObservedRunningTime="2026-03-16 13:34:41.224104699 +0000 UTC m=+1725.623417246" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.246525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerStarted","Data":"fc3457b1fede2bf0db58d7f68458b2b61c29dd78b8b3ac1aae6f0124e244a793"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.246578 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerStarted","Data":"8ba917d0b3bf657f72e94e0dc30fa4fbeb07fb01b31cd1f76d1d37c4e2486382"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.246592 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerStarted","Data":"d5a899dece779acebe43ebc57c7f4ecfb82e5e55cd5baba566982c7d954708f5"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.248793 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250280 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250379 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250402 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqjz\" (UniqueName: \"kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.250641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.254186 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.273200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.273491 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.276068 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.276514 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.279159 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.296414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqjz\" (UniqueName: \"kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz\") pod \"keystone-bootstrap-crjsm\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.307904 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerStarted","Data":"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.307951 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerStarted","Data":"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.342688 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.353989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.354110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.354197 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab150ef5428da313633b54205716dc8a1e254a6604faf45c6afe3ae96fcae1e9" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.354306 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.354398 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh22r\" (UniqueName: \"kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.354505 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.357152 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" podStartSLOduration=3.3571222179999998 podStartE2EDuration="3.357122218s" podCreationTimestamp="2026-03-16 13:34:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:41.305940193 +0000 UTC m=+1725.705252740" watchObservedRunningTime="2026-03-16 13:34:41.357122218 +0000 UTC m=+1725.756434765" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.365088 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" podStartSLOduration=3.365081316 podStartE2EDuration="3.365081316s" podCreationTimestamp="2026-03-16 13:34:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:41.359642879 +0000 UTC m=+1725.758955415" watchObservedRunningTime="2026-03-16 13:34:41.365081316 +0000 UTC m=+1725.764393863" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.374971 5030 status_manager.go:895] "Failed to get status for pod" podUID="a1786247-15e8-44c8-9a08-cfe244232583" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" err="pods \"keystone-bootstrap-mvwf7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.400009 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.404683 5030 generic.go:358] "Generic (PLEG): container finished" podID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" exitCode=0 Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.404739 5030 generic.go:358] "Generic (PLEG): container finished" podID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" exitCode=2 Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.404746 5030 generic.go:358] "Generic (PLEG): container finished" podID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" exitCode=0 Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.404753 5030 generic.go:358] "Generic (PLEG): container finished" podID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" exitCode=0 Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.405212 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerDied","Data":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406840 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerDied","Data":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerDied","Data":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406864 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerDied","Data":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406873 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"d526a6f1-5f99-4e78-a4b2-bf9e85ae7951","Type":"ContainerDied","Data":"d531e63393a180e59fb804ce12a87f3c016354750290ba279255f6a4f76de96f"} Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.406897 5030 scope.go:117] "RemoveContainer" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.411469 5030 status_manager.go:895] "Failed to get status for pod" podUID="a1786247-15e8-44c8-9a08-cfe244232583" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" err="pods \"keystone-bootstrap-mvwf7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:34:41 crc kubenswrapper[5030]: W0316 13:34:41.412017 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e70a41c_6cd3_40dd_aa49_55254cbb5852.slice/crio-866900ffe0efd4e7265c6f705ce51db0d14ad6cd5e0f0b8e13308d520617460e WatchSource:0}: Error finding container 866900ffe0efd4e7265c6f705ce51db0d14ad6cd5e0f0b8e13308d520617460e: Status 404 returned error can't find the container with id 866900ffe0efd4e7265c6f705ce51db0d14ad6cd5e0f0b8e13308d520617460e Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.419728 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.459890 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh22r\" (UniqueName: \"kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.460025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.460347 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.460445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.460595 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.462034 5030 status_manager.go:895] "Failed to get status for pod" podUID="a1786247-15e8-44c8-9a08-cfe244232583" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" err="pods \"keystone-bootstrap-mvwf7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.463658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.465660 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.468848 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.479664 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.483157 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh22r\" (UniqueName: \"kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r\") pod \"neutron-7f7c476657-j9b2r\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.486344 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.505392 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.530312 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.537238 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.537391 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.539996 5030 status_manager.go:895] "Failed to get status for pod" podUID="a1786247-15e8-44c8-9a08-cfe244232583" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" err="pods \"keystone-bootstrap-mvwf7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.540380 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.540577 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.544708 5030 scope.go:117] "RemoveContainer" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.574405 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.600823 5030 scope.go:117] "RemoveContainer" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.663542 5030 scope.go:117] "RemoveContainer" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.665376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.665528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.665636 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89clh\" (UniqueName: \"kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.665823 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.666009 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.666202 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.666391 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.771859 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.771941 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.771974 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.772000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89clh\" (UniqueName: \"kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.772076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.772338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.774840 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.782178 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.781951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.785943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.788234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.794013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.794397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89clh\" (UniqueName: \"kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.796262 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.805915 5030 scope.go:117] "RemoveContainer" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: E0316 13:34:41.811953 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": container with ID starting with 4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229 not found: ID does not exist" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.812018 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} err="failed to get container status \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": rpc error: code = NotFound desc = could not find container \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": container with ID starting with 4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229 not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.812052 5030 scope.go:117] "RemoveContainer" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.812380 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-crjsm"] Mar 16 13:34:41 crc kubenswrapper[5030]: E0316 13:34:41.814357 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": container with ID starting with 65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef not found: ID does not exist" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.814429 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} err="failed to get container status \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": rpc error: code = NotFound desc = could not find container \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": container with ID starting with 65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.814483 5030 scope.go:117] "RemoveContainer" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: E0316 13:34:41.815227 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": container with ID starting with d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be not found: ID does not exist" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.815261 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} err="failed to get container status \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": rpc error: code = NotFound desc = could not find container \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": container with ID starting with d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.815283 5030 scope.go:117] "RemoveContainer" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: E0316 13:34:41.816304 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": container with ID starting with 158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e not found: ID does not exist" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.816329 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} err="failed to get container status \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": rpc error: code = NotFound desc = could not find container \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": container with ID starting with 158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.816345 5030 scope.go:117] "RemoveContainer" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.817204 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} err="failed to get container status \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": rpc error: code = NotFound desc = could not find container \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": container with ID starting with 4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229 not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.817235 5030 scope.go:117] "RemoveContainer" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.817683 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} err="failed to get container status \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": rpc error: code = NotFound desc = could not find container \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": container with ID starting with 65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.817723 5030 scope.go:117] "RemoveContainer" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.818383 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} err="failed to get container status \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": rpc error: code = NotFound desc = could not find container \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": container with ID starting with d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.818409 5030 scope.go:117] "RemoveContainer" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.819033 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} err="failed to get container status \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": rpc error: code = NotFound desc = could not find container \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": container with ID starting with 158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.819054 5030 scope.go:117] "RemoveContainer" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.820675 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} err="failed to get container status \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": rpc error: code = NotFound desc = could not find container \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": container with ID starting with 4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229 not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.820714 5030 scope.go:117] "RemoveContainer" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.822218 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} err="failed to get container status \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": rpc error: code = NotFound desc = could not find container \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": container with ID starting with 65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.822242 5030 scope.go:117] "RemoveContainer" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.822587 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} err="failed to get container status \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": rpc error: code = NotFound desc = could not find container \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": container with ID starting with d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.822624 5030 scope.go:117] "RemoveContainer" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.823056 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} err="failed to get container status \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": rpc error: code = NotFound desc = could not find container \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": container with ID starting with 158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.823078 5030 scope.go:117] "RemoveContainer" containerID="4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.827394 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229"} err="failed to get container status \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": rpc error: code = NotFound desc = could not find container \"4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229\": container with ID starting with 4bd3acdc7c62e320c1732aafff404b20787b88c20376ba6b96729e05f3d76229 not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.827420 5030 scope.go:117] "RemoveContainer" containerID="65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.828300 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef"} err="failed to get container status \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": rpc error: code = NotFound desc = could not find container \"65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef\": container with ID starting with 65488d6be48da9514402d2a7acea7078a122ced14927da3106288ac40bc280ef not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.828326 5030 scope.go:117] "RemoveContainer" containerID="d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.829587 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.830739 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be"} err="failed to get container status \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": rpc error: code = NotFound desc = could not find container \"d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be\": container with ID starting with d6098ea9e7f6b6794ece1bd63eed20a3125e7b5902b4d58ac8de619fda45a0be not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.830767 5030 scope.go:117] "RemoveContainer" containerID="158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.831324 5030 status_manager.go:895] "Failed to get status for pod" podUID="a1786247-15e8-44c8-9a08-cfe244232583" pod="openstack-kuttl-tests/keystone-bootstrap-mvwf7" err="pods \"keystone-bootstrap-mvwf7\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.833880 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e"} err="failed to get container status \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": rpc error: code = NotFound desc = could not find container \"158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e\": container with ID starting with 158ee4c568f8cdbb5b9ae7ed63a4ecf407c203aadbf0ee3d0e010206bda6c62e not found: ID does not exist" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.861894 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884478 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884583 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884669 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884688 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l26hq\" (UniqueName: \"kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.884737 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle\") pod \"20694ac7-1dc1-452c-9fe4-5c321678f70a\" (UID: \"20694ac7-1dc1-452c-9fe4-5c321678f70a\") " Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.885234 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.889722 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq" (OuterVolumeSpecName: "kube-api-access-l26hq") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "kube-api-access-l26hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.891070 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.894337 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts" (OuterVolumeSpecName: "scripts") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.936709 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.952766 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data" (OuterVolumeSpecName: "config-data") pod "20694ac7-1dc1-452c-9fe4-5c321678f70a" (UID: "20694ac7-1dc1-452c-9fe4-5c321678f70a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.963662 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1786247-15e8-44c8-9a08-cfe244232583" path="/var/lib/kubelet/pods/a1786247-15e8-44c8-9a08-cfe244232583/volumes" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.964256 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d526a6f1-5f99-4e78-a4b2-bf9e85ae7951" path="/var/lib/kubelet/pods/d526a6f1-5f99-4e78-a4b2-bf9e85ae7951/volumes" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987253 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987495 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/20694ac7-1dc1-452c-9fe4-5c321678f70a-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987507 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l26hq\" (UniqueName: \"kubernetes.io/projected/20694ac7-1dc1-452c-9fe4-5c321678f70a-kube-api-access-l26hq\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987516 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987524 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:41 crc kubenswrapper[5030]: I0316 13:34:41.987533 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/20694ac7-1dc1-452c-9fe4-5c321678f70a-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.147036 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.185151 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:42 crc kubenswrapper[5030]: W0316 13:34:42.198306 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode41d2553_ab9f_44f4_83ef_7444f5ec358b.slice/crio-2ee223c9579e492e135887ba5cb3d13a7754e0d36de3ffd5a30be8ebfbdf4ed5 WatchSource:0}: Error finding container 2ee223c9579e492e135887ba5cb3d13a7754e0d36de3ffd5a30be8ebfbdf4ed5: Status 404 returned error can't find the container with id 2ee223c9579e492e135887ba5cb3d13a7754e0d36de3ffd5a30be8ebfbdf4ed5 Mar 16 13:34:42 crc kubenswrapper[5030]: W0316 13:34:42.206345 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fbead9f_39aa_4158_8d00_5f8686d5beeb.slice/crio-78b4d8725ccebbfc3461292a084d05adab077129e47a34a3005e1d95bb58faa8 WatchSource:0}: Error finding container 78b4d8725ccebbfc3461292a084d05adab077129e47a34a3005e1d95bb58faa8: Status 404 returned error can't find the container with id 78b4d8725ccebbfc3461292a084d05adab077129e47a34a3005e1d95bb58faa8 Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.293249 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.294727 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20694ac7-1dc1-452c-9fe4-5c321678f70a" containerName="cinder-db-sync" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.294749 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="20694ac7-1dc1-452c-9fe4-5c321678f70a" containerName="cinder-db-sync" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.294998 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="20694ac7-1dc1-452c-9fe4-5c321678f70a" containerName="cinder-db-sync" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.300664 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.302815 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.302828 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.402580 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5tt\" (UniqueName: \"kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.402853 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.402997 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.403211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.403334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.403386 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.430744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" event={"ID":"6718c361-7b6a-49a6-9bb3-e533e921478c","Type":"ContainerStarted","Data":"3333641da6802b58c83bf3747184a016a701765bf04144f4e97eb33b065daa64"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.430824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" event={"ID":"6718c361-7b6a-49a6-9bb3-e533e921478c","Type":"ContainerStarted","Data":"182aa19c604869df85ac7852d05a2279f1e4d2afd853b11ecc047b083b3498ef"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.457263 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.474111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" event={"ID":"20694ac7-1dc1-452c-9fe4-5c321678f70a","Type":"ContainerDied","Data":"16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.474164 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16496721f8031977a268884476b7b4f17378f91bdaba1aca395695773ae16f9c" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.474269 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.476240 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-2tjn6" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.479622 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.480592 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.483013 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" podStartSLOduration=1.482989514 podStartE2EDuration="1.482989514s" podCreationTimestamp="2026-03-16 13:34:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:42.451400497 +0000 UTC m=+1726.850713044" watchObservedRunningTime="2026-03-16 13:34:42.482989514 +0000 UTC m=+1726.882302061" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.502860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerStarted","Data":"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.504861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.504913 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5tt\" (UniqueName: \"kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.505018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.505120 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.505282 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.505386 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.506219 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.512239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.512291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.516313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerStarted","Data":"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.521013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.522016 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.523259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerStarted","Data":"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.523285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerStarted","Data":"866900ffe0efd4e7265c6f705ce51db0d14ad6cd5e0f0b8e13308d520617460e"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.524211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5tt\" (UniqueName: \"kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt\") pod \"cinder-scheduler-0\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.524282 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.524316 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.527375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerStarted","Data":"78b4d8725ccebbfc3461292a084d05adab077129e47a34a3005e1d95bb58faa8"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.548634 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" podStartSLOduration=2.548617137 podStartE2EDuration="2.548617137s" podCreationTimestamp="2026-03-16 13:34:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:42.543331717 +0000 UTC m=+1726.942644264" watchObservedRunningTime="2026-03-16 13:34:42.548617137 +0000 UTC m=+1726.947929674" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.560086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerStarted","Data":"2ee223c9579e492e135887ba5cb3d13a7754e0d36de3ffd5a30be8ebfbdf4ed5"} Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608047 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608324 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608410 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608674 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9f22\" (UniqueName: \"kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608967 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.608995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.637953 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.710844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9f22\" (UniqueName: \"kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711016 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711045 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711215 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711485 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.711526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.714577 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.717987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.718852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.723518 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.725329 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9f22\" (UniqueName: \"kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.729182 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:42 crc kubenswrapper[5030]: I0316 13:34:42.814923 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.111837 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.266342 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:43 crc kubenswrapper[5030]: W0316 13:34:43.276033 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8829a31d_4f13_4b5b_a1db_d4889a7bc86b.slice/crio-536a787ed7b0897d2ac505471357169a5d3d4c8dd23bd52c5c35b744c969182f WatchSource:0}: Error finding container 536a787ed7b0897d2ac505471357169a5d3d4c8dd23bd52c5c35b744c969182f: Status 404 returned error can't find the container with id 536a787ed7b0897d2ac505471357169a5d3d4c8dd23bd52c5c35b744c969182f Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.579673 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerStarted","Data":"536a787ed7b0897d2ac505471357169a5d3d4c8dd23bd52c5c35b744c969182f"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.582880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerStarted","Data":"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.586502 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerStarted","Data":"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.590861 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerStarted","Data":"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.600275 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.600258761 podStartE2EDuration="4.600258761s" podCreationTimestamp="2026-03-16 13:34:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:43.598154413 +0000 UTC m=+1727.997466961" watchObservedRunningTime="2026-03-16 13:34:43.600258761 +0000 UTC m=+1727.999571298" Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.607916 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerStarted","Data":"8eaa3f065a708f2c2819d938a36d9bd8e7829389d97d2e8a23ef09131670bb4c"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.615832 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerStarted","Data":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.623065 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.6230480400000005 podStartE2EDuration="4.62304804s" podCreationTimestamp="2026-03-16 13:34:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:43.615520233 +0000 UTC m=+1728.014832790" watchObservedRunningTime="2026-03-16 13:34:43.62304804 +0000 UTC m=+1728.022360587" Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.625339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerStarted","Data":"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.625389 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerStarted","Data":"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3"} Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.625716 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:34:43 crc kubenswrapper[5030]: I0316 13:34:43.642210 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" podStartSLOduration=2.642198325 podStartE2EDuration="2.642198325s" podCreationTimestamp="2026-03-16 13:34:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:43.638331633 +0000 UTC m=+1728.037644180" watchObservedRunningTime="2026-03-16 13:34:43.642198325 +0000 UTC m=+1728.041510872" Mar 16 13:34:44 crc kubenswrapper[5030]: I0316 13:34:44.663140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerStarted","Data":"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5"} Mar 16 13:34:44 crc kubenswrapper[5030]: I0316 13:34:44.677674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerStarted","Data":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} Mar 16 13:34:44 crc kubenswrapper[5030]: I0316 13:34:44.688250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerStarted","Data":"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527"} Mar 16 13:34:44 crc kubenswrapper[5030]: I0316 13:34:44.945677 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:34:44 crc kubenswrapper[5030]: E0316 13:34:44.946040 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.698106 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerStarted","Data":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.702483 5030 generic.go:358] "Generic (PLEG): container finished" podID="6718c361-7b6a-49a6-9bb3-e533e921478c" containerID="3333641da6802b58c83bf3747184a016a701765bf04144f4e97eb33b065daa64" exitCode=0 Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.702714 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" event={"ID":"6718c361-7b6a-49a6-9bb3-e533e921478c","Type":"ContainerDied","Data":"3333641da6802b58c83bf3747184a016a701765bf04144f4e97eb33b065daa64"} Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.706541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerStarted","Data":"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901"} Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.707180 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.711452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerStarted","Data":"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3"} Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.747460 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.747449014 podStartE2EDuration="3.747449014s" podCreationTimestamp="2026-03-16 13:34:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:45.737597847 +0000 UTC m=+1730.136910415" watchObservedRunningTime="2026-03-16 13:34:45.747449014 +0000 UTC m=+1730.146761561" Mar 16 13:34:45 crc kubenswrapper[5030]: I0316 13:34:45.774595 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.774568766 podStartE2EDuration="3.774568766s" podCreationTimestamp="2026-03-16 13:34:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:45.761752112 +0000 UTC m=+1730.161064660" watchObservedRunningTime="2026-03-16 13:34:45.774568766 +0000 UTC m=+1730.173881313" Mar 16 13:34:46 crc kubenswrapper[5030]: I0316 13:34:46.739064 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerStarted","Data":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} Mar 16 13:34:46 crc kubenswrapper[5030]: I0316 13:34:46.739261 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:46 crc kubenswrapper[5030]: I0316 13:34:46.770503 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.469564718 podStartE2EDuration="5.770483038s" podCreationTimestamp="2026-03-16 13:34:41 +0000 UTC" firstStartedPulling="2026-03-16 13:34:42.208994036 +0000 UTC m=+1726.608306584" lastFinishedPulling="2026-03-16 13:34:46.509912357 +0000 UTC m=+1730.909224904" observedRunningTime="2026-03-16 13:34:46.763367937 +0000 UTC m=+1731.162680484" watchObservedRunningTime="2026-03-16 13:34:46.770483038 +0000 UTC m=+1731.169795585" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.052175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150499 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150673 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfqjz\" (UniqueName: \"kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150749 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.150999 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts\") pod \"6718c361-7b6a-49a6-9bb3-e533e921478c\" (UID: \"6718c361-7b6a-49a6-9bb3-e533e921478c\") " Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.156166 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.156185 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.156486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz" (OuterVolumeSpecName: "kube-api-access-mfqjz") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "kube-api-access-mfqjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.156730 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts" (OuterVolumeSpecName: "scripts") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.172772 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data" (OuterVolumeSpecName: "config-data") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.173007 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6718c361-7b6a-49a6-9bb3-e533e921478c" (UID: "6718c361-7b6a-49a6-9bb3-e533e921478c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.253923 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfqjz\" (UniqueName: \"kubernetes.io/projected/6718c361-7b6a-49a6-9bb3-e533e921478c-kube-api-access-mfqjz\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.253969 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.253981 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.253992 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.254003 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.254012 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6718c361-7b6a-49a6-9bb3-e533e921478c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.639021 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.750933 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" event={"ID":"6718c361-7b6a-49a6-9bb3-e533e921478c","Type":"ContainerDied","Data":"182aa19c604869df85ac7852d05a2279f1e4d2afd853b11ecc047b083b3498ef"} Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.750988 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="182aa19c604869df85ac7852d05a2279f1e4d2afd853b11ecc047b083b3498ef" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.751217 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-crjsm" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.869594 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.870748 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6718c361-7b6a-49a6-9bb3-e533e921478c" containerName="keystone-bootstrap" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.870773 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6718c361-7b6a-49a6-9bb3-e533e921478c" containerName="keystone-bootstrap" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.871717 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6718c361-7b6a-49a6-9bb3-e533e921478c" containerName="keystone-bootstrap" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.875638 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.878641 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.878660 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.878714 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.878750 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.878871 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-2bqg2\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.880256 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:34:47 crc kubenswrapper[5030]: I0316 13:34:47.883733 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.071169 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jpt9\" (UniqueName: \"kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.071233 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.071496 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.071674 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.071941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.072213 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.072305 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.072428 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.170215 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jpt9\" (UniqueName: \"kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175441 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175498 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175570 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175688 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175824 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175877 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.175944 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.186409 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.187061 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.187526 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.187799 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.188251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.195713 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.195900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.199233 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jpt9\" (UniqueName: \"kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9\") pod \"keystone-56f9f44796-kvxtm\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.358371 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.499989 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.772292 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-central-agent" containerID="cri-o://0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.772954 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="proxy-httpd" containerID="cri-o://edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.773024 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="sg-core" containerID="cri-o://d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.773061 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-notification-agent" containerID="cri-o://ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.773258 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api" containerID="cri-o://4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.772796 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api-log" containerID="cri-o://94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" gracePeriod=30 Mar 16 13:34:48 crc kubenswrapper[5030]: I0316 13:34:48.993197 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:34:49 crc kubenswrapper[5030]: W0316 13:34:49.056709 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04d53072_e5ed_4045_8246_495440196ae5.slice/crio-89923f456663fc8518cf2c422a526e82caf414b5c6f9fba1ab4212c58cc4f2da WatchSource:0}: Error finding container 89923f456663fc8518cf2c422a526e82caf414b5c6f9fba1ab4212c58cc4f2da: Status 404 returned error can't find the container with id 89923f456663fc8518cf2c422a526e82caf414b5c6f9fba1ab4212c58cc4f2da Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.768641 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.770781 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.770806 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.796804 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.796843 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.800096 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.804238 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.805565 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" exitCode=0 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.805615 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" exitCode=2 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.805623 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" exitCode=0 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.805629 5030 generic.go:358] "Generic (PLEG): container finished" podID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" exitCode=0 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerDied","Data":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerDied","Data":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806040 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerDied","Data":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806048 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerDied","Data":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1fbead9f-39aa-4158-8d00-5f8686d5beeb","Type":"ContainerDied","Data":"78b4d8725ccebbfc3461292a084d05adab077129e47a34a3005e1d95bb58faa8"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.806071 5030 scope.go:117] "RemoveContainer" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.824986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" event={"ID":"04d53072-e5ed-4045-8246-495440196ae5","Type":"ContainerStarted","Data":"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.825015 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" event={"ID":"04d53072-e5ed-4045-8246-495440196ae5","Type":"ContainerStarted","Data":"89923f456663fc8518cf2c422a526e82caf414b5c6f9fba1ab4212c58cc4f2da"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.825626 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.831544 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.840223 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.840415 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.840448 5030 scope.go:117] "RemoveContainer" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.846909 5030 generic.go:358] "Generic (PLEG): container finished" podID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerID="4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" exitCode=0 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.846938 5030 generic.go:358] "Generic (PLEG): container finished" podID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerID="94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" exitCode=143 Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.847180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerDied","Data":"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.847209 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerDied","Data":"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.847220 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"8829a31d-4f13-4b5b-a1db-d4889a7bc86b","Type":"ContainerDied","Data":"536a787ed7b0897d2ac505471357169a5d3d4c8dd23bd52c5c35b744c969182f"} Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.849385 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.849909 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.850115 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.879127 5030 scope.go:117] "RemoveContainer" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.911254 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" podStartSLOduration=2.911235798 podStartE2EDuration="2.911235798s" podCreationTimestamp="2026-03-16 13:34:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:49.90650427 +0000 UTC m=+1734.305816837" watchObservedRunningTime="2026-03-16 13:34:49.911235798 +0000 UTC m=+1734.310548355" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913712 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913789 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913889 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89clh\" (UniqueName: \"kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913908 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9f22\" (UniqueName: \"kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913945 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.913992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914023 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914068 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914123 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914231 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs\") pod \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\" (UID: \"8829a31d-4f13-4b5b-a1db-d4889a7bc86b\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.914327 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd\") pod \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\" (UID: \"1fbead9f-39aa-4158-8d00-5f8686d5beeb\") " Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.917308 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.918387 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs" (OuterVolumeSpecName: "logs") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.918982 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.919182 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.922601 5030 scope.go:117] "RemoveContainer" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.922871 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.923515 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22" (OuterVolumeSpecName: "kube-api-access-f9f22") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "kube-api-access-f9f22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.926657 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts" (OuterVolumeSpecName: "scripts") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.951189 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts" (OuterVolumeSpecName: "scripts") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.951745 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh" (OuterVolumeSpecName: "kube-api-access-89clh") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "kube-api-access-89clh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.983225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.985473 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:49 crc kubenswrapper[5030]: I0316 13:34:49.993642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data" (OuterVolumeSpecName: "config-data") pod "8829a31d-4f13-4b5b-a1db-d4889a7bc86b" (UID: "8829a31d-4f13-4b5b-a1db-d4889a7bc86b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020605 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020642 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020651 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020659 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1fbead9f-39aa-4158-8d00-5f8686d5beeb-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020667 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020677 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89clh\" (UniqueName: \"kubernetes.io/projected/1fbead9f-39aa-4158-8d00-5f8686d5beeb-kube-api-access-89clh\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020685 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9f22\" (UniqueName: \"kubernetes.io/projected/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-kube-api-access-f9f22\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020693 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020702 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020711 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020719 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.020727 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8829a31d-4f13-4b5b-a1db-d4889a7bc86b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.025044 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.040997 5030 scope.go:117] "RemoveContainer" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.041486 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": container with ID starting with edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af not found: ID does not exist" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.041606 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} err="failed to get container status \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": rpc error: code = NotFound desc = could not find container \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": container with ID starting with edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.041689 5030 scope.go:117] "RemoveContainer" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.042010 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": container with ID starting with d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631 not found: ID does not exist" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042046 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} err="failed to get container status \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": rpc error: code = NotFound desc = could not find container \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": container with ID starting with d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042073 5030 scope.go:117] "RemoveContainer" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.042331 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": container with ID starting with ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b not found: ID does not exist" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042446 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} err="failed to get container status \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": rpc error: code = NotFound desc = could not find container \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": container with ID starting with ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042523 5030 scope.go:117] "RemoveContainer" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.042771 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": container with ID starting with 0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06 not found: ID does not exist" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042840 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} err="failed to get container status \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": rpc error: code = NotFound desc = could not find container \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": container with ID starting with 0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.042908 5030 scope.go:117] "RemoveContainer" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.043169 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} err="failed to get container status \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": rpc error: code = NotFound desc = could not find container \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": container with ID starting with edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.043247 5030 scope.go:117] "RemoveContainer" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.043512 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} err="failed to get container status \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": rpc error: code = NotFound desc = could not find container \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": container with ID starting with d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.043879 5030 scope.go:117] "RemoveContainer" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.044161 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} err="failed to get container status \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": rpc error: code = NotFound desc = could not find container \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": container with ID starting with ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.044250 5030 scope.go:117] "RemoveContainer" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.044641 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} err="failed to get container status \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": rpc error: code = NotFound desc = could not find container \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": container with ID starting with 0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.044729 5030 scope.go:117] "RemoveContainer" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.045063 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} err="failed to get container status \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": rpc error: code = NotFound desc = could not find container \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": container with ID starting with edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.045167 5030 scope.go:117] "RemoveContainer" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.045703 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} err="failed to get container status \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": rpc error: code = NotFound desc = could not find container \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": container with ID starting with d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.045728 5030 scope.go:117] "RemoveContainer" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.045965 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} err="failed to get container status \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": rpc error: code = NotFound desc = could not find container \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": container with ID starting with ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046054 5030 scope.go:117] "RemoveContainer" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046351 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} err="failed to get container status \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": rpc error: code = NotFound desc = could not find container \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": container with ID starting with 0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046421 5030 scope.go:117] "RemoveContainer" containerID="edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046681 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af"} err="failed to get container status \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": rpc error: code = NotFound desc = could not find container \"edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af\": container with ID starting with edabd6d012ff1e4344cc539a64b729788955cdfd26c9b653f34b4b8e91ac18af not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046700 5030 scope.go:117] "RemoveContainer" containerID="d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046881 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631"} err="failed to get container status \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": rpc error: code = NotFound desc = could not find container \"d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631\": container with ID starting with d9769d5b935c1417bd33bd8e3a67e9d518a5988b260ef649328715023625f631 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.046901 5030 scope.go:117] "RemoveContainer" containerID="ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.047067 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b"} err="failed to get container status \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": rpc error: code = NotFound desc = could not find container \"ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b\": container with ID starting with ed3795d236672fccc7b14acfebcb9bdd9dcfaf1c39d2ab094a01f8fafaab3a0b not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.047080 5030 scope.go:117] "RemoveContainer" containerID="0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.047238 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06"} err="failed to get container status \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": rpc error: code = NotFound desc = could not find container \"0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06\": container with ID starting with 0b96ac355ee39decf9021733f27621db364953bfa2452f88eae2955915920d06 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.047255 5030 scope.go:117] "RemoveContainer" containerID="4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.052683 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data" (OuterVolumeSpecName: "config-data") pod "1fbead9f-39aa-4158-8d00-5f8686d5beeb" (UID: "1fbead9f-39aa-4158-8d00-5f8686d5beeb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.066802 5030 scope.go:117] "RemoveContainer" containerID="94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.082995 5030 scope.go:117] "RemoveContainer" containerID="4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.083538 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901\": container with ID starting with 4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901 not found: ID does not exist" containerID="4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.083577 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901"} err="failed to get container status \"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901\": rpc error: code = NotFound desc = could not find container \"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901\": container with ID starting with 4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.083594 5030 scope.go:117] "RemoveContainer" containerID="94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" Mar 16 13:34:50 crc kubenswrapper[5030]: E0316 13:34:50.083879 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527\": container with ID starting with 94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527 not found: ID does not exist" containerID="94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.083915 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527"} err="failed to get container status \"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527\": rpc error: code = NotFound desc = could not find container \"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527\": container with ID starting with 94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.083938 5030 scope.go:117] "RemoveContainer" containerID="4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.084237 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901"} err="failed to get container status \"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901\": rpc error: code = NotFound desc = could not find container \"4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901\": container with ID starting with 4541410321c52adc84c83867692649dcda456835de0580e685ee8de9f792c901 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.084258 5030 scope.go:117] "RemoveContainer" containerID="94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.084502 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527"} err="failed to get container status \"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527\": rpc error: code = NotFound desc = could not find container \"94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527\": container with ID starting with 94accd8739ab314bded132eecd3b10414c2a47d0b518c214fa32b798a5030527 not found: ID does not exist" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.123027 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.123059 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1fbead9f-39aa-4158-8d00-5f8686d5beeb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.179747 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.184630 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.200231 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201377 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-central-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201451 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-central-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201533 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api-log" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201604 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api-log" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201656 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="sg-core" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201723 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="sg-core" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201781 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201834 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201892 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-notification-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.201937 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-notification-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202006 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="proxy-httpd" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202054 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="proxy-httpd" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202289 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="sg-core" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202353 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api-log" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202403 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-central-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202463 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="proxy-httpd" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202512 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" containerName="cinder-api" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.202594 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" containerName="ceilometer-notification-agent" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.216918 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.220829 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.221794 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.222051 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.234751 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.272707 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340431 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340521 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340729 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbmkp\" (UniqueName: \"kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340850 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340891 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.340965 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.341037 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.390970 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.443426 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.443818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.443869 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.443899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbmkp\" (UniqueName: \"kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.443923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.445496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.445598 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.445648 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.445693 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.445747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.448784 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.450053 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.450451 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.453301 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.454390 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.456109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.457030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.469091 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbmkp\" (UniqueName: \"kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp\") pod \"cinder-api-0\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.553338 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.601420 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.610924 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.628608 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.645508 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.651896 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.667815 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.712877 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.721637 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.736010 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.756905 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.756983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zprnb\" (UniqueName: \"kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757012 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757037 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757265 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdzpp\" (UniqueName: \"kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757446 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757858 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.757902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.858699 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860041 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zprnb\" (UniqueName: \"kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860099 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860225 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdzpp\" (UniqueName: \"kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860254 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860304 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860390 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860442 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860472 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860529 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860635 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm5tz\" (UniqueName: \"kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.860702 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.863102 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.863213 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.863657 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.863892 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.875510 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.875858 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.877377 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.877637 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zprnb\" (UniqueName: \"kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.878204 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.879378 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-v46hp\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.880029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.880416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdzpp\" (UniqueName: \"kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp\") pod \"barbican-keystone-listener-74df56b946-qxhc7\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.965201 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.969927 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.971019 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.971875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.971973 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.972062 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.972202 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wm5tz\" (UniqueName: \"kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.973916 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.974966 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.979123 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.980081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.982179 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.996903 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:50 crc kubenswrapper[5030]: I0316 13:34:50.998230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm5tz\" (UniqueName: \"kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz\") pod \"barbican-api-687bcb57cb-pqrwv\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.000688 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.018920 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.023990 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.032381 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.032532 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.075311 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.089494 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.144391 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.159497 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.164412 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.165669 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.169390 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178144 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178191 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178234 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178258 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178505 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178524 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.178807 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stm5j\" (UniqueName: \"kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281107 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281248 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281332 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stm5j\" (UniqueName: \"kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281408 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281465 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281515 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281535 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281595 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281617 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.281705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5kc6\" (UniqueName: \"kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.285854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.287673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.288930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.293277 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.294524 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.297093 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.334238 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stm5j\" (UniqueName: \"kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j\") pod \"ceilometer-0\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.354984 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395502 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395764 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395803 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5kc6\" (UniqueName: \"kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395902 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395970 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.395990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.418211 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.421449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.421507 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.421844 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.422168 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.427748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5kc6\" (UniqueName: \"kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.434133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config\") pod \"neutron-594754ff8-k48hp\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.492474 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.705028 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.713870 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.883480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerStarted","Data":"963a6e4e0363941712cabc3078fbfcaa7bb66625d5c9aba8c555da92d8d53757"} Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.886583 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.893861 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerStarted","Data":"96d0675832cf110f3f6b9a59e05b61b55bfe7b155457a61e3501a661f30c06a6"} Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.899476 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerStarted","Data":"1be699050ea579f53b945ec54dcd8b31eca6bd714a13d0cf0b4eda4acbcaf1f2"} Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.982936 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fbead9f-39aa-4158-8d00-5f8686d5beeb" path="/var/lib/kubelet/pods/1fbead9f-39aa-4158-8d00-5f8686d5beeb/volumes" Mar 16 13:34:51 crc kubenswrapper[5030]: I0316 13:34:51.996825 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8829a31d-4f13-4b5b-a1db-d4889a7bc86b" path="/var/lib/kubelet/pods/8829a31d-4f13-4b5b-a1db-d4889a7bc86b/volumes" Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.040082 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.040216 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.044286 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.113729 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.223846 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.970328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerStarted","Data":"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb"} Mar 16 13:34:52 crc kubenswrapper[5030]: I0316 13:34:52.983129 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.002357 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.018444 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.020365 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.021033 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.023891 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.050860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerStarted","Data":"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.050897 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerStarted","Data":"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.050909 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerStarted","Data":"e416e4a0076ce9c04c8cbbe8085671ef81de30c7a0e8233b207f8f57e033ddcc"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.052073 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.052103 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.057350 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerStarted","Data":"b9e1bd3cd0e9abd3563b451f64482fc7d0cfda8e03a8eaedc0eedecfd5a3f657"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.057376 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerStarted","Data":"8801f5a43490c7b8a04b01a44b494173f4d4b975c3ecf0ec6b33ca607e759078"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.078806 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerStarted","Data":"48dd22a56719097d149cdb874bf37e5007fba178322ba763c597700e2a99b7fb"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.083269 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" podStartSLOduration=3.083256202 podStartE2EDuration="3.083256202s" podCreationTimestamp="2026-03-16 13:34:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:53.06847302 +0000 UTC m=+1737.467785567" watchObservedRunningTime="2026-03-16 13:34:53.083256202 +0000 UTC m=+1737.482568750" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.083826 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.114463 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerStarted","Data":"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.114531 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerStarted","Data":"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.136144 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerStarted","Data":"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.136206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerStarted","Data":"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.136231 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerStarted","Data":"d961139a1bc54d472b89eb97f9113c7028d921e8b6dd3be2dff317fc93f739ef"} Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.136381 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.140274 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" podStartSLOduration=3.140257913 podStartE2EDuration="3.140257913s" podCreationTimestamp="2026-03-16 13:34:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:53.092379801 +0000 UTC m=+1737.491692348" watchObservedRunningTime="2026-03-16 13:34:53.140257913 +0000 UTC m=+1737.539570459" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.177067 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.184771 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.184832 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.184945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.185033 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qp9\" (UniqueName: \"kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.185056 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.185127 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.210861 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.211268 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker-log" containerID="cri-o://4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123" gracePeriod=30 Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.211881 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker" containerID="cri-o://063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03" gracePeriod=30 Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.223597 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.238843 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" podStartSLOduration=3.238825383 podStartE2EDuration="3.238825383s" podCreationTimestamp="2026-03-16 13:34:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:53.140641984 +0000 UTC m=+1737.539954532" watchObservedRunningTime="2026-03-16 13:34:53.238825383 +0000 UTC m=+1737.638137930" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.240864 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" podStartSLOduration=2.240857895 podStartE2EDuration="2.240857895s" podCreationTimestamp="2026-03-16 13:34:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:53.172409298 +0000 UTC m=+1737.571721834" watchObservedRunningTime="2026-03-16 13:34:53.240857895 +0000 UTC m=+1737.640170443" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.254727 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.254984 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener-log" containerID="cri-o://b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882" gracePeriod=30 Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.255114 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener" containerID="cri-o://8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655" gracePeriod=30 Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.289815 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.289865 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.289892 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.289980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.290049 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qp9\" (UniqueName: \"kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.290079 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.290122 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.291743 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.298375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.299043 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.301340 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.303813 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.305650 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.307462 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qp9\" (UniqueName: \"kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9\") pod \"barbican-api-7bf4b85f7b-nj8rh\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.384093 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.591245 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.591464 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.633929 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:34:53 crc kubenswrapper[5030]: I0316 13:34:53.826242 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:34:53 crc kubenswrapper[5030]: W0316 13:34:53.827503 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7040e1_0208_45fd_889d_3db3d5b29e11.slice/crio-bffde15f9e0b825d20ef5bc7e1e6c427a3bb57aef6345076e81c635d52690cde WatchSource:0}: Error finding container bffde15f9e0b825d20ef5bc7e1e6c427a3bb57aef6345076e81c635d52690cde: Status 404 returned error can't find the container with id bffde15f9e0b825d20ef5bc7e1e6c427a3bb57aef6345076e81c635d52690cde Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.159410 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerID="b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882" exitCode=143 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.159814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerDied","Data":"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.161482 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerStarted","Data":"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.162468 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.166357 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerStarted","Data":"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.166379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerStarted","Data":"bffde15f9e0b825d20ef5bc7e1e6c427a3bb57aef6345076e81c635d52690cde"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.168669 5030 generic.go:358] "Generic (PLEG): container finished" podID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerID="4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123" exitCode=143 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.168773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerDied","Data":"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.171425 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerStarted","Data":"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.171473 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerStarted","Data":"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48"} Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.172735 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api-log" containerID="cri-o://96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" gracePeriod=30 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.172845 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api" containerID="cri-o://01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" gracePeriod=30 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.173315 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="cinder-scheduler" containerID="cri-o://cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5" gracePeriod=30 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.173441 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="probe" containerID="cri-o://8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3" gracePeriod=30 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.778766 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.797188 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.797165548 podStartE2EDuration="4.797165548s" podCreationTimestamp="2026-03-16 13:34:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:54.1950807 +0000 UTC m=+1738.594393247" watchObservedRunningTime="2026-03-16 13:34:54.797165548 +0000 UTC m=+1739.196478095" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.829800 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs\") pod \"e6065584-ddd7-46f0-b89d-f308cd1babc7\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.830169 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm5tz\" (UniqueName: \"kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz\") pod \"e6065584-ddd7-46f0-b89d-f308cd1babc7\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.830310 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data\") pod \"e6065584-ddd7-46f0-b89d-f308cd1babc7\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.830348 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom\") pod \"e6065584-ddd7-46f0-b89d-f308cd1babc7\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.830493 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle\") pod \"e6065584-ddd7-46f0-b89d-f308cd1babc7\" (UID: \"e6065584-ddd7-46f0-b89d-f308cd1babc7\") " Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.833078 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs" (OuterVolumeSpecName: "logs") pod "e6065584-ddd7-46f0-b89d-f308cd1babc7" (UID: "e6065584-ddd7-46f0-b89d-f308cd1babc7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.837680 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e6065584-ddd7-46f0-b89d-f308cd1babc7" (UID: "e6065584-ddd7-46f0-b89d-f308cd1babc7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.840474 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz" (OuterVolumeSpecName: "kube-api-access-wm5tz") pod "e6065584-ddd7-46f0-b89d-f308cd1babc7" (UID: "e6065584-ddd7-46f0-b89d-f308cd1babc7"). InnerVolumeSpecName "kube-api-access-wm5tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.860692 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e6065584-ddd7-46f0-b89d-f308cd1babc7" (UID: "e6065584-ddd7-46f0-b89d-f308cd1babc7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:54 crc kubenswrapper[5030]: E0316 13:34:54.863034 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1693404 actualBytes=10240 Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.877210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data" (OuterVolumeSpecName: "config-data") pod "e6065584-ddd7-46f0-b89d-f308cd1babc7" (UID: "e6065584-ddd7-46f0-b89d-f308cd1babc7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.935842 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.936075 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e6065584-ddd7-46f0-b89d-f308cd1babc7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.936186 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm5tz\" (UniqueName: \"kubernetes.io/projected/e6065584-ddd7-46f0-b89d-f308cd1babc7-kube-api-access-wm5tz\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.936285 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:54 crc kubenswrapper[5030]: I0316 13:34:54.936378 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e6065584-ddd7-46f0-b89d-f308cd1babc7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.186461 5030 generic.go:358] "Generic (PLEG): container finished" podID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerID="8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3" exitCode=0 Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.186541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerDied","Data":"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.189912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerStarted","Data":"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.192234 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerStarted","Data":"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.192371 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.192635 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.194760 5030 generic.go:358] "Generic (PLEG): container finished" podID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerID="01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" exitCode=0 Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.194784 5030 generic.go:358] "Generic (PLEG): container finished" podID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerID="96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" exitCode=143 Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.195492 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.195497 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerDied","Data":"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.195701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerDied","Data":"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.195717 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv" event={"ID":"e6065584-ddd7-46f0-b89d-f308cd1babc7","Type":"ContainerDied","Data":"e416e4a0076ce9c04c8cbbe8085671ef81de30c7a0e8233b207f8f57e033ddcc"} Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.195734 5030 scope.go:117] "RemoveContainer" containerID="01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.221393 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" podStartSLOduration=3.221380887 podStartE2EDuration="3.221380887s" podCreationTimestamp="2026-03-16 13:34:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:34:55.212577771 +0000 UTC m=+1739.611890318" watchObservedRunningTime="2026-03-16 13:34:55.221380887 +0000 UTC m=+1739.620693423" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.227303 5030 scope.go:117] "RemoveContainer" containerID="96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.236104 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.241723 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-687bcb57cb-pqrwv"] Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.251830 5030 scope.go:117] "RemoveContainer" containerID="01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" Mar 16 13:34:55 crc kubenswrapper[5030]: E0316 13:34:55.252388 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c\": container with ID starting with 01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c not found: ID does not exist" containerID="01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252421 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c"} err="failed to get container status \"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c\": rpc error: code = NotFound desc = could not find container \"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c\": container with ID starting with 01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c not found: ID does not exist" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252446 5030 scope.go:117] "RemoveContainer" containerID="96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" Mar 16 13:34:55 crc kubenswrapper[5030]: E0316 13:34:55.252684 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5\": container with ID starting with 96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5 not found: ID does not exist" containerID="96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252705 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5"} err="failed to get container status \"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5\": rpc error: code = NotFound desc = could not find container \"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5\": container with ID starting with 96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5 not found: ID does not exist" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252718 5030 scope.go:117] "RemoveContainer" containerID="01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252904 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c"} err="failed to get container status \"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c\": rpc error: code = NotFound desc = could not find container \"01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c\": container with ID starting with 01e0428abde680ddb0a791609eb2e7208e49e24047fb7d536d65050bf053cd2c not found: ID does not exist" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.252922 5030 scope.go:117] "RemoveContainer" containerID="96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.253110 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5"} err="failed to get container status \"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5\": rpc error: code = NotFound desc = could not find container \"96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5\": container with ID starting with 96b12def4b2a38a5e6ecd7c83add3fde36bdce2747ee22ab605ca04181fa51f5 not found: ID does not exist" Mar 16 13:34:55 crc kubenswrapper[5030]: I0316 13:34:55.976508 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" path="/var/lib/kubelet/pods/e6065584-ddd7-46f0-b89d-f308cd1babc7/volumes" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.203692 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.218562 5030 generic.go:358] "Generic (PLEG): container finished" podID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerID="063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03" exitCode=0 Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.219133 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerDied","Data":"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03"} Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.219242 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" event={"ID":"f188ab32-da27-40d6-a238-95f2bd3e7a1d","Type":"ContainerDied","Data":"3567be29174babee823dc80b3c3ae3b40cde022d0c3dfa311ec11c724723d7a9"} Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.219275 5030 scope.go:117] "RemoveContainer" containerID="063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.219641 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.249899 5030 scope.go:117] "RemoveContainer" containerID="4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.269418 5030 scope.go:117] "RemoveContainer" containerID="063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.271767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle\") pod \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.272014 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data\") pod \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.272051 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom\") pod \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.272744 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs\") pod \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.272799 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t92j\" (UniqueName: \"kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j\") pod \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\" (UID: \"f188ab32-da27-40d6-a238-95f2bd3e7a1d\") " Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.273207 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs" (OuterVolumeSpecName: "logs") pod "f188ab32-da27-40d6-a238-95f2bd3e7a1d" (UID: "f188ab32-da27-40d6-a238-95f2bd3e7a1d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:56 crc kubenswrapper[5030]: E0316 13:34:56.273709 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03\": container with ID starting with 063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03 not found: ID does not exist" containerID="063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.273757 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03"} err="failed to get container status \"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03\": rpc error: code = NotFound desc = could not find container \"063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03\": container with ID starting with 063229b08bf9c1977dc4d07a2c356f31bf61f32d3bfc76678679b9f48a730a03 not found: ID does not exist" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.273784 5030 scope.go:117] "RemoveContainer" containerID="4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123" Mar 16 13:34:56 crc kubenswrapper[5030]: E0316 13:34:56.274102 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123\": container with ID starting with 4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123 not found: ID does not exist" containerID="4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.274154 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123"} err="failed to get container status \"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123\": rpc error: code = NotFound desc = could not find container \"4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123\": container with ID starting with 4c4918b27cdcae696a3c16a5b2e73793a75ea18583bb741bbb4b87471a920123 not found: ID does not exist" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.283542 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j" (OuterVolumeSpecName: "kube-api-access-7t92j") pod "f188ab32-da27-40d6-a238-95f2bd3e7a1d" (UID: "f188ab32-da27-40d6-a238-95f2bd3e7a1d"). InnerVolumeSpecName "kube-api-access-7t92j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.286545 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f188ab32-da27-40d6-a238-95f2bd3e7a1d" (UID: "f188ab32-da27-40d6-a238-95f2bd3e7a1d"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.298080 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f188ab32-da27-40d6-a238-95f2bd3e7a1d" (UID: "f188ab32-da27-40d6-a238-95f2bd3e7a1d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.311129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data" (OuterVolumeSpecName: "config-data") pod "f188ab32-da27-40d6-a238-95f2bd3e7a1d" (UID: "f188ab32-da27-40d6-a238-95f2bd3e7a1d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.376431 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f188ab32-da27-40d6-a238-95f2bd3e7a1d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.376754 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t92j\" (UniqueName: \"kubernetes.io/projected/f188ab32-da27-40d6-a238-95f2bd3e7a1d-kube-api-access-7t92j\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.376780 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.376791 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.376803 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f188ab32-da27-40d6-a238-95f2bd3e7a1d-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.561668 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.567645 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-648b84c88c-z6lnf"] Mar 16 13:34:56 crc kubenswrapper[5030]: I0316 13:34:56.946104 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:34:56 crc kubenswrapper[5030]: E0316 13:34:56.946677 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:34:57 crc kubenswrapper[5030]: I0316 13:34:57.238985 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerStarted","Data":"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc"} Mar 16 13:34:57 crc kubenswrapper[5030]: I0316 13:34:57.239128 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:34:57 crc kubenswrapper[5030]: I0316 13:34:57.262707 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=3.002658447 podStartE2EDuration="7.262355224s" podCreationTimestamp="2026-03-16 13:34:50 +0000 UTC" firstStartedPulling="2026-03-16 13:34:52.171881631 +0000 UTC m=+1736.571194178" lastFinishedPulling="2026-03-16 13:34:56.431578408 +0000 UTC m=+1740.830890955" observedRunningTime="2026-03-16 13:34:57.256244802 +0000 UTC m=+1741.655557349" watchObservedRunningTime="2026-03-16 13:34:57.262355224 +0000 UTC m=+1741.661667771" Mar 16 13:34:57 crc kubenswrapper[5030]: I0316 13:34:57.962286 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" path="/var/lib/kubelet/pods/f188ab32-da27-40d6-a238-95f2bd3e7a1d/volumes" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.697993 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838077 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s574s\" (UniqueName: \"kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s\") pod \"f7b253c6-bd02-49ef-9112-a6c28d89a553\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data\") pod \"f7b253c6-bd02-49ef-9112-a6c28d89a553\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838238 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs\") pod \"f7b253c6-bd02-49ef-9112-a6c28d89a553\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838304 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle\") pod \"f7b253c6-bd02-49ef-9112-a6c28d89a553\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838366 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom\") pod \"f7b253c6-bd02-49ef-9112-a6c28d89a553\" (UID: \"f7b253c6-bd02-49ef-9112-a6c28d89a553\") " Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.838985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs" (OuterVolumeSpecName: "logs") pod "f7b253c6-bd02-49ef-9112-a6c28d89a553" (UID: "f7b253c6-bd02-49ef-9112-a6c28d89a553"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.845363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "f7b253c6-bd02-49ef-9112-a6c28d89a553" (UID: "f7b253c6-bd02-49ef-9112-a6c28d89a553"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.856895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s" (OuterVolumeSpecName: "kube-api-access-s574s") pod "f7b253c6-bd02-49ef-9112-a6c28d89a553" (UID: "f7b253c6-bd02-49ef-9112-a6c28d89a553"). InnerVolumeSpecName "kube-api-access-s574s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.863522 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7b253c6-bd02-49ef-9112-a6c28d89a553" (UID: "f7b253c6-bd02-49ef-9112-a6c28d89a553"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.877678 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data" (OuterVolumeSpecName: "config-data") pod "f7b253c6-bd02-49ef-9112-a6c28d89a553" (UID: "f7b253c6-bd02-49ef-9112-a6c28d89a553"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.941732 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s574s\" (UniqueName: \"kubernetes.io/projected/f7b253c6-bd02-49ef-9112-a6c28d89a553-kube-api-access-s574s\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.941775 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.941787 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7b253c6-bd02-49ef-9112-a6c28d89a553-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.941799 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:58 crc kubenswrapper[5030]: I0316 13:34:58.941814 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/f7b253c6-bd02-49ef-9112-a6c28d89a553-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.259291 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerID="8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655" exitCode=0 Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.259359 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerDied","Data":"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655"} Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.259418 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.259441 5030 scope.go:117] "RemoveContainer" containerID="8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.259423 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2" event={"ID":"f7b253c6-bd02-49ef-9112-a6c28d89a553","Type":"ContainerDied","Data":"af0d82830da9d7fa83d3bc15d0a69af8246b9f48666c036334cf02f2a6625736"} Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.288731 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.288893 5030 scope.go:117] "RemoveContainer" containerID="b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.295645 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-65dfb6fb9b-zkqb2"] Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.310337 5030 scope.go:117] "RemoveContainer" containerID="8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655" Mar 16 13:34:59 crc kubenswrapper[5030]: E0316 13:34:59.310752 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655\": container with ID starting with 8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655 not found: ID does not exist" containerID="8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.310792 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655"} err="failed to get container status \"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655\": rpc error: code = NotFound desc = could not find container \"8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655\": container with ID starting with 8530f8bd292d60e64aff9b6a07278be345c22ec54e8647b43bef226d3c44f655 not found: ID does not exist" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.310817 5030 scope.go:117] "RemoveContainer" containerID="b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882" Mar 16 13:34:59 crc kubenswrapper[5030]: E0316 13:34:59.311167 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882\": container with ID starting with b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882 not found: ID does not exist" containerID="b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.311259 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882"} err="failed to get container status \"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882\": rpc error: code = NotFound desc = could not find container \"b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882\": container with ID starting with b81cb1b9bb9bc6b4f023e5d789b0f041b50aaea702806e9aa2c24c8d07c4d882 not found: ID does not exist" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.904856 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.958871 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" path="/var/lib/kubelet/pods/f7b253c6-bd02-49ef-9112-a6c28d89a553/volumes" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975381 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975520 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975642 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg5tt\" (UniqueName: \"kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975903 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.975949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts\") pod \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\" (UID: \"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f\") " Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.976924 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.983762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts" (OuterVolumeSpecName: "scripts") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.987662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:34:59 crc kubenswrapper[5030]: I0316 13:34:59.987723 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt" (OuterVolumeSpecName: "kube-api-access-pg5tt") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "kube-api-access-pg5tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.029637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.079009 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.079038 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg5tt\" (UniqueName: \"kubernetes.io/projected/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-kube-api-access-pg5tt\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.079050 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.079059 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.085864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data" (OuterVolumeSpecName: "config-data") pod "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" (UID: "12ef5fda-be12-4206-bcfe-2eb7c86f7d7f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.180166 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.269360 5030 generic.go:358] "Generic (PLEG): container finished" podID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerID="cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5" exitCode=0 Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.269582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerDied","Data":"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5"} Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.269612 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"12ef5fda-be12-4206-bcfe-2eb7c86f7d7f","Type":"ContainerDied","Data":"8eaa3f065a708f2c2819d938a36d9bd8e7829389d97d2e8a23ef09131670bb4c"} Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.269631 5030 scope.go:117] "RemoveContainer" containerID="8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.269792 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.293562 5030 scope.go:117] "RemoveContainer" containerID="cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.306411 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.319810 5030 scope.go:117] "RemoveContainer" containerID="8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3" Mar 16 13:35:00 crc kubenswrapper[5030]: E0316 13:35:00.320278 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3\": container with ID starting with 8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3 not found: ID does not exist" containerID="8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.320314 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3"} err="failed to get container status \"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3\": rpc error: code = NotFound desc = could not find container \"8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3\": container with ID starting with 8bbd1e1df91adf6208bb28bca48ddd68664853017e5aa73430cdbc945b047bb3 not found: ID does not exist" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.320339 5030 scope.go:117] "RemoveContainer" containerID="cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5" Mar 16 13:35:00 crc kubenswrapper[5030]: E0316 13:35:00.320658 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5\": container with ID starting with cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5 not found: ID does not exist" containerID="cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.320704 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5"} err="failed to get container status \"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5\": rpc error: code = NotFound desc = could not find container \"cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5\": container with ID starting with cd611f313d9f1d2e529a8432b69522be2ec92de28d31913d02d3329a4acc06a5 not found: ID does not exist" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.322064 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.334364 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335452 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335470 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335483 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335489 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335504 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="probe" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335510 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="probe" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335520 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335526 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335532 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="cinder-scheduler" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335538 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="cinder-scheduler" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335565 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335570 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335650 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335658 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335676 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335683 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335856 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335868 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7b253c6-bd02-49ef-9112-a6c28d89a553" containerName="barbican-keystone-listener-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335880 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335887 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335896 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="probe" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335904 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e6065584-ddd7-46f0-b89d-f308cd1babc7" containerName="barbican-api-log" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335913 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" containerName="cinder-scheduler" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.335920 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f188ab32-da27-40d6-a238-95f2bd3e7a1d" containerName="barbican-worker" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.339408 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.339986 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.341603 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.384730 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.384846 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.384915 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqdh5\" (UniqueName: \"kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.384976 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.385036 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.385126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487111 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487213 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdh5\" (UniqueName: \"kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487233 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487333 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.487569 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.491728 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.491993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.492421 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.492810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.504900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqdh5\" (UniqueName: \"kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5\") pod \"cinder-scheduler-0\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:00 crc kubenswrapper[5030]: I0316 13:35:00.653126 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:01 crc kubenswrapper[5030]: I0316 13:35:01.060968 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:35:01 crc kubenswrapper[5030]: W0316 13:35:01.061704 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod580a4811_8d4a_4ea6_b645_5efc678daab6.slice/crio-2b890aa62fe9ba5631121772613e59d5b90b7e1bf7099a319f5651f050a71984 WatchSource:0}: Error finding container 2b890aa62fe9ba5631121772613e59d5b90b7e1bf7099a319f5651f050a71984: Status 404 returned error can't find the container with id 2b890aa62fe9ba5631121772613e59d5b90b7e1bf7099a319f5651f050a71984 Mar 16 13:35:01 crc kubenswrapper[5030]: I0316 13:35:01.283902 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerStarted","Data":"2b890aa62fe9ba5631121772613e59d5b90b7e1bf7099a319f5651f050a71984"} Mar 16 13:35:01 crc kubenswrapper[5030]: I0316 13:35:01.961204 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ef5fda-be12-4206-bcfe-2eb7c86f7d7f" path="/var/lib/kubelet/pods/12ef5fda-be12-4206-bcfe-2eb7c86f7d7f/volumes" Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.301753 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerStarted","Data":"fae7ed8acca861259d993aff4a47e78b8d77d7b5ea1f4dbc2ba10f1a51be5ea9"} Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.301817 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerStarted","Data":"6bf0389c78a2b8389634fe9da023b9400cd16ef479dbd093526f22fa223a1840"} Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.330664 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=2.330645338 podStartE2EDuration="2.330645338s" podCreationTimestamp="2026-03-16 13:35:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:02.322085792 +0000 UTC m=+1746.721398338" watchObservedRunningTime="2026-03-16 13:35:02.330645338 +0000 UTC m=+1746.729957886" Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.385953 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.453261 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.559181 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.559858 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api-log" containerID="cri-o://8ba917d0b3bf657f72e94e0dc30fa4fbeb07fb01b31cd1f76d1d37c4e2486382" gracePeriod=30 Mar 16 13:35:02 crc kubenswrapper[5030]: I0316 13:35:02.560437 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api" containerID="cri-o://fc3457b1fede2bf0db58d7f68458b2b61c29dd78b8b3ac1aae6f0124e244a793" gracePeriod=30 Mar 16 13:35:03 crc kubenswrapper[5030]: I0316 13:35:03.120060 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:35:03 crc kubenswrapper[5030]: I0316 13:35:03.319367 5030 generic.go:358] "Generic (PLEG): container finished" podID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerID="8ba917d0b3bf657f72e94e0dc30fa4fbeb07fb01b31cd1f76d1d37c4e2486382" exitCode=143 Mar 16 13:35:03 crc kubenswrapper[5030]: I0316 13:35:03.319474 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerDied","Data":"8ba917d0b3bf657f72e94e0dc30fa4fbeb07fb01b31cd1f76d1d37c4e2486382"} Mar 16 13:35:05 crc kubenswrapper[5030]: I0316 13:35:05.654412 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.066165 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.114:9311/healthcheck\": read tcp 10.217.0.2:60106->10.217.1.114:9311: read: connection reset by peer" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.066226 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.114:9311/healthcheck\": read tcp 10.217.0.2:60120->10.217.1.114:9311: read: connection reset by peer" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.361198 5030 generic.go:358] "Generic (PLEG): container finished" podID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerID="fc3457b1fede2bf0db58d7f68458b2b61c29dd78b8b3ac1aae6f0124e244a793" exitCode=0 Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.361247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerDied","Data":"fc3457b1fede2bf0db58d7f68458b2b61c29dd78b8b3ac1aae6f0124e244a793"} Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.443806 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.553018 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkf7t\" (UniqueName: \"kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t\") pod \"8294e2f4-b688-49c4-9ea6-4511261d1f29\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.554534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle\") pod \"8294e2f4-b688-49c4-9ea6-4511261d1f29\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.554809 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data\") pod \"8294e2f4-b688-49c4-9ea6-4511261d1f29\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.554933 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom\") pod \"8294e2f4-b688-49c4-9ea6-4511261d1f29\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.555066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs\") pod \"8294e2f4-b688-49c4-9ea6-4511261d1f29\" (UID: \"8294e2f4-b688-49c4-9ea6-4511261d1f29\") " Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.555427 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs" (OuterVolumeSpecName: "logs") pod "8294e2f4-b688-49c4-9ea6-4511261d1f29" (UID: "8294e2f4-b688-49c4-9ea6-4511261d1f29"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.556485 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8294e2f4-b688-49c4-9ea6-4511261d1f29-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.560273 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8294e2f4-b688-49c4-9ea6-4511261d1f29" (UID: "8294e2f4-b688-49c4-9ea6-4511261d1f29"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.562500 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t" (OuterVolumeSpecName: "kube-api-access-gkf7t") pod "8294e2f4-b688-49c4-9ea6-4511261d1f29" (UID: "8294e2f4-b688-49c4-9ea6-4511261d1f29"). InnerVolumeSpecName "kube-api-access-gkf7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.588710 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8294e2f4-b688-49c4-9ea6-4511261d1f29" (UID: "8294e2f4-b688-49c4-9ea6-4511261d1f29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.596725 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data" (OuterVolumeSpecName: "config-data") pod "8294e2f4-b688-49c4-9ea6-4511261d1f29" (UID: "8294e2f4-b688-49c4-9ea6-4511261d1f29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.660116 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.661174 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.661261 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8294e2f4-b688-49c4-9ea6-4511261d1f29-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:06 crc kubenswrapper[5030]: I0316 13:35:06.661338 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkf7t\" (UniqueName: \"kubernetes.io/projected/8294e2f4-b688-49c4-9ea6-4511261d1f29-kube-api-access-gkf7t\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.384063 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" event={"ID":"8294e2f4-b688-49c4-9ea6-4511261d1f29","Type":"ContainerDied","Data":"d5a899dece779acebe43ebc57c7f4ecfb82e5e55cd5baba566982c7d954708f5"} Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.384162 5030 scope.go:117] "RemoveContainer" containerID="fc3457b1fede2bf0db58d7f68458b2b61c29dd78b8b3ac1aae6f0124e244a793" Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.384288 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc" Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.425426 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.430574 5030 scope.go:117] "RemoveContainer" containerID="8ba917d0b3bf657f72e94e0dc30fa4fbeb07fb01b31cd1f76d1d37c4e2486382" Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.433267 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-57548bcf56-5hlvc"] Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.946315 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:35:07 crc kubenswrapper[5030]: E0316 13:35:07.946726 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:35:07 crc kubenswrapper[5030]: I0316 13:35:07.958229 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" path="/var/lib/kubelet/pods/8294e2f4-b688-49c4-9ea6-4511261d1f29/volumes" Mar 16 13:35:10 crc kubenswrapper[5030]: I0316 13:35:10.867087 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:35:13 crc kubenswrapper[5030]: I0316 13:35:13.635691 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.402421 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.613186 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.613848 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-log" containerID="cri-o://f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c" gracePeriod=30 Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.613949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-api" containerID="cri-o://6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976" gracePeriod=30 Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.619564 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.117:8778/\": EOF" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.619696 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.117:8778/\": EOF" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.634427 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635444 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api-log" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635466 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api-log" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635489 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635495 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635713 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api-log" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.635725 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8294e2f4-b688-49c4-9ea6-4511261d1f29" containerName="barbican-api" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.638729 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.648422 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.723264 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.723434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxqp9\" (UniqueName: \"kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.723598 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.723780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.724211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.724444 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.724592 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828735 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxqp9\" (UniqueName: \"kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828832 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828944 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.828984 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.829011 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.830483 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.836097 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.836517 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.836596 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.836839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.849326 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxqp9\" (UniqueName: \"kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.849399 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs\") pod \"placement-7ffc7fcfd6-k5f8p\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:14 crc kubenswrapper[5030]: I0316 13:35:14.965285 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.405258 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.487810 5030 generic.go:358] "Generic (PLEG): container finished" podID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerID="f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c" exitCode=143 Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.487931 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerDied","Data":"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c"} Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.488990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerStarted","Data":"d49b2719a0a0cf9fad16b45e96fa4046214e5b8c89d708560c318aa4242c3b67"} Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.551825 5030 scope.go:117] "RemoveContainer" containerID="ac82ba7994f73619397bf75a66d64d6e409e3dd4bec43628c5871c16a96e4d26" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.568824 5030 scope.go:117] "RemoveContainer" containerID="1d59f1bf99ee76482798762a86345163ac0835f828b811fef21b5e3fed01c0f7" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.706932 5030 scope.go:117] "RemoveContainer" containerID="7d9b8557c1cf6d6e55cb6d230982e95de1ba974ea529c3e0592b3b07ca95cc80" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.717215 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.726415 5030 scope.go:117] "RemoveContainer" containerID="4e838a0f76bffc3adf9872617ad9d3573fc04847c0ab0477d610c2558ee9c128" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.849631 5030 scope.go:117] "RemoveContainer" containerID="0597c268c505829fc3b9e804a1d5a9fd4f8e47ef5ca53026cc892559b2600716" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.896419 5030 scope.go:117] "RemoveContainer" containerID="560f1c7534b3e927b727f758c05ed8d3154f10f75eb82188447d0163dd95be18" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.950787 5030 scope.go:117] "RemoveContainer" containerID="aafaab0234ba26854e3807e885f5ee1d8f39c9d254749932ea0bca5ce1850443" Mar 16 13:35:15 crc kubenswrapper[5030]: I0316 13:35:15.984378 5030 scope.go:117] "RemoveContainer" containerID="a4420e6d592e293197b23276322e1cbb924faedc68f713ebc378f61736200726" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.014362 5030 scope.go:117] "RemoveContainer" containerID="45cd776cfd3f2b62c621482d21f04df99fc2a5c7d13351dea5bdab697212b25c" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.052366 5030 scope.go:117] "RemoveContainer" containerID="a5ce7ba27007a0aaa93feadf5bba21d3859e2640111699bd074e2b5be168c157" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.085007 5030 scope.go:117] "RemoveContainer" containerID="5d79cb0f03f129542bf7e59637521e0f7fd02be5c586536a2b4a61f050223f43" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.100481 5030 scope.go:117] "RemoveContainer" containerID="162b2e78bb5a73a4368c330f80da034167f3b961aea53158aea8c32fbb321142" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.147066 5030 scope.go:117] "RemoveContainer" containerID="8da5f76655a4d15504bca4555d4ab03c63f1e5902ddf415b149676c5f285aed5" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.178413 5030 scope.go:117] "RemoveContainer" containerID="bf826ed251cedfbbf2070a9a54a4adb54b938da2e06234e9fa2c1171b9ce54f9" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.213731 5030 scope.go:117] "RemoveContainer" containerID="f6b6022deab7358ce5a5b274c64507e2c96bd7604d0ffd460756da35132192e3" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.244000 5030 scope.go:117] "RemoveContainer" containerID="f58d05d36952eea06086c2695cb65175a7d3b22ba74b69a94fa51ad36f38ffbf" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.268497 5030 scope.go:117] "RemoveContainer" containerID="9a75ce20f7cad765a5a074668abdbe9b1ad859b199547ff845eb05a62894c99f" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.299477 5030 scope.go:117] "RemoveContainer" containerID="41b92f197a4a60897b91bed6e99c000cf2bed6404c4032d095f1798d396ce51b" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.319661 5030 scope.go:117] "RemoveContainer" containerID="ba77909881a2affc2b7fc8d2fe68ef686fa09ef811a6fbcb3ef5a1621b99757a" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.346724 5030 scope.go:117] "RemoveContainer" containerID="b48a5aded88db64f8f3afe32b970eca6e240e709467374559e974ae943372a67" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.368065 5030 scope.go:117] "RemoveContainer" containerID="f4ef1ea67f35b369bf6bc211bcfeb89dbb9b30ae98889d84f099a8d966b90302" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.536178 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerStarted","Data":"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2"} Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.536230 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerStarted","Data":"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8"} Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.536860 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.536910 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.549523 5030 scope.go:117] "RemoveContainer" containerID="29fec4cc4a0f107fe6a63bab372f01d7bc5d94eef061b196724414ddd0428d71" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.569537 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" podStartSLOduration=2.569510985 podStartE2EDuration="2.569510985s" podCreationTimestamp="2026-03-16 13:35:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:16.558376509 +0000 UTC m=+1760.957689057" watchObservedRunningTime="2026-03-16 13:35:16.569510985 +0000 UTC m=+1760.968823552" Mar 16 13:35:16 crc kubenswrapper[5030]: I0316 13:35:16.585504 5030 scope.go:117] "RemoveContainer" containerID="49dc2a14fd486dbaa0d4179dfda7484c141488f90359859fb50a04fba3f61259" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.336500 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9555\" (UniqueName: \"kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347464 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs" (OuterVolumeSpecName: "logs") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347487 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347815 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.347979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.348219 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.348370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs\") pod \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\" (UID: \"6e70a41c-6cd3-40dd-aa49-55254cbb5852\") " Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.349189 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6e70a41c-6cd3-40dd-aa49-55254cbb5852-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.362160 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555" (OuterVolumeSpecName: "kube-api-access-k9555") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "kube-api-access-k9555". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.369753 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts" (OuterVolumeSpecName: "scripts") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.395124 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.421842 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data" (OuterVolumeSpecName: "config-data") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.428135 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.432943 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6e70a41c-6cd3-40dd-aa49-55254cbb5852" (UID: "6e70a41c-6cd3-40dd-aa49-55254cbb5852"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452501 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452573 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452584 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452598 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452609 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9555\" (UniqueName: \"kubernetes.io/projected/6e70a41c-6cd3-40dd-aa49-55254cbb5852-kube-api-access-k9555\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.452619 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6e70a41c-6cd3-40dd-aa49-55254cbb5852-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.593400 5030 generic.go:358] "Generic (PLEG): container finished" podID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerID="6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976" exitCode=0 Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.593623 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerDied","Data":"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976"} Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.593902 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" event={"ID":"6e70a41c-6cd3-40dd-aa49-55254cbb5852","Type":"ContainerDied","Data":"866900ffe0efd4e7265c6f705ce51db0d14ad6cd5e0f0b8e13308d520617460e"} Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.593931 5030 scope.go:117] "RemoveContainer" containerID="6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.593764 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7b7c5575f4-zcbjd" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.617562 5030 scope.go:117] "RemoveContainer" containerID="f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.628190 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.636696 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7b7c5575f4-zcbjd"] Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.641233 5030 scope.go:117] "RemoveContainer" containerID="6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976" Mar 16 13:35:19 crc kubenswrapper[5030]: E0316 13:35:19.641616 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976\": container with ID starting with 6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976 not found: ID does not exist" containerID="6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.641664 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976"} err="failed to get container status \"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976\": rpc error: code = NotFound desc = could not find container \"6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976\": container with ID starting with 6263528b24ecccedd08719bb7e265cfd901e16285bec9040a266ca863daa4976 not found: ID does not exist" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.641694 5030 scope.go:117] "RemoveContainer" containerID="f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c" Mar 16 13:35:19 crc kubenswrapper[5030]: E0316 13:35:19.642004 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c\": container with ID starting with f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c not found: ID does not exist" containerID="f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.642059 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c"} err="failed to get container status \"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c\": rpc error: code = NotFound desc = could not find container \"f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c\": container with ID starting with f3563b6c21d1026b3ae8df3191d423fc360bff67927d0a5159e92b3309d2d01c not found: ID does not exist" Mar 16 13:35:19 crc kubenswrapper[5030]: I0316 13:35:19.956462 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" path="/var/lib/kubelet/pods/6e70a41c-6cd3-40dd-aa49-55254cbb5852/volumes" Mar 16 13:35:20 crc kubenswrapper[5030]: I0316 13:35:20.946343 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:35:20 crc kubenswrapper[5030]: E0316 13:35:20.946734 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:35:23 crc kubenswrapper[5030]: I0316 13:35:23.173418 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.179988 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.231293 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.231588 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-api" containerID="cri-o://7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3" gracePeriod=30 Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.231690 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-httpd" containerID="cri-o://57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792" gracePeriod=30 Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.654580 5030 generic.go:358] "Generic (PLEG): container finished" podID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerID="57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792" exitCode=0 Mar 16 13:35:24 crc kubenswrapper[5030]: I0316 13:35:24.654793 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerDied","Data":"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792"} Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.408277 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409469 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-log" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409489 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-log" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409513 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-api" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409519 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-api" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409703 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-api" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.409726 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e70a41c-6cd3-40dd-aa49-55254cbb5852" containerName="placement-log" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.423425 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.423537 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.426405 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.426589 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.426815 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-mgm6r\"" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.505168 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74k7p\" (UniqueName: \"kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.505386 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.505522 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.505574 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.607741 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74k7p\" (UniqueName: \"kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.607839 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.607894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.607912 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.609673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.619064 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.622529 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74k7p\" (UniqueName: \"kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.630068 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle\") pod \"openstackclient\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:26 crc kubenswrapper[5030]: I0316 13:35:26.749367 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.042047 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.042583 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-central-agent" containerID="cri-o://30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48" gracePeriod=30 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.043014 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="proxy-httpd" containerID="cri-o://c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc" gracePeriod=30 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.043088 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="sg-core" containerID="cri-o://86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841" gracePeriod=30 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.043130 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-notification-agent" containerID="cri-o://b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c" gracePeriod=30 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.056956 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.1.128:3000/\": EOF" Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.211266 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.697484 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db","Type":"ContainerStarted","Data":"31ce460042feb0213ba1454666846e5c3ad2ea58527ded11eff4bf7e4df234c0"} Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.697542 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db","Type":"ContainerStarted","Data":"85b06eaf46e10aefec379751174c29fa537b0603ccd7299465b32d08341cc7b2"} Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700538 5030 generic.go:358] "Generic (PLEG): container finished" podID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerID="c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc" exitCode=0 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700831 5030 generic.go:358] "Generic (PLEG): container finished" podID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerID="86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841" exitCode=2 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700842 5030 generic.go:358] "Generic (PLEG): container finished" podID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerID="30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48" exitCode=0 Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerDied","Data":"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc"} Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700882 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerDied","Data":"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841"} Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.700896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerDied","Data":"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48"} Mar 16 13:35:27 crc kubenswrapper[5030]: I0316 13:35:27.715954 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.715940883 podStartE2EDuration="1.715940883s" podCreationTimestamp="2026-03-16 13:35:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:27.70939776 +0000 UTC m=+1772.108710307" watchObservedRunningTime="2026-03-16 13:35:27.715940883 +0000 UTC m=+1772.115253430" Mar 16 13:35:28 crc kubenswrapper[5030]: I0316 13:35:28.223719 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:28 crc kubenswrapper[5030]: I0316 13:35:28.223979 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-log" containerID="cri-o://f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba" gracePeriod=30 Mar 16 13:35:28 crc kubenswrapper[5030]: I0316 13:35:28.224161 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-httpd" containerID="cri-o://da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21" gracePeriod=30 Mar 16 13:35:28 crc kubenswrapper[5030]: I0316 13:35:28.713490 5030 generic.go:358] "Generic (PLEG): container finished" podID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerID="f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba" exitCode=143 Mar 16 13:35:28 crc kubenswrapper[5030]: I0316 13:35:28.713590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerDied","Data":"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba"} Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.177229 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.177502 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-log" containerID="cri-o://02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097" gracePeriod=30 Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.177664 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-httpd" containerID="cri-o://a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556" gracePeriod=30 Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.232127 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.241661 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.244622 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.245182 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.248665 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.255758 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371666 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371732 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371905 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gvq\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371939 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.371964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.476844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.476963 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477036 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477139 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477197 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477494 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gvq\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477783 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.477856 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.488022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.488133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.488754 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.490115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.490363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.495229 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gvq\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq\") pod \"swift-proxy-5db587c58-zdwb9\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.549145 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.569324 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682035 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682117 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stm5j\" (UniqueName: \"kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682201 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682416 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682573 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682676 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.682716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd\") pod \"24408ed7-2b6d-4bde-9fef-71c22b773987\" (UID: \"24408ed7-2b6d-4bde-9fef-71c22b773987\") " Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.684125 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.684772 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.689072 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j" (OuterVolumeSpecName: "kube-api-access-stm5j") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "kube-api-access-stm5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.691680 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts" (OuterVolumeSpecName: "scripts") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.745832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.762426 5030 generic.go:358] "Generic (PLEG): container finished" podID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerID="b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c" exitCode=0 Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.763173 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerDied","Data":"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c"} Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.763218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"24408ed7-2b6d-4bde-9fef-71c22b773987","Type":"ContainerDied","Data":"48dd22a56719097d149cdb874bf37e5007fba178322ba763c597700e2a99b7fb"} Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.763242 5030 scope.go:117] "RemoveContainer" containerID="c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.763484 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.777119 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerID="02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097" exitCode=143 Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.777327 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerDied","Data":"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097"} Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.786188 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.786441 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.786461 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stm5j\" (UniqueName: \"kubernetes.io/projected/24408ed7-2b6d-4bde-9fef-71c22b773987-kube-api-access-stm5j\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.786495 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/24408ed7-2b6d-4bde-9fef-71c22b773987-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.786505 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.794848 5030 scope.go:117] "RemoveContainer" containerID="86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.816122 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.820997 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data" (OuterVolumeSpecName: "config-data") pod "24408ed7-2b6d-4bde-9fef-71c22b773987" (UID: "24408ed7-2b6d-4bde-9fef-71c22b773987"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.826768 5030 scope.go:117] "RemoveContainer" containerID="b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.884116 5030 scope.go:117] "RemoveContainer" containerID="30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.889351 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.889392 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/24408ed7-2b6d-4bde-9fef-71c22b773987-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.912430 5030 scope.go:117] "RemoveContainer" containerID="c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc" Mar 16 13:35:29 crc kubenswrapper[5030]: E0316 13:35:29.912726 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc\": container with ID starting with c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc not found: ID does not exist" containerID="c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.912762 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc"} err="failed to get container status \"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc\": rpc error: code = NotFound desc = could not find container \"c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc\": container with ID starting with c443b063baa23cad1c26d9406c980d014b690e0c63ce8fca169d364ffa9c7fcc not found: ID does not exist" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.912786 5030 scope.go:117] "RemoveContainer" containerID="86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841" Mar 16 13:35:29 crc kubenswrapper[5030]: E0316 13:35:29.913024 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841\": container with ID starting with 86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841 not found: ID does not exist" containerID="86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.913049 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841"} err="failed to get container status \"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841\": rpc error: code = NotFound desc = could not find container \"86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841\": container with ID starting with 86049d627aaf7e6c9c2bba609946f172c3cd8f74c73d1ade04c4b3f398646841 not found: ID does not exist" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.913062 5030 scope.go:117] "RemoveContainer" containerID="b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c" Mar 16 13:35:29 crc kubenswrapper[5030]: E0316 13:35:29.913249 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c\": container with ID starting with b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c not found: ID does not exist" containerID="b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.913274 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c"} err="failed to get container status \"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c\": rpc error: code = NotFound desc = could not find container \"b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c\": container with ID starting with b2b7566cd17e9a8bcd9a9c10edd7299fef24f4ce61067e2b2192817c07c8151c not found: ID does not exist" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.913288 5030 scope.go:117] "RemoveContainer" containerID="30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48" Mar 16 13:35:29 crc kubenswrapper[5030]: E0316 13:35:29.913455 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48\": container with ID starting with 30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48 not found: ID does not exist" containerID="30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48" Mar 16 13:35:29 crc kubenswrapper[5030]: I0316 13:35:29.913477 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48"} err="failed to get container status \"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48\": rpc error: code = NotFound desc = could not find container \"30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48\": container with ID starting with 30a6a5b1049606399390ec7e8a7b662a1aed399061d229a890306cf70c55cb48 not found: ID does not exist" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.045883 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:35:30 crc kubenswrapper[5030]: W0316 13:35:30.047507 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e1c091d_1b18_4cec_b78d_6c41368faf75.slice/crio-952bb1cd2601eb5003b445284ca23ba6999922bbd75fba18ee76b8cbba664ec0 WatchSource:0}: Error finding container 952bb1cd2601eb5003b445284ca23ba6999922bbd75fba18ee76b8cbba664ec0: Status 404 returned error can't find the container with id 952bb1cd2601eb5003b445284ca23ba6999922bbd75fba18ee76b8cbba664ec0 Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.107086 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.118899 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.126408 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.126427 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127461 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="proxy-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="proxy-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127496 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-api" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127503 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-api" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127520 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-notification-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127527 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-notification-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127539 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-central-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127544 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-central-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127588 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127594 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127629 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="sg-core" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127635 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="sg-core" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127793 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-api" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127806 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-central-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127819 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="sg-core" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127826 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="proxy-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127837 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerName="neutron-httpd" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.127847 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" containerName="ceilometer-notification-agent" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.147540 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.147773 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.151168 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.151418 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.300777 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config\") pod \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.301362 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle\") pod \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.301535 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh22r\" (UniqueName: \"kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r\") pod \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.302197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config\") pod \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.302475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs\") pod \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\" (UID: \"e41d2553-ab9f-44f4-83ef-7444f5ec358b\") " Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.303474 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.303620 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.303890 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxlx6\" (UniqueName: \"kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.304051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.304448 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.304576 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.304837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.315203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "e41d2553-ab9f-44f4-83ef-7444f5ec358b" (UID: "e41d2553-ab9f-44f4-83ef-7444f5ec358b"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.315438 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r" (OuterVolumeSpecName: "kube-api-access-qh22r") pod "e41d2553-ab9f-44f4-83ef-7444f5ec358b" (UID: "e41d2553-ab9f-44f4-83ef-7444f5ec358b"). InnerVolumeSpecName "kube-api-access-qh22r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.347963 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config" (OuterVolumeSpecName: "config") pod "e41d2553-ab9f-44f4-83ef-7444f5ec358b" (UID: "e41d2553-ab9f-44f4-83ef-7444f5ec358b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.348221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e41d2553-ab9f-44f4-83ef-7444f5ec358b" (UID: "e41d2553-ab9f-44f4-83ef-7444f5ec358b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.406890 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.406935 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407010 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407045 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407067 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxlx6\" (UniqueName: \"kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407130 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407200 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407212 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407222 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh22r\" (UniqueName: \"kubernetes.io/projected/e41d2553-ab9f-44f4-83ef-7444f5ec358b-kube-api-access-qh22r\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407231 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.407782 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.408145 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.410863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.412433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.412776 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.413214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.418944 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "e41d2553-ab9f-44f4-83ef-7444f5ec358b" (UID: "e41d2553-ab9f-44f4-83ef-7444f5ec358b"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.428210 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxlx6\" (UniqueName: \"kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6\") pod \"ceilometer-0\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.509484 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/e41d2553-ab9f-44f4-83ef-7444f5ec358b-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.552153 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.847265 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.864522 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" event={"ID":"4e1c091d-1b18-4cec-b78d-6c41368faf75","Type":"ContainerStarted","Data":"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9"} Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.864570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" event={"ID":"4e1c091d-1b18-4cec-b78d-6c41368faf75","Type":"ContainerStarted","Data":"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459"} Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.864580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" event={"ID":"4e1c091d-1b18-4cec-b78d-6c41368faf75","Type":"ContainerStarted","Data":"952bb1cd2601eb5003b445284ca23ba6999922bbd75fba18ee76b8cbba664ec0"} Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.866185 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.866215 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.896048 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" podStartSLOduration=1.896027185 podStartE2EDuration="1.896027185s" podCreationTimestamp="2026-03-16 13:35:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:30.894927228 +0000 UTC m=+1775.294239774" watchObservedRunningTime="2026-03-16 13:35:30.896027185 +0000 UTC m=+1775.295339732" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.900032 5030 generic.go:358] "Generic (PLEG): container finished" podID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" containerID="7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3" exitCode=0 Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.900192 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerDied","Data":"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3"} Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.900207 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.900228 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-7f7c476657-j9b2r" event={"ID":"e41d2553-ab9f-44f4-83ef-7444f5ec358b","Type":"ContainerDied","Data":"2ee223c9579e492e135887ba5cb3d13a7754e0d36de3ffd5a30be8ebfbdf4ed5"} Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.900249 5030 scope.go:117] "RemoveContainer" containerID="57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.958624 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.968312 5030 scope.go:117] "RemoveContainer" containerID="7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.970160 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-7f7c476657-j9b2r"] Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.990621 5030 scope.go:117] "RemoveContainer" containerID="57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792" Mar 16 13:35:30 crc kubenswrapper[5030]: E0316 13:35:30.991338 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792\": container with ID starting with 57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792 not found: ID does not exist" containerID="57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.991384 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792"} err="failed to get container status \"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792\": rpc error: code = NotFound desc = could not find container \"57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792\": container with ID starting with 57450d3d55f81b3a9b99f0a87de234c2511b70181e49cd77f4c2e0e36ab20792 not found: ID does not exist" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.991412 5030 scope.go:117] "RemoveContainer" containerID="7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3" Mar 16 13:35:30 crc kubenswrapper[5030]: E0316 13:35:30.991860 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3\": container with ID starting with 7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3 not found: ID does not exist" containerID="7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3" Mar 16 13:35:30 crc kubenswrapper[5030]: I0316 13:35:30.991903 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3"} err="failed to get container status \"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3\": rpc error: code = NotFound desc = could not find container \"7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3\": container with ID starting with 7f21a766ac9654a594bc0994b20fdb4292d42b89f44b43b947a29e63539810c3 not found: ID does not exist" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.260884 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.695718 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841068 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841255 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841367 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841389 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841411 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841615 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841661 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj8fv\" (UniqueName: \"kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.842914 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.841635 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs" (OuterVolumeSpecName: "logs") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.857713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts" (OuterVolumeSpecName: "scripts") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.862674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.885889 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv" (OuterVolumeSpecName: "kube-api-access-zj8fv") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "kube-api-access-zj8fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.891167 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.918406 5030 generic.go:358] "Generic (PLEG): container finished" podID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerID="da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21" exitCode=0 Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.918517 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerDied","Data":"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21"} Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.918542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.918581 5030 scope.go:117] "RemoveContainer" containerID="da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.918566 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"fd466f12-cf2d-4f18-8aba-c036fc4a13c0","Type":"ContainerDied","Data":"1d43243c60d47d234b05d4f351c301fe82c976e0d4e1cc751b029d22ed264189"} Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.922620 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerStarted","Data":"13110cdb63d56fbb62e52fd6f4186e652404c75a8b4553668cc03dcbe9902002"} Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.922652 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerStarted","Data":"0caa1025fe8a7043af512ea44924c43e3bb0253cbec48c0f8f324a190318457f"} Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.923016 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.944269 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data" (OuterVolumeSpecName: "config-data") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.950202 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:35:31 crc kubenswrapper[5030]: E0316 13:35:31.950879 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.953420 5030 scope.go:117] "RemoveContainer" containerID="f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.953852 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") pod \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\" (UID: \"fd466f12-cf2d-4f18-8aba-c036fc4a13c0\") " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954758 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954804 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954814 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954825 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954846 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.954857 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj8fv\" (UniqueName: \"kubernetes.io/projected/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-kube-api-access-zj8fv\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:31 crc kubenswrapper[5030]: W0316 13:35:31.955936 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/fd466f12-cf2d-4f18-8aba-c036fc4a13c0/volumes/kubernetes.io~secret/config-data Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.955953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data" (OuterVolumeSpecName: "config-data") pod "fd466f12-cf2d-4f18-8aba-c036fc4a13c0" (UID: "fd466f12-cf2d-4f18-8aba-c036fc4a13c0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.965739 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24408ed7-2b6d-4bde-9fef-71c22b773987" path="/var/lib/kubelet/pods/24408ed7-2b6d-4bde-9fef-71c22b773987/volumes" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.966630 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41d2553-ab9f-44f4-83ef-7444f5ec358b" path="/var/lib/kubelet/pods/e41d2553-ab9f-44f4-83ef-7444f5ec358b/volumes" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.976622 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.979206 5030 scope.go:117] "RemoveContainer" containerID="da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21" Mar 16 13:35:31 crc kubenswrapper[5030]: E0316 13:35:31.979591 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21\": container with ID starting with da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21 not found: ID does not exist" containerID="da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.979626 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21"} err="failed to get container status \"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21\": rpc error: code = NotFound desc = could not find container \"da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21\": container with ID starting with da02e769fb2955c6b76b731385421ff46f8dcf0a47db7e41395d2283b172bf21 not found: ID does not exist" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.979664 5030 scope.go:117] "RemoveContainer" containerID="f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba" Mar 16 13:35:31 crc kubenswrapper[5030]: E0316 13:35:31.981653 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba\": container with ID starting with f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba not found: ID does not exist" containerID="f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba" Mar 16 13:35:31 crc kubenswrapper[5030]: I0316 13:35:31.981690 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba"} err="failed to get container status \"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba\": rpc error: code = NotFound desc = could not find container \"f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba\": container with ID starting with f6aaae47a7679ab2f2b6fa8c667a790655785148d50094227811714f397870ba not found: ID does not exist" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.058075 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.058262 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fd466f12-cf2d-4f18-8aba-c036fc4a13c0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.246831 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.258318 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.275689 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.276969 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-httpd" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.276989 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-httpd" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.277041 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-log" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.277047 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-log" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.277243 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-httpd" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.277261 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" containerName="glance-log" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.287268 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.292621 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.294961 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.295225 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363502 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363597 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8t6n\" (UniqueName: \"kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363803 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.363953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.364076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466472 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8t6n\" (UniqueName: \"kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466766 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.466544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.469662 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.470122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.471007 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.471175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.476483 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.476574 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.483244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8t6n\" (UniqueName: \"kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.493934 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.619662 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.733339 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.884088 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.884204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.884307 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.884936 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.885084 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.885660 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.885714 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjf79\" (UniqueName: \"kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.885739 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts\") pod \"7e775f8d-9b22-49aa-b847-77f72b62f41d\" (UID: \"7e775f8d-9b22-49aa-b847-77f72b62f41d\") " Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.885865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs" (OuterVolumeSpecName: "logs") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.886043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.886901 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.886924 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7e775f8d-9b22-49aa-b847-77f72b62f41d-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.889820 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts" (OuterVolumeSpecName: "scripts") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.890191 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79" (OuterVolumeSpecName: "kube-api-access-mjf79") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "kube-api-access-mjf79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.897683 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.906023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.930257 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.934719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data" (OuterVolumeSpecName: "config-data") pod "7e775f8d-9b22-49aa-b847-77f72b62f41d" (UID: "7e775f8d-9b22-49aa-b847-77f72b62f41d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.939440 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerID="a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556" exitCode=0 Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.939514 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.939533 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerDied","Data":"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556"} Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.939584 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7e775f8d-9b22-49aa-b847-77f72b62f41d","Type":"ContainerDied","Data":"9dfd445654d062e5644a03221980d36fc4a61e639b0016ffcb7bfa6514561dbf"} Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.939605 5030 scope.go:117] "RemoveContainer" containerID="a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.949201 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerStarted","Data":"7b25dab5240b95806825988fa0fd9a1ddecc967ec3ed3dada714d55b6c397036"} Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.973774 5030 scope.go:117] "RemoveContainer" containerID="02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097" Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.981647 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:32 crc kubenswrapper[5030]: I0316 13:35:32.981693 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996034 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996086 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996104 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjf79\" (UniqueName: \"kubernetes.io/projected/7e775f8d-9b22-49aa-b847-77f72b62f41d-kube-api-access-mjf79\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996113 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996121 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:32.996130 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7e775f8d-9b22-49aa-b847-77f72b62f41d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.003028 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.004804 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-log" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.004823 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-log" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.004894 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-httpd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.004900 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-httpd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.005101 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-log" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.005117 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" containerName="glance-httpd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.008635 5030 scope.go:117] "RemoveContainer" containerID="a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556" Mar 16 13:35:33 crc kubenswrapper[5030]: E0316 13:35:33.010032 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556\": container with ID starting with a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556 not found: ID does not exist" containerID="a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.010063 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556"} err="failed to get container status \"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556\": rpc error: code = NotFound desc = could not find container \"a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556\": container with ID starting with a5fd7cf62fedff90091f0701fe52a0d4fc7b9cdadaf08d7ba82d1f708fc67556 not found: ID does not exist" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.010087 5030 scope.go:117] "RemoveContainer" containerID="02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097" Mar 16 13:35:33 crc kubenswrapper[5030]: E0316 13:35:33.011729 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097\": container with ID starting with 02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097 not found: ID does not exist" containerID="02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.011791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097"} err="failed to get container status \"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097\": rpc error: code = NotFound desc = could not find container \"02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097\": container with ID starting with 02f786d6df870b2df5f4ef473e9db591c91856da1ac4de2bacb5d6342303d097 not found: ID does not exist" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.012611 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.014967 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.016525 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.025392 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.025436 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:33 crc kubenswrapper[5030]: W0316 13:35:33.085672 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82fa560d_afe4_4e21_aa74_f006b2406e52.slice/crio-41314bc436c5a22da85dc7f078456003684fcfefbe64d2355b5c47b017b46917 WatchSource:0}: Error finding container 41314bc436c5a22da85dc7f078456003684fcfefbe64d2355b5c47b017b46917: Status 404 returned error can't find the container with id 41314bc436c5a22da85dc7f078456003684fcfefbe64d2355b5c47b017b46917 Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.086575 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.098120 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.199882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.199932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th89v\" (UniqueName: \"kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.199999 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.200046 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.200136 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.200236 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.200327 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.200471 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302177 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302258 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302324 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302358 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302380 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th89v\" (UniqueName: \"kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302409 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302432 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.302948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.303228 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.304828 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.307659 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.311175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.313047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.319007 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.322132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th89v\" (UniqueName: \"kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.347023 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.641069 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.697625 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-znbcd"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.719608 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-znbcd"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.719764 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.797193 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-57dc6"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.803306 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.804854 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-57dc6"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.814773 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.814871 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcxxv\" (UniqueName: \"kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.907609 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nw282"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.927800 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.929459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.929716 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7k9c\" (UniqueName: \"kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.929836 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.929959 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcxxv\" (UniqueName: \"kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.933589 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.948848 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.948857 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nw282"] Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.953300 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.953497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.958772 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcxxv\" (UniqueName: \"kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv\") pod \"nova-api-db-create-znbcd\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.994063 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e775f8d-9b22-49aa-b847-77f72b62f41d" path="/var/lib/kubelet/pods/7e775f8d-9b22-49aa-b847-77f72b62f41d/volumes" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.995037 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd466f12-cf2d-4f18-8aba-c036fc4a13c0" path="/var/lib/kubelet/pods/fd466f12-cf2d-4f18-8aba-c036fc4a13c0/volumes" Mar 16 13:35:33 crc kubenswrapper[5030]: I0316 13:35:33.995944 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.003092 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerStarted","Data":"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b"} Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.003210 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerStarted","Data":"41314bc436c5a22da85dc7f078456003684fcfefbe64d2355b5c47b017b46917"} Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.012399 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerStarted","Data":"c5ad0a40ecf2f3795ace418338b0033f5e62f93495aad56ca7d364639a66358b"} Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.033095 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.033176 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7k9c\" (UniqueName: \"kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.033224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdts\" (UniqueName: \"kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.033301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.033929 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.045735 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.049122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7k9c\" (UniqueName: \"kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c\") pod \"nova-cell0-db-create-57dc6\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.100257 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.106478 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.109250 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.119899 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.134398 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.135957 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdts\" (UniqueName: \"kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.136069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.136141 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.136199 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.137833 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.147417 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.151313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdts\" (UniqueName: \"kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts\") pod \"nova-cell1-db-create-nw282\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.238996 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.239279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.239485 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcpzf\" (UniqueName: \"kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.239616 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.240279 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.254338 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv\") pod \"nova-api-0768-account-create-update-2jg65\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.255175 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.280330 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.314408 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.319257 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.321296 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.325630 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.342384 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.342468 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcpzf\" (UniqueName: \"kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.343749 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.358722 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcpzf\" (UniqueName: \"kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf\") pod \"nova-cell0-f61e-account-create-update-9hrr2\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.435145 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.446644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5ljk\" (UniqueName: \"kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.446724 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.549243 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5ljk\" (UniqueName: \"kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.549355 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.550016 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.568991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5ljk\" (UniqueName: \"kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk\") pod \"nova-cell1-ea8b-account-create-update-4jn6g\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.605709 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-znbcd"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.658163 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.673867 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-57dc6"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.838592 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.919464 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nw282"] Mar 16 13:35:34 crc kubenswrapper[5030]: W0316 13:35:34.929181 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod761940b5_90f6_4c99_b5c9_5aab7ecf09ce.slice/crio-0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8 WatchSource:0}: Error finding container 0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8: Status 404 returned error can't find the container with id 0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8 Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.964088 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2"] Mar 16 13:35:34 crc kubenswrapper[5030]: I0316 13:35:34.973503 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g"] Mar 16 13:35:34 crc kubenswrapper[5030]: W0316 13:35:34.991795 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58ded5f4_a756_47c1_812f_25d2405e2824.slice/crio-6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5 WatchSource:0}: Error finding container 6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5: Status 404 returned error can't find the container with id 6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5 Mar 16 13:35:35 crc kubenswrapper[5030]: W0316 13:35:35.002286 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da66385_b1da_4248_8518_4fb80b8969c1.slice/crio-12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7 WatchSource:0}: Error finding container 12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7: Status 404 returned error can't find the container with id 12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7 Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.034239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerStarted","Data":"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.037450 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" event={"ID":"3da66385-b1da-4248-8518-4fb80b8969c1","Type":"ContainerStarted","Data":"12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.051047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" event={"ID":"2abd1835-1ef3-4b42-a8c6-df45ce29513f","Type":"ContainerStarted","Data":"05be438c16f7cc07d73c9be8416a3e11f04cd9ea225c0144382e579b01b4c86e"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.051073 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" event={"ID":"2abd1835-1ef3-4b42-a8c6-df45ce29513f","Type":"ContainerStarted","Data":"43f602ecfb9f2f3e47417520e5900e0e1684e426245390f92e02745b3c7e39d2"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.069399 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.069388025 podStartE2EDuration="3.069388025s" podCreationTimestamp="2026-03-16 13:35:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:35.051411144 +0000 UTC m=+1779.450723681" watchObservedRunningTime="2026-03-16 13:35:35.069388025 +0000 UTC m=+1779.468700561" Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.084299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" event={"ID":"0006c2de-2330-4fcd-a854-ed0a25027735","Type":"ContainerStarted","Data":"7548cdb3220640abc95d8517dac1ecb2d40734dd129ab8fdb70f502eb3668b97"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.087855 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" podStartSLOduration=2.0878406 podStartE2EDuration="2.0878406s" podCreationTimestamp="2026-03-16 13:35:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:35.070783618 +0000 UTC m=+1779.470096166" watchObservedRunningTime="2026-03-16 13:35:35.0878406 +0000 UTC m=+1779.487153146" Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.088417 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" event={"ID":"761940b5-90f6-4c99-b5c9-5aab7ecf09ce","Type":"ContainerStarted","Data":"0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.091956 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" event={"ID":"58ded5f4-a756-47c1-812f-25d2405e2824","Type":"ContainerStarted","Data":"6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.098631 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" event={"ID":"4caa7fe2-4967-46e9-8877-f8c00d468708","Type":"ContainerStarted","Data":"b83caba6a6863ca924241e3545d0c5847ba3a0bd980d807936d043745b7ae405"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.098667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" event={"ID":"4caa7fe2-4967-46e9-8877-f8c00d468708","Type":"ContainerStarted","Data":"c709aaa478f961c57aca4c2ffc72c2fc46f2887adc72e80ac20e5ca586292ad3"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.104571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerStarted","Data":"1de1df71d41bdb3035ea7db58e09deb6077e130ba0e90c390010ef38cb7a9f91"} Mar 16 13:35:35 crc kubenswrapper[5030]: I0316 13:35:35.137117 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" podStartSLOduration=2.137091864 podStartE2EDuration="2.137091864s" podCreationTimestamp="2026-03-16 13:35:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:35.118292858 +0000 UTC m=+1779.517605394" watchObservedRunningTime="2026-03-16 13:35:35.137091864 +0000 UTC m=+1779.536404411" Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.132638 5030 generic.go:358] "Generic (PLEG): container finished" podID="3da66385-b1da-4248-8518-4fb80b8969c1" containerID="7d17f24d949dd1bc68b4d3666daa243dd4da7b8e0ea98877dd427d30f0a09db4" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.133776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" event={"ID":"3da66385-b1da-4248-8518-4fb80b8969c1","Type":"ContainerDied","Data":"7d17f24d949dd1bc68b4d3666daa243dd4da7b8e0ea98877dd427d30f0a09db4"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.135198 5030 generic.go:358] "Generic (PLEG): container finished" podID="2abd1835-1ef3-4b42-a8c6-df45ce29513f" containerID="05be438c16f7cc07d73c9be8416a3e11f04cd9ea225c0144382e579b01b4c86e" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.135336 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" event={"ID":"2abd1835-1ef3-4b42-a8c6-df45ce29513f","Type":"ContainerDied","Data":"05be438c16f7cc07d73c9be8416a3e11f04cd9ea225c0144382e579b01b4c86e"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.136565 5030 generic.go:358] "Generic (PLEG): container finished" podID="0006c2de-2330-4fcd-a854-ed0a25027735" containerID="6698db1ac1ffaf2b90b75b486edce322016be4998065142387f0f7df8f1dafc2" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.136687 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" event={"ID":"0006c2de-2330-4fcd-a854-ed0a25027735","Type":"ContainerDied","Data":"6698db1ac1ffaf2b90b75b486edce322016be4998065142387f0f7df8f1dafc2"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.137874 5030 generic.go:358] "Generic (PLEG): container finished" podID="761940b5-90f6-4c99-b5c9-5aab7ecf09ce" containerID="6ce3cc876201e249e535661657085f98810d891a457e25b4fee73d15d538879d" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.137962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" event={"ID":"761940b5-90f6-4c99-b5c9-5aab7ecf09ce","Type":"ContainerDied","Data":"6ce3cc876201e249e535661657085f98810d891a457e25b4fee73d15d538879d"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.139130 5030 generic.go:358] "Generic (PLEG): container finished" podID="58ded5f4-a756-47c1-812f-25d2405e2824" containerID="7e26dcce3440baf9597675468ed929ce100b008d1eaa17bb63c61610d7027a4d" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.139249 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" event={"ID":"58ded5f4-a756-47c1-812f-25d2405e2824","Type":"ContainerDied","Data":"7e26dcce3440baf9597675468ed929ce100b008d1eaa17bb63c61610d7027a4d"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.140332 5030 generic.go:358] "Generic (PLEG): container finished" podID="4caa7fe2-4967-46e9-8877-f8c00d468708" containerID="b83caba6a6863ca924241e3545d0c5847ba3a0bd980d807936d043745b7ae405" exitCode=0 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.140421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" event={"ID":"4caa7fe2-4967-46e9-8877-f8c00d468708","Type":"ContainerDied","Data":"b83caba6a6863ca924241e3545d0c5847ba3a0bd980d807936d043745b7ae405"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.142920 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerStarted","Data":"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.142952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerStarted","Data":"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.149448 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerStarted","Data":"a8336322caa38223b2d6e94a98fe9b4f9aae4283000f9ce1794ad4a68e41d1bb"} Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.150108 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.150180 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="sg-core" containerID="cri-o://c5ad0a40ecf2f3795ace418338b0033f5e62f93495aad56ca7d364639a66358b" gracePeriod=30 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.150256 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="proxy-httpd" containerID="cri-o://a8336322caa38223b2d6e94a98fe9b4f9aae4283000f9ce1794ad4a68e41d1bb" gracePeriod=30 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.150295 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-central-agent" containerID="cri-o://13110cdb63d56fbb62e52fd6f4186e652404c75a8b4553668cc03dcbe9902002" gracePeriod=30 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.150492 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-notification-agent" containerID="cri-o://7b25dab5240b95806825988fa0fd9a1ddecc967ec3ed3dada714d55b6c397036" gracePeriod=30 Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.190563 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.190531095 podStartE2EDuration="4.190531095s" podCreationTimestamp="2026-03-16 13:35:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:36.183525603 +0000 UTC m=+1780.582838170" watchObservedRunningTime="2026-03-16 13:35:36.190531095 +0000 UTC m=+1780.589843642" Mar 16 13:35:36 crc kubenswrapper[5030]: I0316 13:35:36.269314 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.937649067 podStartE2EDuration="6.269300521s" podCreationTimestamp="2026-03-16 13:35:30 +0000 UTC" firstStartedPulling="2026-03-16 13:35:30.865306162 +0000 UTC m=+1775.264618709" lastFinishedPulling="2026-03-16 13:35:35.196957616 +0000 UTC m=+1779.596270163" observedRunningTime="2026-03-16 13:35:36.268340656 +0000 UTC m=+1780.667653203" watchObservedRunningTime="2026-03-16 13:35:36.269300521 +0000 UTC m=+1780.668613068" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.159809 5030 generic.go:358] "Generic (PLEG): container finished" podID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerID="a8336322caa38223b2d6e94a98fe9b4f9aae4283000f9ce1794ad4a68e41d1bb" exitCode=0 Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.160136 5030 generic.go:358] "Generic (PLEG): container finished" podID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerID="c5ad0a40ecf2f3795ace418338b0033f5e62f93495aad56ca7d364639a66358b" exitCode=2 Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.160144 5030 generic.go:358] "Generic (PLEG): container finished" podID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerID="7b25dab5240b95806825988fa0fd9a1ddecc967ec3ed3dada714d55b6c397036" exitCode=0 Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.159855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerDied","Data":"a8336322caa38223b2d6e94a98fe9b4f9aae4283000f9ce1794ad4a68e41d1bb"} Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.160248 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerDied","Data":"c5ad0a40ecf2f3795ace418338b0033f5e62f93495aad56ca7d364639a66358b"} Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.160261 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerDied","Data":"7b25dab5240b95806825988fa0fd9a1ddecc967ec3ed3dada714d55b6c397036"} Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.530144 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.624830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts\") pod \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.625818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "2abd1835-1ef3-4b42-a8c6-df45ce29513f" (UID: "2abd1835-1ef3-4b42-a8c6-df45ce29513f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.626203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcxxv\" (UniqueName: \"kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv\") pod \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\" (UID: \"2abd1835-1ef3-4b42-a8c6-df45ce29513f\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.628268 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/2abd1835-1ef3-4b42-a8c6-df45ce29513f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.632525 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv" (OuterVolumeSpecName: "kube-api-access-kcxxv") pod "2abd1835-1ef3-4b42-a8c6-df45ce29513f" (UID: "2abd1835-1ef3-4b42-a8c6-df45ce29513f"). InnerVolumeSpecName "kube-api-access-kcxxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.730192 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcxxv\" (UniqueName: \"kubernetes.io/projected/2abd1835-1ef3-4b42-a8c6-df45ce29513f-kube-api-access-kcxxv\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.746933 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.751968 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.757989 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.774142 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.795624 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.831797 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7k9c\" (UniqueName: \"kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c\") pod \"4caa7fe2-4967-46e9-8877-f8c00d468708\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.831872 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts\") pod \"58ded5f4-a756-47c1-812f-25d2405e2824\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.831962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts\") pod \"0006c2de-2330-4fcd-a854-ed0a25027735\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.831995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts\") pod \"3da66385-b1da-4248-8518-4fb80b8969c1\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832033 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcpzf\" (UniqueName: \"kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf\") pod \"58ded5f4-a756-47c1-812f-25d2405e2824\" (UID: \"58ded5f4-a756-47c1-812f-25d2405e2824\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv\") pod \"0006c2de-2330-4fcd-a854-ed0a25027735\" (UID: \"0006c2de-2330-4fcd-a854-ed0a25027735\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832485 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "58ded5f4-a756-47c1-812f-25d2405e2824" (UID: "58ded5f4-a756-47c1-812f-25d2405e2824"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0006c2de-2330-4fcd-a854-ed0a25027735" (UID: "0006c2de-2330-4fcd-a854-ed0a25027735"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832588 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5ljk\" (UniqueName: \"kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk\") pod \"3da66385-b1da-4248-8518-4fb80b8969c1\" (UID: \"3da66385-b1da-4248-8518-4fb80b8969c1\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832657 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpdts\" (UniqueName: \"kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts\") pod \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts\") pod \"4caa7fe2-4967-46e9-8877-f8c00d468708\" (UID: \"4caa7fe2-4967-46e9-8877-f8c00d468708\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.832956 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts\") pod \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\" (UID: \"761940b5-90f6-4c99-b5c9-5aab7ecf09ce\") " Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.833163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3da66385-b1da-4248-8518-4fb80b8969c1" (UID: "3da66385-b1da-4248-8518-4fb80b8969c1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.833872 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ded5f4-a756-47c1-812f-25d2405e2824-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.833892 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0006c2de-2330-4fcd-a854-ed0a25027735-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.833902 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3da66385-b1da-4248-8518-4fb80b8969c1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.834129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4caa7fe2-4967-46e9-8877-f8c00d468708" (UID: "4caa7fe2-4967-46e9-8877-f8c00d468708"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.834217 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "761940b5-90f6-4c99-b5c9-5aab7ecf09ce" (UID: "761940b5-90f6-4c99-b5c9-5aab7ecf09ce"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.835667 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv" (OuterVolumeSpecName: "kube-api-access-sgrpv") pod "0006c2de-2330-4fcd-a854-ed0a25027735" (UID: "0006c2de-2330-4fcd-a854-ed0a25027735"). InnerVolumeSpecName "kube-api-access-sgrpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.838039 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf" (OuterVolumeSpecName: "kube-api-access-wcpzf") pod "58ded5f4-a756-47c1-812f-25d2405e2824" (UID: "58ded5f4-a756-47c1-812f-25d2405e2824"). InnerVolumeSpecName "kube-api-access-wcpzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.851465 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c" (OuterVolumeSpecName: "kube-api-access-t7k9c") pod "4caa7fe2-4967-46e9-8877-f8c00d468708" (UID: "4caa7fe2-4967-46e9-8877-f8c00d468708"). InnerVolumeSpecName "kube-api-access-t7k9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.853071 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk" (OuterVolumeSpecName: "kube-api-access-p5ljk") pod "3da66385-b1da-4248-8518-4fb80b8969c1" (UID: "3da66385-b1da-4248-8518-4fb80b8969c1"). InnerVolumeSpecName "kube-api-access-p5ljk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.855033 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts" (OuterVolumeSpecName: "kube-api-access-xpdts") pod "761940b5-90f6-4c99-b5c9-5aab7ecf09ce" (UID: "761940b5-90f6-4c99-b5c9-5aab7ecf09ce"). InnerVolumeSpecName "kube-api-access-xpdts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.936804 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5ljk\" (UniqueName: \"kubernetes.io/projected/3da66385-b1da-4248-8518-4fb80b8969c1-kube-api-access-p5ljk\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.936952 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpdts\" (UniqueName: \"kubernetes.io/projected/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-kube-api-access-xpdts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.937017 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4caa7fe2-4967-46e9-8877-f8c00d468708-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.937075 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/761940b5-90f6-4c99-b5c9-5aab7ecf09ce-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.937144 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7k9c\" (UniqueName: \"kubernetes.io/projected/4caa7fe2-4967-46e9-8877-f8c00d468708-kube-api-access-t7k9c\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.937218 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcpzf\" (UniqueName: \"kubernetes.io/projected/58ded5f4-a756-47c1-812f-25d2405e2824-kube-api-access-wcpzf\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.937269 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/0006c2de-2330-4fcd-a854-ed0a25027735-kube-api-access-sgrpv\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.970948 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:37 crc kubenswrapper[5030]: I0316 13:35:37.972635 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.172852 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.173125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-57dc6" event={"ID":"4caa7fe2-4967-46e9-8877-f8c00d468708","Type":"ContainerDied","Data":"c709aaa478f961c57aca4c2ffc72c2fc46f2887adc72e80ac20e5ca586292ad3"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.173175 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c709aaa478f961c57aca4c2ffc72c2fc46f2887adc72e80ac20e5ca586292ad3" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.174730 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.174745 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g" event={"ID":"3da66385-b1da-4248-8518-4fb80b8969c1","Type":"ContainerDied","Data":"12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.174799 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12e92abfa53b326fb618102131e023785e8868edf8263c8d70f7345cc272d9d7" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.176083 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" event={"ID":"2abd1835-1ef3-4b42-a8c6-df45ce29513f","Type":"ContainerDied","Data":"43f602ecfb9f2f3e47417520e5900e0e1684e426245390f92e02745b3c7e39d2"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.176127 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43f602ecfb9f2f3e47417520e5900e0e1684e426245390f92e02745b3c7e39d2" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.176209 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-znbcd" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.178508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" event={"ID":"0006c2de-2330-4fcd-a854-ed0a25027735","Type":"ContainerDied","Data":"7548cdb3220640abc95d8517dac1ecb2d40734dd129ab8fdb70f502eb3668b97"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.178544 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.178563 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7548cdb3220640abc95d8517dac1ecb2d40734dd129ab8fdb70f502eb3668b97" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.179932 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.179982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-nw282" event={"ID":"761940b5-90f6-4c99-b5c9-5aab7ecf09ce","Type":"ContainerDied","Data":"0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.180011 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f17c7679f28b57aef6d3b50209f470d3e2689ca2cb92fa95e199713840cfbc8" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.182880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" event={"ID":"58ded5f4-a756-47c1-812f-25d2405e2824","Type":"ContainerDied","Data":"6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5"} Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.182905 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ae701176f9eafc163d1cb07a8ed99763b6935f929ab5c1cc9d4b558603a1ed5" Mar 16 13:35:38 crc kubenswrapper[5030]: I0316 13:35:38.183302 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.314507 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn"] Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.315962 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2abd1835-1ef3-4b42-a8c6-df45ce29513f" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.315985 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2abd1835-1ef3-4b42-a8c6-df45ce29513f" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316021 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0006c2de-2330-4fcd-a854-ed0a25027735" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316028 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0006c2de-2330-4fcd-a854-ed0a25027735" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316038 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761940b5-90f6-4c99-b5c9-5aab7ecf09ce" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316043 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="761940b5-90f6-4c99-b5c9-5aab7ecf09ce" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316052 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4caa7fe2-4967-46e9-8877-f8c00d468708" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316057 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4caa7fe2-4967-46e9-8877-f8c00d468708" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316068 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ded5f4-a756-47c1-812f-25d2405e2824" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316074 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ded5f4-a756-47c1-812f-25d2405e2824" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316080 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da66385-b1da-4248-8518-4fb80b8969c1" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316085 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da66385-b1da-4248-8518-4fb80b8969c1" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316297 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2abd1835-1ef3-4b42-a8c6-df45ce29513f" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316311 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="58ded5f4-a756-47c1-812f-25d2405e2824" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316320 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3da66385-b1da-4248-8518-4fb80b8969c1" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316335 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0006c2de-2330-4fcd-a854-ed0a25027735" containerName="mariadb-account-create-update" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316344 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="761940b5-90f6-4c99-b5c9-5aab7ecf09ce" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.316356 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4caa7fe2-4967-46e9-8877-f8c00d468708" containerName="mariadb-database-create" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.319783 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.321960 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.322261 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-q2vxs\"" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.322635 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn"] Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.341342 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.376591 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swc4m\" (UniqueName: \"kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.376898 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.377085 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.377182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.479326 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swc4m\" (UniqueName: \"kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.479633 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.479756 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.479798 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.488221 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.488492 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.488441 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.497117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swc4m\" (UniqueName: \"kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m\") pod \"nova-cell0-conductor-db-sync-6m5bn\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:39 crc kubenswrapper[5030]: I0316 13:35:39.645941 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:40 crc kubenswrapper[5030]: I0316 13:35:40.074964 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn"] Mar 16 13:35:40 crc kubenswrapper[5030]: W0316 13:35:40.077534 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28278e6e_77e5_4bc0_9555_7ab7a21df349.slice/crio-0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c WatchSource:0}: Error finding container 0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c: Status 404 returned error can't find the container with id 0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c Mar 16 13:35:40 crc kubenswrapper[5030]: I0316 13:35:40.217505 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" event={"ID":"28278e6e-77e5-4bc0-9555-7ab7a21df349","Type":"ContainerStarted","Data":"0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c"} Mar 16 13:35:41 crc kubenswrapper[5030]: I0316 13:35:41.231597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" event={"ID":"28278e6e-77e5-4bc0-9555-7ab7a21df349","Type":"ContainerStarted","Data":"f9d562705a940bffc1836315cdc77a47960b337a18d9ee1f0ad1f5b38b626d2c"} Mar 16 13:35:41 crc kubenswrapper[5030]: I0316 13:35:41.256421 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" podStartSLOduration=2.256403231 podStartE2EDuration="2.256403231s" podCreationTimestamp="2026-03-16 13:35:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:41.252504952 +0000 UTC m=+1785.651817488" watchObservedRunningTime="2026-03-16 13:35:41.256403231 +0000 UTC m=+1785.655715778" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.243113 5030 generic.go:358] "Generic (PLEG): container finished" podID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerID="13110cdb63d56fbb62e52fd6f4186e652404c75a8b4553668cc03dcbe9902002" exitCode=0 Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.243209 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerDied","Data":"13110cdb63d56fbb62e52fd6f4186e652404c75a8b4553668cc03dcbe9902002"} Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.243470 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"4013ea60-ea41-4bb8-99e6-37a4a33d947f","Type":"ContainerDied","Data":"0caa1025fe8a7043af512ea44924c43e3bb0253cbec48c0f8f324a190318457f"} Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.243499 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0caa1025fe8a7043af512ea44924c43e3bb0253cbec48c0f8f324a190318457f" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.272893 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.334433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.334521 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.334609 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.334771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxlx6\" (UniqueName: \"kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.334794 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335009 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335060 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml\") pod \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\" (UID: \"4013ea60-ea41-4bb8-99e6-37a4a33d947f\") " Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335141 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335618 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.335639 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4013ea60-ea41-4bb8-99e6-37a4a33d947f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.346997 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts" (OuterVolumeSpecName: "scripts") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.363288 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6" (OuterVolumeSpecName: "kube-api-access-bxlx6") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "kube-api-access-bxlx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.371257 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.408089 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.420911 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data" (OuterVolumeSpecName: "config-data") pod "4013ea60-ea41-4bb8-99e6-37a4a33d947f" (UID: "4013ea60-ea41-4bb8-99e6-37a4a33d947f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.437466 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.437495 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.437504 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxlx6\" (UniqueName: \"kubernetes.io/projected/4013ea60-ea41-4bb8-99e6-37a4a33d947f-kube-api-access-bxlx6\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.437517 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.437526 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/4013ea60-ea41-4bb8-99e6-37a4a33d947f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.619962 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.620010 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.652698 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.652772 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:42 crc kubenswrapper[5030]: I0316 13:35:42.946428 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:35:42 crc kubenswrapper[5030]: E0316 13:35:42.946737 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.258542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.259234 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.260574 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.330963 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.345612 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.365710 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367383 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="sg-core" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367420 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="sg-core" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367430 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-notification-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367437 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-notification-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367445 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-central-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367451 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-central-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367490 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="proxy-httpd" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367495 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="proxy-httpd" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367729 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-central-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367740 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="sg-core" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367746 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="proxy-httpd" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.367759 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" containerName="ceilometer-notification-agent" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.374216 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.377000 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.377121 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.377487 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:43 crc kubenswrapper[5030]: E0316 13:35:43.415644 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4013ea60_ea41_4bb8_99e6_37a4a33d947f.slice/crio-0caa1025fe8a7043af512ea44924c43e3bb0253cbec48c0f8f324a190318457f\": RecentStats: unable to find data in memory cache]" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.467276 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.467580 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.467702 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.467981 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.468059 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.468142 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.468185 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9cb7\" (UniqueName: \"kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570030 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570085 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cb7\" (UniqueName: \"kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570163 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570196 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570780 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.570789 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.571216 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.576959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.577966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.578318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.584319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.588227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9cb7\" (UniqueName: \"kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7\") pod \"ceilometer-0\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.642033 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.642102 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.675972 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.676082 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.695109 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:43 crc kubenswrapper[5030]: I0316 13:35:43.958798 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4013ea60-ea41-4bb8-99e6-37a4a33d947f" path="/var/lib/kubelet/pods/4013ea60-ea41-4bb8-99e6-37a4a33d947f/volumes" Mar 16 13:35:44 crc kubenswrapper[5030]: I0316 13:35:44.131115 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:44 crc kubenswrapper[5030]: W0316 13:35:44.136806 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod021b4952_e9f3_445e_a6c5_a245c5e938cc.slice/crio-48e9286675255e2c1d4e0d73062ad426fd16b46359fb168ae4458c23d2f6d8d3 WatchSource:0}: Error finding container 48e9286675255e2c1d4e0d73062ad426fd16b46359fb168ae4458c23d2f6d8d3: Status 404 returned error can't find the container with id 48e9286675255e2c1d4e0d73062ad426fd16b46359fb168ae4458c23d2f6d8d3 Mar 16 13:35:44 crc kubenswrapper[5030]: I0316 13:35:44.267770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerStarted","Data":"48e9286675255e2c1d4e0d73062ad426fd16b46359fb168ae4458c23d2f6d8d3"} Mar 16 13:35:44 crc kubenswrapper[5030]: I0316 13:35:44.268915 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:44 crc kubenswrapper[5030]: I0316 13:35:44.269208 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:44 crc kubenswrapper[5030]: I0316 13:35:44.933882 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:45 crc kubenswrapper[5030]: I0316 13:35:45.059732 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:35:45 crc kubenswrapper[5030]: I0316 13:35:45.280704 5030 generic.go:358] "Generic (PLEG): container finished" podID="28278e6e-77e5-4bc0-9555-7ab7a21df349" containerID="f9d562705a940bffc1836315cdc77a47960b337a18d9ee1f0ad1f5b38b626d2c" exitCode=0 Mar 16 13:35:45 crc kubenswrapper[5030]: I0316 13:35:45.280800 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" event={"ID":"28278e6e-77e5-4bc0-9555-7ab7a21df349","Type":"ContainerDied","Data":"f9d562705a940bffc1836315cdc77a47960b337a18d9ee1f0ad1f5b38b626d2c"} Mar 16 13:35:45 crc kubenswrapper[5030]: I0316 13:35:45.282706 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerStarted","Data":"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7"} Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.044042 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.121000 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.297479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerStarted","Data":"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121"} Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.613161 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.635949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data\") pod \"28278e6e-77e5-4bc0-9555-7ab7a21df349\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.636128 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle\") pod \"28278e6e-77e5-4bc0-9555-7ab7a21df349\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.636197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts\") pod \"28278e6e-77e5-4bc0-9555-7ab7a21df349\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.636254 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swc4m\" (UniqueName: \"kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m\") pod \"28278e6e-77e5-4bc0-9555-7ab7a21df349\" (UID: \"28278e6e-77e5-4bc0-9555-7ab7a21df349\") " Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.645034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m" (OuterVolumeSpecName: "kube-api-access-swc4m") pod "28278e6e-77e5-4bc0-9555-7ab7a21df349" (UID: "28278e6e-77e5-4bc0-9555-7ab7a21df349"). InnerVolumeSpecName "kube-api-access-swc4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.669770 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts" (OuterVolumeSpecName: "scripts") pod "28278e6e-77e5-4bc0-9555-7ab7a21df349" (UID: "28278e6e-77e5-4bc0-9555-7ab7a21df349"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.686761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data" (OuterVolumeSpecName: "config-data") pod "28278e6e-77e5-4bc0-9555-7ab7a21df349" (UID: "28278e6e-77e5-4bc0-9555-7ab7a21df349"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.695658 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "28278e6e-77e5-4bc0-9555-7ab7a21df349" (UID: "28278e6e-77e5-4bc0-9555-7ab7a21df349"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.741847 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.742061 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.742186 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/28278e6e-77e5-4bc0-9555-7ab7a21df349-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:46 crc kubenswrapper[5030]: I0316 13:35:46.742262 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swc4m\" (UniqueName: \"kubernetes.io/projected/28278e6e-77e5-4bc0-9555-7ab7a21df349-kube-api-access-swc4m\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.315157 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" event={"ID":"28278e6e-77e5-4bc0-9555-7ab7a21df349","Type":"ContainerDied","Data":"0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c"} Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.315715 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aa42f67fc6d2f4bbcef8e9fe988040c8b8792671dc56433dc94465e9393ca0c" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.315182 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.319095 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerStarted","Data":"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d"} Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.367686 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.368763 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28278e6e-77e5-4bc0-9555-7ab7a21df349" containerName="nova-cell0-conductor-db-sync" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.368788 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="28278e6e-77e5-4bc0-9555-7ab7a21df349" containerName="nova-cell0-conductor-db-sync" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.368998 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="28278e6e-77e5-4bc0-9555-7ab7a21df349" containerName="nova-cell0-conductor-db-sync" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.372590 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.375198 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-q2vxs\"" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.375557 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.376752 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.461792 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.462030 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmstx\" (UniqueName: \"kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.462194 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.563998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.564054 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmstx\" (UniqueName: \"kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.564106 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.577693 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.577860 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.581981 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmstx\" (UniqueName: \"kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx\") pod \"nova-cell0-conductor-0\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.584401 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:47 crc kubenswrapper[5030]: I0316 13:35:47.690569 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:48 crc kubenswrapper[5030]: W0316 13:35:48.114008 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode446e59a_e04d_464e_8e01_16544888b99a.slice/crio-677ca311d5ad74d4f22559cd9172383ed335f115ae84a24194a23f7d5b17eeb0 WatchSource:0}: Error finding container 677ca311d5ad74d4f22559cd9172383ed335f115ae84a24194a23f7d5b17eeb0: Status 404 returned error can't find the container with id 677ca311d5ad74d4f22559cd9172383ed335f115ae84a24194a23f7d5b17eeb0 Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.114639 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.335417 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e446e59a-e04d-464e-8e01-16544888b99a","Type":"ContainerStarted","Data":"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37"} Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.335734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.335751 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e446e59a-e04d-464e-8e01-16544888b99a","Type":"ContainerStarted","Data":"677ca311d5ad74d4f22559cd9172383ed335f115ae84a24194a23f7d5b17eeb0"} Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.356577 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.356532073 podStartE2EDuration="1.356532073s" podCreationTimestamp="2026-03-16 13:35:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:35:48.3549401 +0000 UTC m=+1792.754252647" watchObservedRunningTime="2026-03-16 13:35:48.356532073 +0000 UTC m=+1792.755844620" Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.418494 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.497979 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.501000 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-log" containerID="cri-o://79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191" gracePeriod=30 Mar 16 13:35:48 crc kubenswrapper[5030]: I0316 13:35:48.501208 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-api" containerID="cri-o://52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc" gracePeriod=30 Mar 16 13:35:49 crc kubenswrapper[5030]: I0316 13:35:49.348874 5030 generic.go:358] "Generic (PLEG): container finished" podID="336632fa-5886-453c-8d8e-53c8d01a6829" containerID="79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191" exitCode=143 Mar 16 13:35:49 crc kubenswrapper[5030]: I0316 13:35:49.348948 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerDied","Data":"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191"} Mar 16 13:35:49 crc kubenswrapper[5030]: I0316 13:35:49.360953 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerStarted","Data":"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b"} Mar 16 13:35:49 crc kubenswrapper[5030]: I0316 13:35:49.391736 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.126933805 podStartE2EDuration="6.391701051s" podCreationTimestamp="2026-03-16 13:35:43 +0000 UTC" firstStartedPulling="2026-03-16 13:35:44.138748348 +0000 UTC m=+1788.538060895" lastFinishedPulling="2026-03-16 13:35:48.403515603 +0000 UTC m=+1792.802828141" observedRunningTime="2026-03-16 13:35:49.385203986 +0000 UTC m=+1793.784516532" watchObservedRunningTime="2026-03-16 13:35:49.391701051 +0000 UTC m=+1793.791013599" Mar 16 13:35:49 crc kubenswrapper[5030]: I0316 13:35:49.924298 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:35:50 crc kubenswrapper[5030]: I0316 13:35:50.368807 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" containerID="cri-o://2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" gracePeriod=30 Mar 16 13:35:50 crc kubenswrapper[5030]: I0316 13:35:50.370039 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:50 crc kubenswrapper[5030]: I0316 13:35:50.571080 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.036893 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.184052 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs\") pod \"336632fa-5886-453c-8d8e-53c8d01a6829\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.184635 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv7ld\" (UniqueName: \"kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld\") pod \"336632fa-5886-453c-8d8e-53c8d01a6829\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.184650 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs" (OuterVolumeSpecName: "logs") pod "336632fa-5886-453c-8d8e-53c8d01a6829" (UID: "336632fa-5886-453c-8d8e-53c8d01a6829"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.185105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data\") pod \"336632fa-5886-453c-8d8e-53c8d01a6829\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.185228 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle\") pod \"336632fa-5886-453c-8d8e-53c8d01a6829\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.185478 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts\") pod \"336632fa-5886-453c-8d8e-53c8d01a6829\" (UID: \"336632fa-5886-453c-8d8e-53c8d01a6829\") " Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.186497 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/336632fa-5886-453c-8d8e-53c8d01a6829-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.192610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts" (OuterVolumeSpecName: "scripts") pod "336632fa-5886-453c-8d8e-53c8d01a6829" (UID: "336632fa-5886-453c-8d8e-53c8d01a6829"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.193244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld" (OuterVolumeSpecName: "kube-api-access-dv7ld") pod "336632fa-5886-453c-8d8e-53c8d01a6829" (UID: "336632fa-5886-453c-8d8e-53c8d01a6829"). InnerVolumeSpecName "kube-api-access-dv7ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.232740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "336632fa-5886-453c-8d8e-53c8d01a6829" (UID: "336632fa-5886-453c-8d8e-53c8d01a6829"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.237146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data" (OuterVolumeSpecName: "config-data") pod "336632fa-5886-453c-8d8e-53c8d01a6829" (UID: "336632fa-5886-453c-8d8e-53c8d01a6829"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.290066 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv7ld\" (UniqueName: \"kubernetes.io/projected/336632fa-5886-453c-8d8e-53c8d01a6829-kube-api-access-dv7ld\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.290119 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.290135 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.290145 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/336632fa-5886-453c-8d8e-53c8d01a6829-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.392034 5030 generic.go:358] "Generic (PLEG): container finished" podID="336632fa-5886-453c-8d8e-53c8d01a6829" containerID="52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc" exitCode=0 Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.392371 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.392438 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerDied","Data":"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc"} Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.392477 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-76944fdc46-mfr86" event={"ID":"336632fa-5886-453c-8d8e-53c8d01a6829","Type":"ContainerDied","Data":"bc6b6a305416dcbdd3345144c7d9742a4c68b947de41f4806c9e305423dcad26"} Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.392499 5030 scope.go:117] "RemoveContainer" containerID="52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.394050 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-central-agent" containerID="cri-o://7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7" gracePeriod=30 Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.394106 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="sg-core" containerID="cri-o://b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d" gracePeriod=30 Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.394132 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-notification-agent" containerID="cri-o://f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121" gracePeriod=30 Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.394106 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="proxy-httpd" containerID="cri-o://28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b" gracePeriod=30 Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.436835 5030 scope.go:117] "RemoveContainer" containerID="79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.442315 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.449219 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-76944fdc46-mfr86"] Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.463106 5030 scope.go:117] "RemoveContainer" containerID="52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc" Mar 16 13:35:52 crc kubenswrapper[5030]: E0316 13:35:52.463468 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc\": container with ID starting with 52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc not found: ID does not exist" containerID="52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.463502 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc"} err="failed to get container status \"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc\": rpc error: code = NotFound desc = could not find container \"52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc\": container with ID starting with 52c49d0bf33694b7f0b222b2814e74a967578b2a9c6ba1564d750e14af3fe7cc not found: ID does not exist" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.463524 5030 scope.go:117] "RemoveContainer" containerID="79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191" Mar 16 13:35:52 crc kubenswrapper[5030]: E0316 13:35:52.463838 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191\": container with ID starting with 79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191 not found: ID does not exist" containerID="79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191" Mar 16 13:35:52 crc kubenswrapper[5030]: I0316 13:35:52.463874 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191"} err="failed to get container status \"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191\": rpc error: code = NotFound desc = could not find container \"79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191\": container with ID starting with 79712a80686c0e4abb4e018ab159bf9f7eb71656843676e70814ce4240d2c191 not found: ID does not exist" Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.410576 5030 generic.go:358] "Generic (PLEG): container finished" podID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerID="28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b" exitCode=0 Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.410946 5030 generic.go:358] "Generic (PLEG): container finished" podID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerID="b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d" exitCode=2 Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.410954 5030 generic.go:358] "Generic (PLEG): container finished" podID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerID="f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121" exitCode=0 Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.410623 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerDied","Data":"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b"} Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.411058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerDied","Data":"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d"} Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.411075 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerDied","Data":"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121"} Mar 16 13:35:53 crc kubenswrapper[5030]: I0316 13:35:53.959208 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" path="/var/lib/kubelet/pods/336632fa-5886-453c-8d8e-53c8d01a6829/volumes" Mar 16 13:35:53 crc kubenswrapper[5030]: E0316 13:35:53.968391 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1612336 actualBytes=10240 Mar 16 13:35:54 crc kubenswrapper[5030]: I0316 13:35:54.945776 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:35:54 crc kubenswrapper[5030]: E0316 13:35:54.946396 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:35:54 crc kubenswrapper[5030]: I0316 13:35:54.949858 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051438 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051525 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051655 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051748 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051836 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051948 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9cb7\" (UniqueName: \"kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.051984 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd\") pod \"021b4952-e9f3-445e-a6c5-a245c5e938cc\" (UID: \"021b4952-e9f3-445e-a6c5-a245c5e938cc\") " Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.052476 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.052510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.052652 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.052678 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/021b4952-e9f3-445e-a6c5-a245c5e938cc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.057292 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts" (OuterVolumeSpecName: "scripts") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.057584 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7" (OuterVolumeSpecName: "kube-api-access-v9cb7") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "kube-api-access-v9cb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.074619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.105246 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.118526 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data" (OuterVolumeSpecName: "config-data") pod "021b4952-e9f3-445e-a6c5-a245c5e938cc" (UID: "021b4952-e9f3-445e-a6c5-a245c5e938cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.155128 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.155167 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.155178 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.155193 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9cb7\" (UniqueName: \"kubernetes.io/projected/021b4952-e9f3-445e-a6c5-a245c5e938cc-kube-api-access-v9cb7\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.155203 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/021b4952-e9f3-445e-a6c5-a245c5e938cc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.372026 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.374219 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.375525 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.375585 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.433708 5030 generic.go:358] "Generic (PLEG): container finished" podID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerID="7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7" exitCode=0 Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.433752 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerDied","Data":"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7"} Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.433798 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"021b4952-e9f3-445e-a6c5-a245c5e938cc","Type":"ContainerDied","Data":"48e9286675255e2c1d4e0d73062ad426fd16b46359fb168ae4458c23d2f6d8d3"} Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.433819 5030 scope.go:117] "RemoveContainer" containerID="28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.433991 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.475251 5030 scope.go:117] "RemoveContainer" containerID="b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.491181 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.500525 5030 scope.go:117] "RemoveContainer" containerID="f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.505037 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.514737 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.515912 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="sg-core" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.515933 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="sg-core" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.515995 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-central-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516002 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-central-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516029 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-api" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516035 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-api" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516052 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="proxy-httpd" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516058 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="proxy-httpd" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516069 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-log" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516074 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-log" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516083 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-notification-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516089 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-notification-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516274 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-api" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516289 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="336632fa-5886-453c-8d8e-53c8d01a6829" containerName="placement-log" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516305 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="proxy-httpd" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516313 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-notification-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516322 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="ceilometer-central-agent" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.516332 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" containerName="sg-core" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.521677 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.523693 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.524066 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.525663 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.525946 5030 scope.go:117] "RemoveContainer" containerID="7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.546849 5030 scope.go:117] "RemoveContainer" containerID="28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b" Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.547279 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b\": container with ID starting with 28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b not found: ID does not exist" containerID="28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547322 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b"} err="failed to get container status \"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b\": rpc error: code = NotFound desc = could not find container \"28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b\": container with ID starting with 28812b3aa977d50c40917137aa19b330c7b101b573a3fd867029d5e422a4192b not found: ID does not exist" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547343 5030 scope.go:117] "RemoveContainer" containerID="b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d" Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.547643 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d\": container with ID starting with b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d not found: ID does not exist" containerID="b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547674 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d"} err="failed to get container status \"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d\": rpc error: code = NotFound desc = could not find container \"b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d\": container with ID starting with b090e8f79190f21b377874a25fb3a17beec22ce8fe9bbb3aeca79ef3aa6cf87d not found: ID does not exist" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547693 5030 scope.go:117] "RemoveContainer" containerID="f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121" Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.547933 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121\": container with ID starting with f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121 not found: ID does not exist" containerID="f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547949 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121"} err="failed to get container status \"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121\": rpc error: code = NotFound desc = could not find container \"f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121\": container with ID starting with f241cdfbc4d8aefa4d7ef2f428571f2e012888d39cadf2ee9e1f818aa096b121 not found: ID does not exist" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.547963 5030 scope.go:117] "RemoveContainer" containerID="7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7" Mar 16 13:35:55 crc kubenswrapper[5030]: E0316 13:35:55.548292 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7\": container with ID starting with 7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7 not found: ID does not exist" containerID="7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.548311 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7"} err="failed to get container status \"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7\": rpc error: code = NotFound desc = could not find container \"7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7\": container with ID starting with 7f6fbc5286a264fda1466e63ff35e58a628ab829c7126c96a7d4cfc4264332c7 not found: ID does not exist" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666428 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fkvm\" (UniqueName: \"kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666532 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.666579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.767500 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.767885 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.767920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fkvm\" (UniqueName: \"kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.767968 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.768001 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.768024 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.768068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.769613 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.770067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.773606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.773616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.774082 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.774994 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.783951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fkvm\" (UniqueName: \"kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm\") pod \"ceilometer-0\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.841297 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:35:55 crc kubenswrapper[5030]: I0316 13:35:55.968718 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021b4952-e9f3-445e-a6c5-a245c5e938cc" path="/var/lib/kubelet/pods/021b4952-e9f3-445e-a6c5-a245c5e938cc/volumes" Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.289087 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.455350 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerStarted","Data":"70948f6d22bf5a0a098dc3792414018d843f63c8dfbf9eed1a27e953251b2baf"} Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.779045 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.790834 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.813093 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:35:56 crc kubenswrapper[5030]: I0316 13:35:56.823936 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:35:57 crc kubenswrapper[5030]: I0316 13:35:57.472066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerStarted","Data":"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8"} Mar 16 13:35:58 crc kubenswrapper[5030]: I0316 13:35:58.490373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerStarted","Data":"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c"} Mar 16 13:35:58 crc kubenswrapper[5030]: I0316 13:35:58.491105 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerStarted","Data":"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9"} Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.127722 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561136-27rpk"] Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.132875 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.134524 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.134867 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.136296 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561136-27rpk"] Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.137200 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.170658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6b5r\" (UniqueName: \"kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r\") pod \"auto-csr-approver-29561136-27rpk\" (UID: \"3c25d9b6-5683-44f9-8642-21c83b9d17bc\") " pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.273246 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6b5r\" (UniqueName: \"kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r\") pod \"auto-csr-approver-29561136-27rpk\" (UID: \"3c25d9b6-5683-44f9-8642-21c83b9d17bc\") " pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.290994 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6b5r\" (UniqueName: \"kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r\") pod \"auto-csr-approver-29561136-27rpk\" (UID: \"3c25d9b6-5683-44f9-8642-21c83b9d17bc\") " pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:00 crc kubenswrapper[5030]: E0316 13:36:00.371267 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:00 crc kubenswrapper[5030]: E0316 13:36:00.372603 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:00 crc kubenswrapper[5030]: E0316 13:36:00.373862 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:00 crc kubenswrapper[5030]: E0316 13:36:00.373910 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.461458 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.512504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerStarted","Data":"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507"} Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.512701 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.573448 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.999607989 podStartE2EDuration="5.573429409s" podCreationTimestamp="2026-03-16 13:35:55 +0000 UTC" firstStartedPulling="2026-03-16 13:35:56.292609931 +0000 UTC m=+1800.691922478" lastFinishedPulling="2026-03-16 13:35:59.866431351 +0000 UTC m=+1804.265743898" observedRunningTime="2026-03-16 13:36:00.536701061 +0000 UTC m=+1804.936013607" watchObservedRunningTime="2026-03-16 13:36:00.573429409 +0000 UTC m=+1804.972741956" Mar 16 13:36:00 crc kubenswrapper[5030]: I0316 13:36:00.865702 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561136-27rpk"] Mar 16 13:36:01 crc kubenswrapper[5030]: I0316 13:36:01.525026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561136-27rpk" event={"ID":"3c25d9b6-5683-44f9-8642-21c83b9d17bc","Type":"ContainerStarted","Data":"1f6a7fd383921613430b605fb43611241df3ea657c7a318ec2202fa405a0e862"} Mar 16 13:36:03 crc kubenswrapper[5030]: I0316 13:36:03.551344 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c25d9b6-5683-44f9-8642-21c83b9d17bc" containerID="c4af88105e395719e57752a2f391be7f4698fb9cbfa0fbe832f4df3e9e341c4d" exitCode=0 Mar 16 13:36:03 crc kubenswrapper[5030]: I0316 13:36:03.551408 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561136-27rpk" event={"ID":"3c25d9b6-5683-44f9-8642-21c83b9d17bc","Type":"ContainerDied","Data":"c4af88105e395719e57752a2f391be7f4698fb9cbfa0fbe832f4df3e9e341c4d"} Mar 16 13:36:04 crc kubenswrapper[5030]: I0316 13:36:04.862486 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:04 crc kubenswrapper[5030]: I0316 13:36:04.979780 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6b5r\" (UniqueName: \"kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r\") pod \"3c25d9b6-5683-44f9-8642-21c83b9d17bc\" (UID: \"3c25d9b6-5683-44f9-8642-21c83b9d17bc\") " Mar 16 13:36:04 crc kubenswrapper[5030]: I0316 13:36:04.986318 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r" (OuterVolumeSpecName: "kube-api-access-l6b5r") pod "3c25d9b6-5683-44f9-8642-21c83b9d17bc" (UID: "3c25d9b6-5683-44f9-8642-21c83b9d17bc"). InnerVolumeSpecName "kube-api-access-l6b5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.081862 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6b5r\" (UniqueName: \"kubernetes.io/projected/3c25d9b6-5683-44f9-8642-21c83b9d17bc-kube-api-access-l6b5r\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:05 crc kubenswrapper[5030]: E0316 13:36:05.372047 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:05 crc kubenswrapper[5030]: E0316 13:36:05.374000 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:05 crc kubenswrapper[5030]: E0316 13:36:05.375598 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:05 crc kubenswrapper[5030]: E0316 13:36:05.375636 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.572603 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561136-27rpk" event={"ID":"3c25d9b6-5683-44f9-8642-21c83b9d17bc","Type":"ContainerDied","Data":"1f6a7fd383921613430b605fb43611241df3ea657c7a318ec2202fa405a0e862"} Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.572661 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f6a7fd383921613430b605fb43611241df3ea657c7a318ec2202fa405a0e862" Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.572956 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561136-27rpk" Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.936513 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561130-bphmj"] Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.957198 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561130-bphmj"] Mar 16 13:36:05 crc kubenswrapper[5030]: I0316 13:36:05.957361 5030 status_manager.go:895] "Failed to get status for pod" podUID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" pod="openshift-infra/auto-csr-approver-29561130-bphmj" err="pods \"auto-csr-approver-29561130-bphmj\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-infra\": no relationship found between node 'crc' and this object" Mar 16 13:36:07 crc kubenswrapper[5030]: I0316 13:36:07.947697 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:36:07 crc kubenswrapper[5030]: E0316 13:36:07.949109 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:36:07 crc kubenswrapper[5030]: I0316 13:36:07.960183 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f263c53-55a3-4d42-9b1a-d2f3d2600126" path="/var/lib/kubelet/pods/0f263c53-55a3-4d42-9b1a-d2f3d2600126/volumes" Mar 16 13:36:10 crc kubenswrapper[5030]: E0316 13:36:10.372201 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:10 crc kubenswrapper[5030]: E0316 13:36:10.374355 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:10 crc kubenswrapper[5030]: E0316 13:36:10.376855 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:10 crc kubenswrapper[5030]: E0316 13:36:10.376903 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:36:15 crc kubenswrapper[5030]: E0316 13:36:15.371187 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:15 crc kubenswrapper[5030]: E0316 13:36:15.374441 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:15 crc kubenswrapper[5030]: E0316 13:36:15.375831 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:15 crc kubenswrapper[5030]: E0316 13:36:15.375966 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.125329 5030 scope.go:117] "RemoveContainer" containerID="be3021b0ad3241a0fd1fdaeafe2aeaf0f3ba124c5658485700f64f151898ba89" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.150524 5030 scope.go:117] "RemoveContainer" containerID="6676b29fcc80e0bee745a0d2c16489fefb7d477acb3c5f2107b4eb383c1c9962" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.188504 5030 scope.go:117] "RemoveContainer" containerID="d00ca3258b8728f5a4b1544c8284e63ba022b5901bb0a1adf286404eefe58ce9" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.214825 5030 scope.go:117] "RemoveContainer" containerID="c5e8822170f352c1e727e24e5a897d47bba1a09b493a06a33fa46f991961dc16" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.308146 5030 scope.go:117] "RemoveContainer" containerID="27cbf1661e45377b3ba39b34e3b8d84ed1a32926de78d78f885c4057edf37aeb" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.348844 5030 scope.go:117] "RemoveContainer" containerID="e52fd36ea4a9b71a4b9e1d332348b8e113df83007ce510f0b63219d335b3c2c3" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.370626 5030 scope.go:117] "RemoveContainer" containerID="3d6a6b027551a674c70ccdac4cd42c3e402319a88552c11d881b43c4150d52fa" Mar 16 13:36:17 crc kubenswrapper[5030]: I0316 13:36:17.394319 5030 scope.go:117] "RemoveContainer" containerID="46cef5d1d64b356716135af45dbdb034352e8473e8cab3d5d9ad5170e6244801" Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.371446 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.375059 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.376637 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.376715 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.597739 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode446e59a_e04d_464e_8e01_16544888b99a.slice/crio-conmon-2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode446e59a_e04d_464e_8e01_16544888b99a.slice/crio-2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.720678 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.730324 5030 generic.go:358] "Generic (PLEG): container finished" podID="e446e59a-e04d-464e-8e01-16544888b99a" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" exitCode=137 Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.730697 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e446e59a-e04d-464e-8e01-16544888b99a","Type":"ContainerDied","Data":"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37"} Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.730735 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"e446e59a-e04d-464e-8e01-16544888b99a","Type":"ContainerDied","Data":"677ca311d5ad74d4f22559cd9172383ed335f115ae84a24194a23f7d5b17eeb0"} Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.730758 5030 scope.go:117] "RemoveContainer" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.730968 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.765642 5030 scope.go:117] "RemoveContainer" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" Mar 16 13:36:20 crc kubenswrapper[5030]: E0316 13:36:20.766298 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37\": container with ID starting with 2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37 not found: ID does not exist" containerID="2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.766360 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37"} err="failed to get container status \"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37\": rpc error: code = NotFound desc = could not find container \"2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37\": container with ID starting with 2d05b9f07d42243aad08ccd1eedef5e918d786b792c0658ef987387664239b37 not found: ID does not exist" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.808732 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data\") pod \"e446e59a-e04d-464e-8e01-16544888b99a\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.808795 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmstx\" (UniqueName: \"kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx\") pod \"e446e59a-e04d-464e-8e01-16544888b99a\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.808944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle\") pod \"e446e59a-e04d-464e-8e01-16544888b99a\" (UID: \"e446e59a-e04d-464e-8e01-16544888b99a\") " Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.814148 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx" (OuterVolumeSpecName: "kube-api-access-kmstx") pod "e446e59a-e04d-464e-8e01-16544888b99a" (UID: "e446e59a-e04d-464e-8e01-16544888b99a"). InnerVolumeSpecName "kube-api-access-kmstx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.829417 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data" (OuterVolumeSpecName: "config-data") pod "e446e59a-e04d-464e-8e01-16544888b99a" (UID: "e446e59a-e04d-464e-8e01-16544888b99a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.830184 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e446e59a-e04d-464e-8e01-16544888b99a" (UID: "e446e59a-e04d-464e-8e01-16544888b99a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.912064 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.912104 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmstx\" (UniqueName: \"kubernetes.io/projected/e446e59a-e04d-464e-8e01-16544888b99a-kube-api-access-kmstx\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:20 crc kubenswrapper[5030]: I0316 13:36:20.912141 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e446e59a-e04d-464e-8e01-16544888b99a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.066867 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.074631 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.082708 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083565 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083582 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083607 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c25d9b6-5683-44f9-8642-21c83b9d17bc" containerName="oc" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083614 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c25d9b6-5683-44f9-8642-21c83b9d17bc" containerName="oc" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083772 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c25d9b6-5683-44f9-8642-21c83b9d17bc" containerName="oc" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.083788 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e446e59a-e04d-464e-8e01-16544888b99a" containerName="nova-cell0-conductor-conductor" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.088501 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.090227 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.090310 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-q2vxs\"" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.094867 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.116004 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb4jt\" (UniqueName: \"kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.116303 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.116384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.219032 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.219354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.219407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb4jt\" (UniqueName: \"kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.224697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.225270 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.235961 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb4jt\" (UniqueName: \"kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt\") pod \"nova-cell0-conductor-0\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.402880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:21 crc kubenswrapper[5030]: W0316 13:36:21.831990 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9d73e6f_f428_4d46_8fc0_4c9ac5cd7d68.slice/crio-1ee250b2b63021df5e4cc5fa9c781aad6768f7568903f7add91e68ed99a59aa9 WatchSource:0}: Error finding container 1ee250b2b63021df5e4cc5fa9c781aad6768f7568903f7add91e68ed99a59aa9: Status 404 returned error can't find the container with id 1ee250b2b63021df5e4cc5fa9c781aad6768f7568903f7add91e68ed99a59aa9 Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.832692 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.946593 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:36:21 crc kubenswrapper[5030]: E0316 13:36:21.947078 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:36:21 crc kubenswrapper[5030]: I0316 13:36:21.959013 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e446e59a-e04d-464e-8e01-16544888b99a" path="/var/lib/kubelet/pods/e446e59a-e04d-464e-8e01-16544888b99a/volumes" Mar 16 13:36:22 crc kubenswrapper[5030]: I0316 13:36:22.753268 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68","Type":"ContainerStarted","Data":"5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e"} Mar 16 13:36:22 crc kubenswrapper[5030]: I0316 13:36:22.753853 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:22 crc kubenswrapper[5030]: I0316 13:36:22.753914 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68","Type":"ContainerStarted","Data":"1ee250b2b63021df5e4cc5fa9c781aad6768f7568903f7add91e68ed99a59aa9"} Mar 16 13:36:22 crc kubenswrapper[5030]: I0316 13:36:22.782419 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.782394852 podStartE2EDuration="1.782394852s" podCreationTimestamp="2026-03-16 13:36:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:22.774619071 +0000 UTC m=+1827.173931619" watchObservedRunningTime="2026-03-16 13:36:22.782394852 +0000 UTC m=+1827.181707399" Mar 16 13:36:28 crc kubenswrapper[5030]: I0316 13:36:28.796714 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.278924 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.283913 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.290763 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.291350 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.298821 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.389966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.390376 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.390421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.390498 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9j9z\" (UniqueName: \"kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.390772 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.396395 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.402090 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.403667 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.464185 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.476370 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.483902 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.484941 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494046 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494084 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494144 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4rz9\" (UniqueName: \"kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494297 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9j9z\" (UniqueName: \"kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.494807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.511164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.511278 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.515977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.516418 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9j9z\" (UniqueName: \"kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z\") pod \"nova-cell0-cell-mapping-mdnwj\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.553562 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.570924 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.575421 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.577120 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.580076 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.580384 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.585083 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.586927 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.596676 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8q7\" (UniqueName: \"kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.596741 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.597099 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.597346 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.597958 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.598066 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4rz9\" (UniqueName: \"kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.598400 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.602010 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.605230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.618439 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.620240 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4rz9\" (UniqueName: \"kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9\") pod \"nova-scheduler-0\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.700880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dznd\" (UniqueName: \"kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.700924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701004 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwzb\" (UniqueName: \"kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8q7\" (UniqueName: \"kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701263 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701327 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701380 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.701779 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.702460 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.707574 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.708075 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.731992 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8q7\" (UniqueName: \"kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7\") pod \"nova-metadata-0\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.732937 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.805667 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.806099 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.806263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.808202 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dznd\" (UniqueName: \"kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.808254 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.808392 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwzb\" (UniqueName: \"kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.808479 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.808589 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.811990 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.813303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.819015 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.822102 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.831818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dznd\" (UniqueName: \"kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd\") pod \"nova-api-0\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.833786 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwzb\" (UniqueName: \"kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb\") pod \"nova-cell1-novncproxy-0\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.878057 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.900168 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:29 crc kubenswrapper[5030]: I0316 13:36:29.997249 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.073931 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj"] Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.128608 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4"] Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.134313 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.142024 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.142073 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4"] Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.142251 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.172812 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.227632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5775\" (UniqueName: \"kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.227684 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.227922 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.228103 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.310718 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:30 crc kubenswrapper[5030]: W0316 13:36:30.312188 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81fb0f21_4fa8_42e1_928e_7ff6e7b8446c.slice/crio-31b450c17694995d291720917465634051161e7e2080b3472e8c2c4e284b5714 WatchSource:0}: Error finding container 31b450c17694995d291720917465634051161e7e2080b3472e8c2c4e284b5714: Status 404 returned error can't find the container with id 31b450c17694995d291720917465634051161e7e2080b3472e8c2c4e284b5714 Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.329998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5775\" (UniqueName: \"kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.330043 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.330132 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.330219 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.334766 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.334888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.338257 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.345618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5775\" (UniqueName: \"kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775\") pod \"nova-cell1-conductor-db-sync-zmrs4\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.394193 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:30 crc kubenswrapper[5030]: W0316 13:36:30.394935 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd2bdd76_ff9e_4c44_b6fc_1e784d9dff2c.slice/crio-506abed44aff394800fd658aade5e3961197b415c429d44b42089848d4ec1eb2 WatchSource:0}: Error finding container 506abed44aff394800fd658aade5e3961197b415c429d44b42089848d4ec1eb2: Status 404 returned error can't find the container with id 506abed44aff394800fd658aade5e3961197b415c429d44b42089848d4ec1eb2 Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.456848 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.514277 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:30 crc kubenswrapper[5030]: W0316 13:36:30.536814 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5662c44c_f62a_47d8_b2fe_d2dcb561720f.slice/crio-8ab0d7725e7384a601e4ea92c83fca17ebd9ec3c69c9f674ef1e5c6e26c9ffbd WatchSource:0}: Error finding container 8ab0d7725e7384a601e4ea92c83fca17ebd9ec3c69c9f674ef1e5c6e26c9ffbd: Status 404 returned error can't find the container with id 8ab0d7725e7384a601e4ea92c83fca17ebd9ec3c69c9f674ef1e5c6e26c9ffbd Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.856373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59","Type":"ContainerStarted","Data":"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.856780 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59","Type":"ContainerStarted","Data":"20bacf2f389a60c2336c3be6a28e4f4e5588b10859aa7058cc68e7e28466ab75"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.860008 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerStarted","Data":"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.860055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerStarted","Data":"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.860066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerStarted","Data":"506abed44aff394800fd658aade5e3961197b415c429d44b42089848d4ec1eb2"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.861509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" event={"ID":"9e43fccc-dd40-45c7-b54d-3e9faf5d5039","Type":"ContainerStarted","Data":"4ecebf9d1e932efc3788ecab96dea7dc8121a27ef50ade84cf82f4c464504816"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.861563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" event={"ID":"9e43fccc-dd40-45c7-b54d-3e9faf5d5039","Type":"ContainerStarted","Data":"e13a1d3cea79434f2becd32d39d5dccca26481909b71c37ff96e1bbfadc3e82a"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.865178 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerStarted","Data":"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.865225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerStarted","Data":"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.865247 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerStarted","Data":"31b450c17694995d291720917465634051161e7e2080b3472e8c2c4e284b5714"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.875428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5662c44c-f62a-47d8-b2fe-d2dcb561720f","Type":"ContainerStarted","Data":"8ab0d7725e7384a601e4ea92c83fca17ebd9ec3c69c9f674ef1e5c6e26c9ffbd"} Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.890386 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.8903714219999999 podStartE2EDuration="1.890371422s" podCreationTimestamp="2026-03-16 13:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:30.868350216 +0000 UTC m=+1835.267662763" watchObservedRunningTime="2026-03-16 13:36:30.890371422 +0000 UTC m=+1835.289683969" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.912114 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=1.9121004080000001 podStartE2EDuration="1.912100408s" podCreationTimestamp="2026-03-16 13:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:30.886825204 +0000 UTC m=+1835.286137750" watchObservedRunningTime="2026-03-16 13:36:30.912100408 +0000 UTC m=+1835.311412955" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.933050 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" podStartSLOduration=1.9330327349999998 podStartE2EDuration="1.933032735s" podCreationTimestamp="2026-03-16 13:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:30.919141196 +0000 UTC m=+1835.318453743" watchObservedRunningTime="2026-03-16 13:36:30.933032735 +0000 UTC m=+1835.332345282" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.948869 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=1.9488594940000001 podStartE2EDuration="1.948859494s" podCreationTimestamp="2026-03-16 13:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:30.947853973 +0000 UTC m=+1835.347166520" watchObservedRunningTime="2026-03-16 13:36:30.948859494 +0000 UTC m=+1835.348172041" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.967022 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=1.96700982 podStartE2EDuration="1.96700982s" podCreationTimestamp="2026-03-16 13:36:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:30.960460436 +0000 UTC m=+1835.359772984" watchObservedRunningTime="2026-03-16 13:36:30.96700982 +0000 UTC m=+1835.366322368" Mar 16 13:36:30 crc kubenswrapper[5030]: I0316 13:36:30.979643 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4"] Mar 16 13:36:31 crc kubenswrapper[5030]: I0316 13:36:31.531065 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:31 crc kubenswrapper[5030]: I0316 13:36:31.886016 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" event={"ID":"409fc4db-a8fa-4f83-93c6-891e182eb2dd","Type":"ContainerStarted","Data":"c682fa91f1a777a42f4f7d4d6f156a4ff592b9b949d9be274627796dd060613b"} Mar 16 13:36:31 crc kubenswrapper[5030]: I0316 13:36:31.886081 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" event={"ID":"409fc4db-a8fa-4f83-93c6-891e182eb2dd","Type":"ContainerStarted","Data":"e609ddee24c11df1c676fb4fdc844571bbbbfddae18c6a3f52454a1e845a49a0"} Mar 16 13:36:31 crc kubenswrapper[5030]: I0316 13:36:31.887707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5662c44c-f62a-47d8-b2fe-d2dcb561720f","Type":"ContainerStarted","Data":"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44"} Mar 16 13:36:31 crc kubenswrapper[5030]: I0316 13:36:31.899632 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" podStartSLOduration=1.899613351 podStartE2EDuration="1.899613351s" podCreationTimestamp="2026-03-16 13:36:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:31.896721162 +0000 UTC m=+1836.296033710" watchObservedRunningTime="2026-03-16 13:36:31.899613351 +0000 UTC m=+1836.298925898" Mar 16 13:36:32 crc kubenswrapper[5030]: I0316 13:36:32.021251 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:32 crc kubenswrapper[5030]: I0316 13:36:32.042051 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:32 crc kubenswrapper[5030]: I0316 13:36:32.896624 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-log" containerID="cri-o://a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" gracePeriod=30 Mar 16 13:36:32 crc kubenswrapper[5030]: I0316 13:36:32.896674 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-metadata" containerID="cri-o://b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" gracePeriod=30 Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.456916 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.508626 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v8q7\" (UniqueName: \"kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7\") pod \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.508918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle\") pod \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.508955 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data\") pod \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.509066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs\") pod \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\" (UID: \"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c\") " Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.509375 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs" (OuterVolumeSpecName: "logs") pod "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" (UID: "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.510396 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.531940 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7" (OuterVolumeSpecName: "kube-api-access-8v8q7") pod "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" (UID: "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c"). InnerVolumeSpecName "kube-api-access-8v8q7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.536348 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data" (OuterVolumeSpecName: "config-data") pod "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" (UID: "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.546886 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" (UID: "81fb0f21-4fa8-42e1-928e-7ff6e7b8446c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.612488 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v8q7\" (UniqueName: \"kubernetes.io/projected/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-kube-api-access-8v8q7\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.612514 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.612525 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906570 5030 generic.go:358] "Generic (PLEG): container finished" podID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerID="b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" exitCode=0 Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906856 5030 generic.go:358] "Generic (PLEG): container finished" podID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerID="a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" exitCode=143 Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerDied","Data":"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b"} Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerDied","Data":"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74"} Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"81fb0f21-4fa8-42e1-928e-7ff6e7b8446c","Type":"ContainerDied","Data":"31b450c17694995d291720917465634051161e7e2080b3472e8c2c4e284b5714"} Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906981 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.906983 5030 scope.go:117] "RemoveContainer" containerID="b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.912434 5030 generic.go:358] "Generic (PLEG): container finished" podID="409fc4db-a8fa-4f83-93c6-891e182eb2dd" containerID="c682fa91f1a777a42f4f7d4d6f156a4ff592b9b949d9be274627796dd060613b" exitCode=0 Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.912504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" event={"ID":"409fc4db-a8fa-4f83-93c6-891e182eb2dd","Type":"ContainerDied","Data":"c682fa91f1a777a42f4f7d4d6f156a4ff592b9b949d9be274627796dd060613b"} Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.912755 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44" gracePeriod=30 Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.933488 5030 scope.go:117] "RemoveContainer" containerID="a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.956205 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.958695 5030 scope.go:117] "RemoveContainer" containerID="b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" Mar 16 13:36:33 crc kubenswrapper[5030]: E0316 13:36:33.961415 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b\": container with ID starting with b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b not found: ID does not exist" containerID="b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.961445 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b"} err="failed to get container status \"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b\": rpc error: code = NotFound desc = could not find container \"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b\": container with ID starting with b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b not found: ID does not exist" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.961468 5030 scope.go:117] "RemoveContainer" containerID="a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" Mar 16 13:36:33 crc kubenswrapper[5030]: E0316 13:36:33.961805 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74\": container with ID starting with a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74 not found: ID does not exist" containerID="a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.961848 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74"} err="failed to get container status \"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74\": rpc error: code = NotFound desc = could not find container \"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74\": container with ID starting with a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74 not found: ID does not exist" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.961875 5030 scope.go:117] "RemoveContainer" containerID="b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.962422 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b"} err="failed to get container status \"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b\": rpc error: code = NotFound desc = could not find container \"b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b\": container with ID starting with b985f29879934750e274adaa4201b10f2ebce0ea9d84078d6c820da306dcd49b not found: ID does not exist" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.962460 5030 scope.go:117] "RemoveContainer" containerID="a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.962874 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74"} err="failed to get container status \"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74\": rpc error: code = NotFound desc = could not find container \"a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74\": container with ID starting with a9d32d9528c82dd7bfa690cfae91a6973b245baa358ae5a54545864e67ff7d74 not found: ID does not exist" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.971699 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.981590 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982620 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-metadata" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982638 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-metadata" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982661 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-log" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982668 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-log" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982858 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-log" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.982879 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" containerName="nova-metadata-metadata" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.990103 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.990213 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.992812 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:36:33 crc kubenswrapper[5030]: I0316 13:36:33.995953 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.033065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.033202 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.033441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.034756 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwj2t\" (UniqueName: \"kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.034932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.136994 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.137097 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwj2t\" (UniqueName: \"kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.137133 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.137186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.137372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.137652 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.142524 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.144935 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.145167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.152304 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwj2t\" (UniqueName: \"kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t\") pod \"nova-metadata-0\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.346031 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.435238 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.552290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qwzb\" (UniqueName: \"kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb\") pod \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.552494 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data\") pod \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.552788 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle\") pod \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\" (UID: \"5662c44c-f62a-47d8-b2fe-d2dcb561720f\") " Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.557966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb" (OuterVolumeSpecName: "kube-api-access-6qwzb") pod "5662c44c-f62a-47d8-b2fe-d2dcb561720f" (UID: "5662c44c-f62a-47d8-b2fe-d2dcb561720f"). InnerVolumeSpecName "kube-api-access-6qwzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.576392 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5662c44c-f62a-47d8-b2fe-d2dcb561720f" (UID: "5662c44c-f62a-47d8-b2fe-d2dcb561720f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.577016 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data" (OuterVolumeSpecName: "config-data") pod "5662c44c-f62a-47d8-b2fe-d2dcb561720f" (UID: "5662c44c-f62a-47d8-b2fe-d2dcb561720f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.656220 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qwzb\" (UniqueName: \"kubernetes.io/projected/5662c44c-f62a-47d8-b2fe-d2dcb561720f-kube-api-access-6qwzb\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.656249 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.656259 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5662c44c-f62a-47d8-b2fe-d2dcb561720f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.733341 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.767480 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:34 crc kubenswrapper[5030]: W0316 13:36:34.771125 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8258531b_5c31_4ec7_8cd3_e741e572920e.slice/crio-7e194aa2006aa7d2beb6686569245ac45dc2b67ebfc0f563a54d9604b41813a8 WatchSource:0}: Error finding container 7e194aa2006aa7d2beb6686569245ac45dc2b67ebfc0f563a54d9604b41813a8: Status 404 returned error can't find the container with id 7e194aa2006aa7d2beb6686569245ac45dc2b67ebfc0f563a54d9604b41813a8 Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.921866 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerStarted","Data":"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7"} Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.922096 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerStarted","Data":"7e194aa2006aa7d2beb6686569245ac45dc2b67ebfc0f563a54d9604b41813a8"} Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.923999 5030 generic.go:358] "Generic (PLEG): container finished" podID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" containerID="f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44" exitCode=0 Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.924073 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.924112 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5662c44c-f62a-47d8-b2fe-d2dcb561720f","Type":"ContainerDied","Data":"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44"} Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.924140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"5662c44c-f62a-47d8-b2fe-d2dcb561720f","Type":"ContainerDied","Data":"8ab0d7725e7384a601e4ea92c83fca17ebd9ec3c69c9f674ef1e5c6e26c9ffbd"} Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.924167 5030 scope.go:117] "RemoveContainer" containerID="f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.926784 5030 generic.go:358] "Generic (PLEG): container finished" podID="9e43fccc-dd40-45c7-b54d-3e9faf5d5039" containerID="4ecebf9d1e932efc3788ecab96dea7dc8121a27ef50ade84cf82f4c464504816" exitCode=0 Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.926818 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" event={"ID":"9e43fccc-dd40-45c7-b54d-3e9faf5d5039","Type":"ContainerDied","Data":"4ecebf9d1e932efc3788ecab96dea7dc8121a27ef50ade84cf82f4c464504816"} Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.968477 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.973622 5030 scope.go:117] "RemoveContainer" containerID="f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44" Mar 16 13:36:34 crc kubenswrapper[5030]: E0316 13:36:34.974064 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44\": container with ID starting with f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44 not found: ID does not exist" containerID="f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.974135 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44"} err="failed to get container status \"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44\": rpc error: code = NotFound desc = could not find container \"f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44\": container with ID starting with f67448d5ab656ae1ca70fd6ffcc187f0987f94903c40431a006c440583ea1c44 not found: ID does not exist" Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.985065 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:34 crc kubenswrapper[5030]: I0316 13:36:34.999594 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.000821 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.000844 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.001110 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.004385 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.004485 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.010267 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.010425 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.011678 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.067670 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.067977 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgrw\" (UniqueName: \"kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.068174 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.068443 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.068687 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.165683 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.166117 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="edb25875-7f99-4dad-b544-226a0bb6c20e" containerName="kube-state-metrics" containerID="cri-o://fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b" gracePeriod=30 Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.170485 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgrw\" (UniqueName: \"kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.170568 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.170652 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.170712 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.170743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.176001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.176101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.176501 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.177152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.195396 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgrw\" (UniqueName: \"kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw\") pod \"nova-cell1-novncproxy-0\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.354418 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.426439 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.476838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5775\" (UniqueName: \"kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775\") pod \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.477098 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle\") pod \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.477224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts\") pod \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.477827 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data\") pod \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\" (UID: \"409fc4db-a8fa-4f83-93c6-891e182eb2dd\") " Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.482565 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775" (OuterVolumeSpecName: "kube-api-access-g5775") pod "409fc4db-a8fa-4f83-93c6-891e182eb2dd" (UID: "409fc4db-a8fa-4f83-93c6-891e182eb2dd"). InnerVolumeSpecName "kube-api-access-g5775". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.483196 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts" (OuterVolumeSpecName: "scripts") pod "409fc4db-a8fa-4f83-93c6-891e182eb2dd" (UID: "409fc4db-a8fa-4f83-93c6-891e182eb2dd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.522654 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "409fc4db-a8fa-4f83-93c6-891e182eb2dd" (UID: "409fc4db-a8fa-4f83-93c6-891e182eb2dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.523777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data" (OuterVolumeSpecName: "config-data") pod "409fc4db-a8fa-4f83-93c6-891e182eb2dd" (UID: "409fc4db-a8fa-4f83-93c6-891e182eb2dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.589129 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.589167 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.589178 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5775\" (UniqueName: \"kubernetes.io/projected/409fc4db-a8fa-4f83-93c6-891e182eb2dd-kube-api-access-g5775\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.589189 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/409fc4db-a8fa-4f83-93c6-891e182eb2dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.624042 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.690394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98glk\" (UniqueName: \"kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk\") pod \"edb25875-7f99-4dad-b544-226a0bb6c20e\" (UID: \"edb25875-7f99-4dad-b544-226a0bb6c20e\") " Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.694731 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk" (OuterVolumeSpecName: "kube-api-access-98glk") pod "edb25875-7f99-4dad-b544-226a0bb6c20e" (UID: "edb25875-7f99-4dad-b544-226a0bb6c20e"). InnerVolumeSpecName "kube-api-access-98glk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.792579 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98glk\" (UniqueName: \"kubernetes.io/projected/edb25875-7f99-4dad-b544-226a0bb6c20e-kube-api-access-98glk\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.940569 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerStarted","Data":"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893"} Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.946797 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:36:35 crc kubenswrapper[5030]: E0316 13:36:35.947353 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.949861 5030 generic.go:358] "Generic (PLEG): container finished" podID="edb25875-7f99-4dad-b544-226a0bb6c20e" containerID="fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b" exitCode=2 Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.951609 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.957542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.964098 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5662c44c-f62a-47d8-b2fe-d2dcb561720f" path="/var/lib/kubelet/pods/5662c44c-f62a-47d8-b2fe-d2dcb561720f/volumes" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.967694 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81fb0f21-4fa8-42e1-928e-7ff6e7b8446c" path="/var/lib/kubelet/pods/81fb0f21-4fa8-42e1-928e-7ff6e7b8446c/volumes" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.968922 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"edb25875-7f99-4dad-b544-226a0bb6c20e","Type":"ContainerDied","Data":"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b"} Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.968958 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"edb25875-7f99-4dad-b544-226a0bb6c20e","Type":"ContainerDied","Data":"a9484d333bc5380c68003d91d10ccecf217f4ef971db50c2da165b9c7a2a6519"} Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.968973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4" event={"ID":"409fc4db-a8fa-4f83-93c6-891e182eb2dd","Type":"ContainerDied","Data":"e609ddee24c11df1c676fb4fdc844571bbbbfddae18c6a3f52454a1e845a49a0"} Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.968985 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e609ddee24c11df1c676fb4fdc844571bbbbfddae18c6a3f52454a1e845a49a0" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.972741 5030 scope.go:117] "RemoveContainer" containerID="fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b" Mar 16 13:36:35 crc kubenswrapper[5030]: I0316 13:36:35.981804 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.9817898510000003 podStartE2EDuration="2.981789851s" podCreationTimestamp="2026-03-16 13:36:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:35.966024508 +0000 UTC m=+1840.365337056" watchObservedRunningTime="2026-03-16 13:36:35.981789851 +0000 UTC m=+1840.381102398" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.017939 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.023083 5030 scope.go:117] "RemoveContainer" containerID="fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b" Mar 16 13:36:36 crc kubenswrapper[5030]: E0316 13:36:36.040286 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b\": container with ID starting with fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b not found: ID does not exist" containerID="fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.040330 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b"} err="failed to get container status \"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b\": rpc error: code = NotFound desc = could not find container \"fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b\": container with ID starting with fe01650d3edc60217b9cb2cc48da2a4936da2b57eed9274bb1dce9a3b72a7b1b not found: ID does not exist" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.040368 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041395 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409fc4db-a8fa-4f83-93c6-891e182eb2dd" containerName="nova-cell1-conductor-db-sync" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041413 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="409fc4db-a8fa-4f83-93c6-891e182eb2dd" containerName="nova-cell1-conductor-db-sync" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041480 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb25875-7f99-4dad-b544-226a0bb6c20e" containerName="kube-state-metrics" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041486 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb25875-7f99-4dad-b544-226a0bb6c20e" containerName="kube-state-metrics" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041721 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="409fc4db-a8fa-4f83-93c6-891e182eb2dd" containerName="nova-cell1-conductor-db-sync" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.041743 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="edb25875-7f99-4dad-b544-226a0bb6c20e" containerName="kube-state-metrics" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.049824 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.052487 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.052728 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.088183 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.103485 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.111936 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.116909 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.118584 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.118674 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.122811 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.203586 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxjdd\" (UniqueName: \"kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.203909 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfk6v\" (UniqueName: \"kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.204003 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.204054 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.204090 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.204173 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.204226 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.289620 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306260 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306492 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjdd\" (UniqueName: \"kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.306642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfk6v\" (UniqueName: \"kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.312040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.314928 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.314969 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.315032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.315526 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.323886 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjdd\" (UniqueName: \"kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd\") pod \"kube-state-metrics-0\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.329961 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfk6v\" (UniqueName: \"kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v\") pod \"nova-cell1-conductor-0\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.408134 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data\") pod \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.408192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle\") pod \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.408290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9j9z\" (UniqueName: \"kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z\") pod \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.408339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts\") pod \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\" (UID: \"9e43fccc-dd40-45c7-b54d-3e9faf5d5039\") " Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.411532 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z" (OuterVolumeSpecName: "kube-api-access-l9j9z") pod "9e43fccc-dd40-45c7-b54d-3e9faf5d5039" (UID: "9e43fccc-dd40-45c7-b54d-3e9faf5d5039"). InnerVolumeSpecName "kube-api-access-l9j9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.412097 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts" (OuterVolumeSpecName: "scripts") pod "9e43fccc-dd40-45c7-b54d-3e9faf5d5039" (UID: "9e43fccc-dd40-45c7-b54d-3e9faf5d5039"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.429046 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9e43fccc-dd40-45c7-b54d-3e9faf5d5039" (UID: "9e43fccc-dd40-45c7-b54d-3e9faf5d5039"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.432502 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data" (OuterVolumeSpecName: "config-data") pod "9e43fccc-dd40-45c7-b54d-3e9faf5d5039" (UID: "9e43fccc-dd40-45c7-b54d-3e9faf5d5039"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.491495 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.512713 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.512737 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.512748 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9j9z\" (UniqueName: \"kubernetes.io/projected/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-kube-api-access-l9j9z\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.512759 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9e43fccc-dd40-45c7-b54d-3e9faf5d5039-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.528129 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:36 crc kubenswrapper[5030]: W0316 13:36:36.904620 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25f0f5cd_e5d8_420c_a704_93d13a892da7.slice/crio-2fcd54ee6e5edf475e809291b2629b664067e3d7740ffd21479103f4b8a94e72 WatchSource:0}: Error finding container 2fcd54ee6e5edf475e809291b2629b664067e3d7740ffd21479103f4b8a94e72: Status 404 returned error can't find the container with id 2fcd54ee6e5edf475e809291b2629b664067e3d7740ffd21479103f4b8a94e72 Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.909997 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.933521 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.934101 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-central-agent" containerID="cri-o://a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8" gracePeriod=30 Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.934290 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="proxy-httpd" containerID="cri-o://801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507" gracePeriod=30 Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.934360 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="sg-core" containerID="cri-o://8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c" gracePeriod=30 Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.934401 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-notification-agent" containerID="cri-o://1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9" gracePeriod=30 Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.983950 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"25f0f5cd-e5d8-420c-a704-93d13a892da7","Type":"ContainerStarted","Data":"2fcd54ee6e5edf475e809291b2629b664067e3d7740ffd21479103f4b8a94e72"} Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.986065 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.986088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj" event={"ID":"9e43fccc-dd40-45c7-b54d-3e9faf5d5039","Type":"ContainerDied","Data":"e13a1d3cea79434f2becd32d39d5dccca26481909b71c37ff96e1bbfadc3e82a"} Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.986129 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e13a1d3cea79434f2becd32d39d5dccca26481909b71c37ff96e1bbfadc3e82a" Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.989394 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c165722a-e0a3-424b-a423-244347ee7322","Type":"ContainerStarted","Data":"1920b17ad1a7373929b4308b91df49b814dd898f9dc001dcea03364297c5cbca"} Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.989422 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c165722a-e0a3-424b-a423-244347ee7322","Type":"ContainerStarted","Data":"9d93b9f2bc8542d646d3c8d9c795ee74deff595835188194ea442601e5a7a6f9"} Mar 16 13:36:36 crc kubenswrapper[5030]: I0316 13:36:36.991782 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:36:36 crc kubenswrapper[5030]: W0316 13:36:36.995201 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod158d5a38_dbc6_4c91_bcf3_873685dc8920.slice/crio-aa36047212f0d6e9256bb2adc246733172efb66d3f71c958737540ab795bb7b9 WatchSource:0}: Error finding container aa36047212f0d6e9256bb2adc246733172efb66d3f71c958737540ab795bb7b9: Status 404 returned error can't find the container with id aa36047212f0d6e9256bb2adc246733172efb66d3f71c958737540ab795bb7b9 Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.013407 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=3.013393696 podStartE2EDuration="3.013393696s" podCreationTimestamp="2026-03-16 13:36:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:37.003217603 +0000 UTC m=+1841.402530150" watchObservedRunningTime="2026-03-16 13:36:37.013393696 +0000 UTC m=+1841.412706243" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.062323 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.062588 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-log" containerID="cri-o://eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" gracePeriod=30 Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.062954 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-api" containerID="cri-o://c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" gracePeriod=30 Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.080022 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.080256 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" containerName="nova-scheduler-scheduler" containerID="cri-o://cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e" gracePeriod=30 Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.094132 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.498689 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.644786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dznd\" (UniqueName: \"kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd\") pod \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.645089 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs\") pod \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.645192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle\") pod \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.645336 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data\") pod \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\" (UID: \"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c\") " Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.646365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs" (OuterVolumeSpecName: "logs") pod "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" (UID: "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.650110 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd" (OuterVolumeSpecName: "kube-api-access-2dznd") pod "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" (UID: "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c"). InnerVolumeSpecName "kube-api-access-2dznd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.669559 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" (UID: "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.670928 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data" (OuterVolumeSpecName: "config-data") pod "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" (UID: "bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.747110 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.747403 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.747413 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dznd\" (UniqueName: \"kubernetes.io/projected/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-kube-api-access-2dznd\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.747427 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:37 crc kubenswrapper[5030]: I0316 13:36:37.957245 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb25875-7f99-4dad-b544-226a0bb6c20e" path="/var/lib/kubelet/pods/edb25875-7f99-4dad-b544-226a0bb6c20e/volumes" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.003796 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"158d5a38-dbc6-4c91-bcf3-873685dc8920","Type":"ContainerStarted","Data":"85b4b128330a2a72c05b8b9abf6b120ae54b117d646d5a83bde0568fdb84751e"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.003851 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"158d5a38-dbc6-4c91-bcf3-873685dc8920","Type":"ContainerStarted","Data":"aa36047212f0d6e9256bb2adc246733172efb66d3f71c958737540ab795bb7b9"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.005340 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008420 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerID="801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507" exitCode=0 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008442 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerID="8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c" exitCode=2 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008450 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerID="a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8" exitCode=0 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerDied","Data":"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerDied","Data":"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.008567 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerDied","Data":"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020593 5030 generic.go:358] "Generic (PLEG): container finished" podID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerID="c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" exitCode=0 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020619 5030 generic.go:358] "Generic (PLEG): container finished" podID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerID="eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" exitCode=143 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerDied","Data":"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerDied","Data":"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c","Type":"ContainerDied","Data":"506abed44aff394800fd658aade5e3961197b415c429d44b42089848d4ec1eb2"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020776 5030 scope.go:117] "RemoveContainer" containerID="c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.020918 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.025100 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"25f0f5cd-e5d8-420c-a704-93d13a892da7","Type":"ContainerStarted","Data":"96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b"} Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.025151 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.025322 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-log" containerID="cri-o://8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" gracePeriod=30 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.025754 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-metadata" containerID="cri-o://ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" gracePeriod=30 Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.045962 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.668092749 podStartE2EDuration="2.045944893s" podCreationTimestamp="2026-03-16 13:36:36 +0000 UTC" firstStartedPulling="2026-03-16 13:36:36.996693095 +0000 UTC m=+1841.396005642" lastFinishedPulling="2026-03-16 13:36:37.374545238 +0000 UTC m=+1841.773857786" observedRunningTime="2026-03-16 13:36:38.037990928 +0000 UTC m=+1842.437303474" watchObservedRunningTime="2026-03-16 13:36:38.045944893 +0000 UTC m=+1842.445257460" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.061201 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=3.061189987 podStartE2EDuration="3.061189987s" podCreationTimestamp="2026-03-16 13:36:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:38.051407975 +0000 UTC m=+1842.450720522" watchObservedRunningTime="2026-03-16 13:36:38.061189987 +0000 UTC m=+1842.460502534" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.076928 5030 scope.go:117] "RemoveContainer" containerID="eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.084953 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.103175 5030 scope.go:117] "RemoveContainer" containerID="c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" Mar 16 13:36:38 crc kubenswrapper[5030]: E0316 13:36:38.103509 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa\": container with ID starting with c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa not found: ID does not exist" containerID="c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.103571 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa"} err="failed to get container status \"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa\": rpc error: code = NotFound desc = could not find container \"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa\": container with ID starting with c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa not found: ID does not exist" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.103597 5030 scope.go:117] "RemoveContainer" containerID="eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" Mar 16 13:36:38 crc kubenswrapper[5030]: E0316 13:36:38.103894 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f\": container with ID starting with eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f not found: ID does not exist" containerID="eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.103968 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f"} err="failed to get container status \"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f\": rpc error: code = NotFound desc = could not find container \"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f\": container with ID starting with eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f not found: ID does not exist" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.104006 5030 scope.go:117] "RemoveContainer" containerID="c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.104308 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa"} err="failed to get container status \"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa\": rpc error: code = NotFound desc = could not find container \"c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa\": container with ID starting with c5abc260c9e3268e755774769338456490a2b82ef687c35da9b2f1237753a5fa not found: ID does not exist" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.104331 5030 scope.go:117] "RemoveContainer" containerID="eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.104530 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f"} err="failed to get container status \"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f\": rpc error: code = NotFound desc = could not find container \"eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f\": container with ID starting with eaaebab09e7885c0b284c935deb0a25f45b70be0d0ac7d4c292c6364b3dd965f not found: ID does not exist" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.132909 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.149540 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150752 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-log" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150778 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-log" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150796 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e43fccc-dd40-45c7-b54d-3e9faf5d5039" containerName="nova-manage" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150801 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e43fccc-dd40-45c7-b54d-3e9faf5d5039" containerName="nova-manage" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150832 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-api" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.150837 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-api" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.151079 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-api" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.151104 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" containerName="nova-api-log" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.151114 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e43fccc-dd40-45c7-b54d-3e9faf5d5039" containerName="nova-manage" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.154648 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.157705 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.161012 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.261226 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.261424 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.262089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.262286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjvmv\" (UniqueName: \"kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.366926 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.367014 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.367129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.367186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjvmv\" (UniqueName: \"kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.369144 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.373589 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.375181 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.401824 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjvmv\" (UniqueName: \"kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv\") pod \"nova-api-0\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.512014 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.582336 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.674382 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle\") pod \"8258531b-5c31-4ec7-8cd3-e741e572920e\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.674606 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwj2t\" (UniqueName: \"kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t\") pod \"8258531b-5c31-4ec7-8cd3-e741e572920e\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.674880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data\") pod \"8258531b-5c31-4ec7-8cd3-e741e572920e\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.674948 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs\") pod \"8258531b-5c31-4ec7-8cd3-e741e572920e\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.674997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs\") pod \"8258531b-5c31-4ec7-8cd3-e741e572920e\" (UID: \"8258531b-5c31-4ec7-8cd3-e741e572920e\") " Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.676959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs" (OuterVolumeSpecName: "logs") pod "8258531b-5c31-4ec7-8cd3-e741e572920e" (UID: "8258531b-5c31-4ec7-8cd3-e741e572920e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.678723 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t" (OuterVolumeSpecName: "kube-api-access-zwj2t") pod "8258531b-5c31-4ec7-8cd3-e741e572920e" (UID: "8258531b-5c31-4ec7-8cd3-e741e572920e"). InnerVolumeSpecName "kube-api-access-zwj2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.698205 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8258531b-5c31-4ec7-8cd3-e741e572920e" (UID: "8258531b-5c31-4ec7-8cd3-e741e572920e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.699278 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data" (OuterVolumeSpecName: "config-data") pod "8258531b-5c31-4ec7-8cd3-e741e572920e" (UID: "8258531b-5c31-4ec7-8cd3-e741e572920e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.718521 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "8258531b-5c31-4ec7-8cd3-e741e572920e" (UID: "8258531b-5c31-4ec7-8cd3-e741e572920e"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.777946 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwj2t\" (UniqueName: \"kubernetes.io/projected/8258531b-5c31-4ec7-8cd3-e741e572920e-kube-api-access-zwj2t\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.778011 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.778024 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.778033 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8258531b-5c31-4ec7-8cd3-e741e572920e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.778043 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8258531b-5c31-4ec7-8cd3-e741e572920e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:38 crc kubenswrapper[5030]: I0316 13:36:38.994817 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:38 crc kubenswrapper[5030]: W0316 13:36:38.996040 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646 WatchSource:0}: Error finding container 230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646: Status 404 returned error can't find the container with id 230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646 Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036634 5030 generic.go:358] "Generic (PLEG): container finished" podID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerID="ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" exitCode=0 Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036671 5030 generic.go:358] "Generic (PLEG): container finished" podID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerID="8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" exitCode=143 Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036729 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036715 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerDied","Data":"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893"} Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036848 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerDied","Data":"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7"} Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036863 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"8258531b-5c31-4ec7-8cd3-e741e572920e","Type":"ContainerDied","Data":"7e194aa2006aa7d2beb6686569245ac45dc2b67ebfc0f563a54d9604b41813a8"} Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.036887 5030 scope.go:117] "RemoveContainer" containerID="ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.038410 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerStarted","Data":"230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646"} Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.098573 5030 scope.go:117] "RemoveContainer" containerID="8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.129839 5030 scope.go:117] "RemoveContainer" containerID="ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" Mar 16 13:36:39 crc kubenswrapper[5030]: E0316 13:36:39.130148 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893\": container with ID starting with ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893 not found: ID does not exist" containerID="ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.130197 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893"} err="failed to get container status \"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893\": rpc error: code = NotFound desc = could not find container \"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893\": container with ID starting with ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893 not found: ID does not exist" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.130220 5030 scope.go:117] "RemoveContainer" containerID="8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" Mar 16 13:36:39 crc kubenswrapper[5030]: E0316 13:36:39.130456 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7\": container with ID starting with 8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7 not found: ID does not exist" containerID="8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.130493 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7"} err="failed to get container status \"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7\": rpc error: code = NotFound desc = could not find container \"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7\": container with ID starting with 8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7 not found: ID does not exist" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.130515 5030 scope.go:117] "RemoveContainer" containerID="ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.132330 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893"} err="failed to get container status \"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893\": rpc error: code = NotFound desc = could not find container \"ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893\": container with ID starting with ea0219a18b6dea3dfc0765a7c7a69fda57148745d58ed86f0eee4e0471e62893 not found: ID does not exist" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.132379 5030 scope.go:117] "RemoveContainer" containerID="8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.132721 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7"} err="failed to get container status \"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7\": rpc error: code = NotFound desc = could not find container \"8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7\": container with ID starting with 8bd7b15ef4a248f7c562a6407c462f484d5201e600d663213eb9d2cf50a184b7 not found: ID does not exist" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.139500 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.149340 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.162174 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163392 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-metadata" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163407 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-metadata" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163443 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-log" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163449 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-log" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163662 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-metadata" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.163681 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" containerName="nova-metadata-log" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.168685 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.168868 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.172691 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.172936 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.293808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h2nk\" (UniqueName: \"kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.294126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.294173 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.294212 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.294273 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.396529 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7h2nk\" (UniqueName: \"kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.396599 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.396632 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.397778 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.397879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.404985 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.408321 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.409247 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.427089 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.431412 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h2nk\" (UniqueName: \"kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk\") pod \"nova-metadata-0\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.503037 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.543508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610663 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610766 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610792 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610867 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610900 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fkvm\" (UniqueName: \"kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.610976 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.611143 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd\") pod \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\" (UID: \"3c09efeb-cfba-4752-9cad-5c20cc513cd7\") " Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.612145 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.618130 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm" (OuterVolumeSpecName: "kube-api-access-5fkvm") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "kube-api-access-5fkvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.622230 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.631729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts" (OuterVolumeSpecName: "scripts") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.644188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.689842 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.694955 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data" (OuterVolumeSpecName: "config-data") pod "3c09efeb-cfba-4752-9cad-5c20cc513cd7" (UID: "3c09efeb-cfba-4752-9cad-5c20cc513cd7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714393 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714420 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714432 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714445 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714455 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3c09efeb-cfba-4752-9cad-5c20cc513cd7-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714464 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c09efeb-cfba-4752-9cad-5c20cc513cd7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.714474 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fkvm\" (UniqueName: \"kubernetes.io/projected/3c09efeb-cfba-4752-9cad-5c20cc513cd7-kube-api-access-5fkvm\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.930223 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:39 crc kubenswrapper[5030]: W0316 13:36:39.935235 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec08c40a_8fe1_477d_bc54_243803bb2977.slice/crio-7dc9eebf171fb149ffd3bc3a8273a01817218b73376970efbb46873e35136bab WatchSource:0}: Error finding container 7dc9eebf171fb149ffd3bc3a8273a01817218b73376970efbb46873e35136bab: Status 404 returned error can't find the container with id 7dc9eebf171fb149ffd3bc3a8273a01817218b73376970efbb46873e35136bab Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.956584 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8258531b-5c31-4ec7-8cd3-e741e572920e" path="/var/lib/kubelet/pods/8258531b-5c31-4ec7-8cd3-e741e572920e/volumes" Mar 16 13:36:39 crc kubenswrapper[5030]: I0316 13:36:39.957173 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c" path="/var/lib/kubelet/pods/bd2bdd76-ff9e-4c44-b6fc-1e784d9dff2c/volumes" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.060145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerStarted","Data":"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e"} Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.060225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerStarted","Data":"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa"} Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.064591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerStarted","Data":"7dc9eebf171fb149ffd3bc3a8273a01817218b73376970efbb46873e35136bab"} Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.067797 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerID="1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9" exitCode=0 Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.067836 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerDied","Data":"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9"} Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.067889 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.067913 5030 scope.go:117] "RemoveContainer" containerID="801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.067892 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3c09efeb-cfba-4752-9cad-5c20cc513cd7","Type":"ContainerDied","Data":"70948f6d22bf5a0a098dc3792414018d843f63c8dfbf9eed1a27e953251b2baf"} Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.086058 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.086040857 podStartE2EDuration="2.086040857s" podCreationTimestamp="2026-03-16 13:36:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:40.079704904 +0000 UTC m=+1844.479017471" watchObservedRunningTime="2026-03-16 13:36:40.086040857 +0000 UTC m=+1844.485353394" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.096581 5030 scope.go:117] "RemoveContainer" containerID="8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.115276 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.155606 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.158595 5030 scope.go:117] "RemoveContainer" containerID="1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.173624 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174755 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="proxy-httpd" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174775 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="proxy-httpd" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174791 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-notification-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174800 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-notification-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174843 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="sg-core" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174848 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="sg-core" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174880 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-central-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.174886 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-central-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.175048 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="proxy-httpd" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.175065 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-central-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.175074 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="ceilometer-notification-agent" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.175084 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" containerName="sg-core" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.180065 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.180716 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.182083 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.183038 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.183361 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.186616 5030 scope.go:117] "RemoveContainer" containerID="a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.240984 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241029 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241068 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspm5\" (UniqueName: \"kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241250 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.241268 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.287244 5030 scope.go:117] "RemoveContainer" containerID="801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507" Mar 16 13:36:40 crc kubenswrapper[5030]: E0316 13:36:40.288266 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507\": container with ID starting with 801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507 not found: ID does not exist" containerID="801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.288307 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507"} err="failed to get container status \"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507\": rpc error: code = NotFound desc = could not find container \"801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507\": container with ID starting with 801e9bac9ff22d59e102eb2a5c8c11814c45f0ab7355f97e6c09197992e56507 not found: ID does not exist" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.288339 5030 scope.go:117] "RemoveContainer" containerID="8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c" Mar 16 13:36:40 crc kubenswrapper[5030]: E0316 13:36:40.288697 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c\": container with ID starting with 8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c not found: ID does not exist" containerID="8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.288730 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c"} err="failed to get container status \"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c\": rpc error: code = NotFound desc = could not find container \"8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c\": container with ID starting with 8b95d6d52d4916da9578c41ceb79ff2a6ccc8c3a45020fb5577462b8524c7b5c not found: ID does not exist" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.288752 5030 scope.go:117] "RemoveContainer" containerID="1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9" Mar 16 13:36:40 crc kubenswrapper[5030]: E0316 13:36:40.288977 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9\": container with ID starting with 1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9 not found: ID does not exist" containerID="1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.289000 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9"} err="failed to get container status \"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9\": rpc error: code = NotFound desc = could not find container \"1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9\": container with ID starting with 1963e8a345d2c0df40339b983e6b94686eee751d9f2c9617a7c1add751a15ea9 not found: ID does not exist" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.289012 5030 scope.go:117] "RemoveContainer" containerID="a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8" Mar 16 13:36:40 crc kubenswrapper[5030]: E0316 13:36:40.289181 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8\": container with ID starting with a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8 not found: ID does not exist" containerID="a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.289201 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8"} err="failed to get container status \"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8\": rpc error: code = NotFound desc = could not find container \"a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8\": container with ID starting with a380e7c45b4a5c18aca67331a84d1856a2e1bb2c622e6831dad699bdf80c09f8 not found: ID does not exist" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.343648 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kspm5\" (UniqueName: \"kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.343813 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.344652 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.344970 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.344999 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.345063 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.345097 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.345448 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.345816 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.345985 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.350058 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.350200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.350361 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.350605 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.351232 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.359929 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspm5\" (UniqueName: \"kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5\") pod \"ceilometer-0\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.427309 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:40 crc kubenswrapper[5030]: I0316 13:36:40.611971 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.022638 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:36:41 crc kubenswrapper[5030]: W0316 13:36:41.032522 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod761d98cf_0c92_45a3_9a54_414194580194.slice/crio-c382ffdabd307ee1dabf24698b9ec14e37955c97515c60a93d7db2dabe94eb6f WatchSource:0}: Error finding container c382ffdabd307ee1dabf24698b9ec14e37955c97515c60a93d7db2dabe94eb6f: Status 404 returned error can't find the container with id c382ffdabd307ee1dabf24698b9ec14e37955c97515c60a93d7db2dabe94eb6f Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.089986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerStarted","Data":"c382ffdabd307ee1dabf24698b9ec14e37955c97515c60a93d7db2dabe94eb6f"} Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.092680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerStarted","Data":"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab"} Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.092738 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerStarted","Data":"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91"} Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.118746 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.118724213 podStartE2EDuration="2.118724213s" podCreationTimestamp="2026-03-16 13:36:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:41.112437781 +0000 UTC m=+1845.511750319" watchObservedRunningTime="2026-03-16 13:36:41.118724213 +0000 UTC m=+1845.518036759" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.511502 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.595418 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle\") pod \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.595675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data\") pod \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.595980 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4rz9\" (UniqueName: \"kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9\") pod \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\" (UID: \"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59\") " Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.602744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9" (OuterVolumeSpecName: "kube-api-access-m4rz9") pod "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" (UID: "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59"). InnerVolumeSpecName "kube-api-access-m4rz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.621940 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data" (OuterVolumeSpecName: "config-data") pod "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" (UID: "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.623247 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" (UID: "d0c0abca-fa2a-4fbd-ad9a-231ef2804d59"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.701076 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4rz9\" (UniqueName: \"kubernetes.io/projected/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-kube-api-access-m4rz9\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.701207 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.701222 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:41 crc kubenswrapper[5030]: I0316 13:36:41.958879 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c09efeb-cfba-4752-9cad-5c20cc513cd7" path="/var/lib/kubelet/pods/3c09efeb-cfba-4752-9cad-5c20cc513cd7/volumes" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.105781 5030 generic.go:358] "Generic (PLEG): container finished" podID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" containerID="cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e" exitCode=0 Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.105850 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59","Type":"ContainerDied","Data":"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e"} Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.105900 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.105920 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"d0c0abca-fa2a-4fbd-ad9a-231ef2804d59","Type":"ContainerDied","Data":"20bacf2f389a60c2336c3be6a28e4f4e5588b10859aa7058cc68e7e28466ab75"} Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.105954 5030 scope.go:117] "RemoveContainer" containerID="cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.115072 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerStarted","Data":"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1"} Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.142686 5030 scope.go:117] "RemoveContainer" containerID="cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.144728 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:42 crc kubenswrapper[5030]: E0316 13:36:42.146101 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e\": container with ID starting with cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e not found: ID does not exist" containerID="cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.146142 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e"} err="failed to get container status \"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e\": rpc error: code = NotFound desc = could not find container \"cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e\": container with ID starting with cb76e461da0b8c630fa53b06d4b9e7db7664c1b7fbf0e3178951ca212130ef1e not found: ID does not exist" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.163015 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.177407 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.179073 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" containerName="nova-scheduler-scheduler" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.179096 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" containerName="nova-scheduler-scheduler" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.179402 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" containerName="nova-scheduler-scheduler" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.184516 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.189759 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.192125 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.314988 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.315035 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.315124 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkj5h\" (UniqueName: \"kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.417054 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.417106 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.417208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkj5h\" (UniqueName: \"kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.423876 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.424317 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.434205 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkj5h\" (UniqueName: \"kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h\") pod \"nova-scheduler-0\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.503487 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:42 crc kubenswrapper[5030]: W0316 13:36:42.933589 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b9befbc_4206_47a5_ae24_f5a856c4f76b.slice/crio-24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077 WatchSource:0}: Error finding container 24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077: Status 404 returned error can't find the container with id 24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077 Mar 16 13:36:42 crc kubenswrapper[5030]: I0316 13:36:42.934767 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:43 crc kubenswrapper[5030]: I0316 13:36:43.129753 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b9befbc-4206-47a5-ae24-f5a856c4f76b","Type":"ContainerStarted","Data":"36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999"} Mar 16 13:36:43 crc kubenswrapper[5030]: I0316 13:36:43.129823 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b9befbc-4206-47a5-ae24-f5a856c4f76b","Type":"ContainerStarted","Data":"24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077"} Mar 16 13:36:43 crc kubenswrapper[5030]: I0316 13:36:43.135369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerStarted","Data":"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c"} Mar 16 13:36:43 crc kubenswrapper[5030]: I0316 13:36:43.155634 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.1555407 podStartE2EDuration="1.1555407s" podCreationTimestamp="2026-03-16 13:36:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:43.146442192 +0000 UTC m=+1847.545754740" watchObservedRunningTime="2026-03-16 13:36:43.1555407 +0000 UTC m=+1847.554853247" Mar 16 13:36:43 crc kubenswrapper[5030]: I0316 13:36:43.958893 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c0abca-fa2a-4fbd-ad9a-231ef2804d59" path="/var/lib/kubelet/pods/d0c0abca-fa2a-4fbd-ad9a-231ef2804d59/volumes" Mar 16 13:36:44 crc kubenswrapper[5030]: I0316 13:36:44.077358 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:36:44 crc kubenswrapper[5030]: I0316 13:36:44.145328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerStarted","Data":"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1"} Mar 16 13:36:45 crc kubenswrapper[5030]: I0316 13:36:45.428119 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:45 crc kubenswrapper[5030]: I0316 13:36:45.452342 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.182315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerStarted","Data":"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258"} Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.182495 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.205290 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.223479 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.021067745 podStartE2EDuration="6.223455283s" podCreationTimestamp="2026-03-16 13:36:40 +0000 UTC" firstStartedPulling="2026-03-16 13:36:41.035355047 +0000 UTC m=+1845.434667594" lastFinishedPulling="2026-03-16 13:36:45.237742584 +0000 UTC m=+1849.637055132" observedRunningTime="2026-03-16 13:36:46.20178119 +0000 UTC m=+1850.601093736" watchObservedRunningTime="2026-03-16 13:36:46.223455283 +0000 UTC m=+1850.622767830" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.398147 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg"] Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.403333 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.405182 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.407330 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.415528 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg"] Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.509100 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szng5\" (UniqueName: \"kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.509253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.509304 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.509396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.611719 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szng5\" (UniqueName: \"kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.611885 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.611927 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.611990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.619941 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.620034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.628784 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.631498 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szng5\" (UniqueName: \"kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5\") pod \"nova-cell1-cell-mapping-snbhg\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:46 crc kubenswrapper[5030]: I0316 13:36:46.725461 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:47 crc kubenswrapper[5030]: I0316 13:36:47.155829 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg"] Mar 16 13:36:47 crc kubenswrapper[5030]: W0316 13:36:47.159866 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd138ca85_f9e9_496b_b682_48837f301235.slice/crio-7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1 WatchSource:0}: Error finding container 7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1: Status 404 returned error can't find the container with id 7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1 Mar 16 13:36:47 crc kubenswrapper[5030]: I0316 13:36:47.198674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" event={"ID":"d138ca85-f9e9-496b-b682-48837f301235","Type":"ContainerStarted","Data":"7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1"} Mar 16 13:36:47 crc kubenswrapper[5030]: I0316 13:36:47.504820 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:47 crc kubenswrapper[5030]: I0316 13:36:47.945460 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:36:47 crc kubenswrapper[5030]: E0316 13:36:47.945806 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:36:48 crc kubenswrapper[5030]: I0316 13:36:48.208451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" event={"ID":"d138ca85-f9e9-496b-b682-48837f301235","Type":"ContainerStarted","Data":"cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa"} Mar 16 13:36:48 crc kubenswrapper[5030]: I0316 13:36:48.234676 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" podStartSLOduration=2.234663361 podStartE2EDuration="2.234663361s" podCreationTimestamp="2026-03-16 13:36:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:36:48.224378413 +0000 UTC m=+1852.623690960" watchObservedRunningTime="2026-03-16 13:36:48.234663361 +0000 UTC m=+1852.633975908" Mar 16 13:36:48 crc kubenswrapper[5030]: I0316 13:36:48.584026 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:48 crc kubenswrapper[5030]: I0316 13:36:48.584307 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:49 crc kubenswrapper[5030]: I0316 13:36:49.504004 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:49 crc kubenswrapper[5030]: I0316 13:36:49.504049 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:49 crc kubenswrapper[5030]: I0316 13:36:49.624748 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.160:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:36:49 crc kubenswrapper[5030]: I0316 13:36:49.624760 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.160:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:36:50 crc kubenswrapper[5030]: I0316 13:36:50.073423 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:36:50 crc kubenswrapper[5030]: I0316 13:36:50.509679 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.161:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:36:50 crc kubenswrapper[5030]: I0316 13:36:50.509689 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.161:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:36:51 crc kubenswrapper[5030]: E0316 13:36:51.363592 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd138ca85_f9e9_496b_b682_48837f301235.slice/crio-cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd138ca85_f9e9_496b_b682_48837f301235.slice/crio-conmon-cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:36:52 crc kubenswrapper[5030]: I0316 13:36:52.253103 5030 generic.go:358] "Generic (PLEG): container finished" podID="d138ca85-f9e9-496b-b682-48837f301235" containerID="cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa" exitCode=0 Mar 16 13:36:52 crc kubenswrapper[5030]: I0316 13:36:52.253225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" event={"ID":"d138ca85-f9e9-496b-b682-48837f301235","Type":"ContainerDied","Data":"cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa"} Mar 16 13:36:52 crc kubenswrapper[5030]: I0316 13:36:52.505498 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:52 crc kubenswrapper[5030]: I0316 13:36:52.533193 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.299217 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.583333 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.665052 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data\") pod \"d138ca85-f9e9-496b-b682-48837f301235\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.665287 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts\") pod \"d138ca85-f9e9-496b-b682-48837f301235\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.665356 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szng5\" (UniqueName: \"kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5\") pod \"d138ca85-f9e9-496b-b682-48837f301235\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.665529 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle\") pod \"d138ca85-f9e9-496b-b682-48837f301235\" (UID: \"d138ca85-f9e9-496b-b682-48837f301235\") " Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.673686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts" (OuterVolumeSpecName: "scripts") pod "d138ca85-f9e9-496b-b682-48837f301235" (UID: "d138ca85-f9e9-496b-b682-48837f301235"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.674629 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5" (OuterVolumeSpecName: "kube-api-access-szng5") pod "d138ca85-f9e9-496b-b682-48837f301235" (UID: "d138ca85-f9e9-496b-b682-48837f301235"). InnerVolumeSpecName "kube-api-access-szng5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.699412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data" (OuterVolumeSpecName: "config-data") pod "d138ca85-f9e9-496b-b682-48837f301235" (UID: "d138ca85-f9e9-496b-b682-48837f301235"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.700501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d138ca85-f9e9-496b-b682-48837f301235" (UID: "d138ca85-f9e9-496b-b682-48837f301235"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.768936 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.768962 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.768973 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szng5\" (UniqueName: \"kubernetes.io/projected/d138ca85-f9e9-496b-b682-48837f301235-kube-api-access-szng5\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:53 crc kubenswrapper[5030]: I0316 13:36:53.768984 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d138ca85-f9e9-496b-b682-48837f301235-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:54 crc kubenswrapper[5030]: E0316 13:36:54.124813 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1772366 actualBytes=10240 Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.276538 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.276530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg" event={"ID":"d138ca85-f9e9-496b-b682-48837f301235","Type":"ContainerDied","Data":"7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1"} Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.276919 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ac96ced6c7c9ed1a88cfc3cbd6bd9c4c45aacd7dcde9b10bbe983885c7dc6c1" Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.440601 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.440906 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-log" containerID="cri-o://b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa" gracePeriod=30 Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.441443 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-api" containerID="cri-o://55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e" gracePeriod=30 Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.456982 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.465610 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.466071 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-metadata" containerID="cri-o://9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab" gracePeriod=30 Mar 16 13:36:54 crc kubenswrapper[5030]: I0316 13:36:54.465949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-log" containerID="cri-o://938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91" gracePeriod=30 Mar 16 13:36:55 crc kubenswrapper[5030]: I0316 13:36:55.287464 5030 generic.go:358] "Generic (PLEG): container finished" podID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerID="938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91" exitCode=143 Mar 16 13:36:55 crc kubenswrapper[5030]: I0316 13:36:55.287519 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerDied","Data":"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91"} Mar 16 13:36:55 crc kubenswrapper[5030]: I0316 13:36:55.290264 5030 generic.go:358] "Generic (PLEG): container finished" podID="43e575cc-7672-4ec8-a77c-4be023cca870" containerID="b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa" exitCode=143 Mar 16 13:36:55 crc kubenswrapper[5030]: I0316 13:36:55.290350 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerDied","Data":"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa"} Mar 16 13:36:55 crc kubenswrapper[5030]: I0316 13:36:55.290673 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerName="nova-scheduler-scheduler" containerID="cri-o://36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" gracePeriod=30 Mar 16 13:36:56 crc kubenswrapper[5030]: I0316 13:36:56.583246 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:56 crc kubenswrapper[5030]: I0316 13:36:56.583669 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:57 crc kubenswrapper[5030]: I0316 13:36:57.503324 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:57 crc kubenswrapper[5030]: I0316 13:36:57.503397 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.064911 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.071853 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169168 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data\") pod \"ec08c40a-8fe1-477d-bc54-243803bb2977\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjvmv\" (UniqueName: \"kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv\") pod \"43e575cc-7672-4ec8-a77c-4be023cca870\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h2nk\" (UniqueName: \"kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk\") pod \"ec08c40a-8fe1-477d-bc54-243803bb2977\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169482 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data\") pod \"43e575cc-7672-4ec8-a77c-4be023cca870\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169507 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs\") pod \"43e575cc-7672-4ec8-a77c-4be023cca870\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs\") pod \"ec08c40a-8fe1-477d-bc54-243803bb2977\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.169991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs\") pod \"ec08c40a-8fe1-477d-bc54-243803bb2977\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.170023 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle\") pod \"ec08c40a-8fe1-477d-bc54-243803bb2977\" (UID: \"ec08c40a-8fe1-477d-bc54-243803bb2977\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.170073 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle\") pod \"43e575cc-7672-4ec8-a77c-4be023cca870\" (UID: \"43e575cc-7672-4ec8-a77c-4be023cca870\") " Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.170352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs" (OuterVolumeSpecName: "logs") pod "43e575cc-7672-4ec8-a77c-4be023cca870" (UID: "43e575cc-7672-4ec8-a77c-4be023cca870"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.170509 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs" (OuterVolumeSpecName: "logs") pod "ec08c40a-8fe1-477d-bc54-243803bb2977" (UID: "ec08c40a-8fe1-477d-bc54-243803bb2977"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.171780 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ec08c40a-8fe1-477d-bc54-243803bb2977-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.171808 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/43e575cc-7672-4ec8-a77c-4be023cca870-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.176651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk" (OuterVolumeSpecName: "kube-api-access-7h2nk") pod "ec08c40a-8fe1-477d-bc54-243803bb2977" (UID: "ec08c40a-8fe1-477d-bc54-243803bb2977"). InnerVolumeSpecName "kube-api-access-7h2nk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.177914 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv" (OuterVolumeSpecName: "kube-api-access-qjvmv") pod "43e575cc-7672-4ec8-a77c-4be023cca870" (UID: "43e575cc-7672-4ec8-a77c-4be023cca870"). InnerVolumeSpecName "kube-api-access-qjvmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.196797 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data" (OuterVolumeSpecName: "config-data") pod "43e575cc-7672-4ec8-a77c-4be023cca870" (UID: "43e575cc-7672-4ec8-a77c-4be023cca870"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.198455 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ec08c40a-8fe1-477d-bc54-243803bb2977" (UID: "ec08c40a-8fe1-477d-bc54-243803bb2977"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.198836 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data" (OuterVolumeSpecName: "config-data") pod "ec08c40a-8fe1-477d-bc54-243803bb2977" (UID: "ec08c40a-8fe1-477d-bc54-243803bb2977"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.199207 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "43e575cc-7672-4ec8-a77c-4be023cca870" (UID: "43e575cc-7672-4ec8-a77c-4be023cca870"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.214624 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ec08c40a-8fe1-477d-bc54-243803bb2977" (UID: "ec08c40a-8fe1-477d-bc54-243803bb2977"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.268596 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.270461 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.272918 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.273220 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276898 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276942 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjvmv\" (UniqueName: \"kubernetes.io/projected/43e575cc-7672-4ec8-a77c-4be023cca870-kube-api-access-qjvmv\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276957 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h2nk\" (UniqueName: \"kubernetes.io/projected/ec08c40a-8fe1-477d-bc54-243803bb2977-kube-api-access-7h2nk\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276968 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276976 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276985 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ec08c40a-8fe1-477d-bc54-243803bb2977-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.276996 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43e575cc-7672-4ec8-a77c-4be023cca870-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.319408 5030 generic.go:358] "Generic (PLEG): container finished" podID="43e575cc-7672-4ec8-a77c-4be023cca870" containerID="55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e" exitCode=0 Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.319501 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerDied","Data":"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e"} Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.319572 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"43e575cc-7672-4ec8-a77c-4be023cca870","Type":"ContainerDied","Data":"230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646"} Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.319520 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.319600 5030 scope.go:117] "RemoveContainer" containerID="55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.323409 5030 generic.go:358] "Generic (PLEG): container finished" podID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerID="9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab" exitCode=0 Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.323503 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.323539 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerDied","Data":"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab"} Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.323620 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ec08c40a-8fe1-477d-bc54-243803bb2977","Type":"ContainerDied","Data":"7dc9eebf171fb149ffd3bc3a8273a01817218b73376970efbb46873e35136bab"} Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.353251 5030 scope.go:117] "RemoveContainer" containerID="b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.358422 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.367625 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.375467 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.381645 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.388000 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389214 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-log" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389233 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-log" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389318 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d138ca85-f9e9-496b-b682-48837f301235" containerName="nova-manage" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389325 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d138ca85-f9e9-496b-b682-48837f301235" containerName="nova-manage" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389333 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-log" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389340 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-log" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389351 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-metadata" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389356 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-metadata" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389378 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-api" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389384 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-api" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389602 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-log" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389618 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" containerName="nova-api-api" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389628 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-metadata" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389637 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d138ca85-f9e9-496b-b682-48837f301235" containerName="nova-manage" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389643 5030 scope.go:117] "RemoveContainer" containerID="55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.389650 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" containerName="nova-metadata-log" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.394683 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e\": container with ID starting with 55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e not found: ID does not exist" containerID="55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.394787 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e"} err="failed to get container status \"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e\": rpc error: code = NotFound desc = could not find container \"55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e\": container with ID starting with 55a31274a005bfbd06260f8b8fb4aca1294439a98aa6e1512133107f350b2d4e not found: ID does not exist" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.394811 5030 scope.go:117] "RemoveContainer" containerID="b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.395256 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa\": container with ID starting with b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa not found: ID does not exist" containerID="b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.395296 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa"} err="failed to get container status \"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa\": rpc error: code = NotFound desc = could not find container \"b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa\": container with ID starting with b445625cb34181c599aca9eed37b5dadab6415b06cacb4fc96c1c68fd5de42fa not found: ID does not exist" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.395327 5030 scope.go:117] "RemoveContainer" containerID="9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.396734 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.396884 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.400805 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.404519 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.405767 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.408187 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.408372 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.419586 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.442509 5030 scope.go:117] "RemoveContainer" containerID="938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.465264 5030 scope.go:117] "RemoveContainer" containerID="9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.465917 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab\": container with ID starting with 9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab not found: ID does not exist" containerID="9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.465956 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab"} err="failed to get container status \"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab\": rpc error: code = NotFound desc = could not find container \"9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab\": container with ID starting with 9b9abe667fe21036db79ac514a473b2ec79af8178359ed966a0530a847cc16ab not found: ID does not exist" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.465987 5030 scope.go:117] "RemoveContainer" containerID="938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.466295 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91\": container with ID starting with 938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91 not found: ID does not exist" containerID="938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.466323 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91"} err="failed to get container status \"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91\": rpc error: code = NotFound desc = could not find container \"938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91\": container with ID starting with 938cdc96b5ae51fc8c9745d581b3ec10595ff60505de9056cbf57bb75c3f4c91 not found: ID does not exist" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480016 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480095 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480156 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480196 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480298 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480390 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpzs\" (UniqueName: \"kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480477 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rwm\" (UniqueName: \"kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.480526 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.583326 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.583528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.583919 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.583996 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.584154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.584499 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.584512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.584740 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpzs\" (UniqueName: \"kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.584838 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65rwm\" (UniqueName: \"kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.585293 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.585420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.588109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.588427 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.589100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.589097 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.596921 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.598673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpzs\" (UniqueName: \"kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs\") pod \"nova-metadata-0\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.605883 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rwm\" (UniqueName: \"kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm\") pod \"nova-api-0\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.719634 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.731133 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:36:58 crc kubenswrapper[5030]: I0316 13:36:58.946445 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:36:58 crc kubenswrapper[5030]: E0316 13:36:58.947398 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.158839 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:36:59 crc kubenswrapper[5030]: W0316 13:36:59.160946 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d05e60b_dbb3_4926_9cd2_335b0ebd0137.slice/crio-0b12665245cbeeea225b186830d03ea970e52482ff04e9395cb07929441ba949 WatchSource:0}: Error finding container 0b12665245cbeeea225b186830d03ea970e52482ff04e9395cb07929441ba949: Status 404 returned error can't find the container with id 0b12665245cbeeea225b186830d03ea970e52482ff04e9395cb07929441ba949 Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.234237 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:36:59 crc kubenswrapper[5030]: W0316 13:36:59.241716 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode414ab06_97cb_4475_901d_fcdcc233c978.slice/crio-bc6f25b57fa64c58bd95e656b11eeae4d2ff8aafee66e0d08d5135ceac5f366e WatchSource:0}: Error finding container bc6f25b57fa64c58bd95e656b11eeae4d2ff8aafee66e0d08d5135ceac5f366e: Status 404 returned error can't find the container with id bc6f25b57fa64c58bd95e656b11eeae4d2ff8aafee66e0d08d5135ceac5f366e Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.334838 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerStarted","Data":"0b12665245cbeeea225b186830d03ea970e52482ff04e9395cb07929441ba949"} Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.339354 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerStarted","Data":"bc6f25b57fa64c58bd95e656b11eeae4d2ff8aafee66e0d08d5135ceac5f366e"} Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.342854 5030 generic.go:358] "Generic (PLEG): container finished" podID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerID="36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" exitCode=0 Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.342942 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b9befbc-4206-47a5-ae24-f5a856c4f76b","Type":"ContainerDied","Data":"36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999"} Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.342996 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"1b9befbc-4206-47a5-ae24-f5a856c4f76b","Type":"ContainerDied","Data":"24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077"} Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.343011 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24eb35ca25ed243e8be37a877eb7b8626f731df1261062be7d38fa3823743077" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.360129 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.407839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle\") pod \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.408191 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkj5h\" (UniqueName: \"kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h\") pod \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.408343 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data\") pod \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\" (UID: \"1b9befbc-4206-47a5-ae24-f5a856c4f76b\") " Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.420816 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h" (OuterVolumeSpecName: "kube-api-access-bkj5h") pod "1b9befbc-4206-47a5-ae24-f5a856c4f76b" (UID: "1b9befbc-4206-47a5-ae24-f5a856c4f76b"). InnerVolumeSpecName "kube-api-access-bkj5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.445168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1b9befbc-4206-47a5-ae24-f5a856c4f76b" (UID: "1b9befbc-4206-47a5-ae24-f5a856c4f76b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.446389 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data" (OuterVolumeSpecName: "config-data") pod "1b9befbc-4206-47a5-ae24-f5a856c4f76b" (UID: "1b9befbc-4206-47a5-ae24-f5a856c4f76b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.511254 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkj5h\" (UniqueName: \"kubernetes.io/projected/1b9befbc-4206-47a5-ae24-f5a856c4f76b-kube-api-access-bkj5h\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.511281 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.511292 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9befbc-4206-47a5-ae24-f5a856c4f76b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.959389 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43e575cc-7672-4ec8-a77c-4be023cca870" path="/var/lib/kubelet/pods/43e575cc-7672-4ec8-a77c-4be023cca870/volumes" Mar 16 13:36:59 crc kubenswrapper[5030]: I0316 13:36:59.960295 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec08c40a-8fe1-477d-bc54-243803bb2977" path="/var/lib/kubelet/pods/ec08c40a-8fe1-477d-bc54-243803bb2977/volumes" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.354854 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerStarted","Data":"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397"} Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.354918 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerStarted","Data":"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9"} Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.358674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerStarted","Data":"587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193"} Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.358687 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.358712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerStarted","Data":"d5d1bf6659b995933811c79129f6414f68cc82c7d4909d695466a9be3327fccf"} Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.374651 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.374624348 podStartE2EDuration="2.374624348s" podCreationTimestamp="2026-03-16 13:36:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:37:00.371582318 +0000 UTC m=+1864.770894865" watchObservedRunningTime="2026-03-16 13:37:00.374624348 +0000 UTC m=+1864.773936885" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.391589 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.396998 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.416707 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.417959 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerName="nova-scheduler-scheduler" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.417982 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerName="nova-scheduler-scheduler" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.417975 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.4179636970000002 podStartE2EDuration="2.417963697s" podCreationTimestamp="2026-03-16 13:36:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:37:00.402452371 +0000 UTC m=+1864.801764918" watchObservedRunningTime="2026-03-16 13:37:00.417963697 +0000 UTC m=+1864.817276243" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.418188 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" containerName="nova-scheduler-scheduler" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.422821 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.426866 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.440735 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.530777 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.530840 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdhp\" (UniqueName: \"kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.531033 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.633212 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.633272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdhp\" (UniqueName: \"kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.633381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.640244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.640748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.649854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdhp\" (UniqueName: \"kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp\") pod \"nova-scheduler-0\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:00 crc kubenswrapper[5030]: I0316 13:37:00.742944 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:01 crc kubenswrapper[5030]: I0316 13:37:01.132169 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:37:01 crc kubenswrapper[5030]: W0316 13:37:01.136006 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeba8bb89_a3b3_47bb_bb3e_13837d508c4b.slice/crio-3e68428f79ddbc39e06e0bb83a83a43148621a42464f4aa086fbb8424090abee WatchSource:0}: Error finding container 3e68428f79ddbc39e06e0bb83a83a43148621a42464f4aa086fbb8424090abee: Status 404 returned error can't find the container with id 3e68428f79ddbc39e06e0bb83a83a43148621a42464f4aa086fbb8424090abee Mar 16 13:37:01 crc kubenswrapper[5030]: I0316 13:37:01.372601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eba8bb89-a3b3-47bb-bb3e-13837d508c4b","Type":"ContainerStarted","Data":"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2"} Mar 16 13:37:01 crc kubenswrapper[5030]: I0316 13:37:01.372940 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eba8bb89-a3b3-47bb-bb3e-13837d508c4b","Type":"ContainerStarted","Data":"3e68428f79ddbc39e06e0bb83a83a43148621a42464f4aa086fbb8424090abee"} Mar 16 13:37:01 crc kubenswrapper[5030]: I0316 13:37:01.390418 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.390394462 podStartE2EDuration="1.390394462s" podCreationTimestamp="2026-03-16 13:37:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:37:01.38695263 +0000 UTC m=+1865.786265177" watchObservedRunningTime="2026-03-16 13:37:01.390394462 +0000 UTC m=+1865.789706998" Mar 16 13:37:01 crc kubenswrapper[5030]: E0316 13:37:01.581598 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:01 crc kubenswrapper[5030]: I0316 13:37:01.955189 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9befbc-4206-47a5-ae24-f5a856c4f76b" path="/var/lib/kubelet/pods/1b9befbc-4206-47a5-ae24-f5a856c4f76b/volumes" Mar 16 13:37:05 crc kubenswrapper[5030]: I0316 13:37:05.743298 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:08 crc kubenswrapper[5030]: I0316 13:37:08.720143 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:08 crc kubenswrapper[5030]: I0316 13:37:08.720599 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:08 crc kubenswrapper[5030]: I0316 13:37:08.732688 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:08 crc kubenswrapper[5030]: I0316 13:37:08.732741 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:09 crc kubenswrapper[5030]: I0316 13:37:09.737705 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:09 crc kubenswrapper[5030]: I0316 13:37:09.738736 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:09 crc kubenswrapper[5030]: I0316 13:37:09.761688 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.165:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:09 crc kubenswrapper[5030]: I0316 13:37:09.761815 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.165:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:10 crc kubenswrapper[5030]: I0316 13:37:10.743686 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:10 crc kubenswrapper[5030]: I0316 13:37:10.772228 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:10 crc kubenswrapper[5030]: I0316 13:37:10.946075 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:37:10 crc kubenswrapper[5030]: E0316 13:37:10.947041 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:37:11 crc kubenswrapper[5030]: I0316 13:37:11.509252 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:37:11 crc kubenswrapper[5030]: E0316 13:37:11.791495 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:16 crc kubenswrapper[5030]: I0316 13:37:16.720056 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:16 crc kubenswrapper[5030]: I0316 13:37:16.720672 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:16 crc kubenswrapper[5030]: I0316 13:37:16.732213 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:16 crc kubenswrapper[5030]: I0316 13:37:16.732279 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:17 crc kubenswrapper[5030]: I0316 13:37:17.206372 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:17 crc kubenswrapper[5030]: I0316 13:37:17.630460 5030 scope.go:117] "RemoveContainer" containerID="29aeb4a686aab6275ce9c52bb68f9c373648b8df65f4677d1fba4278e98719a7" Mar 16 13:37:17 crc kubenswrapper[5030]: I0316 13:37:17.707529 5030 scope.go:117] "RemoveContainer" containerID="087d84a59bd672366fcf7c9b3657d264f9c114f00453062046cc49b1ee6feac4" Mar 16 13:37:17 crc kubenswrapper[5030]: I0316 13:37:17.746903 5030 scope.go:117] "RemoveContainer" containerID="5a23d06e53851f97be22ab06a21f645e95cf529dfa4e470862faec235ae2a506" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.723233 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.726477 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.726625 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.740275 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.743400 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:18 crc kubenswrapper[5030]: I0316 13:37:18.749921 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:19 crc kubenswrapper[5030]: I0316 13:37:19.578867 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:19 crc kubenswrapper[5030]: I0316 13:37:19.580398 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:37:21 crc kubenswrapper[5030]: I0316 13:37:21.601544 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:21 crc kubenswrapper[5030]: I0316 13:37:21.602054 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-central-agent" containerID="cri-o://bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1" gracePeriod=30 Mar 16 13:37:21 crc kubenswrapper[5030]: I0316 13:37:21.602473 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="proxy-httpd" containerID="cri-o://e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258" gracePeriod=30 Mar 16 13:37:21 crc kubenswrapper[5030]: I0316 13:37:21.602535 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-notification-agent" containerID="cri-o://7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c" gracePeriod=30 Mar 16 13:37:21 crc kubenswrapper[5030]: I0316 13:37:21.602633 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="sg-core" containerID="cri-o://161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1" gracePeriod=30 Mar 16 13:37:22 crc kubenswrapper[5030]: E0316 13:37:22.000733 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod761d98cf_0c92_45a3_9a54_414194580194.slice/crio-bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.267933 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604245 5030 generic.go:358] "Generic (PLEG): container finished" podID="761d98cf-0c92-45a3-9a54-414194580194" containerID="e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258" exitCode=0 Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604285 5030 generic.go:358] "Generic (PLEG): container finished" podID="761d98cf-0c92-45a3-9a54-414194580194" containerID="161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1" exitCode=2 Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604292 5030 generic.go:358] "Generic (PLEG): container finished" podID="761d98cf-0c92-45a3-9a54-414194580194" containerID="bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1" exitCode=0 Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604327 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerDied","Data":"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258"} Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerDied","Data":"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1"} Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604390 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerDied","Data":"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1"} Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604823 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-log" containerID="cri-o://f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397" gracePeriod=30 Mar 16 13:37:22 crc kubenswrapper[5030]: I0316 13:37:22.604941 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-api" containerID="cri-o://5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9" gracePeriod=30 Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.096734 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.204731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.204815 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.204885 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.204912 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205006 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kspm5\" (UniqueName: \"kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205052 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205183 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle\") pod \"761d98cf-0c92-45a3-9a54-414194580194\" (UID: \"761d98cf-0c92-45a3-9a54-414194580194\") " Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.205792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.214481 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5" (OuterVolumeSpecName: "kube-api-access-kspm5") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "kube-api-access-kspm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.214917 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts" (OuterVolumeSpecName: "scripts") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.240649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.260357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.288506 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.298775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data" (OuterVolumeSpecName: "config-data") pod "761d98cf-0c92-45a3-9a54-414194580194" (UID: "761d98cf-0c92-45a3-9a54-414194580194"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308499 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308526 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308543 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/761d98cf-0c92-45a3-9a54-414194580194-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308570 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308580 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308590 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308601 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kspm5\" (UniqueName: \"kubernetes.io/projected/761d98cf-0c92-45a3-9a54-414194580194-kube-api-access-kspm5\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.308610 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/761d98cf-0c92-45a3-9a54-414194580194-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.619931 5030 generic.go:358] "Generic (PLEG): container finished" podID="761d98cf-0c92-45a3-9a54-414194580194" containerID="7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c" exitCode=0 Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.620060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerDied","Data":"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c"} Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.620107 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"761d98cf-0c92-45a3-9a54-414194580194","Type":"ContainerDied","Data":"c382ffdabd307ee1dabf24698b9ec14e37955c97515c60a93d7db2dabe94eb6f"} Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.620069 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.620135 5030 scope.go:117] "RemoveContainer" containerID="e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.624172 5030 generic.go:358] "Generic (PLEG): container finished" podID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerID="f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397" exitCode=143 Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.624211 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerDied","Data":"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397"} Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.654998 5030 scope.go:117] "RemoveContainer" containerID="161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.666604 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.691715 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.698528 5030 scope.go:117] "RemoveContainer" containerID="7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.717823 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719109 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="proxy-httpd" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719133 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="proxy-httpd" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719150 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-central-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719157 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-central-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719186 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-notification-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719192 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-notification-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719226 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="sg-core" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719231 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="sg-core" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719418 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="proxy-httpd" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719436 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="sg-core" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719445 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-central-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.719457 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="761d98cf-0c92-45a3-9a54-414194580194" containerName="ceilometer-notification-agent" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.726738 5030 scope.go:117] "RemoveContainer" containerID="bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.727257 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.728150 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.729943 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.730131 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.731900 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.753910 5030 scope.go:117] "RemoveContainer" containerID="e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258" Mar 16 13:37:23 crc kubenswrapper[5030]: E0316 13:37:23.754309 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258\": container with ID starting with e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258 not found: ID does not exist" containerID="e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.754351 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258"} err="failed to get container status \"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258\": rpc error: code = NotFound desc = could not find container \"e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258\": container with ID starting with e27d3bcd2a6b0fcf37eae0c49f98840ec6b5d813496ff140eaa0a519872c0258 not found: ID does not exist" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.754369 5030 scope.go:117] "RemoveContainer" containerID="161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1" Mar 16 13:37:23 crc kubenswrapper[5030]: E0316 13:37:23.754998 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1\": container with ID starting with 161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1 not found: ID does not exist" containerID="161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.755033 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1"} err="failed to get container status \"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1\": rpc error: code = NotFound desc = could not find container \"161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1\": container with ID starting with 161fcce0b653fe30c2b0f1d8533df045b2d35abfd29f4298d9251bae5771b5b1 not found: ID does not exist" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.755058 5030 scope.go:117] "RemoveContainer" containerID="7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c" Mar 16 13:37:23 crc kubenswrapper[5030]: E0316 13:37:23.755369 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c\": container with ID starting with 7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c not found: ID does not exist" containerID="7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.755408 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c"} err="failed to get container status \"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c\": rpc error: code = NotFound desc = could not find container \"7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c\": container with ID starting with 7825184fc36849b187d8bfd2f356d2052e4c192c193022bb530b197cce14cb0c not found: ID does not exist" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.755438 5030 scope.go:117] "RemoveContainer" containerID="bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1" Mar 16 13:37:23 crc kubenswrapper[5030]: E0316 13:37:23.755791 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1\": container with ID starting with bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1 not found: ID does not exist" containerID="bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.755830 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1"} err="failed to get container status \"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1\": rpc error: code = NotFound desc = could not find container \"bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1\": container with ID starting with bf9f2b4b4b9b8d2a3255c120847218278a7ee7c2688c74a16b7a885febee11e1 not found: ID does not exist" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.819157 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.819227 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.819263 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.819319 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.819821 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.820021 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.820130 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.820244 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgfw\" (UniqueName: \"kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.922689 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.922753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.922907 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923121 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923569 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923715 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923749 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923802 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.923874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgfw\" (UniqueName: \"kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.924269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.929729 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.930861 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.931175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.931194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.933967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.943063 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgfw\" (UniqueName: \"kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw\") pod \"ceilometer-0\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:23 crc kubenswrapper[5030]: I0316 13:37:23.958836 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761d98cf-0c92-45a3-9a54-414194580194" path="/var/lib/kubelet/pods/761d98cf-0c92-45a3-9a54-414194580194/volumes" Mar 16 13:37:24 crc kubenswrapper[5030]: I0316 13:37:24.052982 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:24 crc kubenswrapper[5030]: I0316 13:37:24.492997 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:37:24 crc kubenswrapper[5030]: W0316 13:37:24.496458 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf890e750_60d2_4d91_bc23_a27f011de88e.slice/crio-4fb6c5720304640a562a4f8f742d23fe1f7fbd4a457a4e88fb08738beb89ad3b WatchSource:0}: Error finding container 4fb6c5720304640a562a4f8f742d23fe1f7fbd4a457a4e88fb08738beb89ad3b: Status 404 returned error can't find the container with id 4fb6c5720304640a562a4f8f742d23fe1f7fbd4a457a4e88fb08738beb89ad3b Mar 16 13:37:24 crc kubenswrapper[5030]: I0316 13:37:24.639138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerStarted","Data":"4fb6c5720304640a562a4f8f742d23fe1f7fbd4a457a4e88fb08738beb89ad3b"} Mar 16 13:37:24 crc kubenswrapper[5030]: I0316 13:37:24.945905 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:37:25 crc kubenswrapper[5030]: I0316 13:37:25.653909 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831"} Mar 16 13:37:25 crc kubenswrapper[5030]: I0316 13:37:25.660221 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerStarted","Data":"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae"} Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.136692 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.273343 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle\") pod \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.273570 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65rwm\" (UniqueName: \"kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm\") pod \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.273740 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs\") pod \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.273814 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data\") pod \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\" (UID: \"4d05e60b-dbb3-4926-9cd2-335b0ebd0137\") " Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.276676 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs" (OuterVolumeSpecName: "logs") pod "4d05e60b-dbb3-4926-9cd2-335b0ebd0137" (UID: "4d05e60b-dbb3-4926-9cd2-335b0ebd0137"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.280190 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm" (OuterVolumeSpecName: "kube-api-access-65rwm") pod "4d05e60b-dbb3-4926-9cd2-335b0ebd0137" (UID: "4d05e60b-dbb3-4926-9cd2-335b0ebd0137"). InnerVolumeSpecName "kube-api-access-65rwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.296691 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data" (OuterVolumeSpecName: "config-data") pod "4d05e60b-dbb3-4926-9cd2-335b0ebd0137" (UID: "4d05e60b-dbb3-4926-9cd2-335b0ebd0137"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.305913 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4d05e60b-dbb3-4926-9cd2-335b0ebd0137" (UID: "4d05e60b-dbb3-4926-9cd2-335b0ebd0137"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.376935 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65rwm\" (UniqueName: \"kubernetes.io/projected/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-kube-api-access-65rwm\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.376970 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.376982 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.376990 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d05e60b-dbb3-4926-9cd2-335b0ebd0137-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.674997 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerStarted","Data":"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e"} Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.678068 5030 generic.go:358] "Generic (PLEG): container finished" podID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerID="5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9" exitCode=0 Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.678575 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerDied","Data":"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9"} Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.678605 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4d05e60b-dbb3-4926-9cd2-335b0ebd0137","Type":"ContainerDied","Data":"0b12665245cbeeea225b186830d03ea970e52482ff04e9395cb07929441ba949"} Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.678629 5030 scope.go:117] "RemoveContainer" containerID="5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.678843 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.715627 5030 scope.go:117] "RemoveContainer" containerID="f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.739497 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.742422 5030 scope.go:117] "RemoveContainer" containerID="5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9" Mar 16 13:37:26 crc kubenswrapper[5030]: E0316 13:37:26.742852 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9\": container with ID starting with 5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9 not found: ID does not exist" containerID="5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.742885 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9"} err="failed to get container status \"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9\": rpc error: code = NotFound desc = could not find container \"5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9\": container with ID starting with 5a23030c38183bdcdc7b9c910bac9ef74d032148b962240c59a34087dbbdfea9 not found: ID does not exist" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.742905 5030 scope.go:117] "RemoveContainer" containerID="f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397" Mar 16 13:37:26 crc kubenswrapper[5030]: E0316 13:37:26.743613 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397\": container with ID starting with f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397 not found: ID does not exist" containerID="f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.743646 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397"} err="failed to get container status \"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397\": rpc error: code = NotFound desc = could not find container \"f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397\": container with ID starting with f6fce2a36521876df334f8101f7420d755a08718de784c72481284c195c38397 not found: ID does not exist" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.753355 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.760101 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761299 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-log" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761320 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-log" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761379 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-api" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761386 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-api" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761573 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-log" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.761589 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" containerName="nova-api-api" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.766061 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.766185 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.767985 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.768093 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.769158 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.890939 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.891158 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqk2q\" (UniqueName: \"kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.891249 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.891287 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.891312 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.891540 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994073 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqk2q\" (UniqueName: \"kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994143 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994181 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994530 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.994852 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.999006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.999275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:26 crc kubenswrapper[5030]: I0316 13:37:26.999375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.007909 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqk2q\" (UniqueName: \"kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.007992 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs\") pod \"nova-api-0\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.089223 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.499745 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:37:27 crc kubenswrapper[5030]: W0316 13:37:27.502679 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ce86d2_7cfe_4352_9502_c2e47aedb7f9.slice/crio-77d9e32d30be28ab1bf6f9fb0daa5cf9165a7891587c3292299ce5f241504d29 WatchSource:0}: Error finding container 77d9e32d30be28ab1bf6f9fb0daa5cf9165a7891587c3292299ce5f241504d29: Status 404 returned error can't find the container with id 77d9e32d30be28ab1bf6f9fb0daa5cf9165a7891587c3292299ce5f241504d29 Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.688544 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerStarted","Data":"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42"} Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.693744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerStarted","Data":"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d"} Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.693790 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerStarted","Data":"77d9e32d30be28ab1bf6f9fb0daa5cf9165a7891587c3292299ce5f241504d29"} Mar 16 13:37:27 crc kubenswrapper[5030]: I0316 13:37:27.956687 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d05e60b-dbb3-4926-9cd2-335b0ebd0137" path="/var/lib/kubelet/pods/4d05e60b-dbb3-4926-9cd2-335b0ebd0137/volumes" Mar 16 13:37:28 crc kubenswrapper[5030]: I0316 13:37:28.704012 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerStarted","Data":"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd"} Mar 16 13:37:28 crc kubenswrapper[5030]: I0316 13:37:28.704792 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:37:28 crc kubenswrapper[5030]: I0316 13:37:28.705860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerStarted","Data":"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7"} Mar 16 13:37:28 crc kubenswrapper[5030]: I0316 13:37:28.733314 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.733091388 podStartE2EDuration="5.733302455s" podCreationTimestamp="2026-03-16 13:37:23 +0000 UTC" firstStartedPulling="2026-03-16 13:37:24.498782756 +0000 UTC m=+1888.898095303" lastFinishedPulling="2026-03-16 13:37:28.498993822 +0000 UTC m=+1892.898306370" observedRunningTime="2026-03-16 13:37:28.719013698 +0000 UTC m=+1893.118326235" watchObservedRunningTime="2026-03-16 13:37:28.733302455 +0000 UTC m=+1893.132615002" Mar 16 13:37:28 crc kubenswrapper[5030]: I0316 13:37:28.746113 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.746093124 podStartE2EDuration="2.746093124s" podCreationTimestamp="2026-03-16 13:37:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:37:28.737846698 +0000 UTC m=+1893.137159236" watchObservedRunningTime="2026-03-16 13:37:28.746093124 +0000 UTC m=+1893.145405671" Mar 16 13:37:32 crc kubenswrapper[5030]: E0316 13:37:32.205882 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:37 crc kubenswrapper[5030]: I0316 13:37:37.089950 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:37 crc kubenswrapper[5030]: I0316 13:37:37.090682 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:38 crc kubenswrapper[5030]: I0316 13:37:38.097719 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.169:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:38 crc kubenswrapper[5030]: I0316 13:37:38.098533 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.169:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:37:42 crc kubenswrapper[5030]: E0316 13:37:42.402825 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:45 crc kubenswrapper[5030]: I0316 13:37:45.089325 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:45 crc kubenswrapper[5030]: I0316 13:37:45.089723 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:47 crc kubenswrapper[5030]: I0316 13:37:47.096311 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:47 crc kubenswrapper[5030]: I0316 13:37:47.097734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:47 crc kubenswrapper[5030]: I0316 13:37:47.102444 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:47 crc kubenswrapper[5030]: I0316 13:37:47.934799 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:37:52 crc kubenswrapper[5030]: E0316 13:37:52.625994 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e575cc_7672_4ec8_a77c_4be023cca870.slice/crio-230bcd8f4502779a70595800184697b011dbbf33f419a7746cf95c38f2858646\": RecentStats: unable to find data in memory cache]" Mar 16 13:37:53 crc kubenswrapper[5030]: E0316 13:37:53.905180 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1764363 actualBytes=10240 Mar 16 13:37:59 crc kubenswrapper[5030]: I0316 13:37:59.725622 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.139193 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561138-2gshr"] Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.145313 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561138-2gshr"] Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.145444 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.147898 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.148113 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.148200 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.274389 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zx4f\" (UniqueName: \"kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f\") pod \"auto-csr-approver-29561138-2gshr\" (UID: \"cacd40d5-9a69-4128-bdd5-8adfd13db2b7\") " pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.377588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zx4f\" (UniqueName: \"kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f\") pod \"auto-csr-approver-29561138-2gshr\" (UID: \"cacd40d5-9a69-4128-bdd5-8adfd13db2b7\") " pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.403088 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zx4f\" (UniqueName: \"kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f\") pod \"auto-csr-approver-29561138-2gshr\" (UID: \"cacd40d5-9a69-4128-bdd5-8adfd13db2b7\") " pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.462856 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.860362 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561138-2gshr"] Mar 16 13:38:00 crc kubenswrapper[5030]: W0316 13:38:00.864688 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcacd40d5_9a69_4128_bdd5_8adfd13db2b7.slice/crio-dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821 WatchSource:0}: Error finding container dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821: Status 404 returned error can't find the container with id dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821 Mar 16 13:38:00 crc kubenswrapper[5030]: I0316 13:38:00.866913 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:38:01 crc kubenswrapper[5030]: I0316 13:38:01.050242 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561138-2gshr" event={"ID":"cacd40d5-9a69-4128-bdd5-8adfd13db2b7","Type":"ContainerStarted","Data":"dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821"} Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.069402 5030 generic.go:358] "Generic (PLEG): container finished" podID="cacd40d5-9a69-4128-bdd5-8adfd13db2b7" containerID="b4acc12a66d0145dbecf40627c01df8c7bd337cd03205c0a2b729fd864219f98" exitCode=0 Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.069474 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561138-2gshr" event={"ID":"cacd40d5-9a69-4128-bdd5-8adfd13db2b7","Type":"ContainerDied","Data":"b4acc12a66d0145dbecf40627c01df8c7bd337cd03205c0a2b729fd864219f98"} Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.843800 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.848142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.861685 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.955568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.955672 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.955988 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.956143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.956317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.956412 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzggb\" (UniqueName: \"kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:03 crc kubenswrapper[5030]: I0316 13:38:03.956627 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.058859 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.058958 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.059013 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.059147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.059230 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.059292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.059337 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzggb\" (UniqueName: \"kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.060275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.070704 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.072192 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.072585 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.075924 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.076519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzggb\" (UniqueName: \"kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.077105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs\") pod \"placement-6fcbf4b974-fmfm7\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.168754 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.286238 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.308742 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.313830 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.324985 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.393230 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.475700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zx4f\" (UniqueName: \"kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f\") pod \"cacd40d5-9a69-4128-bdd5-8adfd13db2b7\" (UID: \"cacd40d5-9a69-4128-bdd5-8adfd13db2b7\") " Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476229 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476379 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476777 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svs6\" (UniqueName: \"kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.476800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.482419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f" (OuterVolumeSpecName: "kube-api-access-6zx4f") pod "cacd40d5-9a69-4128-bdd5-8adfd13db2b7" (UID: "cacd40d5-9a69-4128-bdd5-8adfd13db2b7"). InnerVolumeSpecName "kube-api-access-6zx4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.578759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.578813 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.578845 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579513 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6svs6\" (UniqueName: \"kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579537 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.579759 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zx4f\" (UniqueName: \"kubernetes.io/projected/cacd40d5-9a69-4128-bdd5-8adfd13db2b7-kube-api-access-6zx4f\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.583726 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.583888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.583914 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.584072 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.584948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.593448 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svs6\" (UniqueName: \"kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6\") pod \"placement-6897989574-jfvsh\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.651091 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:04 crc kubenswrapper[5030]: W0316 13:38:04.664928 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09c59e2c_5857_4602_8962_5b65860490cc.slice/crio-3d66af29a56edb209e80551b8f2cba24a9f5b182582c32b15f0ea3fd82da799f WatchSource:0}: Error finding container 3d66af29a56edb209e80551b8f2cba24a9f5b182582c32b15f0ea3fd82da799f: Status 404 returned error can't find the container with id 3d66af29a56edb209e80551b8f2cba24a9f5b182582c32b15f0ea3fd82da799f Mar 16 13:38:04 crc kubenswrapper[5030]: I0316 13:38:04.684990 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.113605 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121618 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerStarted","Data":"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a"} Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121661 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerStarted","Data":"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589"} Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121672 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerStarted","Data":"3d66af29a56edb209e80551b8f2cba24a9f5b182582c32b15f0ea3fd82da799f"} Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121826 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-log" containerID="cri-o://756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121901 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.121918 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.122273 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-api" containerID="cri-o://43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.128035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561138-2gshr" event={"ID":"cacd40d5-9a69-4128-bdd5-8adfd13db2b7","Type":"ContainerDied","Data":"dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821"} Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.128069 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbd3886ff80539f936a25e7c7d7a1482858de5f8dbc4a6c458801ce74a6c2821" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.128131 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561138-2gshr" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.164594 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.164859 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-log" containerID="cri-o://5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.165021 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-httpd" containerID="cri-o://a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.168082 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" podStartSLOduration=2.1680629319999998 podStartE2EDuration="2.168062932s" podCreationTimestamp="2026-03-16 13:38:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:05.155526751 +0000 UTC m=+1929.554839297" watchObservedRunningTime="2026-03-16 13:38:05.168062932 +0000 UTC m=+1929.567375480" Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.222787 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.223325 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-log" containerID="cri-o://22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.223395 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-httpd" containerID="cri-o://4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9" gracePeriod=30 Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.458056 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561132-qnrs4"] Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.465610 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561132-qnrs4"] Mar 16 13:38:05 crc kubenswrapper[5030]: I0316 13:38:05.956069 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6" path="/var/lib/kubelet/pods/5a7e2317-4c45-440f-9a0c-f1ceeb6b84c6/volumes" Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.138763 5030 generic.go:358] "Generic (PLEG): container finished" podID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerID="22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055" exitCode=143 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.138864 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerDied","Data":"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.140579 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerStarted","Data":"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.140643 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerStarted","Data":"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.140656 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerStarted","Data":"36d18a01b4fac1f7df944b563fb950e3fa3d1989747fe10e275f5901c20a6072"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.140674 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.140685 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.143529 5030 generic.go:358] "Generic (PLEG): container finished" podID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerID="5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b" exitCode=143 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.143581 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerDied","Data":"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.149202 5030 generic.go:358] "Generic (PLEG): container finished" podID="09c59e2c-5857-4602-8962-5b65860490cc" containerID="756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589" exitCode=143 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.149582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerDied","Data":"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589"} Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.161684 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" podStartSLOduration=2.161668243 podStartE2EDuration="2.161668243s" podCreationTimestamp="2026-03-16 13:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:06.159003341 +0000 UTC m=+1930.558315889" watchObservedRunningTime="2026-03-16 13:38:06.161668243 +0000 UTC m=+1930.560980789" Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.474151 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.474468 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="cinder-scheduler" containerID="cri-o://6bf0389c78a2b8389634fe9da023b9400cd16ef479dbd093526f22fa223a1840" gracePeriod=30 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.474583 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="probe" containerID="cri-o://fae7ed8acca861259d993aff4a47e78b8d77d7b5ea1f4dbc2ba10f1a51be5ea9" gracePeriod=30 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.488238 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.488485 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api-log" containerID="cri-o://f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb" gracePeriod=30 Mar 16 13:38:06 crc kubenswrapper[5030]: I0316 13:38:06.488640 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api" containerID="cri-o://9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a" gracePeriod=30 Mar 16 13:38:07 crc kubenswrapper[5030]: I0316 13:38:07.160081 5030 generic.go:358] "Generic (PLEG): container finished" podID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerID="f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb" exitCode=143 Mar 16 13:38:07 crc kubenswrapper[5030]: I0316 13:38:07.160195 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerDied","Data":"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb"} Mar 16 13:38:07 crc kubenswrapper[5030]: I0316 13:38:07.162782 5030 generic.go:358] "Generic (PLEG): container finished" podID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerID="fae7ed8acca861259d993aff4a47e78b8d77d7b5ea1f4dbc2ba10f1a51be5ea9" exitCode=0 Mar 16 13:38:07 crc kubenswrapper[5030]: I0316 13:38:07.162815 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerDied","Data":"fae7ed8acca861259d993aff4a47e78b8d77d7b5ea1f4dbc2ba10f1a51be5ea9"} Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.334646 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.336384 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacd40d5-9a69-4128-bdd5-8adfd13db2b7" containerName="oc" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.336418 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacd40d5-9a69-4128-bdd5-8adfd13db2b7" containerName="oc" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.336654 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cacd40d5-9a69-4128-bdd5-8adfd13db2b7" containerName="oc" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.340146 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.345890 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389274 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njbf2\" (UniqueName: \"kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389527 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.389710 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.491931 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492017 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492103 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492215 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.492238 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njbf2\" (UniqueName: \"kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.502436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.503103 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.503891 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.505449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.505719 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.519515 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.522205 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njbf2\" (UniqueName: \"kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2\") pod \"neutron-74d78bdb54-b49xg\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.547436 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.549739 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.582496 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.588276 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.601447 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696255 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rphwh\" (UniqueName: \"kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696613 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696690 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.696933 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.697034 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799388 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799651 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rphwh\" (UniqueName: \"kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799679 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799704 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799755 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.799860 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.804850 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.805035 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.805312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.806486 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.807316 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.817479 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.823982 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rphwh\" (UniqueName: \"kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh\") pod \"neutron-6fbf5fccd6-h87r4\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.830111 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901318 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901494 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8t6n\" (UniqueName: \"kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901882 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.901992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run\") pod \"82fa560d-afe4-4e21-aa74-f006b2406e52\" (UID: \"82fa560d-afe4-4e21-aa74-f006b2406e52\") " Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.902832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.904286 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs" (OuterVolumeSpecName: "logs") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.907499 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n" (OuterVolumeSpecName: "kube-api-access-z8t6n") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "kube-api-access-z8t6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.911782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts" (OuterVolumeSpecName: "scripts") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.912064 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.925392 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.931702 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.950001 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data" (OuterVolumeSpecName: "config-data") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:08 crc kubenswrapper[5030]: I0316 13:38:08.971610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "82fa560d-afe4-4e21-aa74-f006b2406e52" (UID: "82fa560d-afe4-4e21-aa74-f006b2406e52"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004694 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8t6n\" (UniqueName: \"kubernetes.io/projected/82fa560d-afe4-4e21-aa74-f006b2406e52-kube-api-access-z8t6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004752 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004768 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004780 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004790 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/82fa560d-afe4-4e21-aa74-f006b2406e52-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004798 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004806 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.004817 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82fa560d-afe4-4e21-aa74-f006b2406e52-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.030738 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.033035 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.106156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.106500 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.106570 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.106672 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.106717 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.107774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.109648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th89v\" (UniqueName: \"kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.110057 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.110123 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs" (OuterVolumeSpecName: "logs") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.110192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\" (UID: \"0575eaf9-1162-47ce-adcc-5d1c4dfba713\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.111663 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.111680 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0575eaf9-1162-47ce-adcc-5d1c4dfba713-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.111689 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.123844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v" (OuterVolumeSpecName: "kube-api-access-th89v") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "kube-api-access-th89v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.124111 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts" (OuterVolumeSpecName: "scripts") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.129060 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.133182 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.153807 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.167115 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.179385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data" (OuterVolumeSpecName: "config-data") pod "0575eaf9-1162-47ce-adcc-5d1c4dfba713" (UID: "0575eaf9-1162-47ce-adcc-5d1c4dfba713"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.194101 5030 generic.go:358] "Generic (PLEG): container finished" podID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerID="6bf0389c78a2b8389634fe9da023b9400cd16ef479dbd093526f22fa223a1840" exitCode=0 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.194374 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerDied","Data":"6bf0389c78a2b8389634fe9da023b9400cd16ef479dbd093526f22fa223a1840"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.207889 5030 generic.go:358] "Generic (PLEG): container finished" podID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerID="4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9" exitCode=0 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.208055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerDied","Data":"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.208086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"0575eaf9-1162-47ce-adcc-5d1c4dfba713","Type":"ContainerDied","Data":"1de1df71d41bdb3035ea7db58e09deb6077e130ba0e90c390010ef38cb7a9f91"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.208109 5030 scope.go:117] "RemoveContainer" containerID="4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.208133 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215168 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215333 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215415 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th89v\" (UniqueName: \"kubernetes.io/projected/0575eaf9-1162-47ce-adcc-5d1c4dfba713-kube-api-access-th89v\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215475 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215596 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.215749 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0575eaf9-1162-47ce-adcc-5d1c4dfba713-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.216978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerStarted","Data":"b1791d785e07e21bdea92b7a88c15eab6451936452f85fd6edf6b2385ef16f17"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.222938 5030 generic.go:358] "Generic (PLEG): container finished" podID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerID="a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d" exitCode=0 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.223000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerDied","Data":"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.223016 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"82fa560d-afe4-4e21-aa74-f006b2406e52","Type":"ContainerDied","Data":"41314bc436c5a22da85dc7f078456003684fcfefbe64d2355b5c47b017b46917"} Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.223068 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.252797 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.255289 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.268853 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.280500 5030 scope.go:117] "RemoveContainer" containerID="22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.280522 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281531 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281569 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281584 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281590 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281620 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281627 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281658 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281663 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281820 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281834 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-httpd" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281848 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.281857 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" containerName="glance-log" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.287157 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.291500 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-vb2g5\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.291821 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.292526 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.293593 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.301974 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.311838 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.318208 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.323150 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.326196 5030 scope.go:117] "RemoveContainer" containerID="4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9" Mar 16 13:38:09 crc kubenswrapper[5030]: E0316 13:38:09.327057 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9\": container with ID starting with 4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9 not found: ID does not exist" containerID="4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.327105 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9"} err="failed to get container status \"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9\": rpc error: code = NotFound desc = could not find container \"4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9\": container with ID starting with 4d7b6f882cab51bbccbe09cefdedf4b33968c0023162314adddb58c7d621e1e9 not found: ID does not exist" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.327135 5030 scope.go:117] "RemoveContainer" containerID="22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055" Mar 16 13:38:09 crc kubenswrapper[5030]: E0316 13:38:09.327720 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055\": container with ID starting with 22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055 not found: ID does not exist" containerID="22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.327760 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055"} err="failed to get container status \"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055\": rpc error: code = NotFound desc = could not find container \"22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055\": container with ID starting with 22075f87abf87bf4714958358caa94208e95f13f01e2432e7ac8368402051055 not found: ID does not exist" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.327778 5030 scope.go:117] "RemoveContainer" containerID="a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.333479 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.341830 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.345879 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.348054 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.350943 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.364244 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.381946 5030 scope.go:117] "RemoveContainer" containerID="5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.419649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420040 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqdh5\" (UniqueName: \"kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420356 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420413 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts\") pod \"580a4811-8d4a-4ea6-b645-5efc678daab6\" (UID: \"580a4811-8d4a-4ea6-b645-5efc678daab6\") " Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420820 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420893 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.420943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421016 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421084 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421262 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659nx\" (UniqueName: \"kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421380 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421400 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsnb\" (UniqueName: \"kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.421464 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.427158 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.452651 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.435211 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts" (OuterVolumeSpecName: "scripts") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.452879 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5" (OuterVolumeSpecName: "kube-api-access-xqdh5") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "kube-api-access-xqdh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526478 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526589 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526678 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526709 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526761 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526798 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659nx\" (UniqueName: \"kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526942 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsnb\" (UniqueName: \"kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.526970 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527008 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527116 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527195 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527290 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527436 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqdh5\" (UniqueName: \"kubernetes.io/projected/580a4811-8d4a-4ea6-b645-5efc678daab6-kube-api-access-xqdh5\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527454 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/580a4811-8d4a-4ea6-b645-5efc678daab6-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527465 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.527478 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.528770 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.530907 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.532142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.533132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.533433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.533539 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.533643 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.545076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.550752 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.550872 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.554440 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.554776 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsnb\" (UniqueName: \"kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.556949 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.559632 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerName="nova-cell0-conductor-conductor" containerID="cri-o://5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.561281 5030 scope.go:117] "RemoveContainer" containerID="a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d" Mar 16 13:38:09 crc kubenswrapper[5030]: E0316 13:38:09.570059 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d\": container with ID starting with a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d not found: ID does not exist" containerID="a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.570106 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d"} err="failed to get container status \"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d\": rpc error: code = NotFound desc = could not find container \"a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d\": container with ID starting with a2c4c9ff1128b9aa92cbb46a7fbe1521f4e4e38e941aa6c47eed197a2017475d not found: ID does not exist" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.570144 5030 scope.go:117] "RemoveContainer" containerID="5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.570336 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: E0316 13:38:09.570981 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b\": container with ID starting with 5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b not found: ID does not exist" containerID="5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.571036 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b"} err="failed to get container status \"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b\": rpc error: code = NotFound desc = could not find container \"5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b\": container with ID starting with 5dfa63c171678d3b468816542a0b0eecdd43185fdc8b97cc5d40e8445c72596b not found: ID does not exist" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.575635 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.595093 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.595544 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659nx\" (UniqueName: \"kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.597370 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.607770 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.608042 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="c165722a-e0a3-424b-a423-244347ee7322" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://1920b17ad1a7373929b4308b91df49b814dd898f9dc001dcea03364297c5cbca" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.622689 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.622936 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerName="nova-scheduler-scheduler" containerID="cri-o://af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.629491 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.629756 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" containerID="cri-o://d5d1bf6659b995933811c79129f6414f68cc82c7d4909d695466a9be3327fccf" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.629904 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" containerID="cri-o://587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.666834 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.671024 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.671248 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-log" containerID="cri-o://c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.671672 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-api" containerID="cri-o://d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7" gracePeriod=30 Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.687384 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.689810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.729755 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data" (OuterVolumeSpecName: "config-data") pod "580a4811-8d4a-4ea6-b645-5efc678daab6" (UID: "580a4811-8d4a-4ea6-b645-5efc678daab6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.732417 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.732443 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/580a4811-8d4a-4ea6-b645-5efc678daab6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.766315 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.773982 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.975257 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0575eaf9-1162-47ce-adcc-5d1c4dfba713" path="/var/lib/kubelet/pods/0575eaf9-1162-47ce-adcc-5d1c4dfba713/volumes" Mar 16 13:38:09 crc kubenswrapper[5030]: I0316 13:38:09.976382 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82fa560d-afe4-4e21-aa74-f006b2406e52" path="/var/lib/kubelet/pods/82fa560d-afe4-4e21-aa74-f006b2406e52/volumes" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.204520 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246161 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246353 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246392 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246411 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246623 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbmkp\" (UniqueName: \"kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246651 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246793 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.246837 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts\") pod \"c78dfa17-ce3f-4361-b343-6dd551cee81b\" (UID: \"c78dfa17-ce3f-4361-b343-6dd551cee81b\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.247019 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs" (OuterVolumeSpecName: "logs") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.248292 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c78dfa17-ce3f-4361-b343-6dd551cee81b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.250505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.260822 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp" (OuterVolumeSpecName: "kube-api-access-wbmkp") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "kube-api-access-wbmkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.262333 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts" (OuterVolumeSpecName: "scripts") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.269943 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.270279 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-api" containerID="cri-o://ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" gracePeriod=30 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.270625 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerStarted","Data":"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.270654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerStarted","Data":"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.270687 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.270988 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-httpd" containerID="cri-o://ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" gracePeriod=30 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.303936 5030 generic.go:358] "Generic (PLEG): container finished" podID="c165722a-e0a3-424b-a423-244347ee7322" containerID="1920b17ad1a7373929b4308b91df49b814dd898f9dc001dcea03364297c5cbca" exitCode=0 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.304060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c165722a-e0a3-424b-a423-244347ee7322","Type":"ContainerDied","Data":"1920b17ad1a7373929b4308b91df49b814dd898f9dc001dcea03364297c5cbca"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.305925 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" podStartSLOduration=2.305908691 podStartE2EDuration="2.305908691s" podCreationTimestamp="2026-03-16 13:38:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:10.292659981 +0000 UTC m=+1934.691972528" watchObservedRunningTime="2026-03-16 13:38:10.305908691 +0000 UTC m=+1934.705221238" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.315121 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.337402 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerStarted","Data":"95200b4e7b4806b197c6dc6c629a9a18625013eb6bcbe56185fb676aec7fcfa9"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.337441 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerStarted","Data":"3faeca43bc7881b5eb8665831a45fbb3d76c6914c5b13fb15dd42f9291d56a3c"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.337451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerStarted","Data":"46f6fbd9625d5a90ed8ccdbd739e247c2e66e83ffe489fe308330100f5e7302a"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.339778 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.346623 5030 generic.go:358] "Generic (PLEG): container finished" podID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerID="c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d" exitCode=143 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.346684 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerDied","Data":"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.350384 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbmkp\" (UniqueName: \"kubernetes.io/projected/c78dfa17-ce3f-4361-b343-6dd551cee81b-kube-api-access-wbmkp\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.350406 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.350416 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.350424 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c78dfa17-ce3f-4361-b343-6dd551cee81b-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.350432 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.351747 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data" (OuterVolumeSpecName: "config-data") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.353798 5030 generic.go:358] "Generic (PLEG): container finished" podID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerID="9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a" exitCode=0 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.353959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerDied","Data":"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.353980 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"c78dfa17-ce3f-4361-b343-6dd551cee81b","Type":"ContainerDied","Data":"96d0675832cf110f3f6b9a59e05b61b55bfe7b155457a61e3501a661f30c06a6"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.353999 5030 scope.go:117] "RemoveContainer" containerID="9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.354122 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.359924 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.371394 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" podStartSLOduration=2.371378693 podStartE2EDuration="2.371378693s" podCreationTimestamp="2026-03-16 13:38:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:10.368149 +0000 UTC m=+1934.767461547" watchObservedRunningTime="2026-03-16 13:38:10.371378693 +0000 UTC m=+1934.770691239" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.380290 5030 generic.go:358] "Generic (PLEG): container finished" podID="e414ab06-97cb-4475-901d-fcdcc233c978" containerID="d5d1bf6659b995933811c79129f6414f68cc82c7d4909d695466a9be3327fccf" exitCode=143 Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.380414 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerDied","Data":"d5d1bf6659b995933811c79129f6414f68cc82c7d4909d695466a9be3327fccf"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.391258 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"580a4811-8d4a-4ea6-b645-5efc678daab6","Type":"ContainerDied","Data":"2b890aa62fe9ba5631121772613e59d5b90b7e1bf7099a319f5651f050a71984"} Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.391391 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.392845 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c78dfa17-ce3f-4361-b343-6dd551cee81b" (UID: "c78dfa17-ce3f-4361-b343-6dd551cee81b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.393616 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.410516 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.452530 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.452577 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.452590 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c78dfa17-ce3f-4361-b343-6dd551cee81b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.579663 5030 scope.go:117] "RemoveContainer" containerID="f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.592397 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.605153 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.619793 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.634118 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635344 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c165722a-e0a3-424b-a423-244347ee7322" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635365 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c165722a-e0a3-424b-a423-244347ee7322" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635397 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635404 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635430 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="cinder-scheduler" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635435 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="cinder-scheduler" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635441 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api-log" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635447 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api-log" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635462 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="probe" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635468 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="probe" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635702 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="cinder-scheduler" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635717 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635734 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" containerName="probe" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635743 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c165722a-e0a3-424b-a423-244347ee7322" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.635750 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" containerName="cinder-api-log" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.642489 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.644067 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.649189 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.652983 5030 scope.go:117] "RemoveContainer" containerID="9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a" Mar 16 13:38:10 crc kubenswrapper[5030]: E0316 13:38:10.653443 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a\": container with ID starting with 9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a not found: ID does not exist" containerID="9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.653520 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a"} err="failed to get container status \"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a\": rpc error: code = NotFound desc = could not find container \"9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a\": container with ID starting with 9f1a148a495b0e57508a15f414315e84b7f201a5b9bf4b92327caa153305d83a not found: ID does not exist" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.653543 5030 scope.go:117] "RemoveContainer" containerID="f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb" Mar 16 13:38:10 crc kubenswrapper[5030]: E0316 13:38:10.658897 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb\": container with ID starting with f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb not found: ID does not exist" containerID="f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.658924 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb"} err="failed to get container status \"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb\": rpc error: code = NotFound desc = could not find container \"f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb\": container with ID starting with f5e99ac01d81ed3162ad8f0c2e7056b8d39419331bd453ec81355866d5ae17fb not found: ID does not exist" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.658939 5030 scope.go:117] "RemoveContainer" containerID="fae7ed8acca861259d993aff4a47e78b8d77d7b5ea1f4dbc2ba10f1a51be5ea9" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.663815 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle\") pod \"c165722a-e0a3-424b-a423-244347ee7322\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.663884 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs\") pod \"c165722a-e0a3-424b-a423-244347ee7322\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.663958 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhgrw\" (UniqueName: \"kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw\") pod \"c165722a-e0a3-424b-a423-244347ee7322\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.664028 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data\") pod \"c165722a-e0a3-424b-a423-244347ee7322\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.664118 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs\") pod \"c165722a-e0a3-424b-a423-244347ee7322\" (UID: \"c165722a-e0a3-424b-a423-244347ee7322\") " Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.671403 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw" (OuterVolumeSpecName: "kube-api-access-mhgrw") pod "c165722a-e0a3-424b-a423-244347ee7322" (UID: "c165722a-e0a3-424b-a423-244347ee7322"). InnerVolumeSpecName "kube-api-access-mhgrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.694757 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data" (OuterVolumeSpecName: "config-data") pod "c165722a-e0a3-424b-a423-244347ee7322" (UID: "c165722a-e0a3-424b-a423-244347ee7322"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.696802 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c165722a-e0a3-424b-a423-244347ee7322" (UID: "c165722a-e0a3-424b-a423-244347ee7322"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.732331 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.732446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "c165722a-e0a3-424b-a423-244347ee7322" (UID: "c165722a-e0a3-424b-a423-244347ee7322"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.746327 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "c165722a-e0a3-424b-a423-244347ee7322" (UID: "c165722a-e0a3-424b-a423-244347ee7322"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.746918 5030 scope.go:117] "RemoveContainer" containerID="6bf0389c78a2b8389634fe9da023b9400cd16ef479dbd093526f22fa223a1840" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.751607 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.766277 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.770358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.770423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hww79\" (UniqueName: \"kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.773528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.773658 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.773695 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774040 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774144 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774166 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774186 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhgrw\" (UniqueName: \"kubernetes.io/projected/c165722a-e0a3-424b-a423-244347ee7322-kube-api-access-mhgrw\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774195 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.774203 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/c165722a-e0a3-424b-a423-244347ee7322-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.775576 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.775697 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.780987 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.781292 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.782698 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876090 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876199 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876370 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hww79\" (UniqueName: \"kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876437 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbp2\" (UniqueName: \"kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876586 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876616 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876681 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876777 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876929 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.876993 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.877025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.877142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.877196 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.877929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.889618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.890150 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.892369 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.895860 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hww79\" (UniqueName: \"kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.902699 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.972236 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.982728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.982799 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.982854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983009 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983127 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbp2\" (UniqueName: \"kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983180 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983198 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983227 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983255 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.983333 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.986121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.987487 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.988327 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.989282 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.990208 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.990960 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:10 crc kubenswrapper[5030]: I0316 13:38:10.991975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.000148 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbp2\" (UniqueName: \"kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2\") pod \"cinder-api-0\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.100084 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.339856 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.408788 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.423856 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerStarted","Data":"ed43192b8cbca8fef6755d6a03af2cc710aee5059ca87a053ad8a480f4a3cbd9"} Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.425186 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c165722a-e0a3-424b-a423-244347ee7322","Type":"ContainerDied","Data":"9d93b9f2bc8542d646d3c8d9c795ee74deff595835188194ea442601e5a7a6f9"} Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.425221 5030 scope.go:117] "RemoveContainer" containerID="1920b17ad1a7373929b4308b91df49b814dd898f9dc001dcea03364297c5cbca" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.425354 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.429301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerStarted","Data":"50fce317a19eb4796b9f1256ad5b65000fd157120978233360dca60c6a16c325"} Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.433276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerStarted","Data":"49e31db3de6d604f3e5767bf35f61f543b8e756e823cffa3a491e326b64e2ae1"} Mar 16 13:38:11 crc kubenswrapper[5030]: E0316 13:38:11.486376 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:11 crc kubenswrapper[5030]: E0316 13:38:11.488404 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:11 crc kubenswrapper[5030]: E0316 13:38:11.490721 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:11 crc kubenswrapper[5030]: E0316 13:38:11.490781 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.534230 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.562789 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.591271 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.596465 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.598808 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.598980 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.599127 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.611617 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.709797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlkc\" (UniqueName: \"kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.710020 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.710089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.710242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.710300 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.812463 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.812644 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.812711 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.812887 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlkc\" (UniqueName: \"kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.812950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.817636 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.818207 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.818537 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.818959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.832719 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlkc\" (UniqueName: \"kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc\") pod \"nova-cell1-novncproxy-0\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.934215 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.973714 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="580a4811-8d4a-4ea6-b645-5efc678daab6" path="/var/lib/kubelet/pods/580a4811-8d4a-4ea6-b645-5efc678daab6/volumes" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.974627 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c165722a-e0a3-424b-a423-244347ee7322" path="/var/lib/kubelet/pods/c165722a-e0a3-424b-a423-244347ee7322/volumes" Mar 16 13:38:11 crc kubenswrapper[5030]: I0316 13:38:11.975209 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78dfa17-ce3f-4361-b343-6dd551cee81b" path="/var/lib/kubelet/pods/c78dfa17-ce3f-4361-b343-6dd551cee81b/volumes" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.183436 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.205264 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.221602 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.235580 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.258298 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.270915 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.282460 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.289433 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.291646 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330167 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330215 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330240 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330463 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330635 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqtbs\" (UniqueName: \"kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.330977 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.331122 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2czj\" (UniqueName: \"kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.432726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2czj\" (UniqueName: \"kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.432783 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.432904 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433026 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433121 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433216 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433258 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433498 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433578 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9jv9\" (UniqueName: \"kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433618 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433644 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433716 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqtbs\" (UniqueName: \"kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.433739 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.435083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.444319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.444495 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.445372 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.447085 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.447103 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.450640 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.454821 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqtbs\" (UniqueName: \"kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs\") pod \"barbican-keystone-listener-79c486444b-pt4lm\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.457995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2czj\" (UniqueName: \"kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj\") pod \"barbican-worker-7b8f6cf599-dkxmd\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.510919 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.528834 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerStarted","Data":"9f1c121d9c2e7b9770e652dec8b3b2cc39b4e5b3da4d456409d14faaa1b5710d"} Mar 16 13:38:12 crc kubenswrapper[5030]: W0316 13:38:12.530188 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7539dd93_cdc3_43c8_88ce_8da150c32bed.slice/crio-6bbe975d0bee33a687942793a273fa0a70f889b0388bd3c36746715ad20b3d67 WatchSource:0}: Error finding container 6bbe975d0bee33a687942793a273fa0a70f889b0388bd3c36746715ad20b3d67: Status 404 returned error can't find the container with id 6bbe975d0bee33a687942793a273fa0a70f889b0388bd3c36746715ad20b3d67 Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.536065 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerStarted","Data":"e9626a5a686c0eeb1257a0eb46e6bda692a09f7c28d91d9d5a2af061889bc971"} Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537244 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9jv9\" (UniqueName: \"kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537459 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537569 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.537950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.538011 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.538601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.544972 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.549616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.550082 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerStarted","Data":"4073dd05b7a8e9ab5ed00fe9070a3acfaa56a0f619a49f98c3e154f93a68f359"} Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.552988 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.553539 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.556433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.563600 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.574003 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.579637 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9jv9\" (UniqueName: \"kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9\") pod \"barbican-api-68f7489858-zd25v\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.612940 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.889567 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:12 crc kubenswrapper[5030]: I0316 13:38:12.889987 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" gracePeriod=30 Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.101682 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": read tcp 10.217.0.2:38948->10.217.1.166:8775: read: connection reset by peer" Mar 16 13:38:13 crc kubenswrapper[5030]: E0316 13:38:13.204200 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode414ab06_97cb_4475_901d_fcdcc233c978.slice/crio-conmon-587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.205417 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.357820 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.383324 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.520025 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.563061 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.569650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.569700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqk2q\" (UniqueName: \"kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.569822 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.570001 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.570111 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle\") pod \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\" (UID: \"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9\") " Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.575335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs" (OuterVolumeSpecName: "logs") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.606689 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q" (OuterVolumeSpecName: "kube-api-access-sqk2q") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "kube-api-access-sqk2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.627991 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerStarted","Data":"5c2419b58e0d927085db71271e26d1258c32638a8878dbe7da195c26dc2adc13"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.636907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerStarted","Data":"02f5fc78f55f22ae4a37fc4f1f7f27bbc640c9208b6496ee3617f74ca211316c"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.663101 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerStarted","Data":"0c8307fa3b9529d4f72950ab858425c439c919e4512718d40ccdb54510d7aa12"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.668961 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.66894569 podStartE2EDuration="4.66894569s" podCreationTimestamp="2026-03-16 13:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:13.647477635 +0000 UTC m=+1938.046790182" watchObservedRunningTime="2026-03-16 13:38:13.66894569 +0000 UTC m=+1938.068258238" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.672532 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqk2q\" (UniqueName: \"kubernetes.io/projected/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-kube-api-access-sqk2q\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.672594 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.691255 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.691240722 podStartE2EDuration="4.691240722s" podCreationTimestamp="2026-03-16 13:38:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:13.690725263 +0000 UTC m=+1938.090037809" watchObservedRunningTime="2026-03-16 13:38:13.691240722 +0000 UTC m=+1938.090553269" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.692135 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerStarted","Data":"22a5075a6d290e8de49a39a24a673979bf17640c2aa045ab88b4f001bc597e45"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.697255 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7539dd93-cdc3-43c8-88ce-8da150c32bed","Type":"ContainerStarted","Data":"98128b1da15f33cbd3b8eebee958aff66e54e0091a739eee794a2009335c1b67"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.697290 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7539dd93-cdc3-43c8-88ce-8da150c32bed","Type":"ContainerStarted","Data":"6bbe975d0bee33a687942793a273fa0a70f889b0388bd3c36746715ad20b3d67"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.699453 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data" (OuterVolumeSpecName: "config-data") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.711921 5030 generic.go:358] "Generic (PLEG): container finished" podID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerID="d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7" exitCode=0 Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.712386 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerDied","Data":"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.712433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"f1ce86d2-7cfe-4352-9502-c2e47aedb7f9","Type":"ContainerDied","Data":"77d9e32d30be28ab1bf6f9fb0daa5cf9165a7891587c3292299ce5f241504d29"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.712478 5030 scope.go:117] "RemoveContainer" containerID="d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.713722 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.720982 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.719419886 podStartE2EDuration="2.719419886s" podCreationTimestamp="2026-03-16 13:38:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:13.713352528 +0000 UTC m=+1938.112665085" watchObservedRunningTime="2026-03-16 13:38:13.719419886 +0000 UTC m=+1938.118732433" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.726929 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerStarted","Data":"7e6f2aaaeadab066f1257f8b16dde1588b22312fc718277ca639a62da375ea1a"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.732286 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerStarted","Data":"704a95b43b7acddabb31141611bb5370014f280d2882a1e4e5a085455d0b8744"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.739015 5030 generic.go:358] "Generic (PLEG): container finished" podID="e414ab06-97cb-4475-901d-fcdcc233c978" containerID="587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193" exitCode=0 Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.739169 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerDied","Data":"587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.743669 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerStarted","Data":"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3"} Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.774709 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:13 crc kubenswrapper[5030]: E0316 13:38:13.783089 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:13 crc kubenswrapper[5030]: E0316 13:38:13.785356 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:13 crc kubenswrapper[5030]: E0316 13:38:13.801284 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:13 crc kubenswrapper[5030]: E0316 13:38:13.801323 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.866840 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.877358 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.883627 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.884044 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" (UID: "f1ce86d2-7cfe-4352-9502-c2e47aedb7f9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.980336 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:13 crc kubenswrapper[5030]: I0316 13:38:13.980362 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.016681 5030 scope.go:117] "RemoveContainer" containerID="c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.037018 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.064860 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.085238 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hpzs\" (UniqueName: \"kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs\") pod \"e414ab06-97cb-4475-901d-fcdcc233c978\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.085289 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data\") pod \"e414ab06-97cb-4475-901d-fcdcc233c978\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.085459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs\") pod \"e414ab06-97cb-4475-901d-fcdcc233c978\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.085738 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle\") pod \"e414ab06-97cb-4475-901d-fcdcc233c978\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.085773 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs\") pod \"e414ab06-97cb-4475-901d-fcdcc233c978\" (UID: \"e414ab06-97cb-4475-901d-fcdcc233c978\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.091207 5030 scope.go:117] "RemoveContainer" containerID="d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.091681 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.092149 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs" (OuterVolumeSpecName: "kube-api-access-2hpzs") pod "e414ab06-97cb-4475-901d-fcdcc233c978" (UID: "e414ab06-97cb-4475-901d-fcdcc233c978"). InnerVolumeSpecName "kube-api-access-2hpzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.097663 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7\": container with ID starting with d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7 not found: ID does not exist" containerID="d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.097711 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7"} err="failed to get container status \"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7\": rpc error: code = NotFound desc = could not find container \"d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7\": container with ID starting with d4cce923d9ee01805da579f36755abe34451db6ba950c60746a2faeb7aaf4ca7 not found: ID does not exist" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.097735 5030 scope.go:117] "RemoveContainer" containerID="c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d" Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.100685 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d\": container with ID starting with c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d not found: ID does not exist" containerID="c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.100721 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d"} err="failed to get container status \"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d\": rpc error: code = NotFound desc = could not find container \"c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d\": container with ID starting with c8cb70f4d70c1caa80957c1fe3372333577542277ecb661f6f4fdc4f46acc19d not found: ID does not exist" Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.106627 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.109501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs" (OuterVolumeSpecName: "logs") pod "e414ab06-97cb-4475-901d-fcdcc233c978" (UID: "e414ab06-97cb-4475-901d-fcdcc233c978"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.110416 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.112251 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.112319 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.119497 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146458 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146493 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146684 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146693 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146703 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-api" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146708 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-api" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146762 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.146769 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.147514 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.147564 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-metadata" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.147586 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" containerName="nova-api-api" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.147606 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.165680 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.172854 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.180510 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.180880 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.201241 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hpzs\" (UniqueName: \"kubernetes.io/projected/e414ab06-97cb-4475-901d-fcdcc233c978-kube-api-access-2hpzs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.201268 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e414ab06-97cb-4475-901d-fcdcc233c978-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.218419 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.228055 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e414ab06-97cb-4475-901d-fcdcc233c978" (UID: "e414ab06-97cb-4475-901d-fcdcc233c978"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.268020 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e414ab06-97cb-4475-901d-fcdcc233c978" (UID: "e414ab06-97cb-4475-901d-fcdcc233c978"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.271936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data" (OuterVolumeSpecName: "config-data") pod "e414ab06-97cb-4475-901d-fcdcc233c978" (UID: "e414ab06-97cb-4475-901d-fcdcc233c978"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305339 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305418 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305456 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305525 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305621 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gvc\" (UniqueName: \"kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.305758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.306233 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.306270 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.306288 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e414ab06-97cb-4475-901d-fcdcc233c978-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.361818 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.407412 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle\") pod \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.407456 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data\") pod \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.407544 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdhp\" (UniqueName: \"kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp\") pod \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\" (UID: \"eba8bb89-a3b3-47bb-bb3e-13837d508c4b\") " Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.407946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.408017 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.408073 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.408105 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.408134 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.408151 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gvc\" (UniqueName: \"kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.419139 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.419609 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.436043 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.436723 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp" (OuterVolumeSpecName: "kube-api-access-cmdhp") pod "eba8bb89-a3b3-47bb-bb3e-13837d508c4b" (UID: "eba8bb89-a3b3-47bb-bb3e-13837d508c4b"). InnerVolumeSpecName "kube-api-access-cmdhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.452922 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.453009 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.460860 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gvc\" (UniqueName: \"kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc\") pod \"nova-api-0\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.495275 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.511934 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdhp\" (UniqueName: \"kubernetes.io/projected/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-kube-api-access-cmdhp\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.512855 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eba8bb89-a3b3-47bb-bb3e-13837d508c4b" (UID: "eba8bb89-a3b3-47bb-bb3e-13837d508c4b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.524789 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data" (OuterVolumeSpecName: "config-data") pod "eba8bb89-a3b3-47bb-bb3e-13837d508c4b" (UID: "eba8bb89-a3b3-47bb-bb3e-13837d508c4b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.617595 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.617625 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eba8bb89-a3b3-47bb-bb3e-13837d508c4b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.791859 5030 generic.go:358] "Generic (PLEG): container finished" podID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" exitCode=0 Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.791951 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.791968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eba8bb89-a3b3-47bb-bb3e-13837d508c4b","Type":"ContainerDied","Data":"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.793676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eba8bb89-a3b3-47bb-bb3e-13837d508c4b","Type":"ContainerDied","Data":"3e68428f79ddbc39e06e0bb83a83a43148621a42464f4aa086fbb8424090abee"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.793711 5030 scope.go:117] "RemoveContainer" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.814095 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerStarted","Data":"519dbc57c2672d004f4a13b9360369a5ec04556d1594375893b223094bdef83a"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.815792 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerStarted","Data":"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.817821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e414ab06-97cb-4475-901d-fcdcc233c978","Type":"ContainerDied","Data":"bc6f25b57fa64c58bd95e656b11eeae4d2ff8aafee66e0d08d5135ceac5f366e"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.817932 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.821044 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerStarted","Data":"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.830474 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerID="5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" exitCode=0 Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.830610 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68","Type":"ContainerDied","Data":"5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.832161 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerStarted","Data":"241ed8aad54cd5abf2054349eae6ed6953071a6fb197aabd41df12342879c0a9"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.832236 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerStarted","Data":"b6499ad77d8cd643ed391f4019b7ccbe313a0f133463cdf3a7817461b0bc0bad"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.832609 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.832641 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.837984 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerStarted","Data":"09eb367841b2498ede5a4ecf8efaf6ea531864d540dfaec3827bc4dcd01cbd18"} Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.853308 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.855399 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.85538483 podStartE2EDuration="4.85538483s" podCreationTimestamp="2026-03-16 13:38:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:14.836457352 +0000 UTC m=+1939.235769899" watchObservedRunningTime="2026-03-16 13:38:14.85538483 +0000 UTC m=+1939.254697377" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.861656 5030 scope.go:117] "RemoveContainer" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" Mar 16 13:38:14 crc kubenswrapper[5030]: E0316 13:38:14.874692 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2\": container with ID starting with af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2 not found: ID does not exist" containerID="af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.874729 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2"} err="failed to get container status \"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2\": rpc error: code = NotFound desc = could not find container \"af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2\": container with ID starting with af623b924c641d764d75216b7f66500858dc2040c23102630ebcb1af301200e2 not found: ID does not exist" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.874749 5030 scope.go:117] "RemoveContainer" containerID="587059f335761394d7445d2be68abd134d1f8361b7818fc5a865942b98307193" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.906716 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podStartSLOduration=2.90669614 podStartE2EDuration="2.90669614s" podCreationTimestamp="2026-03-16 13:38:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:14.880841175 +0000 UTC m=+1939.280153722" watchObservedRunningTime="2026-03-16 13:38:14.90669614 +0000 UTC m=+1939.306008687" Mar 16 13:38:14 crc kubenswrapper[5030]: I0316 13:38:14.982602 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.021829 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.031597 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.065770 5030 scope.go:117] "RemoveContainer" containerID="d5d1bf6659b995933811c79129f6414f68cc82c7d4909d695466a9be3327fccf" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.107361 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.108597 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerName="nova-scheduler-scheduler" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.108620 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerName="nova-scheduler-scheduler" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.108837 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" containerName="nova-scheduler-scheduler" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.116671 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.122707 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.131988 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.137631 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.184598 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.217731 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.217755 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=5.217736187 podStartE2EDuration="5.217736187s" podCreationTimestamp="2026-03-16 13:38:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:15.082653115 +0000 UTC m=+1939.481965662" watchObservedRunningTime="2026-03-16 13:38:15.217736187 +0000 UTC m=+1939.617048735" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.218942 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.218964 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.219221 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.236930 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.240466 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data\") pod \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.240589 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb4jt\" (UniqueName: \"kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt\") pod \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.240611 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle\") pod \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\" (UID: \"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.240825 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.241098 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.241236 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.241362 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5fqw\" (UniqueName: \"kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.241396 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: W0316 13:38:15.248026 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaddecf4e_78dc_4422_a876_fb21680aff5e.slice/crio-893e7fe6b3ce94bb88ab1d381869b12247c8e67a923b1c17702180df2631430b WatchSource:0}: Error finding container 893e7fe6b3ce94bb88ab1d381869b12247c8e67a923b1c17702180df2631430b: Status 404 returned error can't find the container with id 893e7fe6b3ce94bb88ab1d381869b12247c8e67a923b1c17702180df2631430b Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.254018 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.263793 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt" (OuterVolumeSpecName: "kube-api-access-qb4jt") pod "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" (UID: "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68"). InnerVolumeSpecName "kube-api-access-qb4jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.274726 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" (UID: "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.301245 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.312902 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data" (OuterVolumeSpecName: "config-data") pod "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" (UID: "b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.352800 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5fqw\" (UniqueName: \"kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353107 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353156 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353246 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353390 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgn2n\" (UniqueName: \"kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353455 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353621 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353743 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb4jt\" (UniqueName: \"kubernetes.io/projected/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-kube-api-access-qb4jt\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353759 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.353770 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.359089 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.361815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.371251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5fqw\" (UniqueName: \"kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw\") pod \"nova-scheduler-0\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.473953 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.474046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgn2n\" (UniqueName: \"kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.474082 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.474108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.474218 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.478991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.479313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.483011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.488795 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.497008 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgn2n\" (UniqueName: \"kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.508256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data\") pod \"nova-metadata-0\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.515021 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.515355 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-central-agent" containerID="cri-o://d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" gracePeriod=30 Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.515894 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="proxy-httpd" containerID="cri-o://7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" gracePeriod=30 Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.515964 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="sg-core" containerID="cri-o://4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" gracePeriod=30 Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.516001 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-notification-agent" containerID="cri-o://95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" gracePeriod=30 Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.597792 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.887119 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerStarted","Data":"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb"} Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.887594 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerStarted","Data":"893e7fe6b3ce94bb88ab1d381869b12247c8e67a923b1c17702180df2631430b"} Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.930942 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerStarted","Data":"0a90c20fc66169b4e72b39bb97edb491201a4d9960ffdc66eb03dc9956283d21"} Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.931109 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.984306 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" path="/var/lib/kubelet/pods/e414ab06-97cb-4475-901d-fcdcc233c978/volumes" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.986123 5030 generic.go:358] "Generic (PLEG): container finished" podID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerID="96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" exitCode=0 Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.986269 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.986452 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eba8bb89-a3b3-47bb-bb3e-13837d508c4b" path="/var/lib/kubelet/pods/eba8bb89-a3b3-47bb-bb3e-13837d508c4b/volumes" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.987388 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ce86d2-7cfe-4352-9502-c2e47aedb7f9" path="/var/lib/kubelet/pods/f1ce86d2-7cfe-4352-9502-c2e47aedb7f9/volumes" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.987832 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle\") pod \"25f0f5cd-e5d8-420c-a704-93d13a892da7\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.988040 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data\") pod \"25f0f5cd-e5d8-420c-a704-93d13a892da7\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.988215 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfk6v\" (UniqueName: \"kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v\") pod \"25f0f5cd-e5d8-420c-a704-93d13a892da7\" (UID: \"25f0f5cd-e5d8-420c-a704-93d13a892da7\") " Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.992209 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.992246 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v" (OuterVolumeSpecName: "kube-api-access-lfk6v") pod "25f0f5cd-e5d8-420c-a704-93d13a892da7" (UID: "25f0f5cd-e5d8-420c-a704-93d13a892da7"). InnerVolumeSpecName "kube-api-access-lfk6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.992246 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerStarted","Data":"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16"} Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.992301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"25f0f5cd-e5d8-420c-a704-93d13a892da7","Type":"ContainerDied","Data":"96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b"} Mar 16 13:38:15 crc kubenswrapper[5030]: I0316 13:38:15.992330 5030 scope.go:117] "RemoveContainer" containerID="96f0acae999b61587562e49cfc0ef4af0a159068ef1870ae6e729f9c98ecc86b" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.021851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25f0f5cd-e5d8-420c-a704-93d13a892da7" (UID: "25f0f5cd-e5d8-420c-a704-93d13a892da7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.024155 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data" (OuterVolumeSpecName: "config-data") pod "25f0f5cd-e5d8-420c-a704-93d13a892da7" (UID: "25f0f5cd-e5d8-420c-a704-93d13a892da7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.026706 5030 generic.go:358] "Generic (PLEG): container finished" podID="f890e750-60d2-4d91-bc23-a27f011de88e" containerID="7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" exitCode=0 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.026851 5030 generic.go:358] "Generic (PLEG): container finished" podID="f890e750-60d2-4d91-bc23-a27f011de88e" containerID="4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" exitCode=2 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.026918 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerDied","Data":"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd"} Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.026985 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerDied","Data":"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42"} Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.036270 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.038540 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68","Type":"ContainerDied","Data":"1ee250b2b63021df5e4cc5fa9c781aad6768f7568903f7add91e68ed99a59aa9"} Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.097723 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.097862 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25f0f5cd-e5d8-420c-a704-93d13a892da7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.097953 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfk6v\" (UniqueName: \"kubernetes.io/projected/25f0f5cd-e5d8-420c-a704-93d13a892da7-kube-api-access-lfk6v\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.109644 5030 scope.go:117] "RemoveContainer" containerID="5338fc6011d5d6b3d83fd1a3c5c21283163890be416e3805e6b3c4add7cad70e" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.141610 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.144074 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" podStartSLOduration=4.144051535 podStartE2EDuration="4.144051535s" podCreationTimestamp="2026-03-16 13:38:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:16.061892033 +0000 UTC m=+1940.461204580" watchObservedRunningTime="2026-03-16 13:38:16.144051535 +0000 UTC m=+1940.543364082" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.166616 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.166955 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener-log" containerID="cri-o://7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb" gracePeriod=30 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.167106 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener" containerID="cri-o://1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377" gracePeriod=30 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.190404 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" podStartSLOduration=4.190381518 podStartE2EDuration="4.190381518s" podCreationTimestamp="2026-03-16 13:38:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:16.089297242 +0000 UTC m=+1940.488609790" watchObservedRunningTime="2026-03-16 13:38:16.190381518 +0000 UTC m=+1940.589694065" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.215191 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.237410 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.265607 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.265931 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker-log" containerID="cri-o://8801f5a43490c7b8a04b01a44b494173f4d4b975c3ecf0ec6b33ca607e759078" gracePeriod=30 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.266481 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker" containerID="cri-o://b9e1bd3cd0e9abd3563b451f64482fc7d0cfda8e03a8eaedc0eedecfd5a3f657" gracePeriod=30 Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.277043 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.278369 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerName="nova-cell1-conductor-conductor" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.278389 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerName="nova-cell1-conductor-conductor" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.278599 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" containerName="nova-cell1-conductor-conductor" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.282801 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.289329 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.302945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vjbl\" (UniqueName: \"kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.303242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.303344 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.306742 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.318713 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.407743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjbl\" (UniqueName: \"kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.411903 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.413471 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.421761 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.439748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.445104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vjbl\" (UniqueName: \"kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl\") pod \"nova-cell0-conductor-0\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.513335 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.534897 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.550646 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.559032 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.585960 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.586284 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.589697 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.616436 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.616581 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx9k8\" (UniqueName: \"kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.616631 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.720701 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.721281 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx9k8\" (UniqueName: \"kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.721402 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.721592 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.726067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.734716 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.739641 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx9k8\" (UniqueName: \"kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8\") pod \"nova-cell1-conductor-0\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.824673 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.824960 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825001 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqgfw\" (UniqueName: \"kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825146 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825654 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825688 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.825742 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts\") pod \"f890e750-60d2-4d91-bc23-a27f011de88e\" (UID: \"f890e750-60d2-4d91-bc23-a27f011de88e\") " Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.826404 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.826964 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.840366 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw" (OuterVolumeSpecName: "kube-api-access-jqgfw") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "kube-api-access-jqgfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.841236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts" (OuterVolumeSpecName: "scripts") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.860145 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.909966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928054 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928071 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928080 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928091 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928099 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f890e750-60d2-4d91-bc23-a27f011de88e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.928109 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqgfw\" (UniqueName: \"kubernetes.io/projected/f890e750-60d2-4d91-bc23-a27f011de88e-kube-api-access-jqgfw\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.932800 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.934658 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.964341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data" (OuterVolumeSpecName: "config-data") pod "f890e750-60d2-4d91-bc23-a27f011de88e" (UID: "f890e750-60d2-4d91-bc23-a27f011de88e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:16 crc kubenswrapper[5030]: I0316 13:38:16.995603 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.030525 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.030579 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f890e750-60d2-4d91-bc23-a27f011de88e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.046861 5030 generic.go:358] "Generic (PLEG): container finished" podID="f890e750-60d2-4d91-bc23-a27f011de88e" containerID="95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" exitCode=0 Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.046887 5030 generic.go:358] "Generic (PLEG): container finished" podID="f890e750-60d2-4d91-bc23-a27f011de88e" containerID="d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" exitCode=0 Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.046977 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerDied","Data":"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.047000 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerDied","Data":"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.047012 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f890e750-60d2-4d91-bc23-a27f011de88e","Type":"ContainerDied","Data":"4fb6c5720304640a562a4f8f742d23fe1f7fbd4a457a4e88fb08738beb89ad3b"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.047028 5030 scope.go:117] "RemoveContainer" containerID="7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.047144 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.051929 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1","Type":"ContainerStarted","Data":"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.051978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1","Type":"ContainerStarted","Data":"dc35bf10d7fcc33c863e043847a8f0926a5e5585aae92f6404a237972486124d"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.090073 5030 scope.go:117] "RemoveContainer" containerID="4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.093287 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerStarted","Data":"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.093320 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerStarted","Data":"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.093332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerStarted","Data":"d55848d2a4f9713107e0f94fd3bb95204abe11aa3de7cee0cc2d58b5af369d13"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.089454 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=3.08943666 podStartE2EDuration="3.08943666s" podCreationTimestamp="2026-03-16 13:38:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:17.073068443 +0000 UTC m=+1941.472380989" watchObservedRunningTime="2026-03-16 13:38:17.08943666 +0000 UTC m=+1941.488749206" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.118131 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerID="7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb" exitCode=143 Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.118281 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerDied","Data":"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.121133 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerStarted","Data":"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.128506 5030 scope.go:117] "RemoveContainer" containerID="95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.132974 5030 generic.go:358] "Generic (PLEG): container finished" podID="819ff46c-d925-4502-894d-9d461b8e0390" containerID="8801f5a43490c7b8a04b01a44b494173f4d4b975c3ecf0ec6b33ca607e759078" exitCode=143 Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.133668 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerDied","Data":"8801f5a43490c7b8a04b01a44b494173f4d4b975c3ecf0ec6b33ca607e759078"} Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.141731 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.153475 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.162313 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.171638 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173026 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-central-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173051 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-central-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173092 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-notification-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173097 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-notification-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173132 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="sg-core" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173138 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="sg-core" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173148 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="proxy-httpd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173154 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="proxy-httpd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173368 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="proxy-httpd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173391 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="sg-core" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173398 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-notification-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.173409 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" containerName="ceilometer-central-agent" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.184191 5030 scope.go:117] "RemoveContainer" containerID="d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.185008 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.184988362 podStartE2EDuration="3.184988362s" podCreationTimestamp="2026-03-16 13:38:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:17.132392077 +0000 UTC m=+1941.531704624" watchObservedRunningTime="2026-03-16 13:38:17.184988362 +0000 UTC m=+1941.584300908" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.187089 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.187220 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.188818 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.188807713 podStartE2EDuration="3.188807713s" podCreationTimestamp="2026-03-16 13:38:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:17.157381814 +0000 UTC m=+1941.556694360" watchObservedRunningTime="2026-03-16 13:38:17.188807713 +0000 UTC m=+1941.588120260" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.200521 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.201039 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.205718 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.212770 5030 scope.go:117] "RemoveContainer" containerID="7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" Mar 16 13:38:17 crc kubenswrapper[5030]: E0316 13:38:17.213257 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd\": container with ID starting with 7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd not found: ID does not exist" containerID="7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.213326 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd"} err="failed to get container status \"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd\": rpc error: code = NotFound desc = could not find container \"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd\": container with ID starting with 7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.213355 5030 scope.go:117] "RemoveContainer" containerID="4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" Mar 16 13:38:17 crc kubenswrapper[5030]: E0316 13:38:17.214503 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42\": container with ID starting with 4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42 not found: ID does not exist" containerID="4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.214573 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42"} err="failed to get container status \"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42\": rpc error: code = NotFound desc = could not find container \"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42\": container with ID starting with 4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42 not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.214603 5030 scope.go:117] "RemoveContainer" containerID="95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" Mar 16 13:38:17 crc kubenswrapper[5030]: E0316 13:38:17.215967 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e\": container with ID starting with 95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e not found: ID does not exist" containerID="95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.216043 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e"} err="failed to get container status \"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e\": rpc error: code = NotFound desc = could not find container \"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e\": container with ID starting with 95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.216076 5030 scope.go:117] "RemoveContainer" containerID="d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" Mar 16 13:38:17 crc kubenswrapper[5030]: E0316 13:38:17.218380 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae\": container with ID starting with d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae not found: ID does not exist" containerID="d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.218418 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae"} err="failed to get container status \"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae\": rpc error: code = NotFound desc = could not find container \"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae\": container with ID starting with d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.218438 5030 scope.go:117] "RemoveContainer" containerID="7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.218855 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd"} err="failed to get container status \"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd\": rpc error: code = NotFound desc = could not find container \"7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd\": container with ID starting with 7eac17ce492a94ddd9fc8b12a746caec3f85b43790752133e50bfd1ba39afddd not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.218880 5030 scope.go:117] "RemoveContainer" containerID="4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.219312 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42"} err="failed to get container status \"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42\": rpc error: code = NotFound desc = could not find container \"4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42\": container with ID starting with 4f8dde870e1428d9f56a63adab62c52fdf72a7fb66cb960c81454e8d4275dd42 not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.219374 5030 scope.go:117] "RemoveContainer" containerID="95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.223637 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e"} err="failed to get container status \"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e\": rpc error: code = NotFound desc = could not find container \"95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e\": container with ID starting with 95b924defd42795ab3aa6460c1a1a30b7820ab6e461ca9ed6ab5c9f96d3c9d9e not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.223680 5030 scope.go:117] "RemoveContainer" containerID="d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.225506 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae"} err="failed to get container status \"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae\": rpc error: code = NotFound desc = could not find container \"d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae\": container with ID starting with d8130e3a077f53f3de89567bc1c79c3aa5ec1cdf03952cfd1d8db22cde8aa0ae not found: ID does not exist" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.249704 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.252985 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253180 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253294 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253371 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dst4g\" (UniqueName: \"kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253661 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253735 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.253856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356774 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356828 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356857 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dst4g\" (UniqueName: \"kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356936 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356952 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.356975 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.357028 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.357081 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.357472 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.357777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.361059 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.365104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.367206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.370220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.370916 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.371736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dst4g\" (UniqueName: \"kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g\") pod \"ceilometer-0\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.408471 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.418041 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.446603 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459371 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4bqb\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459759 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459813 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459862 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.459882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.518954 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.521191 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562169 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562240 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562286 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562345 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562366 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562409 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.562452 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4bqb\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.563051 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.568227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.569977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.570853 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.571133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.572814 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.577155 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.579537 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4bqb\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb\") pod \"swift-proxy-6984b7d5d-f7h69\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.753154 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:17 crc kubenswrapper[5030]: W0316 13:38:17.763706 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded0af7fe_6ff3_48a8_8813_1b07cf66ac38.slice/crio-2d2d4141d8b0609a8689581a9f04bfe4971f8d5da84d287522e377f62b974fcb WatchSource:0}: Error finding container 2d2d4141d8b0609a8689581a9f04bfe4971f8d5da84d287522e377f62b974fcb: Status 404 returned error can't find the container with id 2d2d4141d8b0609a8689581a9f04bfe4971f8d5da84d287522e377f62b974fcb Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.769230 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.892918 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.964077 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25f0f5cd-e5d8-420c-a704-93d13a892da7" path="/var/lib/kubelet/pods/25f0f5cd-e5d8-420c-a704-93d13a892da7/volumes" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.964856 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68" path="/var/lib/kubelet/pods/b9d73e6f-f428-4d46-8fc0-4c9ac5cd7d68/volumes" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.965344 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f890e750-60d2-4d91-bc23-a27f011de88e" path="/var/lib/kubelet/pods/f890e750-60d2-4d91-bc23-a27f011de88e/volumes" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.973390 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle\") pod \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.973442 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdzpp\" (UniqueName: \"kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp\") pod \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.973464 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data\") pod \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.973481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom\") pod \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.973743 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs\") pod \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\" (UID: \"2c052399-a0ea-4c39-ba2d-bbdfc52471a2\") " Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.974493 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs" (OuterVolumeSpecName: "logs") pod "2c052399-a0ea-4c39-ba2d-bbdfc52471a2" (UID: "2c052399-a0ea-4c39-ba2d-bbdfc52471a2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.986011 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp" (OuterVolumeSpecName: "kube-api-access-wdzpp") pod "2c052399-a0ea-4c39-ba2d-bbdfc52471a2" (UID: "2c052399-a0ea-4c39-ba2d-bbdfc52471a2"). InnerVolumeSpecName "kube-api-access-wdzpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:17 crc kubenswrapper[5030]: I0316 13:38:17.986365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2c052399-a0ea-4c39-ba2d-bbdfc52471a2" (UID: "2c052399-a0ea-4c39-ba2d-bbdfc52471a2"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.011656 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2c052399-a0ea-4c39-ba2d-bbdfc52471a2" (UID: "2c052399-a0ea-4c39-ba2d-bbdfc52471a2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.013009 5030 scope.go:117] "RemoveContainer" containerID="a26b9e9da454d6eca51cbe99bcca6a3a822aa0352b903441f1cfbcdfe1a58adf" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.043861 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data" (OuterVolumeSpecName: "config-data") pod "2c052399-a0ea-4c39-ba2d-bbdfc52471a2" (UID: "2c052399-a0ea-4c39-ba2d-bbdfc52471a2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.079753 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.079782 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdzpp\" (UniqueName: \"kubernetes.io/projected/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-kube-api-access-wdzpp\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.079793 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.079802 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.079810 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2c052399-a0ea-4c39-ba2d-bbdfc52471a2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.151030 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerStarted","Data":"2d2d4141d8b0609a8689581a9f04bfe4971f8d5da84d287522e377f62b974fcb"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.152941 5030 generic.go:358] "Generic (PLEG): container finished" podID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerID="1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377" exitCode=0 Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.153035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerDied","Data":"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.153052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" event={"ID":"2c052399-a0ea-4c39-ba2d-bbdfc52471a2","Type":"ContainerDied","Data":"963a6e4e0363941712cabc3078fbfcaa7bb66625d5c9aba8c555da92d8d53757"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.153072 5030 scope.go:117] "RemoveContainer" containerID="1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.153206 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.178266 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"b950ae83-00a2-4a07-b2f7-674ccfda4f65","Type":"ContainerStarted","Data":"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.178368 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"b950ae83-00a2-4a07-b2f7-674ccfda4f65","Type":"ContainerStarted","Data":"852ffe330bc6e8dea8be017a5d621d0cd270fdb478bb3097458309a933b36232"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.178897 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.188050 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5ba7b63-0221-4f46-a2c5-c7cb81849527","Type":"ContainerStarted","Data":"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.188094 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.188104 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5ba7b63-0221-4f46-a2c5-c7cb81849527","Type":"ContainerStarted","Data":"6492e8b860b710d5db3a818ccdff6ec9d8e84f324fad87972d5fea29925c266b"} Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.192913 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.199231 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-qxhc7"] Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.201027 5030 scope.go:117] "RemoveContainer" containerID="7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.203447 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.203435371 podStartE2EDuration="2.203435371s" podCreationTimestamp="2026-03-16 13:38:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:18.201140456 +0000 UTC m=+1942.600453003" watchObservedRunningTime="2026-03-16 13:38:18.203435371 +0000 UTC m=+1942.602747938" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.226766 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.226753797 podStartE2EDuration="2.226753797s" podCreationTimestamp="2026-03-16 13:38:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:18.214097559 +0000 UTC m=+1942.613410106" watchObservedRunningTime="2026-03-16 13:38:18.226753797 +0000 UTC m=+1942.626066343" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.239765 5030 scope.go:117] "RemoveContainer" containerID="1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377" Mar 16 13:38:18 crc kubenswrapper[5030]: E0316 13:38:18.240724 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377\": container with ID starting with 1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377 not found: ID does not exist" containerID="1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.240772 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377"} err="failed to get container status \"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377\": rpc error: code = NotFound desc = could not find container \"1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377\": container with ID starting with 1a4bf7f686df90895b53bca25271ac824d29f9939e022b8bea069ab774936377 not found: ID does not exist" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.240803 5030 scope.go:117] "RemoveContainer" containerID="7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb" Mar 16 13:38:18 crc kubenswrapper[5030]: E0316 13:38:18.241116 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb\": container with ID starting with 7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb not found: ID does not exist" containerID="7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.241151 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb"} err="failed to get container status \"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb\": rpc error: code = NotFound desc = could not find container \"7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb\": container with ID starting with 7f09bbe14ff6c9cb7b59c78b901bab3ac964c0656f99852782df100c5c3e54bb not found: ID does not exist" Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.271292 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:18 crc kubenswrapper[5030]: W0316 13:38:18.297808 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7870762_c567_4da0_b9bd_785c76c82749.slice/crio-1bcad3871c137a99a94badccf85b1ddd1733a980ccb768b55590677af02defb6 WatchSource:0}: Error finding container 1bcad3871c137a99a94badccf85b1ddd1733a980ccb768b55590677af02defb6: Status 404 returned error can't find the container with id 1bcad3871c137a99a94badccf85b1ddd1733a980ccb768b55590677af02defb6 Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.580401 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.581002 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-log" containerID="cri-o://4073dd05b7a8e9ab5ed00fe9070a3acfaa56a0f619a49f98c3e154f93a68f359" gracePeriod=30 Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.581454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-httpd" containerID="cri-o://5c2419b58e0d927085db71271e26d1258c32638a8878dbe7da195c26dc2adc13" gracePeriod=30 Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.630405 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.630682 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-log" containerID="cri-o://9f1c121d9c2e7b9770e652dec8b3b2cc39b4e5b3da4d456409d14faaa1b5710d" gracePeriod=30 Mar 16 13:38:18 crc kubenswrapper[5030]: I0316 13:38:18.631766 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-httpd" containerID="cri-o://0c8307fa3b9529d4f72950ab858425c439c919e4512718d40ccdb54510d7aa12" gracePeriod=30 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.218069 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerStarted","Data":"6adefe51f73c5c07b1d81b5ed830836b42dc64c15523f5c08416edbfb39ee8cf"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.218535 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerStarted","Data":"1bcad3871c137a99a94badccf85b1ddd1733a980ccb768b55590677af02defb6"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.220809 5030 generic.go:358] "Generic (PLEG): container finished" podID="819ff46c-d925-4502-894d-9d461b8e0390" containerID="b9e1bd3cd0e9abd3563b451f64482fc7d0cfda8e03a8eaedc0eedecfd5a3f657" exitCode=0 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.221044 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerDied","Data":"b9e1bd3cd0e9abd3563b451f64482fc7d0cfda8e03a8eaedc0eedecfd5a3f657"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.222785 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerID="5c2419b58e0d927085db71271e26d1258c32638a8878dbe7da195c26dc2adc13" exitCode=0 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.222804 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerID="4073dd05b7a8e9ab5ed00fe9070a3acfaa56a0f619a49f98c3e154f93a68f359" exitCode=143 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.222946 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerDied","Data":"5c2419b58e0d927085db71271e26d1258c32638a8878dbe7da195c26dc2adc13"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.222967 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerDied","Data":"4073dd05b7a8e9ab5ed00fe9070a3acfaa56a0f619a49f98c3e154f93a68f359"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.224113 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerStarted","Data":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.226200 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerID="0c8307fa3b9529d4f72950ab858425c439c919e4512718d40ccdb54510d7aa12" exitCode=0 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.226212 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerID="9f1c121d9c2e7b9770e652dec8b3b2cc39b4e5b3da4d456409d14faaa1b5710d" exitCode=143 Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.226648 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerDied","Data":"0c8307fa3b9529d4f72950ab858425c439c919e4512718d40ccdb54510d7aa12"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.226699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerDied","Data":"9f1c121d9c2e7b9770e652dec8b3b2cc39b4e5b3da4d456409d14faaa1b5710d"} Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.391146 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.422649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.422775 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.422827 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.423000 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.423026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwsnb\" (UniqueName: \"kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.423048 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.423155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.423237 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs\") pod \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\" (UID: \"f0d9516c-019b-4c79-8cdd-3931b0e66bc6\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.424446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs" (OuterVolumeSpecName: "logs") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.424597 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.430885 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.431145 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts" (OuterVolumeSpecName: "scripts") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.433696 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb" (OuterVolumeSpecName: "kube-api-access-lwsnb") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "kube-api-access-lwsnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.436221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.457576 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.482168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530041 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530094 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwsnb\" (UniqueName: \"kubernetes.io/projected/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-kube-api-access-lwsnb\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530109 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530150 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530163 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.530179 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.537357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data" (OuterVolumeSpecName: "config-data") pod "f0d9516c-019b-4c79-8cdd-3931b0e66bc6" (UID: "f0d9516c-019b-4c79-8cdd-3931b0e66bc6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.564811 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.633234 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.633493 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f0d9516c-019b-4c79-8cdd-3931b0e66bc6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.688989 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.718563 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736424 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736747 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs\") pod \"819ff46c-d925-4502-894d-9d461b8e0390\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736790 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom\") pod \"819ff46c-d925-4502-894d-9d461b8e0390\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736878 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.736972 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-659nx\" (UniqueName: \"kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737083 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle\") pod \"819ff46c-d925-4502-894d-9d461b8e0390\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737226 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zprnb\" (UniqueName: \"kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb\") pod \"819ff46c-d925-4502-894d-9d461b8e0390\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737254 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737310 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737365 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data\") pod \"819ff46c-d925-4502-894d-9d461b8e0390\" (UID: \"819ff46c-d925-4502-894d-9d461b8e0390\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.737382 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle\") pod \"3c6b98f2-3cea-40ac-95af-87b198d71345\" (UID: \"3c6b98f2-3cea-40ac-95af-87b198d71345\") " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.749131 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.749868 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs" (OuterVolumeSpecName: "logs") pod "819ff46c-d925-4502-894d-9d461b8e0390" (UID: "819ff46c-d925-4502-894d-9d461b8e0390"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.750288 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs" (OuterVolumeSpecName: "logs") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.750885 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx" (OuterVolumeSpecName: "kube-api-access-659nx") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "kube-api-access-659nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.773507 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb" (OuterVolumeSpecName: "kube-api-access-zprnb") pod "819ff46c-d925-4502-894d-9d461b8e0390" (UID: "819ff46c-d925-4502-894d-9d461b8e0390"). InnerVolumeSpecName "kube-api-access-zprnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.775256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.784720 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts" (OuterVolumeSpecName: "scripts") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.784851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "819ff46c-d925-4502-894d-9d461b8e0390" (UID: "819ff46c-d925-4502-894d-9d461b8e0390"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.785213 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.809450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "819ff46c-d925-4502-894d-9d461b8e0390" (UID: "819ff46c-d925-4502-894d-9d461b8e0390"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.816670 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844369 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844410 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/819ff46c-d925-4502-894d-9d461b8e0390-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844422 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844430 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844439 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-659nx\" (UniqueName: \"kubernetes.io/projected/3c6b98f2-3cea-40ac-95af-87b198d71345-kube-api-access-659nx\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844451 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844459 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844468 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zprnb\" (UniqueName: \"kubernetes.io/projected/819ff46c-d925-4502-894d-9d461b8e0390-kube-api-access-zprnb\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844482 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c6b98f2-3cea-40ac-95af-87b198d71345-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844519 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.844528 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.852741 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data" (OuterVolumeSpecName: "config-data") pod "3c6b98f2-3cea-40ac-95af-87b198d71345" (UID: "3c6b98f2-3cea-40ac-95af-87b198d71345"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.854048 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data" (OuterVolumeSpecName: "config-data") pod "819ff46c-d925-4502-894d-9d461b8e0390" (UID: "819ff46c-d925-4502-894d-9d461b8e0390"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.877297 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.946200 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.946242 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/819ff46c-d925-4502-894d-9d461b8e0390-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.946257 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c6b98f2-3cea-40ac-95af-87b198d71345-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:19 crc kubenswrapper[5030]: I0316 13:38:19.955707 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" path="/var/lib/kubelet/pods/2c052399-a0ea-4c39-ba2d-bbdfc52471a2/volumes" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.202749 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.203004 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-log" containerID="cri-o://4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.203165 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-api" containerID="cri-o://c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.213034 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.172:8778/\": EOF" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.213399 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.172:8778/\": EOF" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.243897 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.244893 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp" event={"ID":"819ff46c-d925-4502-894d-9d461b8e0390","Type":"ContainerDied","Data":"1be699050ea579f53b945ec54dcd8b31eca6bd714a13d0cf0b4eda4acbcaf1f2"} Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.244981 5030 scope.go:117] "RemoveContainer" containerID="b9e1bd3cd0e9abd3563b451f64482fc7d0cfda8e03a8eaedc0eedecfd5a3f657" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.246197 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.246457 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api-log" containerID="cri-o://22a5075a6d290e8de49a39a24a673979bf17640c2aa045ab88b4f001bc597e45" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.246839 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" containerID="cri-o://09eb367841b2498ede5a4ecf8efaf6ea531864d540dfaec3827bc4dcd01cbd18" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.258440 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.178:8776/healthcheck\": EOF" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.264471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"f0d9516c-019b-4c79-8cdd-3931b0e66bc6","Type":"ContainerDied","Data":"ed43192b8cbca8fef6755d6a03af2cc710aee5059ca87a053ad8a480f4a3cbd9"} Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.264910 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.274781 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.178:8776/healthcheck\": EOF" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.282750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerStarted","Data":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.307029 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.320776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"3c6b98f2-3cea-40ac-95af-87b198d71345","Type":"ContainerDied","Data":"50fce317a19eb4796b9f1256ad5b65000fd157120978233360dca60c6a16c325"} Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.320887 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.325833 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-v46hp"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.334635 5030 scope.go:117] "RemoveContainer" containerID="8801f5a43490c7b8a04b01a44b494173f4d4b975c3ecf0ec6b33ca607e759078" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.336772 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.340206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerStarted","Data":"7e93346fee000174d7a3fbfb238170727253453f06b58405d7b425893fa3a9e9"} Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.340256 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.340323 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.342168 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.348606 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359525 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359567 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359576 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359582 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359600 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359605 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359622 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359628 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359650 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359656 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359668 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359675 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359680 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359686 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359692 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359869 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359885 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359891 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" containerName="glance-httpd" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359903 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359913 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359922 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2c052399-a0ea-4c39-ba2d-bbdfc52471a2" containerName="barbican-keystone-listener" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359931 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" containerName="glance-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.359938 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="819ff46c-d925-4502-894d-9d461b8e0390" containerName="barbican-worker-log" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.364143 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.367586 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.367638 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-vb2g5\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.367874 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.370696 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.377841 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.383835 5030 scope.go:117] "RemoveContainer" containerID="5c2419b58e0d927085db71271e26d1258c32638a8878dbe7da195c26dc2adc13" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.425879 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.425929 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.434868 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.441331 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.449222 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.451457 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.468924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469235 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469294 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469507 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2wt\" (UniqueName: \"kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469533 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.469614 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.482857 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.486529 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" podStartSLOduration=3.486511459 podStartE2EDuration="3.486511459s" podCreationTimestamp="2026-03-16 13:38:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:20.470771464 +0000 UTC m=+1944.870084010" watchObservedRunningTime="2026-03-16 13:38:20.486511459 +0000 UTC m=+1944.885824005" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.490655 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.514588 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.514888 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-api" containerID="cri-o://3faeca43bc7881b5eb8665831a45fbb3d76c6914c5b13fb15dd42f9291d56a3c" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.516913 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-httpd" containerID="cri-o://95200b4e7b4806b197c6dc6c629a9a18625013eb6bcbe56185fb676aec7fcfa9" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.533491 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.174:9696/\": EOF" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572513 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572567 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572623 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572645 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572677 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2wt\" (UniqueName: \"kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572804 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572846 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.572989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkkbs\" (UniqueName: \"kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573101 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573599 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.573818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.580231 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.583738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.588206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.591037 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.599150 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2wt\" (UniqueName: \"kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.634615 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"glance-default-internal-api-0\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.636741 5030 scope.go:117] "RemoveContainer" containerID="4073dd05b7a8e9ab5ed00fe9070a3acfaa56a0f619a49f98c3e154f93a68f359" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.676327 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.676743 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" containerName="nova-cell0-conductor-conductor" containerID="cri-o://445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7" gracePeriod=30 Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679530 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679765 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679853 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkkbs\" (UniqueName: \"kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.679980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.681854 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") device mount path \"/mnt/openstack/pv12\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.681932 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.686225 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.699675 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.721462 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.724885 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.732597 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.740518 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkkbs\" (UniqueName: \"kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.798563 5030 scope.go:117] "RemoveContainer" containerID="0c8307fa3b9529d4f72950ab858425c439c919e4512718d40ccdb54510d7aa12" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.799056 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"glance-default-external-api-0\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.817071 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:20 crc kubenswrapper[5030]: I0316 13:38:20.937047 5030 scope.go:117] "RemoveContainer" containerID="9f1c121d9c2e7b9770e652dec8b3b2cc39b4e5b3da4d456409d14faaa1b5710d" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.034322 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.067306 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.068734 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.095799 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.105294 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.105329 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.105440 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.108854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.108903 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.108953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.108993 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109023 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjft2\" (UniqueName: \"kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109050 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109093 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55jc\" (UniqueName: \"kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109117 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.109240 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.113995 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.114235 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" containerID="cri-o://b6499ad77d8cd643ed391f4019b7ccbe313a0f133463cdf3a7817461b0bc0bad" gracePeriod=30 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.114358 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" containerID="cri-o://241ed8aad54cd5abf2054349eae6ed6953071a6fb197aabd41df12342879c0a9" gracePeriod=30 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.150091 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.182:9311/healthcheck\": EOF" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.150978 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.182:9311/healthcheck\": EOF" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.157727 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.182:9311/healthcheck\": EOF" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.197106 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.221576 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6svs6\" (UniqueName: \"kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.221803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.221995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.222228 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.222430 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.222722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.222930 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs\") pod \"9b76f78c-2081-43d0-bca9-884c5f1468f3\" (UID: \"9b76f78c-2081-43d0-bca9-884c5f1468f3\") " Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.223703 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224061 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224111 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224160 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224253 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224310 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjft2\" (UniqueName: \"kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224372 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j55jc\" (UniqueName: \"kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.224982 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.225211 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs" (OuterVolumeSpecName: "logs") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.234974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.237954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.249276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.251974 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.282892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts" (OuterVolumeSpecName: "scripts") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.283838 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6" (OuterVolumeSpecName: "kube-api-access-6svs6") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "kube-api-access-6svs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.284127 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.284255 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.284868 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.297767 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55jc\" (UniqueName: \"kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc\") pod \"barbican-keystone-listener-74df56b946-xl8g6\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.309508 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjft2\" (UniqueName: \"kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2\") pod \"barbican-worker-688778b5c5-phqpb\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.336041 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6svs6\" (UniqueName: \"kubernetes.io/projected/9b76f78c-2081-43d0-bca9-884c5f1468f3-kube-api-access-6svs6\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.336076 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.336088 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9b76f78c-2081-43d0-bca9-884c5f1468f3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.355052 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data" (OuterVolumeSpecName: "config-data") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.384444 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.402684 5030 generic.go:358] "Generic (PLEG): container finished" podID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerID="c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" exitCode=0 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.402961 5030 generic.go:358] "Generic (PLEG): container finished" podID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerID="4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" exitCode=143 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.403083 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerDied","Data":"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.403119 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerDied","Data":"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.403130 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" event={"ID":"9b76f78c-2081-43d0-bca9-884c5f1468f3","Type":"ContainerDied","Data":"36d18a01b4fac1f7df944b563fb950e3fa3d1989747fe10e275f5901c20a6072"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.403145 5030 scope.go:117] "RemoveContainer" containerID="c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.403281 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6897989574-jfvsh" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.439210 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.442363 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.445786 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.446793 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.456085 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerStarted","Data":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.456390 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.462586 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.466270 5030 generic.go:358] "Generic (PLEG): container finished" podID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerID="b6499ad77d8cd643ed391f4019b7ccbe313a0f133463cdf3a7817461b0bc0bad" exitCode=143 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.466353 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerDied","Data":"b6499ad77d8cd643ed391f4019b7ccbe313a0f133463cdf3a7817461b0bc0bad"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.490505 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerID="22a5075a6d290e8de49a39a24a673979bf17640c2aa045ab88b4f001bc597e45" exitCode=143 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.490654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerDied","Data":"22a5075a6d290e8de49a39a24a673979bf17640c2aa045ab88b4f001bc597e45"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.505217 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerID="95200b4e7b4806b197c6dc6c629a9a18625013eb6bcbe56185fb676aec7fcfa9" exitCode=0 Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.506360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerDied","Data":"95200b4e7b4806b197c6dc6c629a9a18625013eb6bcbe56185fb676aec7fcfa9"} Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.514636 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.527390 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.560885 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.591214 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9b76f78c-2081-43d0-bca9-884c5f1468f3" (UID: "9b76f78c-2081-43d0-bca9-884c5f1468f3"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.665260 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.668311 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b76f78c-2081-43d0-bca9-884c5f1468f3-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.747682 5030 scope.go:117] "RemoveContainer" containerID="4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.788360 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.834717 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6897989574-jfvsh"] Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.898724 5030 scope.go:117] "RemoveContainer" containerID="c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" Mar 16 13:38:21 crc kubenswrapper[5030]: E0316 13:38:21.901925 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382\": container with ID starting with c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382 not found: ID does not exist" containerID="c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.901976 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382"} err="failed to get container status \"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382\": rpc error: code = NotFound desc = could not find container \"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382\": container with ID starting with c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382 not found: ID does not exist" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.901999 5030 scope.go:117] "RemoveContainer" containerID="4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" Mar 16 13:38:21 crc kubenswrapper[5030]: E0316 13:38:21.902640 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638\": container with ID starting with 4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638 not found: ID does not exist" containerID="4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.902679 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638"} err="failed to get container status \"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638\": rpc error: code = NotFound desc = could not find container \"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638\": container with ID starting with 4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638 not found: ID does not exist" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.902697 5030 scope.go:117] "RemoveContainer" containerID="c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.908882 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382"} err="failed to get container status \"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382\": rpc error: code = NotFound desc = could not find container \"c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382\": container with ID starting with c637e7934c5b052789efd95f6bdb697dc2cd67e926987bb8b15f13e3fa218382 not found: ID does not exist" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.908917 5030 scope.go:117] "RemoveContainer" containerID="4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638" Mar 16 13:38:21 crc kubenswrapper[5030]: I0316 13:38:21.909282 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638"} err="failed to get container status \"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638\": rpc error: code = NotFound desc = could not find container \"4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638\": container with ID starting with 4d23a809192625e23eb8ba2e4c163fc0b1cdd4490b41602cf9ffaa57b6aa9638 not found: ID does not exist" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.057843 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6b98f2-3cea-40ac-95af-87b198d71345" path="/var/lib/kubelet/pods/3c6b98f2-3cea-40ac-95af-87b198d71345/volumes" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.058854 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819ff46c-d925-4502-894d-9d461b8e0390" path="/var/lib/kubelet/pods/819ff46c-d925-4502-894d-9d461b8e0390/volumes" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.059286 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.059449 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" path="/var/lib/kubelet/pods/9b76f78c-2081-43d0-bca9-884c5f1468f3/volumes" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.060647 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0d9516c-019b-4c79-8cdd-3931b0e66bc6" path="/var/lib/kubelet/pods/f0d9516c-019b-4c79-8cdd-3931b0e66bc6/volumes" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.061316 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.101691 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle\") pod \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.101787 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data\") pod \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.101839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vjbl\" (UniqueName: \"kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl\") pod \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\" (UID: \"f5ba7b63-0221-4f46-a2c5-c7cb81849527\") " Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.114744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl" (OuterVolumeSpecName: "kube-api-access-2vjbl") pod "f5ba7b63-0221-4f46-a2c5-c7cb81849527" (UID: "f5ba7b63-0221-4f46-a2c5-c7cb81849527"). InnerVolumeSpecName "kube-api-access-2vjbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.159967 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f5ba7b63-0221-4f46-a2c5-c7cb81849527" (UID: "f5ba7b63-0221-4f46-a2c5-c7cb81849527"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.175908 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data" (OuterVolumeSpecName: "config-data") pod "f5ba7b63-0221-4f46-a2c5-c7cb81849527" (UID: "f5ba7b63-0221-4f46-a2c5-c7cb81849527"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.208019 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.208052 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f5ba7b63-0221-4f46-a2c5-c7cb81849527-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.208063 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vjbl\" (UniqueName: \"kubernetes.io/projected/f5ba7b63-0221-4f46-a2c5-c7cb81849527-kube-api-access-2vjbl\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.277874 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.300337 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.306896 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:22 crc kubenswrapper[5030]: W0316 13:38:22.328727 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e437910_2ec4_4783_b220_e8e6de0a240b.slice/crio-e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd WatchSource:0}: Error finding container e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd: Status 404 returned error can't find the container with id e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.530259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerStarted","Data":"15dbda8ebb8eec1cd1f9b67de035392132d84483f9e18ff5f6aa9a9b30a621e2"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.538926 5030 generic.go:358] "Generic (PLEG): container finished" podID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" containerID="445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7" exitCode=0 Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.539067 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.539103 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5ba7b63-0221-4f46-a2c5-c7cb81849527","Type":"ContainerDied","Data":"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.539145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"f5ba7b63-0221-4f46-a2c5-c7cb81849527","Type":"ContainerDied","Data":"6492e8b860b710d5db3a818ccdff6ec9d8e84f324fad87972d5fea29925c266b"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.539169 5030 scope.go:117] "RemoveContainer" containerID="445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.575138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerStarted","Data":"9c23402b7462ae50c5f1eac5231b79069052af1281b451e76cd473997161f034"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.595985 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerStarted","Data":"d018334d3997c0fc7fae4b508912aaba2e43bfaaa7c92c00ecb71baae45efcca"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.665627 5030 scope.go:117] "RemoveContainer" containerID="445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.665731 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerStarted","Data":"e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd"} Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.665970 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="cinder-scheduler" containerID="cri-o://ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3" gracePeriod=30 Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.666424 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="probe" containerID="cri-o://4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01" gracePeriod=30 Mar 16 13:38:22 crc kubenswrapper[5030]: E0316 13:38:22.667334 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7\": container with ID starting with 445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7 not found: ID does not exist" containerID="445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.667381 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7"} err="failed to get container status \"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7\": rpc error: code = NotFound desc = could not find container \"445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7\": container with ID starting with 445364125d108f8be50302dcd3067b3def5f15f8a4ee4d768858de5fb7127bc7 not found: ID does not exist" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.683083 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.697835 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.747328 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.770765 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.771972 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.771988 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772021 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-api" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772027 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-api" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772052 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-log" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772058 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-log" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772239 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-log" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772255 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" containerName="nova-cell0-conductor-conductor" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.772270 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b76f78c-2081-43d0-bca9-884c5f1468f3" containerName="placement-api" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.777361 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.781031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.790825 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.877950 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhk74\" (UniqueName: \"kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.878420 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.878573 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.984304 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhk74\" (UniqueName: \"kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.984927 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.985045 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:22 crc kubenswrapper[5030]: I0316 13:38:22.995443 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.001365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhk74\" (UniqueName: \"kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.005482 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.279677 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:23 crc kubenswrapper[5030]: E0316 13:38:23.526923 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1006b214_ccf3_4a8e_a1ff_cc9dc6fbaf42.slice/crio-conmon-4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.546142 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.596023 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:23 crc kubenswrapper[5030]: W0316 13:38:23.665741 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73a8fdc5_4144_429a_8954_d1e0f4baac91.slice/crio-72cbe4578d05973758552485e1af916c9d2eb14af18c73cb044ca36d4ae7e708 WatchSource:0}: Error finding container 72cbe4578d05973758552485e1af916c9d2eb14af18c73cb044ca36d4ae7e708: Status 404 returned error can't find the container with id 72cbe4578d05973758552485e1af916c9d2eb14af18c73cb044ca36d4ae7e708 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.691478 5030 generic.go:358] "Generic (PLEG): container finished" podID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerID="4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01" exitCode=0 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.691571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerDied","Data":"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.694768 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerStarted","Data":"d05277fe3d566f4707731dcb914f5be26c907ccaf0b2c041269d4a1ad8a72846"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.694823 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerStarted","Data":"418c2ae8a3e29aaebfe75d39aa3e156dea569cf6f9a33c380b5741e55ed1f16e"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.699083 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerStarted","Data":"1f7c92f93e44ab836cfa9064dde2240bad3aaed7f708d3b42d9a27bc5a7d49f2"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.732864 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" podStartSLOduration=2.732844454 podStartE2EDuration="2.732844454s" podCreationTimestamp="2026-03-16 13:38:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:23.713273716 +0000 UTC m=+1948.112586263" watchObservedRunningTime="2026-03-16 13:38:23.732844454 +0000 UTC m=+1948.132157001" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.751030 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.751264 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener-log" containerID="cri-o://519dbc57c2672d004f4a13b9360369a5ec04556d1594375893b223094bdef83a" gracePeriod=30 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.751695 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener" containerID="cri-o://0a90c20fc66169b4e72b39bb97edb491201a4d9960ffdc66eb03dc9956283d21" gracePeriod=30 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.758118 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerStarted","Data":"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.758243 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerStarted","Data":"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.773757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"73a8fdc5-4144-429a-8954-d1e0f4baac91","Type":"ContainerStarted","Data":"72cbe4578d05973758552485e1af916c9d2eb14af18c73cb044ca36d4ae7e708"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.789887 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" podStartSLOduration=2.789874776 podStartE2EDuration="2.789874776s" podCreationTimestamp="2026-03-16 13:38:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:23.78762724 +0000 UTC m=+1948.186939787" watchObservedRunningTime="2026-03-16 13:38:23.789874776 +0000 UTC m=+1948.189187323" Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.794136 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerStarted","Data":"9efe6bd97770092e07dfe30bb192ac574b37f38b8f821b5cea5875ae51c15516"} Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.841825 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.846242 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker-log" containerID="cri-o://791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6" gracePeriod=30 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.846580 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker" containerID="cri-o://8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16" gracePeriod=30 Mar 16 13:38:23 crc kubenswrapper[5030]: I0316 13:38:23.961351 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ba7b63-0221-4f46-a2c5-c7cb81849527" path="/var/lib/kubelet/pods/f5ba7b63-0221-4f46-a2c5-c7cb81849527/volumes" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.252871 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.496644 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.496725 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.579363 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.804303 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"73a8fdc5-4144-429a-8954-d1e0f4baac91","Type":"ContainerStarted","Data":"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.805370 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.806955 5030 generic.go:358] "Generic (PLEG): container finished" podID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerID="519dbc57c2672d004f4a13b9360369a5ec04556d1594375893b223094bdef83a" exitCode=143 Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.807027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerDied","Data":"519dbc57c2672d004f4a13b9360369a5ec04556d1594375893b223094bdef83a"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.808981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerStarted","Data":"c4c004de843d0ad1792bbf115b0ceeb341223f6d0f9d98e26a07b1a262c184d0"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.810777 5030 generic.go:358] "Generic (PLEG): container finished" podID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerID="791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6" exitCode=143 Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.811070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerDied","Data":"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.813924 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerStarted","Data":"a0bc82281b28010668e4849584debbef2b893d2b293d6882a12a0509256fd66e"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.823995 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.82398652 podStartE2EDuration="2.82398652s" podCreationTimestamp="2026-03-16 13:38:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:24.815596595 +0000 UTC m=+1949.214909142" watchObservedRunningTime="2026-03-16 13:38:24.82398652 +0000 UTC m=+1949.223299067" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.839149 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerStarted","Data":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.841060 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.84103712 podStartE2EDuration="4.84103712s" podCreationTimestamp="2026-03-16 13:38:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:24.83486304 +0000 UTC m=+1949.234175588" watchObservedRunningTime="2026-03-16 13:38:24.84103712 +0000 UTC m=+1949.240349666" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.861020 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.861008782 podStartE2EDuration="4.861008782s" podCreationTimestamp="2026-03-16 13:38:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:24.853819894 +0000 UTC m=+1949.253132441" watchObservedRunningTime="2026-03-16 13:38:24.861008782 +0000 UTC m=+1949.260321329" Mar 16 13:38:24 crc kubenswrapper[5030]: I0316 13:38:24.875793 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.29941312 podStartE2EDuration="7.875776088s" podCreationTimestamp="2026-03-16 13:38:17 +0000 UTC" firstStartedPulling="2026-03-16 13:38:17.767238526 +0000 UTC m=+1942.166551073" lastFinishedPulling="2026-03-16 13:38:23.343601494 +0000 UTC m=+1947.742914041" observedRunningTime="2026-03-16 13:38:24.872197418 +0000 UTC m=+1949.271509966" watchObservedRunningTime="2026-03-16 13:38:24.875776088 +0000 UTC m=+1949.275088635" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.489592 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.505680 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.183:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.507893 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.183:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.526674 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.562544 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.601748 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.601800 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.652835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.652967 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hww79\" (UniqueName: \"kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.653151 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.653267 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.653472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.653731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts\") pod \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\" (UID: \"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.654899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.673159 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.677638 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts" (OuterVolumeSpecName: "scripts") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.677879 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79" (OuterVolumeSpecName: "kube-api-access-hww79") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "kube-api-access-hww79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.749621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.757460 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.757500 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hww79\" (UniqueName: \"kubernetes.io/projected/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-kube-api-access-hww79\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.757515 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.757524 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.757532 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.820285 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.833655 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data" (OuterVolumeSpecName: "config-data") pod "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" (UID: "1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.860801 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs\") pod \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.861020 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2czj\" (UniqueName: \"kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj\") pod \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.861056 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data\") pod \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.861142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom\") pod \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.861687 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle\") pod \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\" (UID: \"155f78b4-1aa4-42a9-8e53-3a2387c931bb\") " Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.862221 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.863940 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs" (OuterVolumeSpecName: "logs") pod "155f78b4-1aa4-42a9-8e53-3a2387c931bb" (UID: "155f78b4-1aa4-42a9-8e53-3a2387c931bb"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.864454 5030 generic.go:358] "Generic (PLEG): container finished" podID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerID="ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3" exitCode=0 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.865100 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerDied","Data":"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3"} Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.865137 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42","Type":"ContainerDied","Data":"e9626a5a686c0eeb1257a0eb46e6bda692a09f7c28d91d9d5a2af061889bc971"} Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.865160 5030 scope.go:117] "RemoveContainer" containerID="4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.865304 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.873704 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj" (OuterVolumeSpecName: "kube-api-access-z2czj") pod "155f78b4-1aa4-42a9-8e53-3a2387c931bb" (UID: "155f78b4-1aa4-42a9-8e53-3a2387c931bb"). InnerVolumeSpecName "kube-api-access-z2czj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.875958 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "155f78b4-1aa4-42a9-8e53-3a2387c931bb" (UID: "155f78b4-1aa4-42a9-8e53-3a2387c931bb"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.876896 5030 generic.go:358] "Generic (PLEG): container finished" podID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerID="8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16" exitCode=0 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.877959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerDied","Data":"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16"} Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.877982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" event={"ID":"155f78b4-1aa4-42a9-8e53-3a2387c931bb","Type":"ContainerDied","Data":"704a95b43b7acddabb31141611bb5370014f280d2882a1e4e5a085455d0b8744"} Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878168 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-central-agent" containerID="cri-o://279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" gracePeriod=30 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878281 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="proxy-httpd" containerID="cri-o://21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" gracePeriod=30 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878340 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="sg-core" containerID="cri-o://25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" gracePeriod=30 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878376 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-notification-agent" containerID="cri-o://35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" gracePeriod=30 Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878510 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.878561 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.926958 5030 scope.go:117] "RemoveContainer" containerID="ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.948718 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "155f78b4-1aa4-42a9-8e53-3a2387c931bb" (UID: "155f78b4-1aa4-42a9-8e53-3a2387c931bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.977731 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data" (OuterVolumeSpecName: "config-data") pod "155f78b4-1aa4-42a9-8e53-3a2387c931bb" (UID: "155f78b4-1aa4-42a9-8e53-3a2387c931bb"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.994114 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.994656 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/155f78b4-1aa4-42a9-8e53-3a2387c931bb-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.994699 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2czj\" (UniqueName: \"kubernetes.io/projected/155f78b4-1aa4-42a9-8e53-3a2387c931bb-kube-api-access-z2czj\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.994722 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:25 crc kubenswrapper[5030]: I0316 13:38:25.994737 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/155f78b4-1aa4-42a9-8e53-3a2387c931bb-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.001016 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.001044 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.001061 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.001080 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003189 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="cinder-scheduler" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003211 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="cinder-scheduler" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003259 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003265 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003289 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker-log" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003295 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker-log" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003306 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="probe" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003311 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="probe" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003747 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003759 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="probe" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003793 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" containerName="cinder-scheduler" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.003804 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" containerName="barbican-worker-log" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.009493 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.009649 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.011045 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.016384 5030 scope.go:117] "RemoveContainer" containerID="4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01" Mar 16 13:38:26 crc kubenswrapper[5030]: E0316 13:38:26.017006 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01\": container with ID starting with 4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01 not found: ID does not exist" containerID="4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.017042 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01"} err="failed to get container status \"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01\": rpc error: code = NotFound desc = could not find container \"4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01\": container with ID starting with 4c0cfd73e00ad109a87fdfc3366b7248321b413b112396ec0f3111f108b91e01 not found: ID does not exist" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.017065 5030 scope.go:117] "RemoveContainer" containerID="ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3" Mar 16 13:38:26 crc kubenswrapper[5030]: E0316 13:38:26.017481 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3\": container with ID starting with ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3 not found: ID does not exist" containerID="ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.017508 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3"} err="failed to get container status \"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3\": rpc error: code = NotFound desc = could not find container \"ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3\": container with ID starting with ddd4fdf3fd463c99412efc269d806895f35dff3984077a4e95a8cc5cd49961e3 not found: ID does not exist" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.017526 5030 scope.go:117] "RemoveContainer" containerID="8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.072753 5030 scope.go:117] "RemoveContainer" containerID="791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.092309 5030 scope.go:117] "RemoveContainer" containerID="8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16" Mar 16 13:38:26 crc kubenswrapper[5030]: E0316 13:38:26.092785 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16\": container with ID starting with 8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16 not found: ID does not exist" containerID="8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.092997 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16"} err="failed to get container status \"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16\": rpc error: code = NotFound desc = could not find container \"8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16\": container with ID starting with 8dcd11f297f8557032c3217e5e649176ed8b86cacff8ee58aedfd5eba7a9dc16 not found: ID does not exist" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.093025 5030 scope.go:117] "RemoveContainer" containerID="791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6" Mar 16 13:38:26 crc kubenswrapper[5030]: E0316 13:38:26.093865 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6\": container with ID starting with 791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6 not found: ID does not exist" containerID="791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.093892 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6"} err="failed to get container status \"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6\": rpc error: code = NotFound desc = could not find container \"791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6\": container with ID starting with 791445fefcc84549ef9e81a9172a6025e9d36929e4d009ee1b2d1c78e6be59f6 not found: ID does not exist" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096116 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096303 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7cjk\" (UniqueName: \"kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.096572 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.198724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7cjk\" (UniqueName: \"kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.198934 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.200329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.200467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.200483 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.200715 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.200785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.206103 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.207644 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.211731 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.212920 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.216222 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-7b8f6cf599-dkxmd"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.222975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.228747 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7cjk\" (UniqueName: \"kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk\") pod \"cinder-scheduler-0\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.258422 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.258793 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-httpd" containerID="cri-o://6adefe51f73c5c07b1d81b5ed830836b42dc64c15523f5c08416edbfb39ee8cf" gracePeriod=30 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.259040 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-server" containerID="cri-o://7e93346fee000174d7a3fbfb238170727253453f06b58405d7b425893fa3a9e9" gracePeriod=30 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.325537 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.328526 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-server" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.362977 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.618114 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.185:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.619764 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.185:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.746091 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.1.178:8776/healthcheck\": read tcp 10.217.0.2:60466->10.217.1.178:8776: read: connection reset by peer" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.922719 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927188 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" exitCode=0 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927289 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" exitCode=2 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927348 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" exitCode=0 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927395 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" exitCode=0 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerDied","Data":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927685 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerDied","Data":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927753 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerDied","Data":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927810 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerDied","Data":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927868 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38","Type":"ContainerDied","Data":"2d2d4141d8b0609a8689581a9f04bfe4971f8d5da84d287522e377f62b974fcb"} Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.927936 5030 scope.go:117] "RemoveContainer" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.949822 5030 generic.go:358] "Generic (PLEG): container finished" podID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerID="09eb367841b2498ede5a4ecf8efaf6ea531864d540dfaec3827bc4dcd01cbd18" exitCode=0 Mar 16 13:38:26 crc kubenswrapper[5030]: I0316 13:38:26.950070 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerDied","Data":"09eb367841b2498ede5a4ecf8efaf6ea531864d540dfaec3827bc4dcd01cbd18"} Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.021568 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7870762-c567-4da0-b9bd-785c76c82749" containerID="7e93346fee000174d7a3fbfb238170727253453f06b58405d7b425893fa3a9e9" exitCode=0 Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.021596 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7870762-c567-4da0-b9bd-785c76c82749" containerID="6adefe51f73c5c07b1d81b5ed830836b42dc64c15523f5c08416edbfb39ee8cf" exitCode=0 Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.021821 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerDied","Data":"7e93346fee000174d7a3fbfb238170727253453f06b58405d7b425893fa3a9e9"} Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.021858 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerDied","Data":"6adefe51f73c5c07b1d81b5ed830836b42dc64c15523f5c08416edbfb39ee8cf"} Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.054756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.054839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.054975 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.055014 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dst4g\" (UniqueName: \"kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.055033 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.055142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.055184 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.055298 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle\") pod \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\" (UID: \"ed0af7fe-6ff3-48a8-8813-1b07cf66ac38\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.063653 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.077112 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts" (OuterVolumeSpecName: "scripts") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.080425 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.100186 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.117766 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g" (OuterVolumeSpecName: "kube-api-access-dst4g") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "kube-api-access-dst4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.118142 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.118502 5030 scope.go:117] "RemoveContainer" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.150320 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151459 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151509 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151515 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151526 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-central-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151532 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-central-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151567 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="sg-core" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151573 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="sg-core" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151585 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-notification-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151591 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-notification-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151646 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-server" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151651 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-server" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151835 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-server" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151847 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7870762-c567-4da0-b9bd-785c76c82749" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151860 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-notification-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151874 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="sg-core" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151885 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="ceilometer-central-agent" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.151893 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" containerName="proxy-httpd" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.159941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160104 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4bqb\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160252 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160338 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160510 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160655 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160760 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.160917 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd\") pod \"f7870762-c567-4da0-b9bd-785c76c82749\" (UID: \"f7870762-c567-4da0-b9bd-785c76c82749\") " Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.165983 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.167199 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.167278 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.167345 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.167402 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dst4g\" (UniqueName: \"kubernetes.io/projected/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-kube-api-access-dst4g\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.167461 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.167342 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.167650 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:27.667632435 +0000 UTC m=+1952.066944982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.168108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.168294 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.168349 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:27.668334334 +0000 UTC m=+1952.067646881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.181927 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.191611 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.207125 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.232533 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb" (OuterVolumeSpecName: "kube-api-access-f4bqb") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "kube-api-access-f4bqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.232616 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.245810 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.272517 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.272644 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294238 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzwt\" (UniqueName: \"kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294390 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294516 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4bqb\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-kube-api-access-f4bqb\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294531 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f7870762-c567-4da0-b9bd-785c76c82749-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294542 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f7870762-c567-4da0-b9bd-785c76c82749-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.294566 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.300459 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.300476 5030 scope.go:117] "RemoveContainer" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.301007 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.324170 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.360065 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-kv4gg"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.366473 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.383812 5030 scope.go:117] "RemoveContainer" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.393064 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.398327 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzwt\" (UniqueName: \"kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.398444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.398629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-722zc\" (UniqueName: \"kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.398762 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.398897 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.399827 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.434532 5030 scope.go:117] "RemoveContainer" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.435788 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": container with ID starting with 21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2 not found: ID does not exist" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.435840 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} err="failed to get container status \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": rpc error: code = NotFound desc = could not find container \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": container with ID starting with 21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.435863 5030 scope.go:117] "RemoveContainer" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.442694 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": container with ID starting with 25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912 not found: ID does not exist" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.442722 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} err="failed to get container status \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": rpc error: code = NotFound desc = could not find container \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": container with ID starting with 25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.442740 5030 scope.go:117] "RemoveContainer" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.449023 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": container with ID starting with 35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1 not found: ID does not exist" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.449057 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} err="failed to get container status \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": rpc error: code = NotFound desc = could not find container \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": container with ID starting with 35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.449075 5030 scope.go:117] "RemoveContainer" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.464680 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": container with ID starting with 279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b not found: ID does not exist" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.464702 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} err="failed to get container status \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": rpc error: code = NotFound desc = could not find container \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": container with ID starting with 279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.464720 5030 scope.go:117] "RemoveContainer" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.476712 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} err="failed to get container status \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": rpc error: code = NotFound desc = could not find container \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": container with ID starting with 21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.476740 5030 scope.go:117] "RemoveContainer" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.493165 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.493223 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.493236 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.493257 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.494204 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.497768 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzwt\" (UniqueName: \"kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt\") pod \"placement-bc4b-account-create-update-xggq2\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.498875 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" containerName="openstackclient" containerID="cri-o://31ce460042feb0213ba1454666846e5c3ad2ea58527ded11eff4bf7e4df234c0" gracePeriod=2 Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.500713 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-722zc\" (UniqueName: \"kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.500840 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.501908 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.501922 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} err="failed to get container status \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": rpc error: code = NotFound desc = could not find container \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": container with ID starting with 25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.501962 5030 scope.go:117] "RemoveContainer" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.506703 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} err="failed to get container status \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": rpc error: code = NotFound desc = could not find container \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": container with ID starting with 35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.506728 5030 scope.go:117] "RemoveContainer" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.507040 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.509835 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.512574 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} err="failed to get container status \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": rpc error: code = NotFound desc = could not find container \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": container with ID starting with 279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.512600 5030 scope.go:117] "RemoveContainer" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.518526 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} err="failed to get container status \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": rpc error: code = NotFound desc = could not find container \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": container with ID starting with 21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.518674 5030 scope.go:117] "RemoveContainer" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.525122 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} err="failed to get container status \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": rpc error: code = NotFound desc = could not find container \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": container with ID starting with 25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.525246 5030 scope.go:117] "RemoveContainer" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.525616 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} err="failed to get container status \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": rpc error: code = NotFound desc = could not find container \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": container with ID starting with 35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.525641 5030 scope.go:117] "RemoveContainer" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.527212 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} err="failed to get container status \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": rpc error: code = NotFound desc = could not find container \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": container with ID starting with 279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.527373 5030 scope.go:117] "RemoveContainer" containerID="21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.531258 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.534480 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" containerName="openstackclient" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.534503 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" containerName="openstackclient" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.534736 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" containerName="openstackclient" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.535401 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2"} err="failed to get container status \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": rpc error: code = NotFound desc = could not find container \"21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2\": container with ID starting with 21a001e69995038122d811c43e76ebb673a28d0c3c7567abbda773d99ac785a2 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.535516 5030 scope.go:117] "RemoveContainer" containerID="25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.552216 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912"} err="failed to get container status \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": rpc error: code = NotFound desc = could not find container \"25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912\": container with ID starting with 25ad4aab4657087e8cecdb9036e700072662b9a626b6ff5bf28fef7ed84a9912 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.552254 5030 scope.go:117] "RemoveContainer" containerID="35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.554109 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1"} err="failed to get container status \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": rpc error: code = NotFound desc = could not find container \"35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1\": container with ID starting with 35b05faa97df00fe4da3c5411717bb20c17db077fee042255d0911677b164ba1 not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.554236 5030 scope.go:117] "RemoveContainer" containerID="279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.558360 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b"} err="failed to get container status \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": rpc error: code = NotFound desc = could not find container \"279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b\": container with ID starting with 279fcd4b3c7dee06920f8f045827e57bbed40b3abb99351b92e2e23f4c7f510b not found: ID does not exist" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.559780 5030 status_manager.go:895] "Failed to get status for pod" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.567909 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rk4df"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.567957 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-rk4df"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.567985 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.568001 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.568016 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.569360 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.574775 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-722zc\" (UniqueName: \"kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc\") pod \"root-account-create-update-b8wt7\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.575754 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.589608 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrzq\" (UniqueName: \"kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603620 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603805 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603817 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603826 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.603969 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.610675 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-dn7f7"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.619686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data" (OuterVolumeSpecName: "config-data") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.625044 5030 status_manager.go:895] "Failed to get status for pod" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.627716 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f7870762-c567-4da0-b9bd-785c76c82749" (UID: "f7870762-c567-4da0-b9bd-785c76c82749"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.635535 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.644030 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.647205 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.649257 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.658920 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.676842 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.714511 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qk2tp"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.716593 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.716745 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.716845 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frs97\" (UniqueName: \"kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.717498 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.719381 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xcz\" (UniqueName: \"kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.719678 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grrzq\" (UniqueName: \"kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.723624 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.723702 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7870762-c567-4da0-b9bd-785c76c82749-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.718244 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.723867 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:28.723848798 +0000 UTC m=+1953.123161346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.718519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.723545 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.730357 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:28.730342839 +0000 UTC m=+1953.129655386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.724571 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:38:27 crc kubenswrapper[5030]: E0316 13:38:27.730649 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data podName:0f12cfce-f080-4e4a-b2b7-9aaa7855d10e nodeName:}" failed. No retries permitted until 2026-03-16 13:38:28.230637143 +0000 UTC m=+1952.629949690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data") pod "rabbitmq-server-0" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e") : configmap "rabbitmq-config-data" not found Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.734134 5030 status_manager.go:895] "Failed to get status for pod" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.744665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data" (OuterVolumeSpecName: "config-data") pod "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" (UID: "ed0af7fe-6ff3-48a8-8813-1b07cf66ac38"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.753964 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.766608 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrzq\" (UniqueName: \"kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq\") pod \"cinder-3837-account-create-update-m97sg\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.827060 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frs97\" (UniqueName: \"kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.827199 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.827267 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78xcz\" (UniqueName: \"kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.827382 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.834854 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.835374 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.836406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.848091 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.848256 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.857114 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.865460 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.879783 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.880157 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="ovn-northd" containerID="cri-o://53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" gracePeriod=30 Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.880333 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="openstack-network-exporter" containerID="cri-o://700d22618664a8bae5687619c1f217e02d60020371c0a5168d4e7ce5c96274a2" gracePeriod=30 Mar 16 13:38:27 crc kubenswrapper[5030]: I0316 13:38:27.952855 5030 status_manager.go:895] "Failed to get status for pod" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.001409 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frs97\" (UniqueName: \"kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97\") pod \"barbican-fcb6-account-create-update-qhkcw\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.016484 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.016711 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z2s9\" (UniqueName: \"kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.019333 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xcz\" (UniqueName: \"kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz\") pod \"glance-8b49-account-create-update-w8sbl\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.170044 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.184680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z2s9\" (UniqueName: \"kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.170358 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.170774 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.175332 5030 status_manager.go:895] "Failed to get status for pod" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.170163 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.200931 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42" path="/var/lib/kubelet/pods/1006b214-ccf3-4a8e-a1ff-cc9dc6fbaf42/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.230844 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="155f78b4-1aa4-42a9-8e53-3a2387c931bb" path="/var/lib/kubelet/pods/155f78b4-1aa4-42a9-8e53-3a2387c931bb/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.242778 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b96b94-ac0d-403c-bcd4-71844e15123c" path="/var/lib/kubelet/pods/35b96b94-ac0d-403c-bcd4-71844e15123c/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.243450 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d40483b-2134-4599-b62e-db175eb4992d" path="/var/lib/kubelet/pods/7d40483b-2134-4599-b62e-db175eb4992d/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.250002 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f33cbc87-407d-414e-a969-bd04d3531105" path="/var/lib/kubelet/pods/f33cbc87-407d-414e-a969-bd04d3531105/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.252330 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcda8593-4966-4d87-afc7-3566e38aa6b0" path="/var/lib/kubelet/pods/fcda8593-4966-4d87-afc7-3566e38aa6b0/volumes" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.259231 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.259265 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.283768 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-9jkqg"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.285876 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="openstack-network-exporter" containerID="cri-o://43bd0c72c69ffa1704b2cb1e04e0c0230d50bfd2783783c97a1a8cd59d88b278" gracePeriod=300 Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.297289 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.297389 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data podName:0f12cfce-f080-4e4a-b2b7-9aaa7855d10e nodeName:}" failed. No retries permitted until 2026-03-16 13:38:29.297371532 +0000 UTC m=+1953.696684070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data") pod "rabbitmq-server-0" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e") : configmap "rabbitmq-config-data" not found Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.350465 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.182:9311/healthcheck\": read tcp 10.217.0.2:43312->10.217.1.182:9311: read: connection reset by peer" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.350630 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.182:9311/healthcheck\": read tcp 10.217.0.2:43298->10.217.1.182:9311: read: connection reset by peer" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.356133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z2s9\" (UniqueName: \"kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9\") pod \"neutron-8f68-account-create-update-hm54l\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.357482 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.403972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" event={"ID":"f7870762-c567-4da0-b9bd-785c76c82749","Type":"ContainerDied","Data":"1bcad3871c137a99a94badccf85b1ddd1733a980ccb768b55590677af02defb6"} Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.404027 5030 scope.go:117] "RemoveContainer" containerID="7e93346fee000174d7a3fbfb238170727253453f06b58405d7b425893fa3a9e9" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.404271 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.447160 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.487760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerStarted","Data":"d95d94215fd2409b281fdf46dcc089a114a0cf7c5d42ae75322941181083890d"} Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.523067 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-24ck6"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.529007 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.533313 5030 generic.go:358] "Generic (PLEG): container finished" podID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerID="0a90c20fc66169b4e72b39bb97edb491201a4d9960ffdc66eb03dc9956283d21" exitCode=0 Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.533464 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerDied","Data":"0a90c20fc66169b4e72b39bb97edb491201a4d9960ffdc66eb03dc9956283d21"} Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.583516 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.645863 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-2jg65"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.703714 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="ovsdbserver-nb" containerID="cri-o://3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" gracePeriod=300 Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.712598 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2tjn6"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.747068 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-2tjn6"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.783450 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.784064 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="openstack-network-exporter" containerID="cri-o://67f7f23afc348f233a93cd0b1dd1da1cddfaebd7b11bcb9aad5e09f2260dd4db" gracePeriod=300 Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.808284 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-rw8zp"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.823733 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-rw8zp"] Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.828650 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.828706 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.828691576 +0000 UTC m=+1955.228004123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.828973 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:28 crc kubenswrapper[5030]: E0316 13:38:28.829002 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.828993723 +0000 UTC m=+1955.228306270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.869696 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.877422 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.879714 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.883587 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.903740 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="ovsdbserver-sb" containerID="cri-o://0e089bc213a84f45cb151137664b99776b4a0316ddfcdf2e444885ae7555b0e3" gracePeriod=300 Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.932801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.941276 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6ksc\" (UniqueName: \"kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.961137 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:28 crc kubenswrapper[5030]: I0316 13:38:28.972026 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-4jn6g"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.006115 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.038184 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.045951 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6ksc\" (UniqueName: \"kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.046091 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.047406 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.047489 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.050797 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.098056 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6ksc\" (UniqueName: \"kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc\") pod \"nova-api-0768-account-create-update-j2pq7\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.119812 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.162242 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzbp2\" (UniqueName: \"kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.162312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.163926 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.164042 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.164116 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.164337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.166147 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs" (OuterVolumeSpecName: "logs") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.166224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.166373 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.166448 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data\") pod \"0c423556-b75f-455e-9a6b-af0900be3c9f\" (UID: \"0c423556-b75f-455e-9a6b-af0900be3c9f\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.167382 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.167815 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.169197 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzvc\" (UniqueName: \"kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.169393 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.170450 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/0c423556-b75f-455e-9a6b-af0900be3c9f-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.170465 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0c423556-b75f-455e-9a6b-af0900be3c9f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.188486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2" (OuterVolumeSpecName: "kube-api-access-wzbp2") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "kube-api-access-wzbp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.200790 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-f61e-account-create-update-9hrr2"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.201160 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts" (OuterVolumeSpecName: "scripts") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.201268 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.212203 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-ts9gv"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.221949 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-ts9gv"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.227584 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-c7tv2"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.240000 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-c7tv2"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.255344 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.272598 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzvc\" (UniqueName: \"kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.272874 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.273016 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzbp2\" (UniqueName: \"kubernetes.io/projected/0c423556-b75f-455e-9a6b-af0900be3c9f-kube-api-access-wzbp2\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.273034 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.273044 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.273106 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.273160 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:29.773143842 +0000 UTC m=+1954.172456390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : configmap "openstack-cell1-scripts" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.286799 5030 projected.go:194] Error preparing data for projected volume kube-api-access-wtzvc for pod openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.286954 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:29.78684265 +0000 UTC m=+1954.186155197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wtzvc" (UniqueName: "kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.287161 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.287638 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-server" containerID="cri-o://145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.287960 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="swift-recon-cron" containerID="cri-o://63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.288009 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="rsync" containerID="cri-o://5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.288045 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-expirer" containerID="cri-o://a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.288080 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-updater" containerID="cri-o://03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.288117 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-auditor" containerID="cri-o://e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.288149 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-replicator" containerID="cri-o://3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.290741 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-server" containerID="cri-o://e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.291519 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.291590 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-reaper" containerID="cri-o://71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.291983 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-auditor" containerID="cri-o://f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.292041 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-replicator" containerID="cri-o://05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.292081 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-server" containerID="cri-o://cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.292494 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-replicator" containerID="cri-o://85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.293386 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-auditor" containerID="cri-o://772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.326753 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-updater" containerID="cri-o://99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.345833 5030 scope.go:117] "RemoveContainer" containerID="6adefe51f73c5c07b1d81b5ed830836b42dc64c15523f5c08416edbfb39ee8cf" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.370729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.371302 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.375746 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs\") pod \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.375873 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data\") pod \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.375896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle\") pod \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.376087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom\") pod \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.376214 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqtbs\" (UniqueName: \"kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs\") pod \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\" (UID: \"25c8266f-c926-4d64-90aa-cd8d4543b0c4\") " Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.382968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs" (OuterVolumeSpecName: "logs") pod "25c8266f-c926-4d64-90aa-cd8d4543b0c4" (UID: "25c8266f-c926-4d64-90aa-cd8d4543b0c4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.385477 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/25c8266f-c926-4d64-90aa-cd8d4543b0c4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.385504 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.385522 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.385609 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.385671 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data podName:0f12cfce-f080-4e4a-b2b7-9aaa7855d10e nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.385654111 +0000 UTC m=+1955.784966829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data") pod "rabbitmq-server-0" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e") : configmap "rabbitmq-config-data" not found Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.432096 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-spqtz"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.440415 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "25c8266f-c926-4d64-90aa-cd8d4543b0c4" (UID: "25c8266f-c926-4d64-90aa-cd8d4543b0c4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.458186 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs" (OuterVolumeSpecName: "kube-api-access-qqtbs") pod "25c8266f-c926-4d64-90aa-cd8d4543b0c4" (UID: "25c8266f-c926-4d64-90aa-cd8d4543b0c4"). InnerVolumeSpecName "kube-api-access-qqtbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.459505 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "25c8266f-c926-4d64-90aa-cd8d4543b0c4" (UID: "25c8266f-c926-4d64-90aa-cd8d4543b0c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.493311 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.493355 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqtbs\" (UniqueName: \"kubernetes.io/projected/25c8266f-c926-4d64-90aa-cd8d4543b0c4-kube-api-access-qqtbs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.493372 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.506259 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-spqtz"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.539538 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data" (OuterVolumeSpecName: "config-data") pod "25c8266f-c926-4d64-90aa-cd8d4543b0c4" (UID: "25c8266f-c926-4d64-90aa-cd8d4543b0c4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.542643 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data" (OuterVolumeSpecName: "config-data") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.549889 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "0c423556-b75f-455e-9a6b-af0900be3c9f" (UID: "0c423556-b75f-455e-9a6b-af0900be3c9f"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.554149 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-w589s"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.586505 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-w589s"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.597411 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.597447 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0c423556-b75f-455e-9a6b-af0900be3c9f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.597457 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/25c8266f-c926-4d64-90aa-cd8d4543b0c4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.606291 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.606668 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-log" containerID="cri-o://b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.606948 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-api" containerID="cri-o://cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.639091 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.639241 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm" event={"ID":"25c8266f-c926-4d64-90aa-cd8d4543b0c4","Type":"ContainerDied","Data":"7e6f2aaaeadab066f1257f8b16dde1588b22312fc718277ca639a62da375ea1a"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.663543 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.682659 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-mdnwj"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686467 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686504 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686510 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686517 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686523 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686529 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686535 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686725 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686769 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686779 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686787 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.686802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.701732 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4ae9bce-4f3a-4540-ac99-b763e21a7c07/ovsdbserver-nb/0.log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.701779 5030 generic.go:358] "Generic (PLEG): container finished" podID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerID="43bd0c72c69ffa1704b2cb1e04e0c0230d50bfd2783783c97a1a8cd59d88b278" exitCode=2 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.701795 5030 generic.go:358] "Generic (PLEG): container finished" podID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerID="3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" exitCode=143 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.702102 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerDied","Data":"43bd0c72c69ffa1704b2cb1e04e0c0230d50bfd2783783c97a1a8cd59d88b278"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.702134 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerDied","Data":"3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.708379 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.720064 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5c41eef1-5e65-449f-99bd-1b3f6d4179fa/ovsdbserver-sb/0.log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.720108 5030 generic.go:358] "Generic (PLEG): container finished" podID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerID="67f7f23afc348f233a93cd0b1dd1da1cddfaebd7b11bcb9aad5e09f2260dd4db" exitCode=2 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.720123 5030 generic.go:358] "Generic (PLEG): container finished" podID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerID="0e089bc213a84f45cb151137664b99776b4a0316ddfcdf2e444885ae7555b0e3" exitCode=143 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.720331 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerDied","Data":"67f7f23afc348f233a93cd0b1dd1da1cddfaebd7b11bcb9aad5e09f2260dd4db"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.720356 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerDied","Data":"0e089bc213a84f45cb151137664b99776b4a0316ddfcdf2e444885ae7555b0e3"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.732231 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-snbhg"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.744750 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.754245 5030 generic.go:358] "Generic (PLEG): container finished" podID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerID="700d22618664a8bae5687619c1f217e02d60020371c0a5168d4e7ce5c96274a2" exitCode=2 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.754360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerDied","Data":"700d22618664a8bae5687619c1f217e02d60020371c0a5168d4e7ce5c96274a2"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.759257 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.770970 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.778437 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779669 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779689 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779726 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener-log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779733 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener-log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779742 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api-log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779748 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api-log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779763 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779768 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779978 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.779990 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.780003 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" containerName="cinder-api-log" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.780012 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" containerName="barbican-keystone-listener-log" Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.785308 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980 is running failed: container process not found" containerID="3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.786745 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980 is running failed: container process not found" containerID="3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.789218 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.789408 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.790924 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-6984b7d5d-f7h69"] Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.791398 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980 is running failed: container process not found" containerID="3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.791454 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.795275 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.804914 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.809538 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzvc\" (UniqueName: \"kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.809669 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.809894 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.809944 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.809930694 +0000 UTC m=+1955.209243242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : configmap "openstack-cell1-scripts" not found Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.811449 5030 generic.go:358] "Generic (PLEG): container finished" podID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerID="241ed8aad54cd5abf2054349eae6ed6953071a6fb197aabd41df12342879c0a9" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.812284 5030 projected.go:194] Error preparing data for projected volume kube-api-access-wtzvc for pod openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.812346 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.812325036 +0000 UTC m=+1955.211637583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtzvc" (UniqueName: "kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.820771 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.821022 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.821666 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.821699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerDied","Data":"241ed8aad54cd5abf2054349eae6ed6953071a6fb197aabd41df12342879c0a9"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.823213 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-4k4zb"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.824542 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.824736 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.825391 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.826145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"0c423556-b75f-455e-9a6b-af0900be3c9f","Type":"ContainerDied","Data":"49e31db3de6d604f3e5767bf35f61f543b8e756e823cffa3a491e326b64e2ae1"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.826272 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.830670 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-4k4zb"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.841876 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.845918 5030 scope.go:117] "RemoveContainer" containerID="0a90c20fc66169b4e72b39bb97edb491201a4d9960ffdc66eb03dc9956283d21" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.846675 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-log" containerID="cri-o://1f7c92f93e44ab836cfa9064dde2240bad3aaed7f708d3b42d9a27bc5a7d49f2" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.847056 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-httpd" containerID="cri-o://a0bc82281b28010668e4849584debbef2b893d2b293d6882a12a0509256fd66e" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.854018 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.854293 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-log" containerID="cri-o://9efe6bd97770092e07dfe30bb192ac574b37f38b8f821b5cea5875ae51c15516" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.854802 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-httpd" containerID="cri-o://c4c004de843d0ad1792bbf115b0ceeb341223f6d0f9d98e26a07b1a262c184d0" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.872123 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.875926 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerID="3faeca43bc7881b5eb8665831a45fbb3d76c6914c5b13fb15dd42f9291d56a3c" exitCode=0 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.875959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerDied","Data":"3faeca43bc7881b5eb8665831a45fbb3d76c6914c5b13fb15dd42f9291d56a3c"} Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.880835 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.881100 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-api" containerID="cri-o://aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.881520 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-httpd" containerID="cri-o://dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2" gracePeriod=30 Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.897229 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkglk"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.900353 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-qkglk"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.914252 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.919788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.919839 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.919956 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.919974 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.920075 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.920146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grq67\" (UniqueName: \"kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.920193 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.920301 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.920343 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.929426 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xgr\" (UniqueName: \"kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:29 crc kubenswrapper[5030]: I0316 13:38:29.929509 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.931536 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:29 crc kubenswrapper[5030]: E0316 13:38:29.931626 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data podName:54074f93-8762-4822-b3df-761133496584 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.431606477 +0000 UTC m=+1954.830919024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data") pod "rabbitmq-cell1-server-0" (UID: "54074f93-8762-4822-b3df-761133496584") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:29.995435 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0006c2de-2330-4fcd-a854-ed0a25027735" path="/var/lib/kubelet/pods/0006c2de-2330-4fcd-a854-ed0a25027735/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:29.996127 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4e3703-ac33-43e2-b5c9-a6900c94daf9" path="/var/lib/kubelet/pods/0c4e3703-ac33-43e2-b5c9-a6900c94daf9/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.033060 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20694ac7-1dc1-452c-9fe4-5c321678f70a" path="/var/lib/kubelet/pods/20694ac7-1dc1-452c-9fe4-5c321678f70a/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.034278 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.034385 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236ac437-b3b4-44cf-a66e-26ff35541544" path="/var/lib/kubelet/pods/236ac437-b3b4-44cf-a66e-26ff35541544/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.034837 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.034393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.034932 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.035041 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.535021425 +0000 UTC m=+1954.934333971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035099 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29ead796-035d-4350-83da-1fbb1fbbe0a8" path="/var/lib/kubelet/pods/29ead796-035d-4350-83da-1fbb1fbbe0a8/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grq67\" (UniqueName: \"kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035581 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035686 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da66385-b1da-4248-8518-4fb80b8969c1" path="/var/lib/kubelet/pods/3da66385-b1da-4248-8518-4fb80b8969c1/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035732 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xgr\" (UniqueName: \"kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.035837 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.036144 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.036590 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036704 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036763 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.536749323 +0000 UTC m=+1954.936061871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036808 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036856 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.536848741 +0000 UTC m=+1954.936161287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036888 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.036939 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.536932157 +0000 UTC m=+1954.936244704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.037017 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.037037 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.537031995 +0000 UTC m=+1954.936344542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.037073 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbf1f84-046a-4a5b-8010-fb91e643732f" path="/var/lib/kubelet/pods/4fbf1f84-046a-4a5b-8010-fb91e643732f/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.038377 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.043830 5030 projected.go:194] Error preparing data for projected volume kube-api-access-t9xgr for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.043899 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:30.543881774 +0000 UTC m=+1954.943194322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t9xgr" (UniqueName: "kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.044518 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ded5f4-a756-47c1-812f-25d2405e2824" path="/var/lib/kubelet/pods/58ded5f4-a756-47c1-812f-25d2405e2824/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.045075 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9759eec8-29cb-4b9e-a2a2-c43041da8886" path="/var/lib/kubelet/pods/9759eec8-29cb-4b9e-a2a2-c43041da8886/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.045663 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e43fccc-dd40-45c7-b54d-3e9faf5d5039" path="/var/lib/kubelet/pods/9e43fccc-dd40-45c7-b54d-3e9faf5d5039/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.047306 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f" path="/var/lib/kubelet/pods/a8ffd7b9-ce16-4fb0-b1c2-b83117629c7f/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.061314 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.065185 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb44689a-fb82-41f8-af64-f82888a8c1ee" path="/var/lib/kubelet/pods/cb44689a-fb82-41f8-af64-f82888a8c1ee/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.068055 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d138ca85-f9e9-496b-b682-48837f301235" path="/var/lib/kubelet/pods/d138ca85-f9e9-496b-b682-48837f301235/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.069088 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7bc589c-f459-4baa-89df-6dc22ed935ef" path="/var/lib/kubelet/pods/d7bc589c-f459-4baa-89df-6dc22ed935ef/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.069817 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14" path="/var/lib/kubelet/pods/e434fc4a-fe8c-4d2c-8e8d-1886b2e96d14/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.071227 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0af7fe-6ff3-48a8-8813-1b07cf66ac38" path="/var/lib/kubelet/pods/ed0af7fe-6ff3-48a8-8813-1b07cf66ac38/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.072264 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7870762-c567-4da0-b9bd-785c76c82749" path="/var/lib/kubelet/pods/f7870762-c567-4da0-b9bd-785c76c82749/volumes" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.073139 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mkprr"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.073212 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-mkprr"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.073235 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.095628 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grq67\" (UniqueName: \"kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67\") pod \"dnsmasq-dnsmasq-79dcd846c5-tdht7\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.111211 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.132661 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.136779 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:30 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: if [ -n "placement" ]; then Mar 16 13:38:30 crc kubenswrapper[5030]: GRANT_DATABASE="placement" Mar 16 13:38:30 crc kubenswrapper[5030]: else Mar 16 13:38:30 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:30 crc kubenswrapper[5030]: fi Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:30 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:30 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:30 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:30 crc kubenswrapper[5030]: # support updates Mar 16 13:38:30 crc kubenswrapper[5030]: Mar 16 13:38:30 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.138834 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" podUID="7622c834-10b8-47b7-950f-8fee77132baa" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.146981 5030 scope.go:117] "RemoveContainer" containerID="519dbc57c2672d004f4a13b9360369a5ec04556d1594375893b223094bdef83a" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.153596 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.153816 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-log" containerID="cri-o://cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.154171 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-metadata" containerID="cri-o://2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.159110 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-57dc6"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.166854 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-57dc6"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.181410 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.181662 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-log" containerID="cri-o://9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.181793 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-api" containerID="cri-o://49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.221183 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-slwbl"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.275404 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-slwbl"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.286373 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.290403 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.290905 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api" containerID="cri-o://6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.290966 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api-log" containerID="cri-o://e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.300161 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.301410 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener-log" containerID="cri-o://418c2ae8a3e29aaebfe75d39aa3e156dea569cf6f9a33c380b5741e55ed1f16e" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.302922 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener" containerID="cri-o://d05277fe3d566f4707731dcb914f5be26c907ccaf0b2c041269d4a1ad8a72846" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.304689 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.305020 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker-log" containerID="cri-o://1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.305076 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker" containerID="cri-o://f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.309879 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-znbcd"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.324069 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-znbcd"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.327472 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.335487 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4ae9bce-4f3a-4540-ac99-b763e21a7c07/ovsdbserver-nb/0.log" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.335593 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.336227 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-6m5bn"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.336711 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.348616 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.348821 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" containerID="cri-o://6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.350839 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.352723 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.353966 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.361842 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.361908 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.378727 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.405014 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.452541 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.452867 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.452926 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.452986 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453181 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453221 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwrf8\" (UniqueName: \"kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453305 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453371 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.453407 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459509 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rphwh\" (UniqueName: \"kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config\") pod \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\" (UID: \"f0ebe1c0-5be1-4694-91ca-1bf386b42b18\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459745 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459844 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9jv9\" (UniqueName: \"kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.459941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config\") pod \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\" (UID: \"f4ae9bce-4f3a-4540-ac99-b763e21a7c07\") " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.460275 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs\") pod \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\" (UID: \"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94\") " Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.462718 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.462777 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data podName:54074f93-8762-4822-b3df-761133496584 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.462761078 +0000 UTC m=+1955.862073625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data") pod "rabbitmq-cell1-server-0" (UID: "54074f93-8762-4822-b3df-761133496584") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.463669 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts" (OuterVolumeSpecName: "scripts") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.471397 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs" (OuterVolumeSpecName: "logs") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.477823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.487100 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.492901 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config" (OuterVolumeSpecName: "config") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.493908 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.494186 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" containerID="cri-o://60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.518295 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8" (OuterVolumeSpecName: "kube-api-access-zwrf8") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "kube-api-access-zwrf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.520594 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.537469 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.540758 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-zmrs4"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.546791 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9" (OuterVolumeSpecName: "kube-api-access-g9jv9") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "kube-api-access-g9jv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.553749 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nw282"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.561527 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.561817 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="7539dd93-cdc3-43c8-88ce-8da150c32bed" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://98128b1da15f33cbd3b8eebee958aff66e54e0091a739eee794a2009335c1b67" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564686 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564756 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564829 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564918 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.564949 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xgr\" (UniqueName: \"kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565059 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565069 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565078 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwrf8\" (UniqueName: \"kubernetes.io/projected/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-kube-api-access-zwrf8\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565089 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565098 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565123 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565131 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565142 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9jv9\" (UniqueName: \"kubernetes.io/projected/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-kube-api-access-g9jv9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.565151 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565677 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565737 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.565721451 +0000 UTC m=+1955.965033998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565787 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565810 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.565803245 +0000 UTC m=+1955.965115792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565843 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565869 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.565863999 +0000 UTC m=+1955.965176546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565902 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565922 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.565916748 +0000 UTC m=+1955.965229295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565949 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.565964 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.565959359 +0000 UTC m=+1955.965271906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.592791 5030 projected.go:194] Error preparing data for projected volume kube-api-access-t9xgr for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.592862 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.592844641 +0000 UTC m=+1955.992157177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9xgr" (UniqueName: "kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.593193 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-nw282"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.593234 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.593254 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-mdxq5"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.594268 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wtzvc operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" podUID="042546f9-c010-441f-a2cd-d4f223b87094" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.594541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh" (OuterVolumeSpecName: "kube-api-access-rphwh") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "kube-api-access-rphwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.641780 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-mdxq5"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.674429 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rphwh\" (UniqueName: \"kubernetes.io/projected/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-kube-api-access-rphwh\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.684792 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.737558 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.752599 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.752795 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" containerID="cri-o://f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.759026 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.766231 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.777416 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-79c486444b-pt4lm"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.801077 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.803972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.804712 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="galera" containerID="cri-o://3a29f8a9390772b73127d61489b0831685b6af7e0ccc195eedd81fbae96ee3c0" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.815261 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.819239 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.819866 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs combined-ca-bundle config-data kube-api-access-t9xgr scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="2cf4fe46-38ca-4d7e-a13c-d09fc763d109" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.823106 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.829235 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.832165 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="158d5a38-dbc6-4c91-bcf3-873685dc8920" containerName="kube-state-metrics" containerID="cri-o://85b4b128330a2a72c05b8b9abf6b120ae54b117d646d5a83bde0568fdb84751e" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.837502 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.869443 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.876488 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.899342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910218 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910256 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzvc\" (UniqueName: \"kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910400 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910461 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910757 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910475 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:34.910454921 +0000 UTC m=+1959.309767468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910807 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:32.910790161 +0000 UTC m=+1957.310102709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : configmap "openstack-cell1-scripts" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.910817 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:34.910811502 +0000 UTC m=+1959.310124038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts\") pod \"nova-cell1-ea8b-account-create-update-zxglp\" (UID: \"042546f9-c010-441f-a2cd-d4f223b87094\") " pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910972 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910985 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.910995 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.911004 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.912331 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.912436 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="rabbitmq" containerID="cri-o://6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad" gracePeriod=604800 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.916015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config" (OuterVolumeSpecName: "config") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.916231 5030 projected.go:194] Error preparing data for projected volume kube-api-access-wtzvc for pod openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.916279 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc podName:042546f9-c010-441f-a2cd-d4f223b87094 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:32.916266939 +0000 UTC m=+1957.315579486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wtzvc" (UniqueName: "kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc") pod "nova-cell1-ea8b-account-create-update-zxglp" (UID: "042546f9-c010-441f-a2cd-d4f223b87094") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.916388 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.920389 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.920674 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-httpd" containerID="cri-o://2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.922245 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-server" containerID="cri-o://12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.927320 5030 generic.go:358] "Generic (PLEG): container finished" podID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerID="cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397" exitCode=143 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.927381 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerDied","Data":"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397"} Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.928786 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.928822 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.936700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data" (OuterVolumeSpecName: "config-data") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.937118 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.945626 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.945845 5030 generic.go:358] "Generic (PLEG): container finished" podID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" containerID="31ce460042feb0213ba1454666846e5c3ad2ea58527ded11eff4bf7e4df234c0" exitCode=137 Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.948309 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="f0791789-3d38-4e71-9a25-71e7dc03962a" containerName="memcached" containerID="cri-o://594463b0fd26e0fe6288a169c53eb853c3467ebbe897c1026505aa10d2654049" gracePeriod=30 Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.957526 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.961981 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-274jm"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.965142 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.966833 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.967523 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-68f7489858-zd25v" event={"ID":"a7f15c66-1ad3-461f-a14a-cbb43ce9ec94","Type":"ContainerDied","Data":"02f5fc78f55f22ae4a37fc4f1f7f27bbc640c9208b6496ee3617f74ca211316c"} Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.968905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.969212 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.970857 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.971541 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-274jm"] Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.978765 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.979532 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:38:30 crc kubenswrapper[5030]: E0316 13:38:30.979623 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="ovn-northd" probeResult="unknown" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986393 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986418 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986438 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-httpd" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986444 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-httpd" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986614 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="openstack-network-exporter" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986787 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="openstack-network-exporter" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986839 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.986846 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.987012 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.987019 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.987032 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="ovsdbserver-nb" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.987038 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="ovsdbserver-nb" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988190 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api-log" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988223 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-httpd" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988238 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="openstack-network-exporter" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988577 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" containerName="neutron-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988750 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" containerName="ovsdbserver-nb" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.988759 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" containerName="barbican-api" Mar 16 13:38:30 crc kubenswrapper[5030]: I0316 13:38:30.995974 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerID="1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.006697 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007495 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007525 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerDied","Data":"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" event={"ID":"f0ebe1c0-5be1-4694-91ca-1bf386b42b18","Type":"ContainerDied","Data":"46f6fbd9625d5a90ed8ccdbd739e247c2e66e83ffe489fe308330100f5e7302a"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007589 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-crjsm"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007601 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pqqjb"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007614 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-pqqjb"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.007712 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.013575 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-crjsm"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.013772 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.014711 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.016604 5030 generic.go:358] "Generic (PLEG): container finished" podID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerID="dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.016700 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerDied","Data":"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.019269 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022732 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022759 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022769 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022778 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022786 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.022795 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.024042 5030 generic.go:358] "Generic (PLEG): container finished" podID="e96402f4-7e68-4609-90b3-9db6f070b013" containerID="b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.024115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerDied","Data":"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.030290 5030 generic.go:358] "Generic (PLEG): container finished" podID="addecf4e-78dc-4422-a876-fb21680aff5e" containerID="9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.030360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerDied","Data":"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.031409 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" (UID: "a7f15c66-1ad3-461f-a14a-cbb43ce9ec94"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.032768 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "f4ae9bce-4f3a-4540-ac99-b763e21a7c07" (UID: "f4ae9bce-4f3a-4540-ac99-b763e21a7c07"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.042423 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerStarted","Data":"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.045858 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.046021 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" podUID="04d53072-e5ed-4045-8246-495440196ae5" containerName="keystone-api" containerID="cri-o://2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48" gracePeriod=30 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.049640 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-mwgnm"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.054775 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-mwgnm"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.067615 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s"] Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.069322 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gfr4r operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" podUID="59bba6fa-cae4-4d8e-ac7d-1407ce04c763" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069645 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069665 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069671 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069678 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069687 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069692 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069698 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069762 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069784 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069805 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069814 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069884 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.069923 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.075614 5030 generic.go:358] "Generic (PLEG): container finished" podID="ef6fcda0-d709-4281-881b-62164c605971" containerID="c4c004de843d0ad1792bbf115b0ceeb341223f6d0f9d98e26a07b1a262c184d0" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.075685 5030 generic.go:358] "Generic (PLEG): container finished" podID="ef6fcda0-d709-4281-881b-62164c605971" containerID="9efe6bd97770092e07dfe30bb192ac574b37f38b8f821b5cea5875ae51c15516" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.075816 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerDied","Data":"c4c004de843d0ad1792bbf115b0ceeb341223f6d0f9d98e26a07b1a262c184d0"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.075866 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerDied","Data":"9efe6bd97770092e07dfe30bb192ac574b37f38b8f821b5cea5875ae51c15516"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.083364 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_f4ae9bce-4f3a-4540-ac99-b763e21a7c07/ovsdbserver-nb/0.log" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.083470 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"f4ae9bce-4f3a-4540-ac99-b763e21a7c07","Type":"ContainerDied","Data":"d38133c1400a3d9d6c1850f899c0f93e623e0ca107f3a625bfbfff9db7da96fb"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.083609 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.097294 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.097331 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.102670 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "f0ebe1c0-5be1-4694-91ca-1bf386b42b18" (UID: "f0ebe1c0-5be1-4694-91ca-1bf386b42b18"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.108848 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerID="e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.109031 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerDied","Data":"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.119886 5030 generic.go:358] "Generic (PLEG): container finished" podID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerID="418c2ae8a3e29aaebfe75d39aa3e156dea569cf6f9a33c380b5741e55ed1f16e" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.120125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerDied","Data":"418c2ae8a3e29aaebfe75d39aa3e156dea569cf6f9a33c380b5741e55ed1f16e"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.124373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.124469 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfr4r\" (UniqueName: \"kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.124754 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0ebe1c0-5be1-4694-91ca-1bf386b42b18-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.124769 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4ae9bce-4f3a-4540-ac99-b763e21a7c07-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.124781 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.130754 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" event={"ID":"7622c834-10b8-47b7-950f-8fee77132baa","Type":"ContainerStarted","Data":"18d70e44e8b259888f00b6e7fbe74a97c034ca54ecef007aa44ad5b767b76c14"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.136825 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.141764 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.148345 5030 generic.go:358] "Generic (PLEG): container finished" podID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerID="a0bc82281b28010668e4849584debbef2b893d2b293d6882a12a0509256fd66e" exitCode=0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.148472 5030 generic.go:358] "Generic (PLEG): container finished" podID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerID="1f7c92f93e44ab836cfa9064dde2240bad3aaed7f708d3b42d9a27bc5a7d49f2" exitCode=143 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.148772 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.149528 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerDied","Data":"a0bc82281b28010668e4849584debbef2b893d2b293d6882a12a0509256fd66e"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.151822 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerDied","Data":"1f7c92f93e44ab836cfa9064dde2240bad3aaed7f708d3b42d9a27bc5a7d49f2"} Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.151068 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.184651 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="54074f93-8762-4822-b3df-761133496584" containerName="rabbitmq" containerID="cri-o://9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8" gracePeriod=604800 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.227497 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.227810 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.228104 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.728087484 +0000 UTC m=+1956.127400031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : configmap "openstack-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.228313 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfr4r\" (UniqueName: \"kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.231522 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gfr4r for pod openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.231654 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:31.731633613 +0000 UTC m=+1956.130946159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gfr4r" (UniqueName: "kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.280649 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="galera" containerID="cri-o://a5c37aa82cf27783f9d970554f97e701f281c08601787f57b4961c49be248480" gracePeriod=30 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.287086 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.298589 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.298752 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.319337 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.325632 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5c41eef1-5e65-449f-99bd-1b3f6d4179fa/ovsdbserver-sb/0.log" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.325717 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.341092 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-68f7489858-zd25v"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.413653 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.424213 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6fbf5fccd6-h87r4"] Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438050 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fpg2\" (UniqueName: \"kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438274 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438438 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438582 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438621 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd\") pod \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.438967 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs\") pod \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\" (UID: \"5c41eef1-5e65-449f-99bd-1b3f6d4179fa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.439036 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd\") pod \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.439046 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.439815 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2cf4fe46-38ca-4d7e-a13c-d09fc763d109" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.439969 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.439990 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.442958 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.442965 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.443029 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data podName:0f12cfce-f080-4e4a-b2b7-9aaa7855d10e nodeName:}" failed. No retries permitted until 2026-03-16 13:38:35.443009465 +0000 UTC m=+1959.842322012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data") pod "rabbitmq-server-0" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e") : configmap "rabbitmq-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.443045 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2cf4fe46-38ca-4d7e-a13c-d09fc763d109" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.443122 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2" (OuterVolumeSpecName: "kube-api-access-9fpg2") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "kube-api-access-9fpg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.444458 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config" (OuterVolumeSpecName: "config") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.453932 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts" (OuterVolumeSpecName: "scripts") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.482317 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: W0316 13:38:31.513172 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96da356a_d4b2_49d1_9fc8_74489792a53f.slice/crio-e32014ab793369877b6a880136077bedeb8b83bbbb06551bccaf9d59010cf727 WatchSource:0}: Error finding container e32014ab793369877b6a880136077bedeb8b83bbbb06551bccaf9d59010cf727: Status 404 returned error can't find the container with id e32014ab793369877b6a880136077bedeb8b83bbbb06551bccaf9d59010cf727 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.518645 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: W0316 13:38:31.524895 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e72570b_37ec_4875_ba88_dfaa7d4c71a3.slice/crio-d57a33cbab8c02d815e0248aaaf32c3320fdd4cd9247d68f258cbb04e6c2ecd0 WatchSource:0}: Error finding container d57a33cbab8c02d815e0248aaaf32c3320fdd4cd9247d68f258cbb04e6c2ecd0: Status 404 returned error can't find the container with id d57a33cbab8c02d815e0248aaaf32c3320fdd4cd9247d68f258cbb04e6c2ecd0 Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542785 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542827 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542839 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542851 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542863 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542872 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fpg2\" (UniqueName: \"kubernetes.io/projected/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-kube-api-access-9fpg2\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.542882 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.543190 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.543537 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data podName:54074f93-8762-4822-b3df-761133496584 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.543514851 +0000 UTC m=+1957.942827399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data") pod "rabbitmq-cell1-server-0" (UID: "54074f93-8762-4822-b3df-761133496584") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.543888 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "5c41eef1-5e65-449f-99bd-1b3f6d4179fa" (UID: "5c41eef1-5e65-449f-99bd-1b3f6d4179fa"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.584761 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e414ab06-97cb-4475-901d-fcdcc233c978" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.166:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.610183 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:31 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: if [ -n "" ]; then Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="" Mar 16 13:38:31 crc kubenswrapper[5030]: else Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:31 crc kubenswrapper[5030]: fi Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:31 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:31 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:31 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:31 crc kubenswrapper[5030]: # support updates Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.616923 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:31 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: if [ -n "barbican" ]; then Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="barbican" Mar 16 13:38:31 crc kubenswrapper[5030]: else Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:31 crc kubenswrapper[5030]: fi Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:31 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:31 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:31 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:31 crc kubenswrapper[5030]: # support updates Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.617121 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" podUID="96da356a-d4b2-49d1-9fc8-74489792a53f" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.618036 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:31 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: if [ -n "cinder" ]; then Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="cinder" Mar 16 13:38:31 crc kubenswrapper[5030]: else Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:31 crc kubenswrapper[5030]: fi Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:31 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:31 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:31 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:31 crc kubenswrapper[5030]: # support updates Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.618340 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" podUID="5c533164-3b99-4963-8eb8-1f621cbd2a89" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.620430 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"cinder-db-secret\\\" not found\"" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" podUID="5c1dff27-8288-4111-8e53-d3e6fed34e93" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.639742 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:31 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: if [ -n "neutron" ]; then Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="neutron" Mar 16 13:38:31 crc kubenswrapper[5030]: else Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:31 crc kubenswrapper[5030]: fi Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:31 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:31 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:31 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:31 crc kubenswrapper[5030]: # support updates Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.640291 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:31 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: if [ -n "glance" ]; then Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="glance" Mar 16 13:38:31 crc kubenswrapper[5030]: else Mar 16 13:38:31 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:31 crc kubenswrapper[5030]: fi Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:31 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:31 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:31 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:31 crc kubenswrapper[5030]: # support updates Mar 16 13:38:31 crc kubenswrapper[5030]: Mar 16 13:38:31 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.641117 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" podUID="86177247-e1c9-411c-9ac0-e6b4220f02b0" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.641374 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" podUID="6e72570b-37ec-4875-ba88-dfaa7d4c71a3" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.648962 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649040 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649113 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xgr\" (UniqueName: \"kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr\") pod \"ceilometer-0\" (UID: \"2cf4fe46-38ca-4d7e-a13c-d09fc763d109\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.649426 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5c41eef1-5e65-449f-99bd-1b3f6d4179fa-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649746 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649800 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.649783875 +0000 UTC m=+1958.049096423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649838 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649860 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.649851743 +0000 UTC m=+1958.049164290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "combined-ca-bundle" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649888 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649907 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.649901727 +0000 UTC m=+1958.049214274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649946 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649964 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.649958453 +0000 UTC m=+1958.049271000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "ceilometer-config-data" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.649992 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.650009 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.65000443 +0000 UTC m=+1958.049316978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.652862 5030 projected.go:194] Error preparing data for projected volume kube-api-access-t9xgr for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.652928 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr podName:2cf4fe46-38ca-4d7e-a13c-d09fc763d109 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:33.6529187 +0000 UTC m=+1958.052231246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t9xgr" (UniqueName: "kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr") pod "ceilometer-0" (UID: "2cf4fe46-38ca-4d7e-a13c-d09fc763d109") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.682737 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.708117 5030 scope.go:117] "RemoveContainer" containerID="09eb367841b2498ede5a4ecf8efaf6ea531864d540dfaec3827bc4dcd01cbd18" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.751523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.752018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfr4r\" (UniqueName: \"kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.752243 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.751646 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.752635 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:32.752615867 +0000 UTC m=+1957.151928414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : configmap "openstack-scripts" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.760958 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gfr4r for pod openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:31 crc kubenswrapper[5030]: E0316 13:38:31.761043 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:32.761023045 +0000 UTC m=+1957.160335772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfr4r" (UniqueName: "kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.775807 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.777725 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.782314 5030 scope.go:117] "RemoveContainer" containerID="22a5075a6d290e8de49a39a24a673979bf17640c2aa045ab88b4f001bc597e45" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.786146 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.850964 5030 scope.go:117] "RemoveContainer" containerID="241ed8aad54cd5abf2054349eae6ed6953071a6fb197aabd41df12342879c0a9" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.857622 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret\") pod \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.857770 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.857812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.857855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.857969 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config\") pod \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858013 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858120 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle\") pod \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858151 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74k7p\" (UniqueName: \"kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p\") pod \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\" (UID: \"13c6b0a7-7f2a-440b-9a33-6fd164c8f8db\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858319 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tzwt\" (UniqueName: \"kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt\") pod \"7622c834-10b8-47b7-950f-8fee77132baa\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858794 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858819 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts\") pod \"7622c834-10b8-47b7-950f-8fee77132baa\" (UID: \"7622c834-10b8-47b7-950f-8fee77132baa\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.858996 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs" (OuterVolumeSpecName: "logs") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.859756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.860574 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2wt\" (UniqueName: \"kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt\") pod \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\" (UID: \"15ccecb2-b2b1-496d-9d38-e1357367b8d4\") " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.860091 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.860451 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7622c834-10b8-47b7-950f-8fee77132baa" (UID: "7622c834-10b8-47b7-950f-8fee77132baa"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.868317 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts" (OuterVolumeSpecName: "scripts") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.870044 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.870158 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7622c834-10b8-47b7-950f-8fee77132baa-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.870251 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.870327 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/15ccecb2-b2b1-496d-9d38-e1357367b8d4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.883066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt" (OuterVolumeSpecName: "kube-api-access-pj2wt") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "kube-api-access-pj2wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.886983 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "glance") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.887419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p" (OuterVolumeSpecName: "kube-api-access-74k7p") pod "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" (UID: "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db"). InnerVolumeSpecName "kube-api-access-74k7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.893282 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt" (OuterVolumeSpecName: "kube-api-access-8tzwt") pod "7622c834-10b8-47b7-950f-8fee77132baa" (UID: "7622c834-10b8-47b7-950f-8fee77132baa"). InnerVolumeSpecName "kube-api-access-8tzwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.912665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.926326 5030 scope.go:117] "RemoveContainer" containerID="b6499ad77d8cd643ed391f4019b7ccbe313a0f133463cdf3a7817461b0bc0bad" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.955197 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.977991 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data" (OuterVolumeSpecName: "config-data") pod "15ccecb2-b2b1-496d-9d38-e1357367b8d4" (UID: "15ccecb2-b2b1-496d-9d38-e1357367b8d4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983288 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj2wt\" (UniqueName: \"kubernetes.io/projected/15ccecb2-b2b1-496d-9d38-e1357367b8d4-kube-api-access-pj2wt\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983387 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983446 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983499 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/15ccecb2-b2b1-496d-9d38-e1357367b8d4-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983652 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983859 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74k7p\" (UniqueName: \"kubernetes.io/projected/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-kube-api-access-74k7p\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.983952 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tzwt\" (UniqueName: \"kubernetes.io/projected/7622c834-10b8-47b7-950f-8fee77132baa-kube-api-access-8tzwt\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:31 crc kubenswrapper[5030]: I0316 13:38:31.984150 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" (UID: "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.014739 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c423556-b75f-455e-9a6b-af0900be3c9f" path="/var/lib/kubelet/pods/0c423556-b75f-455e-9a6b-af0900be3c9f/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.021164 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c8266f-c926-4d64-90aa-cd8d4543b0c4" path="/var/lib/kubelet/pods/25c8266f-c926-4d64-90aa-cd8d4543b0c4/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.021941 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28278e6e-77e5-4bc0-9555-7ab7a21df349" path="/var/lib/kubelet/pods/28278e6e-77e5-4bc0-9555-7ab7a21df349/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.023947 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2abd1835-1ef3-4b42-a8c6-df45ce29513f" path="/var/lib/kubelet/pods/2abd1835-1ef3-4b42-a8c6-df45ce29513f/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.024592 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409fc4db-a8fa-4f83-93c6-891e182eb2dd" path="/var/lib/kubelet/pods/409fc4db-a8fa-4f83-93c6-891e182eb2dd/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.027705 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4caa7fe2-4967-46e9-8877-f8c00d468708" path="/var/lib/kubelet/pods/4caa7fe2-4967-46e9-8877-f8c00d468708/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.028360 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ec227f-89bb-4eb3-8b2c-4b8138881432" path="/var/lib/kubelet/pods/51ec227f-89bb-4eb3-8b2c-4b8138881432/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.029195 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6718c361-7b6a-49a6-9bb3-e533e921478c" path="/var/lib/kubelet/pods/6718c361-7b6a-49a6-9bb3-e533e921478c/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.030459 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="761940b5-90f6-4c99-b5c9-5aab7ecf09ce" path="/var/lib/kubelet/pods/761940b5-90f6-4c99-b5c9-5aab7ecf09ce/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.031119 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92ba657c-622d-4ca5-8b0b-cd1a2dd20547" path="/var/lib/kubelet/pods/92ba657c-622d-4ca5-8b0b-cd1a2dd20547/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.031779 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c65424-97bc-427a-8fd4-5956f881ce2c" path="/var/lib/kubelet/pods/a4c65424-97bc-427a-8fd4-5956f881ce2c/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.032932 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f15c66-1ad3-461f-a14a-cbb43ce9ec94" path="/var/lib/kubelet/pods/a7f15c66-1ad3-461f-a14a-cbb43ce9ec94/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.033708 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac542008-cc3c-42cd-83f2-633a1f284240" path="/var/lib/kubelet/pods/ac542008-cc3c-42cd-83f2-633a1f284240/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.034357 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5063ed4-1f74-4636-b93e-05d8abb806bd" path="/var/lib/kubelet/pods/c5063ed4-1f74-4636-b93e-05d8abb806bd/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.035369 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee738805-96da-4590-91dc-d7551be1ca27" path="/var/lib/kubelet/pods/ee738805-96da-4590-91dc-d7551be1ca27/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.035774 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.035428 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.037308 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ebe1c0-5be1-4694-91ca-1bf386b42b18" path="/var/lib/kubelet/pods/f0ebe1c0-5be1-4694-91ca-1bf386b42b18/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.043956 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ae9bce-4f3a-4540-ac99-b763e21a7c07" path="/var/lib/kubelet/pods/f4ae9bce-4f3a-4540-ac99-b763e21a7c07/volumes" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.055096 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" (UID: "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.057146 5030 scope.go:117] "RemoveContainer" containerID="95200b4e7b4806b197c6dc6c629a9a18625013eb6bcbe56185fb676aec7fcfa9" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085355 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085429 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085518 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085727 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085811 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkkbs\" (UniqueName: \"kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085918 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.085944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.086079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") pod \"ef6fcda0-d709-4281-881b-62164c605971\" (UID: \"ef6fcda0-d709-4281-881b-62164c605971\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.086845 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.086864 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.086873 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.087289 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.088135 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" (UID: "13c6b0a7-7f2a-440b-9a33-6fd164c8f8db"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.088171 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs" (OuterVolumeSpecName: "logs") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.093654 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs" (OuterVolumeSpecName: "kube-api-access-jkkbs") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "kube-api-access-jkkbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.093771 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts" (OuterVolumeSpecName: "scripts") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.094252 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage12-crc" (OuterVolumeSpecName: "glance") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "local-storage12-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.102699 5030 scope.go:117] "RemoveContainer" containerID="3faeca43bc7881b5eb8665831a45fbb3d76c6914c5b13fb15dd42f9291d56a3c" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.140045 5030 scope.go:117] "RemoveContainer" containerID="43bd0c72c69ffa1704b2cb1e04e0c0230d50bfd2783783c97a1a8cd59d88b278" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.147918 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data" (OuterVolumeSpecName: "config-data") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.157652 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.194169 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ef6fcda0-d709-4281-881b-62164c605971" (UID: "ef6fcda0-d709-4281-881b-62164c605971"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.195854 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.195877 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkkbs\" (UniqueName: \"kubernetes.io/projected/ef6fcda0-d709-4281-881b-62164c605971-kube-api-access-jkkbs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.195890 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.195898 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ef6fcda0-d709-4281-881b-62164c605971-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.195906 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.196043 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.196057 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.196078 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.196087 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ef6fcda0-d709-4281-881b-62164c605971-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.204069 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" event={"ID":"86177247-e1c9-411c-9ac0-e6b4220f02b0","Type":"ContainerStarted","Data":"8248bffe6e226f333f62b49c5689b5e85c9e0e476a1081bee24efb5acf02d0e4"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.217933 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage12-crc" (UniqueName: "kubernetes.io/local-volume/local-storage12-crc") on node "crc" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.224623 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0791789-3d38-4e71-9a25-71e7dc03962a" containerID="594463b0fd26e0fe6288a169c53eb853c3467ebbe897c1026505aa10d2654049" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.224678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f0791789-3d38-4e71-9a25-71e7dc03962a","Type":"ContainerDied","Data":"594463b0fd26e0fe6288a169c53eb853c3467ebbe897c1026505aa10d2654049"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.230410 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" event={"ID":"6e72570b-37ec-4875-ba88-dfaa7d4c71a3","Type":"ContainerStarted","Data":"d57a33cbab8c02d815e0248aaaf32c3320fdd4cd9247d68f258cbb04e6c2ecd0"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.256310 5030 scope.go:117] "RemoveContainer" containerID="3afb1dea4d49452a06f4fb12ae007ebef45f9d1f66948ac270d5ac466a96d980" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.264233 5030 generic.go:358] "Generic (PLEG): container finished" podID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerID="a5c37aa82cf27783f9d970554f97e701f281c08601787f57b4961c49be248480" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.264310 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerDied","Data":"a5c37aa82cf27783f9d970554f97e701f281c08601787f57b4961c49be248480"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.268759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" event={"ID":"7622c834-10b8-47b7-950f-8fee77132baa","Type":"ContainerDied","Data":"18d70e44e8b259888f00b6e7fbe74a97c034ca54ecef007aa44ad5b767b76c14"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.268769 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.279676 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_5c41eef1-5e65-449f-99bd-1b3f6d4179fa/ovsdbserver-sb/0.log" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.279753 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"5c41eef1-5e65-449f-99bd-1b3f6d4179fa","Type":"ContainerDied","Data":"268f347aa8513bce94e31838d9e44072f501a023536113260a53c29422d892d5"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.279823 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.301939 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.305662 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage12-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage12-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.307326 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-bc4b-account-create-update-xggq2"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.334846 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.353881 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.375561 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.386705 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.386709 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"15ccecb2-b2b1-496d-9d38-e1357367b8d4","Type":"ContainerDied","Data":"15dbda8ebb8eec1cd1f9b67de035392132d84483f9e18ff5f6aa9a9b30a621e2"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.391602 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.391765 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.393795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" event={"ID":"5c1dff27-8288-4111-8e53-d3e6fed34e93","Type":"ContainerStarted","Data":"bd6aa7b1f2f0ffea7db0ae2e14bdfc71ef8e2903f24175e6c06e1fa94141caf2"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.402511 5030 scope.go:117] "RemoveContainer" containerID="67f7f23afc348f233a93cd0b1dd1da1cddfaebd7b11bcb9aad5e09f2260dd4db" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.412542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.421531 5030 generic.go:358] "Generic (PLEG): container finished" podID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerID="3a29f8a9390772b73127d61489b0831685b6af7e0ccc195eedd81fbae96ee3c0" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.421667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerDied","Data":"3a29f8a9390772b73127d61489b0831685b6af7e0ccc195eedd81fbae96ee3c0"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.428596 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.433823 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.464709 5030 generic.go:358] "Generic (PLEG): container finished" podID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerID="12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.464989 5030 generic.go:358] "Generic (PLEG): container finished" podID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerID="2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.464885 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.464945 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" event={"ID":"4e1c091d-1b18-4cec-b78d-6c41368faf75","Type":"ContainerDied","Data":"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.465208 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9" event={"ID":"4e1c091d-1b18-4cec-b78d-6c41368faf75","Type":"ContainerDied","Data":"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.472491 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.476694 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.480170 5030 generic.go:358] "Generic (PLEG): container finished" podID="158d5a38-dbc6-4c91-bcf3-873685dc8920" containerID="85b4b128330a2a72c05b8b9abf6b120ae54b117d646d5a83bde0568fdb84751e" exitCode=2 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.480225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"158d5a38-dbc6-4c91-bcf3-873685dc8920","Type":"ContainerDied","Data":"85b4b128330a2a72c05b8b9abf6b120ae54b117d646d5a83bde0568fdb84751e"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.480279 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.483667 5030 generic.go:358] "Generic (PLEG): container finished" podID="7539dd93-cdc3-43c8-88ce-8da150c32bed" containerID="98128b1da15f33cbd3b8eebee958aff66e54e0091a739eee794a2009335c1b67" exitCode=0 Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.484413 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"7539dd93-cdc3-43c8-88ce-8da150c32bed","Type":"ContainerDied","Data":"98128b1da15f33cbd3b8eebee958aff66e54e0091a739eee794a2009335c1b67"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.484500 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.496913 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.496941 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.497095 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" event={"ID":"96da356a-d4b2-49d1-9fc8-74489792a53f","Type":"ContainerStarted","Data":"e32014ab793369877b6a880136077bedeb8b83bbbb06551bccaf9d59010cf727"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513201 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513263 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs\") pod \"7539dd93-cdc3-43c8-88ce-8da150c32bed\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513301 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9gvq\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513329 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513440 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513469 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data\") pod \"7539dd93-cdc3-43c8-88ce-8da150c32bed\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513495 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513520 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs\") pod \"f0791789-3d38-4e71-9a25-71e7dc03962a\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513582 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l5mn\" (UniqueName: \"kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs\") pod \"158d5a38-dbc6-4c91-bcf3-873685dc8920\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513646 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513662 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513682 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513708 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzlkc\" (UniqueName: \"kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc\") pod \"7539dd93-cdc3-43c8-88ce-8da150c32bed\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config\") pod \"f0791789-3d38-4e71-9a25-71e7dc03962a\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513819 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle\") pod \"7539dd93-cdc3-43c8-88ce-8da150c32bed\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle\") pod \"f0791789-3d38-4e71-9a25-71e7dc03962a\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513883 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513904 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config\") pod \"158d5a38-dbc6-4c91-bcf3-873685dc8920\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513931 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.513987 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxjdd\" (UniqueName: \"kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd\") pod \"158d5a38-dbc6-4c91-bcf3-873685dc8920\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514088 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle\") pod \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\" (UID: \"f88d14c0-1c53-416d-a0bb-31c9cf2411a7\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data\") pod \"f0791789-3d38-4e71-9a25-71e7dc03962a\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514354 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs\") pod \"7539dd93-cdc3-43c8-88ce-8da150c32bed\" (UID: \"7539dd93-cdc3-43c8-88ce-8da150c32bed\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42lq9\" (UniqueName: \"kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9\") pod \"f0791789-3d38-4e71-9a25-71e7dc03962a\" (UID: \"f0791789-3d38-4e71-9a25-71e7dc03962a\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514573 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.514596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle\") pod \"158d5a38-dbc6-4c91-bcf3-873685dc8920\" (UID: \"158d5a38-dbc6-4c91-bcf3-873685dc8920\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.528052 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn" (OuterVolumeSpecName: "kube-api-access-2l5mn") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "kube-api-access-2l5mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.528862 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.529038 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.531047 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data" (OuterVolumeSpecName: "config-data") pod "f0791789-3d38-4e71-9a25-71e7dc03962a" (UID: "f0791789-3d38-4e71-9a25-71e7dc03962a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.535637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq" (OuterVolumeSpecName: "kube-api-access-m9gvq") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "kube-api-access-m9gvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.538217 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f0791789-3d38-4e71-9a25-71e7dc03962a" (UID: "f0791789-3d38-4e71-9a25-71e7dc03962a"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.538515 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.540626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.540757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"ef6fcda0-d709-4281-881b-62164c605971","Type":"ContainerDied","Data":"d018334d3997c0fc7fae4b508912aaba2e43bfaaa7c92c00ecb71baae45efcca"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.540901 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.541319 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.546936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc" (OuterVolumeSpecName: "kube-api-access-pzlkc") pod "7539dd93-cdc3-43c8-88ce-8da150c32bed" (UID: "7539dd93-cdc3-43c8-88ce-8da150c32bed"). InnerVolumeSpecName "kube-api-access-pzlkc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.547419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.547478 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data\") pod \"4e1c091d-1b18-4cec-b78d-6c41368faf75\" (UID: \"4e1c091d-1b18-4cec-b78d-6c41368faf75\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558006 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558031 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9gvq\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-kube-api-access-m9gvq\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558040 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558049 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558058 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l5mn\" (UniqueName: \"kubernetes.io/projected/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-kube-api-access-2l5mn\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558067 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558076 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/4e1c091d-1b18-4cec-b78d-6c41368faf75-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558084 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/4e1c091d-1b18-4cec-b78d-6c41368faf75-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558093 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzlkc\" (UniqueName: \"kubernetes.io/projected/7539dd93-cdc3-43c8-88ce-8da150c32bed-kube-api-access-pzlkc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558101 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f0791789-3d38-4e71-9a25-71e7dc03962a-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.558109 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.559491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.563473 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.565417 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" event={"ID":"5c533164-3b99-4963-8eb8-1f621cbd2a89","Type":"ContainerStarted","Data":"51a3f1a84534e9619829a356571cf3b874adb303f7ae1c63ae5b1dc8a9fc9ced"} Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.566729 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.567378 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.568781 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9" (OuterVolumeSpecName: "kube-api-access-42lq9") pod "f0791789-3d38-4e71-9a25-71e7dc03962a" (UID: "f0791789-3d38-4e71-9a25-71e7dc03962a"). InnerVolumeSpecName "kube-api-access-42lq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.573836 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd" (OuterVolumeSpecName: "kube-api-access-sxjdd") pod "158d5a38-dbc6-4c91-bcf3-873685dc8920" (UID: "158d5a38-dbc6-4c91-bcf3-873685dc8920"). InnerVolumeSpecName "kube-api-access-sxjdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.584892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "158d5a38-dbc6-4c91-bcf3-873685dc8920" (UID: "158d5a38-dbc6-4c91-bcf3-873685dc8920"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.586493 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "158d5a38-dbc6-4c91-bcf3-873685dc8920" (UID: "158d5a38-dbc6-4c91-bcf3-873685dc8920"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.603984 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage07-crc" (OuterVolumeSpecName: "mysql-db") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "local-storage07-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.636146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data" (OuterVolumeSpecName: "config-data") pod "7539dd93-cdc3-43c8-88ce-8da150c32bed" (UID: "7539dd93-cdc3-43c8-88ce-8da150c32bed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663850 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42lq9\" (UniqueName: \"kubernetes.io/projected/f0791789-3d38-4e71-9a25-71e7dc03962a-kube-api-access-42lq9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663884 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663893 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663902 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663927 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663937 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.663948 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxjdd\" (UniqueName: \"kubernetes.io/projected/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-api-access-sxjdd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.667763 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.672418 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: W0316 13:38:32.693758 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0878d5e_a073_4f16_b09b_7e5f5088fdc0.slice/crio-b1c6dc05ba14dc228783f1369d164304670037cc00ca1046e2ca1417f22652af WatchSource:0}: Error finding container b1c6dc05ba14dc228783f1369d164304670037cc00ca1046e2ca1417f22652af: Status 404 returned error can't find the container with id b1c6dc05ba14dc228783f1369d164304670037cc00ca1046e2ca1417f22652af Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.697103 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "f0791789-3d38-4e71-9a25-71e7dc03962a" (UID: "f0791789-3d38-4e71-9a25-71e7dc03962a"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.699786 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage07-crc" (UniqueName: "kubernetes.io/local-volume/local-storage07-crc") on node "crc" Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.700312 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:38:32 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: if [ -n "nova_api" ]; then Mar 16 13:38:32 crc kubenswrapper[5030]: GRANT_DATABASE="nova_api" Mar 16 13:38:32 crc kubenswrapper[5030]: else Mar 16 13:38:32 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:38:32 crc kubenswrapper[5030]: fi Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:38:32 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:38:32 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:38:32 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:38:32 crc kubenswrapper[5030]: # support updates Mar 16 13:38:32 crc kubenswrapper[5030]: Mar 16 13:38:32 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.701468 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" podUID="c0878d5e-a073-4f16-b09b-7e5f5088fdc0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.732276 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.741977 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "158d5a38-dbc6-4c91-bcf3-873685dc8920" (UID: "158d5a38-dbc6-4c91-bcf3-873685dc8920"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.744637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "7539dd93-cdc3-43c8-88ce-8da150c32bed" (UID: "7539dd93-cdc3-43c8-88ce-8da150c32bed"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.752457 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f0791789-3d38-4e71-9a25-71e7dc03962a" (UID: "f0791789-3d38-4e71-9a25-71e7dc03962a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.759418 5030 scope.go:117] "RemoveContainer" containerID="0e089bc213a84f45cb151137664b99776b4a0316ddfcdf2e444885ae7555b0e3" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.766495 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770376 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfr4r\" (UniqueName: \"kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r\") pod \"keystone-078a-account-create-update-7jv5s\" (UID: \"59bba6fa-cae4-4d8e-ac7d-1407ce04c763\") " pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770776 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770793 5030 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770804 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/158d5a38-dbc6-4c91-bcf3-873685dc8920-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770818 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0791789-3d38-4e71-9a25-71e7dc03962a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770827 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage07-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage07-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.770837 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.770918 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.773292 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.776729 5030 projected.go:194] Error preparing data for projected volume kube-api-access-gfr4r for pod openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.779220 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:34.779126137 +0000 UTC m=+1959.178438684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : configmap "openstack-scripts" not found Mar 16 13:38:32 crc kubenswrapper[5030]: E0316 13:38:32.779674 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r podName:59bba6fa-cae4-4d8e-ac7d-1407ce04c763 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:34.779650254 +0000 UTC m=+1959.178962800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfr4r" (UniqueName: "kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r") pod "keystone-078a-account-create-update-7jv5s" (UID: "59bba6fa-cae4-4d8e-ac7d-1407ce04c763") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.788757 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7539dd93-cdc3-43c8-88ce-8da150c32bed" (UID: "7539dd93-cdc3-43c8-88ce-8da150c32bed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.796262 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.799864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.807246 5030 scope.go:117] "RemoveContainer" containerID="a0bc82281b28010668e4849584debbef2b893d2b293d6882a12a0509256fd66e" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.815018 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-ea8b-account-create-update-zxglp"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.830185 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.838920 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.856098 5030 scope.go:117] "RemoveContainer" containerID="1f7c92f93e44ab836cfa9064dde2240bad3aaed7f708d3b42d9a27bc5a7d49f2" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.860059 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "7539dd93-cdc3-43c8-88ce-8da150c32bed" (UID: "7539dd93-cdc3-43c8-88ce-8da150c32bed"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.866441 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.879927 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts\") pod \"86177247-e1c9-411c-9ac0-e6b4220f02b0\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880118 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts\") pod \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880293 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z2s9\" (UniqueName: \"kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9\") pod \"86177247-e1c9-411c-9ac0-e6b4220f02b0\" (UID: \"86177247-e1c9-411c-9ac0-e6b4220f02b0\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880399 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880420 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880444 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880469 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78xcz\" (UniqueName: \"kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz\") pod \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\" (UID: \"6e72570b-37ec-4875-ba88-dfaa7d4c71a3\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880523 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scwgz\" (UniqueName: \"kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880560 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880622 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"be778f00-60cf-413b-97d8-cd9a392fba6d\" (UID: \"be778f00-60cf-413b-97d8-cd9a392fba6d\") " Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.880883 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "6e72570b-37ec-4875-ba88-dfaa7d4c71a3" (UID: "6e72570b-37ec-4875-ba88-dfaa7d4c71a3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.882268 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.885460 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.886904 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.889125 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.889275 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "86177247-e1c9-411c-9ac0-e6b4220f02b0" (UID: "86177247-e1c9-411c-9ac0-e6b4220f02b0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893165 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893207 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893219 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893228 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893237 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893245 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/be778f00-60cf-413b-97d8-cd9a392fba6d-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893256 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893268 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtzvc\" (UniqueName: \"kubernetes.io/projected/042546f9-c010-441f-a2cd-d4f223b87094-kube-api-access-wtzvc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893277 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893285 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/be778f00-60cf-413b-97d8-cd9a392fba6d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893294 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/042546f9-c010-441f-a2cd-d4f223b87094-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893304 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/86177247-e1c9-411c-9ac0-e6b4220f02b0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.893314 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/7539dd93-cdc3-43c8-88ce-8da150c32bed-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.895433 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data" (OuterVolumeSpecName: "config-data") pod "4e1c091d-1b18-4cec-b78d-6c41368faf75" (UID: "4e1c091d-1b18-4cec-b78d-6c41368faf75"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.905599 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.953714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9" (OuterVolumeSpecName: "kube-api-access-5z2s9") pod "86177247-e1c9-411c-9ac0-e6b4220f02b0" (UID: "86177247-e1c9-411c-9ac0-e6b4220f02b0"). InnerVolumeSpecName "kube-api-access-5z2s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.954713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz" (OuterVolumeSpecName: "kube-api-access-78xcz") pod "6e72570b-37ec-4875-ba88-dfaa7d4c71a3" (UID: "6e72570b-37ec-4875-ba88-dfaa7d4c71a3"). InnerVolumeSpecName "kube-api-access-78xcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.959943 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.960801 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz" (OuterVolumeSpecName: "kube-api-access-scwgz") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "kube-api-access-scwgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.966865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "f88d14c0-1c53-416d-a0bb-31c9cf2411a7" (UID: "f88d14c0-1c53-416d-a0bb-31c9cf2411a7"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.977729 5030 scope.go:117] "RemoveContainer" containerID="31ce460042feb0213ba1454666846e5c3ad2ea58527ded11eff4bf7e4df234c0" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.982812 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.999694 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e1c091d-1b18-4cec-b78d-6c41368faf75-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.999729 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f88d14c0-1c53-416d-a0bb-31c9cf2411a7-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.999747 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z2s9\" (UniqueName: \"kubernetes.io/projected/86177247-e1c9-411c-9ac0-e6b4220f02b0-kube-api-access-5z2s9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.999757 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78xcz\" (UniqueName: \"kubernetes.io/projected/6e72570b-37ec-4875-ba88-dfaa7d4c71a3-kube-api-access-78xcz\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:32 crc kubenswrapper[5030]: I0316 13:38:32.999767 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scwgz\" (UniqueName: \"kubernetes.io/projected/be778f00-60cf-413b-97d8-cd9a392fba6d-kube-api-access-scwgz\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.000009 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.022490 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.024957 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.031826 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.042576 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.049003 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.076915 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.085493 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.088237 5030 scope.go:117] "RemoveContainer" containerID="12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.089865 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.099386 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.100190 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be778f00-60cf-413b-97d8-cd9a392fba6d" (UID: "be778f00-60cf-413b-97d8-cd9a392fba6d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101378 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-722zc\" (UniqueName: \"kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc\") pod \"96da356a-d4b2-49d1-9fc8-74489792a53f\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101560 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grrzq\" (UniqueName: \"kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq\") pod \"5c1dff27-8288-4111-8e53-d3e6fed34e93\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts\") pod \"96da356a-d4b2-49d1-9fc8-74489792a53f\" (UID: \"96da356a-d4b2-49d1-9fc8-74489792a53f\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101656 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts\") pod \"5c1dff27-8288-4111-8e53-d3e6fed34e93\" (UID: \"5c1dff27-8288-4111-8e53-d3e6fed34e93\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101920 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts\") pod \"5c533164-3b99-4963-8eb8-1f621cbd2a89\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.101962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frs97\" (UniqueName: \"kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97\") pod \"5c533164-3b99-4963-8eb8-1f621cbd2a89\" (UID: \"5c533164-3b99-4963-8eb8-1f621cbd2a89\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.103133 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106163 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106196 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106209 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/be778f00-60cf-413b-97d8-cd9a392fba6d-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106220 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106232 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106244 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9xgr\" (UniqueName: \"kubernetes.io/projected/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-kube-api-access-t9xgr\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106272 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106285 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2cf4fe46-38ca-4d7e-a13c-d09fc763d109-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.106853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5c1dff27-8288-4111-8e53-d3e6fed34e93" (UID: "5c1dff27-8288-4111-8e53-d3e6fed34e93"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.107606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq" (OuterVolumeSpecName: "kube-api-access-grrzq") pod "5c1dff27-8288-4111-8e53-d3e6fed34e93" (UID: "5c1dff27-8288-4111-8e53-d3e6fed34e93"). InnerVolumeSpecName "kube-api-access-grrzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.107945 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5c533164-3b99-4963-8eb8-1f621cbd2a89" (UID: "5c533164-3b99-4963-8eb8-1f621cbd2a89"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.108475 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "96da356a-d4b2-49d1-9fc8-74489792a53f" (UID: "96da356a-d4b2-49d1-9fc8-74489792a53f"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.110187 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.111070 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc" (OuterVolumeSpecName: "kube-api-access-722zc") pod "96da356a-d4b2-49d1-9fc8-74489792a53f" (UID: "96da356a-d4b2-49d1-9fc8-74489792a53f"). InnerVolumeSpecName "kube-api-access-722zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.111225 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97" (OuterVolumeSpecName: "kube-api-access-frs97") pod "5c533164-3b99-4963-8eb8-1f621cbd2a89" (UID: "5c533164-3b99-4963-8eb8-1f621cbd2a89"). InnerVolumeSpecName "kube-api-access-frs97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.151948 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.166671 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.171788 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.175833 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5db587c58-zdwb9"] Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.192721 5030 scope.go:117] "RemoveContainer" containerID="2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214538 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c533164-3b99-4963-8eb8-1f621cbd2a89-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214779 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frs97\" (UniqueName: \"kubernetes.io/projected/5c533164-3b99-4963-8eb8-1f621cbd2a89-kube-api-access-frs97\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214789 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-722zc\" (UniqueName: \"kubernetes.io/projected/96da356a-d4b2-49d1-9fc8-74489792a53f-kube-api-access-722zc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214798 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grrzq\" (UniqueName: \"kubernetes.io/projected/5c1dff27-8288-4111-8e53-d3e6fed34e93-kube-api-access-grrzq\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214806 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/96da356a-d4b2-49d1-9fc8-74489792a53f-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.214814 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5c1dff27-8288-4111-8e53-d3e6fed34e93-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.262605 5030 scope.go:117] "RemoveContainer" containerID="12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9" Mar 16 13:38:33 crc kubenswrapper[5030]: E0316 13:38:33.263035 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9\": container with ID starting with 12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9 not found: ID does not exist" containerID="12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.263100 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9"} err="failed to get container status \"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9\": rpc error: code = NotFound desc = could not find container \"12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9\": container with ID starting with 12be5af07dce1eb38df2dfd2dccf20bb8f8d07b94ee1619c35d4e652c9933df9 not found: ID does not exist" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.263129 5030 scope.go:117] "RemoveContainer" containerID="2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459" Mar 16 13:38:33 crc kubenswrapper[5030]: E0316 13:38:33.263729 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459\": container with ID starting with 2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459 not found: ID does not exist" containerID="2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.263755 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459"} err="failed to get container status \"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459\": rpc error: code = NotFound desc = could not find container \"2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459\": container with ID starting with 2e0ef7e17c0c1765d8389373c0c83d7ba4839af010d52f4043c774817b06a459 not found: ID does not exist" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.263776 5030 scope.go:117] "RemoveContainer" containerID="85b4b128330a2a72c05b8b9abf6b120ae54b117d646d5a83bde0568fdb84751e" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.286966 5030 scope.go:117] "RemoveContainer" containerID="98128b1da15f33cbd3b8eebee958aff66e54e0091a739eee794a2009335c1b67" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.304900 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.326290 5030 scope.go:117] "RemoveContainer" containerID="c4c004de843d0ad1792bbf115b0ceeb341223f6d0f9d98e26a07b1a262c184d0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.356316 5030 scope.go:117] "RemoveContainer" containerID="9efe6bd97770092e07dfe30bb192ac574b37f38b8f821b5cea5875ae51c15516" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.417316 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle\") pod \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.417499 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs\") pod \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.417593 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjft2\" (UniqueName: \"kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2\") pod \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.417626 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom\") pod \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.417816 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data\") pod \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\" (UID: \"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.419310 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs" (OuterVolumeSpecName: "logs") pod "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" (UID: "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.422487 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" (UID: "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.423437 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2" (OuterVolumeSpecName: "kube-api-access-xjft2") pod "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" (UID: "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c"). InnerVolumeSpecName "kube-api-access-xjft2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.441860 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.446004 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" (UID: "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.465523 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data" (OuterVolumeSpecName: "config-data") pod "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" (UID: "2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521308 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521641 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxqp9\" (UniqueName: \"kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521686 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521761 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521831 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521863 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.521903 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.522447 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.522463 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.522504 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.522514 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjft2\" (UniqueName: \"kubernetes.io/projected/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-kube-api-access-xjft2\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.522525 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.545384 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs" (OuterVolumeSpecName: "logs") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.548839 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9" (OuterVolumeSpecName: "kube-api-access-hxqp9") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "kube-api-access-hxqp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.549153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts" (OuterVolumeSpecName: "scripts") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.563873 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.1.130:9311/healthcheck\": read tcp 10.217.0.2:49708->10.217.1.130:9311: read: connection reset by peer" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.563887 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.1.130:9311/healthcheck\": read tcp 10.217.0.2:51404->10.217.1.130:9311: read: connection reset by peer" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.593091 5030 generic.go:358] "Generic (PLEG): container finished" podID="06859e34-1622-4e83-9610-5db910da5a99" containerID="21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233" exitCode=0 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.593228 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" event={"ID":"06859e34-1622-4e83-9610-5db910da5a99","Type":"ContainerDied","Data":"21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.593270 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" event={"ID":"06859e34-1622-4e83-9610-5db910da5a99","Type":"ContainerStarted","Data":"96c1cd2dffa1b15443278535991ecbe472c5e85954bfacb9b6a59a5cb96896ee"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.599302 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.599344 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.605853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerStarted","Data":"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.606002 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="cinder-scheduler" containerID="cri-o://3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" gracePeriod=30 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.606097 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="probe" containerID="cri-o://4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" gracePeriod=30 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.606842 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data" (OuterVolumeSpecName: "config-data") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.624467 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.625231 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") pod \"e96402f4-7e68-4609-90b3-9db6f070b013\" (UID: \"e96402f4-7e68-4609-90b3-9db6f070b013\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.625754 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.625775 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.625786 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxqp9\" (UniqueName: \"kubernetes.io/projected/e96402f4-7e68-4609-90b3-9db6f070b013-kube-api-access-hxqp9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.625795 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e96402f4-7e68-4609-90b3-9db6f070b013-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: E0316 13:38:33.625858 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:33 crc kubenswrapper[5030]: E0316 13:38:33.625908 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data podName:54074f93-8762-4822-b3df-761133496584 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:37.625890609 +0000 UTC m=+1962.025203156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data") pod "rabbitmq-cell1-server-0" (UID: "54074f93-8762-4822-b3df-761133496584") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:38:33 crc kubenswrapper[5030]: W0316 13:38:33.627692 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/e96402f4-7e68-4609-90b3-9db6f070b013/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.627725 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.633696 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" event={"ID":"5c533164-3b99-4963-8eb8-1f621cbd2a89","Type":"ContainerDied","Data":"51a3f1a84534e9619829a356571cf3b874adb303f7ae1c63ae5b1dc8a9fc9ced"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.633820 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.635340 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" event={"ID":"c0878d5e-a073-4f16-b09b-7e5f5088fdc0","Type":"ContainerStarted","Data":"b1c6dc05ba14dc228783f1369d164304670037cc00ca1046e2ca1417f22652af"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.641435 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.642037 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" event={"ID":"86177247-e1c9-411c-9ac0-e6b4220f02b0","Type":"ContainerDied","Data":"8248bffe6e226f333f62b49c5689b5e85c9e0e476a1081bee24efb5acf02d0e4"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.642141 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.643402 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=8.643390593 podStartE2EDuration="8.643390593s" podCreationTimestamp="2026-03-16 13:38:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:33.63825689 +0000 UTC m=+1958.037569438" watchObservedRunningTime="2026-03-16 13:38:33.643390593 +0000 UTC m=+1958.042703140" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.645998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"f0791789-3d38-4e71-9a25-71e7dc03962a","Type":"ContainerDied","Data":"892873971e77e095b21ebbb78b1727e784cbfac09b3b7ca6ababfe7cf35c96fb"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.646015 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.646044 5030 scope.go:117] "RemoveContainer" containerID="594463b0fd26e0fe6288a169c53eb853c3467ebbe897c1026505aa10d2654049" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.648471 5030 generic.go:358] "Generic (PLEG): container finished" podID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerID="d05277fe3d566f4707731dcb914f5be26c907ccaf0b2c041269d4a1ad8a72846" exitCode=0 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.648576 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerDied","Data":"d05277fe3d566f4707731dcb914f5be26c907ccaf0b2c041269d4a1ad8a72846"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.648600 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" event={"ID":"2e437910-2ec4-4783-b220-e8e6de0a240b","Type":"ContainerDied","Data":"e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.648611 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e17c0330081396eec5ec770edc61b79d4e4b7efe90d70f844c15b714bcc936dd" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.649492 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" event={"ID":"6e72570b-37ec-4875-ba88-dfaa7d4c71a3","Type":"ContainerDied","Data":"d57a33cbab8c02d815e0248aaaf32c3320fdd4cd9247d68f258cbb04e6c2ecd0"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.649581 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.653014 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"be778f00-60cf-413b-97d8-cd9a392fba6d","Type":"ContainerDied","Data":"2d753b96382973673f6a8452c7220c3ec1bdfe6fb28b146055653365e72d9fbd"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.653086 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.673404 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" event={"ID":"5c1dff27-8288-4111-8e53-d3e6fed34e93","Type":"ContainerDied","Data":"bd6aa7b1f2f0ffea7db0ae2e14bdfc71ef8e2903f24175e6c06e1fa94141caf2"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.673496 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-3837-account-create-update-m97sg" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.675893 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f88d14c0-1c53-416d-a0bb-31c9cf2411a7","Type":"ContainerDied","Data":"9b4a459854731b0f311064aaead1c533188a68569948d3835e17a3cbd0ffc7e8"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.676024 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.699141 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7398cd2a-34fe-4637-baf9-4c4872a59c29/ovn-northd/0.log" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.700217 5030 generic.go:358] "Generic (PLEG): container finished" podID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerID="53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" exitCode=139 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.700496 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerDied","Data":"53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.700693 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "e96402f4-7e68-4609-90b3-9db6f070b013" (UID: "e96402f4-7e68-4609-90b3-9db6f070b013"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.722622 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerID="f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b" exitCode=0 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.722760 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.722804 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerDied","Data":"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.723201 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb" event={"ID":"2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c","Type":"ContainerDied","Data":"9c23402b7462ae50c5f1eac5231b79069052af1281b451e76cd473997161f034"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.727960 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.727990 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.728003 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e96402f4-7e68-4609-90b3-9db6f070b013-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.728600 5030 generic.go:358] "Generic (PLEG): container finished" podID="e96402f4-7e68-4609-90b3-9db6f070b013" containerID="cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2" exitCode=0 Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.728693 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.728789 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerDied","Data":"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.729291 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p" event={"ID":"e96402f4-7e68-4609-90b3-9db6f070b013","Type":"ContainerDied","Data":"d49b2719a0a0cf9fad16b45e96fa4046214e5b8c89d708560c318aa4242c3b67"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.763791 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.764327 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" event={"ID":"96da356a-d4b2-49d1-9fc8-74489792a53f","Type":"ContainerDied","Data":"e32014ab793369877b6a880136077bedeb8b83bbbb06551bccaf9d59010cf727"} Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.764428 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-b8wt7" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.887233 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.893267 5030 scope.go:117] "RemoveContainer" containerID="a5c37aa82cf27783f9d970554f97e701f281c08601787f57b4961c49be248480" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.908472 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7398cd2a-34fe-4637-baf9-4c4872a59c29/ovn-northd/0.log" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.908574 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.932061 5030 scope.go:117] "RemoveContainer" containerID="81ee2f14a946a44c5d890a808c954079719d6a07c936f19544e5949bbcbbcf63" Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.932890 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j55jc\" (UniqueName: \"kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc\") pod \"2e437910-2ec4-4783-b220-e8e6de0a240b\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.932917 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle\") pod \"2e437910-2ec4-4783-b220-e8e6de0a240b\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.933080 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs\") pod \"2e437910-2ec4-4783-b220-e8e6de0a240b\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.933149 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom\") pod \"2e437910-2ec4-4783-b220-e8e6de0a240b\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.933197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data\") pod \"2e437910-2ec4-4783-b220-e8e6de0a240b\" (UID: \"2e437910-2ec4-4783-b220-e8e6de0a240b\") " Mar 16 13:38:33 crc kubenswrapper[5030]: I0316 13:38:33.934374 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs" (OuterVolumeSpecName: "logs") pod "2e437910-2ec4-4783-b220-e8e6de0a240b" (UID: "2e437910-2ec4-4783-b220-e8e6de0a240b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:33 crc kubenswrapper[5030]: E0316 13:38:33.975262 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7398cd2a_34fe_4637_baf9_4c4872a59c29.slice/crio-53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef.scope\": RecentStats: unable to find data in memory cache], [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@2-135271-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7398cd2a_34fe_4637_baf9_4c4872a59c29.slice/crio-conmon-53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c533164_3b99_4963_8eb8_1f621cbd2a89.slice/crio-51a3f1a84534e9619829a356571cf3b874adb303f7ae1c63ae5b1dc8a9fc9ced\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7040e1_0208_45fd_889d_3db3d5b29e11.slice/crio-conmon-6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe778f00_60cf_413b_97d8_cd9a392fba6d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f7040e1_0208_45fd_889d_3db3d5b29e11.slice/crio-6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf88d14c0_1c53_416d_a0bb_31c9cf2411a7.slice\": RecentStats: unable to find data in memory cache]" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.000649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc" (OuterVolumeSpecName: "kube-api-access-j55jc") pod "2e437910-2ec4-4783-b220-e8e6de0a240b" (UID: "2e437910-2ec4-4783-b220-e8e6de0a240b"). InnerVolumeSpecName "kube-api-access-j55jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.002409 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042546f9-c010-441f-a2cd-d4f223b87094" path="/var/lib/kubelet/pods/042546f9-c010-441f-a2cd-d4f223b87094/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.002982 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c6b0a7-7f2a-440b-9a33-6fd164c8f8db" path="/var/lib/kubelet/pods/13c6b0a7-7f2a-440b-9a33-6fd164c8f8db/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.003605 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158d5a38-dbc6-4c91-bcf3-873685dc8920" path="/var/lib/kubelet/pods/158d5a38-dbc6-4c91-bcf3-873685dc8920/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.004709 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "2e437910-2ec4-4783-b220-e8e6de0a240b" (UID: "2e437910-2ec4-4783-b220-e8e6de0a240b"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.005439 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" path="/var/lib/kubelet/pods/15ccecb2-b2b1-496d-9d38-e1357367b8d4/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.009323 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf4fe46-38ca-4d7e-a13c-d09fc763d109" path="/var/lib/kubelet/pods/2cf4fe46-38ca-4d7e-a13c-d09fc763d109/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.009749 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" path="/var/lib/kubelet/pods/4e1c091d-1b18-4cec-b78d-6c41368faf75/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.010600 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" path="/var/lib/kubelet/pods/5c41eef1-5e65-449f-99bd-1b3f6d4179fa/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.011834 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7539dd93-cdc3-43c8-88ce-8da150c32bed" path="/var/lib/kubelet/pods/7539dd93-cdc3-43c8-88ce-8da150c32bed/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.012362 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7622c834-10b8-47b7-950f-8fee77132baa" path="/var/lib/kubelet/pods/7622c834-10b8-47b7-950f-8fee77132baa/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.012863 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6fcda0-d709-4281-881b-62164c605971" path="/var/lib/kubelet/pods/ef6fcda0-d709-4281-881b-62164c605971/volumes" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.025090 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2e437910-2ec4-4783-b220-e8e6de0a240b" (UID: "2e437910-2ec4-4783-b220-e8e6de0a240b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.028787 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.033269 5030 scope.go:117] "RemoveContainer" containerID="3a29f8a9390772b73127d61489b0831685b6af7e0ccc195eedd81fbae96ee3c0" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.034631 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk4fs\" (UniqueName: \"kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.034984 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.036724 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.036949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.036996 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.037203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.037239 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir\") pod \"7398cd2a-34fe-4637-baf9-4c4872a59c29\" (UID: \"7398cd2a-34fe-4637-baf9-4c4872a59c29\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.038432 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j55jc\" (UniqueName: \"kubernetes.io/projected/2e437910-2ec4-4783-b220-e8e6de0a240b-kube-api-access-j55jc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.038454 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.038464 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2e437910-2ec4-4783-b220-e8e6de0a240b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.038473 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.059377 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.061041 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts" (OuterVolumeSpecName: "scripts") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.061342 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs" (OuterVolumeSpecName: "kube-api-access-zk4fs") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "kube-api-access-zk4fs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.066350 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config" (OuterVolumeSpecName: "config") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.070227 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.080204 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.114710 5030 scope.go:117] "RemoveContainer" containerID="9dfed78faeaedbb4b0c30fdeb1c0c0c0a3e6a1d8527462b8ca622c76c463b9cc" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.120542 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data" (OuterVolumeSpecName: "config-data") pod "2e437910-2ec4-4783-b220-e8e6de0a240b" (UID: "2e437910-2ec4-4783-b220-e8e6de0a240b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.129844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.140604 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6ksc\" (UniqueName: \"kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc\") pod \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.140784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts\") pod \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\" (UID: \"c0878d5e-a073-4f16-b09b-7e5f5088fdc0\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142745 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142773 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142787 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk4fs\" (UniqueName: \"kubernetes.io/projected/7398cd2a-34fe-4637-baf9-4c4872a59c29-kube-api-access-zk4fs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142810 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2e437910-2ec4-4783-b220-e8e6de0a240b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142819 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.142829 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/7398cd2a-34fe-4637-baf9-4c4872a59c29-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.146037 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c0878d5e-a073-4f16-b09b-7e5f5088fdc0" (UID: "c0878d5e-a073-4f16-b09b-7e5f5088fdc0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.147104 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.149125 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc" (OuterVolumeSpecName: "kube-api-access-m6ksc") pod "c0878d5e-a073-4f16-b09b-7e5f5088fdc0" (UID: "c0878d5e-a073-4f16-b09b-7e5f5088fdc0"). InnerVolumeSpecName "kube-api-access-m6ksc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.152322 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.157854 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.172283 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-3837-account-create-update-m97sg"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.177953 5030 scope.go:117] "RemoveContainer" containerID="f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.198995 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.211875 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-078a-account-create-update-7jv5s"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.220986 5030 scope.go:117] "RemoveContainer" containerID="1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.226630 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.232954 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-8f68-account-create-update-hm54l"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.235975 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.237408 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.238878 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.245153 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.245322 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.245518 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-688778b5c5-phqpb"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246265 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246477 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246613 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246737 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7qp9\" (UniqueName: \"kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.246913 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs\") pod \"9f7040e1-0208-45fd-889d-3db3d5b29e11\" (UID: \"9f7040e1-0208-45fd-889d-3db3d5b29e11\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.247635 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.247656 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6ksc\" (UniqueName: \"kubernetes.io/projected/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-kube-api-access-m6ksc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.247667 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0878d5e-a073-4f16-b09b-7e5f5088fdc0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.248737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs" (OuterVolumeSpecName: "logs") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.250200 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "7398cd2a-34fe-4637-baf9-4c4872a59c29" (UID: "7398cd2a-34fe-4637-baf9-4c4872a59c29"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.257279 5030 scope.go:117] "RemoveContainer" containerID="f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.257332 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.257671 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b\": container with ID starting with f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b not found: ID does not exist" containerID="f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.257706 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b"} err="failed to get container status \"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b\": rpc error: code = NotFound desc = could not find container \"f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b\": container with ID starting with f2ae042f043688b3c76e21ba0835c3f8625f745bf61632a64083a8af6e6fa36b not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.257730 5030 scope.go:117] "RemoveContainer" containerID="1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.258118 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15\": container with ID starting with 1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15 not found: ID does not exist" containerID="1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.258150 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15"} err="failed to get container status \"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15\": rpc error: code = NotFound desc = could not find container \"1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15\": container with ID starting with 1973d86408749ba48e8a8a3632947d792e7d5b5973cabc5504c8e9e2df723f15 not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.258166 5030 scope.go:117] "RemoveContainer" containerID="cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.260422 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.262596 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-b8wt7"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.265690 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9" (OuterVolumeSpecName: "kube-api-access-n7qp9") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "kube-api-access-n7qp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.274223 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.280473 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.282357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.289579 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.294739 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.297631 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-7ffc7fcfd6-k5f8p"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.298436 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.298683 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data" (OuterVolumeSpecName: "config-data") pod "9f7040e1-0208-45fd-889d-3db3d5b29e11" (UID: "9f7040e1-0208-45fd-889d-3db3d5b29e11"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.313740 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.318392 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-fcb6-account-create-update-qhkcw"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.319573 5030 scope.go:117] "RemoveContainer" containerID="b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.327453 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.331714 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-8b49-account-create-update-w8sbl"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.335768 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.338493 5030 scope.go:117] "RemoveContainer" containerID="cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.339146 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2\": container with ID starting with cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2 not found: ID does not exist" containerID="cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.339203 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2"} err="failed to get container status \"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2\": rpc error: code = NotFound desc = could not find container \"cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2\": container with ID starting with cdc7d16d567cdd5411453d9fc150764775e98b4aa7f1dea2ae4e2ade65fbbeb2 not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.339238 5030 scope.go:117] "RemoveContainer" containerID="b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.339624 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8\": container with ID starting with b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8 not found: ID does not exist" containerID="b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.339658 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8"} err="failed to get container status \"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8\": rpc error: code = NotFound desc = could not find container \"b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8\": container with ID starting with b53fce6a06faadb1ce9115be78626fd9bd27f7f7ab2e1c59c43c487d1ceb53e8 not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.340466 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350036 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfr4r\" (UniqueName: \"kubernetes.io/projected/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-kube-api-access-gfr4r\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350066 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350078 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350089 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/59bba6fa-cae4-4d8e-ac7d-1407ce04c763-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350099 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9f7040e1-0208-45fd-889d-3db3d5b29e11-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350111 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7qp9\" (UniqueName: \"kubernetes.io/projected/9f7040e1-0208-45fd-889d-3db3d5b29e11-kube-api-access-n7qp9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350121 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350131 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350141 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/7398cd2a-34fe-4637-baf9-4c4872a59c29-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.350151 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9f7040e1-0208-45fd-889d-3db3d5b29e11-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.599018 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667015 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jpt9\" (UniqueName: \"kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667093 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667259 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667323 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667449 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667538 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.667596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data\") pod \"04d53072-e5ed-4045-8246-495440196ae5\" (UID: \"04d53072-e5ed-4045-8246-495440196ae5\") " Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.675212 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.675235 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.675256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9" (OuterVolumeSpecName: "kube-api-access-7jpt9") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "kube-api-access-7jpt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.675488 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts" (OuterVolumeSpecName: "scripts") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.688758 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.688923 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data" (OuterVolumeSpecName: "config-data") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.701313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.702438 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "04d53072-e5ed-4045-8246-495440196ae5" (UID: "04d53072-e5ed-4045-8246-495440196ae5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770368 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770395 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770408 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770418 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770427 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jpt9\" (UniqueName: \"kubernetes.io/projected/04d53072-e5ed-4045-8246-495440196ae5-kube-api-access-7jpt9\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770436 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770444 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.770454 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/04d53072-e5ed-4045-8246-495440196ae5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.777439 5030 generic.go:358] "Generic (PLEG): container finished" podID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerID="6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e" exitCode=0 Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.777538 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerDied","Data":"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.777612 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" event={"ID":"9f7040e1-0208-45fd-889d-3db3d5b29e11","Type":"ContainerDied","Data":"bffde15f9e0b825d20ef5bc7e1e6c427a3bb57aef6345076e81c635d52690cde"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.777632 5030 scope.go:117] "RemoveContainer" containerID="6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.778061 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.786321 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" event={"ID":"c0878d5e-a073-4f16-b09b-7e5f5088fdc0","Type":"ContainerDied","Data":"b1c6dc05ba14dc228783f1369d164304670037cc00ca1046e2ca1417f22652af"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.787204 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.792838 5030 generic.go:358] "Generic (PLEG): container finished" podID="04d53072-e5ed-4045-8246-495440196ae5" containerID="2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48" exitCode=0 Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.793020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" event={"ID":"04d53072-e5ed-4045-8246-495440196ae5","Type":"ContainerDied","Data":"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.794615 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" event={"ID":"04d53072-e5ed-4045-8246-495440196ae5","Type":"ContainerDied","Data":"89923f456663fc8518cf2c422a526e82caf414b5c6f9fba1ab4212c58cc4f2da"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.793047 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-56f9f44796-kvxtm" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.798461 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_7398cd2a-34fe-4637-baf9-4c4872a59c29/ovn-northd/0.log" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.798791 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.799276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"7398cd2a-34fe-4637-baf9-4c4872a59c29","Type":"ContainerDied","Data":"547771254a5f9687877ef15065531984da3d16c38abd9b87cbbc7552d73932a7"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.805405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" event={"ID":"06859e34-1622-4e83-9610-5db910da5a99","Type":"ContainerStarted","Data":"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731"} Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.805733 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.805877 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.816200 5030 scope.go:117] "RemoveContainer" containerID="e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.834092 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" podStartSLOduration=6.834066278 podStartE2EDuration="6.834066278s" podCreationTimestamp="2026-03-16 13:38:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:38:34.823080342 +0000 UTC m=+1959.222392939" watchObservedRunningTime="2026-03-16 13:38:34.834066278 +0000 UTC m=+1959.233378826" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.852272 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.860850 5030 scope.go:117] "RemoveContainer" containerID="6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.861446 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e\": container with ID starting with 6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e not found: ID does not exist" containerID="6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.861498 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e"} err="failed to get container status \"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e\": rpc error: code = NotFound desc = could not find container \"6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e\": container with ID starting with 6a48ad5e5048f71b525f467505b8c6a4ebdd4f9d7399119a3e7370ee8b152b1e not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.861533 5030 scope.go:117] "RemoveContainer" containerID="e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.862106 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247\": container with ID starting with e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247 not found: ID does not exist" containerID="e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.862151 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247"} err="failed to get container status \"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247\": rpc error: code = NotFound desc = could not find container \"e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247\": container with ID starting with e3b6813a05e9d2a937e806ed06da058b3da1871b7d72fe36389a7e38dea39247 not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.862195 5030 scope.go:117] "RemoveContainer" containerID="2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.867582 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7bf4b85f7b-nj8rh"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.877484 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.892318 5030 scope.go:117] "RemoveContainer" containerID="2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48" Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.892818 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48\": container with ID starting with 2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48 not found: ID does not exist" containerID="2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.892876 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48"} err="failed to get container status \"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48\": rpc error: code = NotFound desc = could not find container \"2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48\": container with ID starting with 2152e2fe74d59b618a9657913cc9d767d9c9577ee940b122d77a93b691d22f48 not found: ID does not exist" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.892897 5030 scope.go:117] "RemoveContainer" containerID="700d22618664a8bae5687619c1f217e02d60020371c0a5168d4e7ce5c96274a2" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.893026 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-74df56b946-xl8g6"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.918351 5030 scope.go:117] "RemoveContainer" containerID="53f6a79c4cdf858d8f550bcaa0351b707c59293ee82bc30f6002f575b73153ef" Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.941446 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.948666 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0768-account-create-update-j2pq7"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.954654 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.963007 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-56f9f44796-kvxtm"] Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.970394 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.974422 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.974582 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:42.974533595 +0000 UTC m=+1967.373846142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.974582 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:34 crc kubenswrapper[5030]: E0316 13:38:34.974627 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:42.974620187 +0000 UTC m=+1967.373932734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:34 crc kubenswrapper[5030]: I0316 13:38:34.976607 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.143950 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.1.171:8778/\": EOF" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.144874 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.1.171:8778/\": EOF" Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.352382 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.354939 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.356693 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.356737 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.410845 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484161 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484288 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484351 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484465 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzggb\" (UniqueName: \"kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484750 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484778 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs" (OuterVolumeSpecName: "logs") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484819 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.484870 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data\") pod \"09c59e2c-5857-4602-8962-5b65860490cc\" (UID: \"09c59e2c-5857-4602-8962-5b65860490cc\") " Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.485283 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/09c59e2c-5857-4602-8962-5b65860490cc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.485371 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.485436 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data podName:0f12cfce-f080-4e4a-b2b7-9aaa7855d10e nodeName:}" failed. No retries permitted until 2026-03-16 13:38:43.485414355 +0000 UTC m=+1967.884726902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data") pod "rabbitmq-server-0" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e") : configmap "rabbitmq-config-data" not found Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.489411 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb" (OuterVolumeSpecName: "kube-api-access-gzggb") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "kube-api-access-gzggb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.496250 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts" (OuterVolumeSpecName: "scripts") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.520148 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.523722 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data" (OuterVolumeSpecName: "config-data") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.548939 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.551043 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "09c59e2c-5857-4602-8962-5b65860490cc" (UID: "09c59e2c-5857-4602-8962-5b65860490cc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587428 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587466 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587477 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587488 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587499 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/09c59e2c-5857-4602-8962-5b65860490cc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.587510 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzggb\" (UniqueName: \"kubernetes.io/projected/09c59e2c-5857-4602-8962-5b65860490cc-kube-api-access-gzggb\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.820649 5030 generic.go:358] "Generic (PLEG): container finished" podID="09c59e2c-5857-4602-8962-5b65860490cc" containerID="43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a" exitCode=137 Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.820705 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerDied","Data":"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a"} Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.820766 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.820800 5030 scope.go:117] "RemoveContainer" containerID="43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.820779 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-6fcbf4b974-fmfm7" event={"ID":"09c59e2c-5857-4602-8962-5b65860490cc","Type":"ContainerDied","Data":"3d66af29a56edb209e80551b8f2cba24a9f5b182582c32b15f0ea3fd82da799f"} Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.849098 5030 scope.go:117] "RemoveContainer" containerID="756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.859675 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.863889 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-6fcbf4b974-fmfm7"] Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.868037 5030 scope.go:117] "RemoveContainer" containerID="43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a" Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.868444 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a\": container with ID starting with 43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a not found: ID does not exist" containerID="43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.868497 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a"} err="failed to get container status \"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a\": rpc error: code = NotFound desc = could not find container \"43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a\": container with ID starting with 43ab2fdefac9e565006489ededb4fba5baac44592b8505f6fe7ea0c7c52ec83a not found: ID does not exist" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.868530 5030 scope.go:117] "RemoveContainer" containerID="756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589" Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.868851 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589\": container with ID starting with 756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589 not found: ID does not exist" containerID="756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.868899 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589"} err="failed to get container status \"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589\": rpc error: code = NotFound desc = could not find container \"756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589\": container with ID starting with 756449f50e2a6f4fe581d2fed56091d21a1cb75669df68bcf7769bee2e5ca589 not found: ID does not exist" Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.881643 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.882941 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.884894 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:35 crc kubenswrapper[5030]: E0316 13:38:35.884937 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.957945 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d53072-e5ed-4045-8246-495440196ae5" path="/var/lib/kubelet/pods/04d53072-e5ed-4045-8246-495440196ae5/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.958564 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c59e2c-5857-4602-8962-5b65860490cc" path="/var/lib/kubelet/pods/09c59e2c-5857-4602-8962-5b65860490cc/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.959170 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" path="/var/lib/kubelet/pods/2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.960291 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" path="/var/lib/kubelet/pods/2e437910-2ec4-4783-b220-e8e6de0a240b/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.960797 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59bba6fa-cae4-4d8e-ac7d-1407ce04c763" path="/var/lib/kubelet/pods/59bba6fa-cae4-4d8e-ac7d-1407ce04c763/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.961082 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1dff27-8288-4111-8e53-d3e6fed34e93" path="/var/lib/kubelet/pods/5c1dff27-8288-4111-8e53-d3e6fed34e93/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.961414 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c533164-3b99-4963-8eb8-1f621cbd2a89" path="/var/lib/kubelet/pods/5c533164-3b99-4963-8eb8-1f621cbd2a89/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.961759 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e72570b-37ec-4875-ba88-dfaa7d4c71a3" path="/var/lib/kubelet/pods/6e72570b-37ec-4875-ba88-dfaa7d4c71a3/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.962659 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" path="/var/lib/kubelet/pods/7398cd2a-34fe-4637-baf9-4c4872a59c29/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.963203 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86177247-e1c9-411c-9ac0-e6b4220f02b0" path="/var/lib/kubelet/pods/86177247-e1c9-411c-9ac0-e6b4220f02b0/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.963640 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96da356a-d4b2-49d1-9fc8-74489792a53f" path="/var/lib/kubelet/pods/96da356a-d4b2-49d1-9fc8-74489792a53f/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.964006 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" path="/var/lib/kubelet/pods/9f7040e1-0208-45fd-889d-3db3d5b29e11/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.965154 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" path="/var/lib/kubelet/pods/be778f00-60cf-413b-97d8-cd9a392fba6d/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.965751 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0878d5e-a073-4f16-b09b-7e5f5088fdc0" path="/var/lib/kubelet/pods/c0878d5e-a073-4f16-b09b-7e5f5088fdc0/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.966210 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" path="/var/lib/kubelet/pods/e96402f4-7e68-4609-90b3-9db6f070b013/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.969463 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0791789-3d38-4e71-9a25-71e7dc03962a" path="/var/lib/kubelet/pods/f0791789-3d38-4e71-9a25-71e7dc03962a/volumes" Mar 16 13:38:35 crc kubenswrapper[5030]: I0316 13:38:35.970112 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" path="/var/lib/kubelet/pods/f88d14c0-1c53-416d-a0bb-31c9cf2411a7/volumes" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.224845 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.74:5671: connect: connection refused" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.226408 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="54074f93-8762-4822-b3df-761133496584" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.75:5671: connect: connection refused" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.442019 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.520895 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.520957 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521029 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521127 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521206 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521303 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521341 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521377 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwhns\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.521502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") pod \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\" (UID: \"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.522412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.523994 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.523997 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.527047 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.527229 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage20-crc" (OuterVolumeSpecName: "persistence") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "local-storage20-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.527275 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info" (OuterVolumeSpecName: "pod-info") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.528181 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns" (OuterVolumeSpecName: "kube-api-access-gwhns") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "kube-api-access-gwhns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.529798 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.541412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data" (OuterVolumeSpecName: "config-data") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.554741 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf" (OuterVolumeSpecName: "server-conf") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.587782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" (UID: "0f12cfce-f080-4e4a-b2b7-9aaa7855d10e"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.598454 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624589 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624614 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624625 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624639 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624648 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwhns\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-kube-api-access-gwhns\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624682 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624692 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624701 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624710 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624719 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.624727 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.651347 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage20-crc" (UniqueName: "kubernetes.io/local-volume/local-storage20-crc") on node "crc" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.725685 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.725838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.725924 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726047 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726315 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726511 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726530 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhqcw\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726766 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726842 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls\") pod \"54074f93-8762-4822-b3df-761133496584\" (UID: \"54074f93-8762-4822-b3df-761133496584\") " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726415 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.726942 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.728063 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.728104 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.728117 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/54074f93-8762-4822-b3df-761133496584-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.728127 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage20-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage20-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.729809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info" (OuterVolumeSpecName: "pod-info") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.730446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "persistence") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.730644 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.731011 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw" (OuterVolumeSpecName: "kube-api-access-rhqcw") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "kube-api-access-rhqcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.731600 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.743337 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data" (OuterVolumeSpecName: "config-data") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.755510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf" (OuterVolumeSpecName: "server-conf") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.781321 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "54074f93-8762-4822-b3df-761133496584" (UID: "54074f93-8762-4822-b3df-761133496584"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830516 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/54074f93-8762-4822-b3df-761133496584-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830569 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830583 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830592 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/54074f93-8762-4822-b3df-761133496584-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830601 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/54074f93-8762-4822-b3df-761133496584-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830609 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830619 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhqcw\" (UniqueName: \"kubernetes.io/projected/54074f93-8762-4822-b3df-761133496584-kube-api-access-rhqcw\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.830655 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.843884 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.849166 5030 generic.go:358] "Generic (PLEG): container finished" podID="54074f93-8762-4822-b3df-761133496584" containerID="9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8" exitCode=0 Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.849487 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerDied","Data":"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8"} Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.849564 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"54074f93-8762-4822-b3df-761133496584","Type":"ContainerDied","Data":"ee62143cc84d1c33077c4c7c4b63e7f0c8a05630ed1a5ab0cb8577026412e13f"} Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.849596 5030 scope.go:117] "RemoveContainer" containerID="9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.850827 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.854233 5030 generic.go:358] "Generic (PLEG): container finished" podID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerID="6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad" exitCode=0 Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.854446 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.855279 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerDied","Data":"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad"} Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.855337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"0f12cfce-f080-4e4a-b2b7-9aaa7855d10e","Type":"ContainerDied","Data":"28ed19b56cfae4e697f28ebf3cbcbd58ae19c0395535480f2263ba29fb215070"} Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.875625 5030 scope.go:117] "RemoveContainer" containerID="05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.927852 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.930022 5030 scope.go:117] "RemoveContainer" containerID="9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8" Mar 16 13:38:37 crc kubenswrapper[5030]: E0316 13:38:37.930600 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8\": container with ID starting with 9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8 not found: ID does not exist" containerID="9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.930685 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8"} err="failed to get container status \"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8\": rpc error: code = NotFound desc = could not find container \"9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8\": container with ID starting with 9c376f0ac897a5cf199a494acb0a85e63c49135233cbc1897e2b15e0c38b23a8 not found: ID does not exist" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.930736 5030 scope.go:117] "RemoveContainer" containerID="05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd" Mar 16 13:38:37 crc kubenswrapper[5030]: E0316 13:38:37.931287 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd\": container with ID starting with 05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd not found: ID does not exist" containerID="05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.931323 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd"} err="failed to get container status \"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd\": rpc error: code = NotFound desc = could not find container \"05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd\": container with ID starting with 05d9fdb40b0e7f65205e5cf76ee465cc11dab57a214151c89cf5581c9e2439fd not found: ID does not exist" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.931342 5030 scope.go:117] "RemoveContainer" containerID="6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.933576 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.934143 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.938298 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.942043 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.953729 5030 scope.go:117] "RemoveContainer" containerID="5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.957259 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" path="/var/lib/kubelet/pods/0f12cfce-f080-4e4a-b2b7-9aaa7855d10e/volumes" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.964697 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54074f93-8762-4822-b3df-761133496584" path="/var/lib/kubelet/pods/54074f93-8762-4822-b3df-761133496584/volumes" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.974155 5030 scope.go:117] "RemoveContainer" containerID="6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad" Mar 16 13:38:37 crc kubenswrapper[5030]: E0316 13:38:37.974724 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad\": container with ID starting with 6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad not found: ID does not exist" containerID="6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.974769 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad"} err="failed to get container status \"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad\": rpc error: code = NotFound desc = could not find container \"6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad\": container with ID starting with 6c02f5b93878666b6cb9de61f08690f3486088b8ecf252db67ea291f27fc43ad not found: ID does not exist" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.974794 5030 scope.go:117] "RemoveContainer" containerID="5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74" Mar 16 13:38:37 crc kubenswrapper[5030]: E0316 13:38:37.975210 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74\": container with ID starting with 5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74 not found: ID does not exist" containerID="5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74" Mar 16 13:38:37 crc kubenswrapper[5030]: I0316 13:38:37.975261 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74"} err="failed to get container status \"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74\": rpc error: code = NotFound desc = could not find container \"5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74\": container with ID starting with 5cd37c30f0b85f8f43ab2164609a65896d7f1234123021d16665694efc0a1d74 not found: ID does not exist" Mar 16 13:38:39 crc kubenswrapper[5030]: E0316 13:38:39.229029 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:39 crc kubenswrapper[5030]: E0316 13:38:39.230260 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:39 crc kubenswrapper[5030]: E0316 13:38:39.231487 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:39 crc kubenswrapper[5030]: E0316 13:38:39.231528 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.283161 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.355138 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.361077 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.362742 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.362811 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.654421 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74d78bdb54-b49xg_968ed402-0d43-4b2a-9370-795d7a80b80c/neutron-httpd/0.log" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.655217 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74d78bdb54-b49xg_968ed402-0d43-4b2a-9370-795d7a80b80c/neutron-api/0.log" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.655305 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.783819 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.783897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.784045 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njbf2\" (UniqueName: \"kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.784094 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.784138 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.784197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.784271 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs\") pod \"968ed402-0d43-4b2a-9370-795d7a80b80c\" (UID: \"968ed402-0d43-4b2a-9370-795d7a80b80c\") " Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.791357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2" (OuterVolumeSpecName: "kube-api-access-njbf2") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "kube-api-access-njbf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.791420 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.816881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.819312 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.820290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config" (OuterVolumeSpecName: "config") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.820539 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.825999 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.835462 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "968ed402-0d43-4b2a-9370-795d7a80b80c" (UID: "968ed402-0d43-4b2a-9370-795d7a80b80c"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.881620 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.881964 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="dnsmasq-dns" containerID="cri-o://93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006" gracePeriod=10 Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.882154 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887791 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njbf2\" (UniqueName: \"kubernetes.io/projected/968ed402-0d43-4b2a-9370-795d7a80b80c-kube-api-access-njbf2\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887818 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887827 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887838 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887846 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887855 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.887866 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/968ed402-0d43-4b2a-9370-795d7a80b80c-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.897661 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.907702 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:40 crc kubenswrapper[5030]: E0316 13:38:40.907816 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.917963 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74d78bdb54-b49xg_968ed402-0d43-4b2a-9370-795d7a80b80c/neutron-httpd/0.log" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.918823 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74d78bdb54-b49xg_968ed402-0d43-4b2a-9370-795d7a80b80c/neutron-api/0.log" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.919596 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.919597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerDied","Data":"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae"} Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.919815 5030 scope.go:117] "RemoveContainer" containerID="ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.918894 5030 generic.go:358] "Generic (PLEG): container finished" podID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerID="ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" exitCode=137 Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.925977 5030 generic.go:358] "Generic (PLEG): container finished" podID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerID="ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" exitCode=137 Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.926062 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerDied","Data":"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315"} Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.926085 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74d78bdb54-b49xg" event={"ID":"968ed402-0d43-4b2a-9370-795d7a80b80c","Type":"ContainerDied","Data":"b1791d785e07e21bdea92b7a88c15eab6451936452f85fd6edf6b2385ef16f17"} Mar 16 13:38:40 crc kubenswrapper[5030]: I0316 13:38:40.945625 5030 scope.go:117] "RemoveContainer" containerID="ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.002830 5030 scope.go:117] "RemoveContainer" containerID="ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" Mar 16 13:38:41 crc kubenswrapper[5030]: E0316 13:38:41.003611 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae\": container with ID starting with ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae not found: ID does not exist" containerID="ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.003661 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae"} err="failed to get container status \"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae\": rpc error: code = NotFound desc = could not find container \"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae\": container with ID starting with ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae not found: ID does not exist" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.003681 5030 scope.go:117] "RemoveContainer" containerID="ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" Mar 16 13:38:41 crc kubenswrapper[5030]: E0316 13:38:41.003941 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315\": container with ID starting with ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315 not found: ID does not exist" containerID="ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.003972 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315"} err="failed to get container status \"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315\": rpc error: code = NotFound desc = could not find container \"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315\": container with ID starting with ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315 not found: ID does not exist" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.003997 5030 scope.go:117] "RemoveContainer" containerID="ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.004233 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae"} err="failed to get container status \"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae\": rpc error: code = NotFound desc = could not find container \"ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae\": container with ID starting with ff942ab4fb1a3ec9f2666446e1414912ba28c24f60bb8a669e59a7183620e8ae not found: ID does not exist" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.004271 5030 scope.go:117] "RemoveContainer" containerID="ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.004479 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315"} err="failed to get container status \"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315\": rpc error: code = NotFound desc = could not find container \"ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315\": container with ID starting with ef52139c1ea66ae53644e2d9add65a46f79b535cfca5aac0c30b624d62213315 not found: ID does not exist" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.006806 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.011119 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-74d78bdb54-b49xg"] Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.232393 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.398486 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc\") pod \"b59dd8c8-d9e0-4210-8b44-04c130f53110\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.398624 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lsls\" (UniqueName: \"kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls\") pod \"b59dd8c8-d9e0-4210-8b44-04c130f53110\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.398677 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config\") pod \"b59dd8c8-d9e0-4210-8b44-04c130f53110\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.398713 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0\") pod \"b59dd8c8-d9e0-4210-8b44-04c130f53110\" (UID: \"b59dd8c8-d9e0-4210-8b44-04c130f53110\") " Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.408313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls" (OuterVolumeSpecName: "kube-api-access-7lsls") pod "b59dd8c8-d9e0-4210-8b44-04c130f53110" (UID: "b59dd8c8-d9e0-4210-8b44-04c130f53110"). InnerVolumeSpecName "kube-api-access-7lsls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.428558 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config" (OuterVolumeSpecName: "config") pod "b59dd8c8-d9e0-4210-8b44-04c130f53110" (UID: "b59dd8c8-d9e0-4210-8b44-04c130f53110"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.432062 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "b59dd8c8-d9e0-4210-8b44-04c130f53110" (UID: "b59dd8c8-d9e0-4210-8b44-04c130f53110"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.432849 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "b59dd8c8-d9e0-4210-8b44-04c130f53110" (UID: "b59dd8c8-d9e0-4210-8b44-04c130f53110"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.501242 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lsls\" (UniqueName: \"kubernetes.io/projected/b59dd8c8-d9e0-4210-8b44-04c130f53110-kube-api-access-7lsls\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.501284 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.501296 5030 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.501307 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/b59dd8c8-d9e0-4210-8b44-04c130f53110-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.956209 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.956573 5030 generic.go:358] "Generic (PLEG): container finished" podID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerID="93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006" exitCode=0 Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.973626 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" path="/var/lib/kubelet/pods/968ed402-0d43-4b2a-9370-795d7a80b80c/volumes" Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.974409 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" event={"ID":"b59dd8c8-d9e0-4210-8b44-04c130f53110","Type":"ContainerDied","Data":"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006"} Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.974446 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls" event={"ID":"b59dd8c8-d9e0-4210-8b44-04c130f53110","Type":"ContainerDied","Data":"fa355e031b66020dc1cd2754a5c58388e2447c0a0dcc8757a0ac889df9a655cc"} Mar 16 13:38:41 crc kubenswrapper[5030]: I0316 13:38:41.974475 5030 scope.go:117] "RemoveContainer" containerID="93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006" Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.004691 5030 scope.go:117] "RemoveContainer" containerID="0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47" Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.006908 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.013729 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-5f5844fc89-txfls"] Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.023057 5030 scope.go:117] "RemoveContainer" containerID="93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006" Mar 16 13:38:42 crc kubenswrapper[5030]: E0316 13:38:42.023386 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006\": container with ID starting with 93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006 not found: ID does not exist" containerID="93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006" Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.023439 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006"} err="failed to get container status \"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006\": rpc error: code = NotFound desc = could not find container \"93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006\": container with ID starting with 93d133b8ac0e0ee41b1733de5def6375b9419e809251504e7e1adf387ca93006 not found: ID does not exist" Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.023475 5030 scope.go:117] "RemoveContainer" containerID="0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47" Mar 16 13:38:42 crc kubenswrapper[5030]: E0316 13:38:42.023815 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47\": container with ID starting with 0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47 not found: ID does not exist" containerID="0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47" Mar 16 13:38:42 crc kubenswrapper[5030]: I0316 13:38:42.023855 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47"} err="failed to get container status \"0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47\": rpc error: code = NotFound desc = could not find container \"0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47\": container with ID starting with 0593a992038d6bdfd562b0f8798d1c42ba0a621fabc8dd63078f27bab3caaf47 not found: ID does not exist" Mar 16 13:38:43 crc kubenswrapper[5030]: E0316 13:38:43.033769 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:43 crc kubenswrapper[5030]: E0316 13:38:43.033835 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:43 crc kubenswrapper[5030]: E0316 13:38:43.033869 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:59.033850142 +0000 UTC m=+1983.433162688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:43 crc kubenswrapper[5030]: E0316 13:38:43.033943 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:38:59.033916678 +0000 UTC m=+1983.433229225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.903187 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgn2n\" (UniqueName: \"kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n\") pod \"ad4ffc6d-9012-4802-9061-04d5767e7583\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950184 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs\") pod \"ad4ffc6d-9012-4802-9061-04d5767e7583\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950600 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle\") pod \"ad4ffc6d-9012-4802-9061-04d5767e7583\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs\") pod \"ad4ffc6d-9012-4802-9061-04d5767e7583\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950799 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs" (OuterVolumeSpecName: "logs") pod "ad4ffc6d-9012-4802-9061-04d5767e7583" (UID: "ad4ffc6d-9012-4802-9061-04d5767e7583"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.950854 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data\") pod \"ad4ffc6d-9012-4802-9061-04d5767e7583\" (UID: \"ad4ffc6d-9012-4802-9061-04d5767e7583\") " Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.953003 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ad4ffc6d-9012-4802-9061-04d5767e7583-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.958575 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n" (OuterVolumeSpecName: "kube-api-access-lgn2n") pod "ad4ffc6d-9012-4802-9061-04d5767e7583" (UID: "ad4ffc6d-9012-4802-9061-04d5767e7583"). InnerVolumeSpecName "kube-api-access-lgn2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.959213 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" path="/var/lib/kubelet/pods/b59dd8c8-d9e0-4210-8b44-04c130f53110/volumes" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.971262 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ad4ffc6d-9012-4802-9061-04d5767e7583" (UID: "ad4ffc6d-9012-4802-9061-04d5767e7583"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.975503 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data" (OuterVolumeSpecName: "config-data") pod "ad4ffc6d-9012-4802-9061-04d5767e7583" (UID: "ad4ffc6d-9012-4802-9061-04d5767e7583"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.986248 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.986757 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ad4ffc6d-9012-4802-9061-04d5767e7583" (UID: "ad4ffc6d-9012-4802-9061-04d5767e7583"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.987168 5030 generic.go:358] "Generic (PLEG): container finished" podID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerID="2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b" exitCode=0 Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.987308 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerDied","Data":"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b"} Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.987344 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ad4ffc6d-9012-4802-9061-04d5767e7583","Type":"ContainerDied","Data":"d55848d2a4f9713107e0f94fd3bb95204abe11aa3de7cee0cc2d58b5af369d13"} Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.987366 5030 scope.go:117] "RemoveContainer" containerID="2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.987470 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:38:43 crc kubenswrapper[5030]: I0316 13:38:43.998875 5030 generic.go:358] "Generic (PLEG): container finished" podID="addecf4e-78dc-4422-a876-fb21680aff5e" containerID="49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0" exitCode=0 Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:43.999974 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerDied","Data":"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0"} Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.000018 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"addecf4e-78dc-4422-a876-fb21680aff5e","Type":"ContainerDied","Data":"893e7fe6b3ce94bb88ab1d381869b12247c8e67a923b1c17702180df2631430b"} Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.000103 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.030071 5030 scope.go:117] "RemoveContainer" containerID="cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.039807 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.043900 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.052097 5030 scope.go:117] "RemoveContainer" containerID="2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b" Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.052624 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b\": container with ID starting with 2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b not found: ID does not exist" containerID="2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.052685 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b"} err="failed to get container status \"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b\": rpc error: code = NotFound desc = could not find container \"2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b\": container with ID starting with 2d6a799c9253f2de1389e3219e7c8adeb9cd64916fc7e3947a1fe5b3f978815b not found: ID does not exist" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.052722 5030 scope.go:117] "RemoveContainer" containerID="cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397" Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.053118 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397\": container with ID starting with cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397 not found: ID does not exist" containerID="cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.053161 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397"} err="failed to get container status \"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397\": rpc error: code = NotFound desc = could not find container \"cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397\": container with ID starting with cbe2a3f2628025b1a9e016b417cb6105e29e99ee1709d43081a929c835719397 not found: ID does not exist" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.053223 5030 scope.go:117] "RemoveContainer" containerID="49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054003 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4gvc\" (UniqueName: \"kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054137 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054533 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054665 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054734 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.054761 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data\") pod \"addecf4e-78dc-4422-a876-fb21680aff5e\" (UID: \"addecf4e-78dc-4422-a876-fb21680aff5e\") " Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.055231 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs" (OuterVolumeSpecName: "logs") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.056543 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgn2n\" (UniqueName: \"kubernetes.io/projected/ad4ffc6d-9012-4802-9061-04d5767e7583-kube-api-access-lgn2n\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.056651 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.056667 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/addecf4e-78dc-4422-a876-fb21680aff5e-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.056680 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.056691 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ad4ffc6d-9012-4802-9061-04d5767e7583-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.064520 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc" (OuterVolumeSpecName: "kube-api-access-f4gvc") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "kube-api-access-f4gvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.074323 5030 scope.go:117] "RemoveContainer" containerID="9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.075721 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data" (OuterVolumeSpecName: "config-data") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.076476 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.086439 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.100768 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "addecf4e-78dc-4422-a876-fb21680aff5e" (UID: "addecf4e-78dc-4422-a876-fb21680aff5e"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.102937 5030 scope.go:117] "RemoveContainer" containerID="49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0" Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.103361 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0\": container with ID starting with 49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0 not found: ID does not exist" containerID="49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.103405 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0"} err="failed to get container status \"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0\": rpc error: code = NotFound desc = could not find container \"49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0\": container with ID starting with 49555eb4dbe8f569f8585f0e8aa88da754c2030b5a9968abdbca5ef62aecf9a0 not found: ID does not exist" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.103432 5030 scope.go:117] "RemoveContainer" containerID="9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb" Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.103813 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb\": container with ID starting with 9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb not found: ID does not exist" containerID="9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.103840 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb"} err="failed to get container status \"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb\": rpc error: code = NotFound desc = could not find container \"9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb\": container with ID starting with 9c998621275171b6103ad2eefaa8774e1b754d0d2fa64e7e1c6ee46ede8d4bdb not found: ID does not exist" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.158625 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4gvc\" (UniqueName: \"kubernetes.io/projected/addecf4e-78dc-4422-a876-fb21680aff5e-kube-api-access-f4gvc\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.158662 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.158672 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.158684 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.158695 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/addecf4e-78dc-4422-a876-fb21680aff5e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.230268 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.231800 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.233170 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:44 crc kubenswrapper[5030]: E0316 13:38:44.233235 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.331615 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:44 crc kubenswrapper[5030]: I0316 13:38:44.336076 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.352250 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.354091 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.355982 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.356031 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.882936 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.884905 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.886580 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:45 crc kubenswrapper[5030]: E0316 13:38:45.886663 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:45 crc kubenswrapper[5030]: I0316 13:38:45.957929 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" path="/var/lib/kubelet/pods/ad4ffc6d-9012-4802-9061-04d5767e7583/volumes" Mar 16 13:38:45 crc kubenswrapper[5030]: I0316 13:38:45.958804 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" path="/var/lib/kubelet/pods/addecf4e-78dc-4422-a876-fb21680aff5e/volumes" Mar 16 13:38:49 crc kubenswrapper[5030]: E0316 13:38:49.234057 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:49 crc kubenswrapper[5030]: E0316 13:38:49.236228 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:49 crc kubenswrapper[5030]: E0316 13:38:49.237440 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:49 crc kubenswrapper[5030]: E0316 13:38:49.237476 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.351483 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.352647 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.354372 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.354403 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.882270 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.883934 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.885138 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:50 crc kubenswrapper[5030]: E0316 13:38:50.885188 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:53 crc kubenswrapper[5030]: E0316 13:38:53.625453 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313268 actualBytes=10240 Mar 16 13:38:54 crc kubenswrapper[5030]: I0316 13:38:54.176342 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.1.129:9696/\": dial tcp 10.217.1.129:9696: connect: connection refused" Mar 16 13:38:54 crc kubenswrapper[5030]: E0316 13:38:54.229613 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:54 crc kubenswrapper[5030]: E0316 13:38:54.230887 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:54 crc kubenswrapper[5030]: E0316 13:38:54.232534 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:54 crc kubenswrapper[5030]: E0316 13:38:54.232594 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.351739 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.353494 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.354793 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.354874 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.882445 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.884201 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.885380 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:38:55 crc kubenswrapper[5030]: E0316 13:38:55.885428 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.119278 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.121070 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle podName:73a8fdc5-4144-429a-8954-d1e0f4baac91 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:31.121047309 +0000 UTC m=+2015.520359857 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91") : secret "combined-ca-bundle" not found Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.119508 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.121280 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle podName:84d9ecc3-01ae-4c5c-92d2-8688e1f241d1 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:31.121271111 +0000 UTC m=+2015.520583658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle") pod "nova-scheduler-0" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1") : secret "combined-ca-bundle" not found Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.229753 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.231027 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.232868 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:38:59 crc kubenswrapper[5030]: E0316 13:38:59.232940 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.713378 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.831941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llcdz\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832078 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832167 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832205 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache\") pod \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\" (UID: \"93f3c38d-e63e-45e8-af66-a42cd159d7bb\") " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.832863 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache" (OuterVolumeSpecName: "cache") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.833170 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock" (OuterVolumeSpecName: "lock") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.836968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "swift") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.837339 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.837670 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz" (OuterVolumeSpecName: "kube-api-access-llcdz") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "kube-api-access-llcdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.934185 5030 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.934221 5030 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/93f3c38d-e63e-45e8-af66-a42cd159d7bb-cache\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.934234 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llcdz\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-kube-api-access-llcdz\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.934263 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.934273 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/93f3c38d-e63e-45e8-af66-a42cd159d7bb-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:38:59 crc kubenswrapper[5030]: I0316 13:38:59.945544 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.029469 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93f3c38d-e63e-45e8-af66-a42cd159d7bb" (UID: "93f3c38d-e63e-45e8-af66-a42cd159d7bb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.036252 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93f3c38d-e63e-45e8-af66-a42cd159d7bb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.036276 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.161433 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-594754ff8-k48hp_f15c4ee7-89eb-4bb4-98ea-e399afa7a596/neutron-api/0.log" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.161791 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.167876 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-594754ff8-k48hp_f15c4ee7-89eb-4bb4-98ea-e399afa7a596/neutron-api/0.log" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.167914 5030 generic.go:358] "Generic (PLEG): container finished" podID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerID="aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69" exitCode=137 Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.168080 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerDied","Data":"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69"} Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.168113 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" event={"ID":"f15c4ee7-89eb-4bb4-98ea-e399afa7a596","Type":"ContainerDied","Data":"d961139a1bc54d472b89eb97f9113c7028d921e8b6dd3be2dff317fc93f739ef"} Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.168131 5030 scope.go:117] "RemoveContainer" containerID="dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.168284 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-594754ff8-k48hp" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.176420 5030 generic.go:358] "Generic (PLEG): container finished" podID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerID="63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0" exitCode=137 Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.176591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0"} Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.176619 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"93f3c38d-e63e-45e8-af66-a42cd159d7bb","Type":"ContainerDied","Data":"4c6c0fe51f233f77748a886a1a387d7ef46429c944458f462359d68f5ebb0806"} Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.176721 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.191150 5030 scope.go:117] "RemoveContainer" containerID="aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.207821 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.212093 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.214789 5030 scope.go:117] "RemoveContainer" containerID="dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.215123 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2\": container with ID starting with dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2 not found: ID does not exist" containerID="dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.215160 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2"} err="failed to get container status \"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2\": rpc error: code = NotFound desc = could not find container \"dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2\": container with ID starting with dcbd428fd656c908273bf6b8b96d9edd6a6df4dad6bf3c67ccabef199fe11af2 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.215188 5030 scope.go:117] "RemoveContainer" containerID="aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.215366 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69\": container with ID starting with aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69 not found: ID does not exist" containerID="aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.215389 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69"} err="failed to get container status \"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69\": rpc error: code = NotFound desc = could not find container \"aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69\": container with ID starting with aee57bacd8fba7e198cde2bb59a302cbf7f2fa99ed7a6c640db1103b61129d69 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.215403 5030 scope.go:117] "RemoveContainer" containerID="63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.232909 5030 scope.go:117] "RemoveContainer" containerID="5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.238919 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239025 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239123 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5kc6\" (UniqueName: \"kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239188 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239215 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.239382 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs\") pod \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\" (UID: \"f15c4ee7-89eb-4bb4-98ea-e399afa7a596\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.242587 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.242872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6" (OuterVolumeSpecName: "kube-api-access-l5kc6") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "kube-api-access-l5kc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.247503 5030 scope.go:117] "RemoveContainer" containerID="a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.263459 5030 scope.go:117] "RemoveContainer" containerID="03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.265957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.267430 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.269166 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config" (OuterVolumeSpecName: "config") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.273407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.279727 5030 scope.go:117] "RemoveContainer" containerID="e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.279897 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "f15c4ee7-89eb-4bb4-98ea-e399afa7a596" (UID: "f15c4ee7-89eb-4bb4-98ea-e399afa7a596"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.295365 5030 scope.go:117] "RemoveContainer" containerID="3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.309675 5030 scope.go:117] "RemoveContainer" containerID="e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.322719 5030 scope.go:117] "RemoveContainer" containerID="99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.336678 5030 scope.go:117] "RemoveContainer" containerID="f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342276 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5kc6\" (UniqueName: \"kubernetes.io/projected/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-kube-api-access-l5kc6\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342297 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342323 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342333 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342341 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342349 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.342357 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f15c4ee7-89eb-4bb4-98ea-e399afa7a596-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.350757 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.351936 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.353284 5030 scope.go:117] "RemoveContainer" containerID="05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.353433 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.353479 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.368308 5030 scope.go:117] "RemoveContainer" containerID="cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.385632 5030 scope.go:117] "RemoveContainer" containerID="71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.442136 5030 scope.go:117] "RemoveContainer" containerID="772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.462887 5030 scope.go:117] "RemoveContainer" containerID="85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.480658 5030 scope.go:117] "RemoveContainer" containerID="145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.548929 5030 scope.go:117] "RemoveContainer" containerID="63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.549717 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0\": container with ID starting with 63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0 not found: ID does not exist" containerID="63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.549772 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0"} err="failed to get container status \"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0\": rpc error: code = NotFound desc = could not find container \"63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0\": container with ID starting with 63f89857566ed09fa79dddee1e3661c8997135fef882221fe6acc044be19afb0 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.549804 5030 scope.go:117] "RemoveContainer" containerID="5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.549872 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.550778 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9\": container with ID starting with 5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9 not found: ID does not exist" containerID="5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.550823 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9"} err="failed to get container status \"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9\": rpc error: code = NotFound desc = could not find container \"5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9\": container with ID starting with 5a5ccbb647dbd1c88f2d28bf0ef0b641584ac7d13193c744097b0154de8f45e9 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.550850 5030 scope.go:117] "RemoveContainer" containerID="a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.551345 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a\": container with ID starting with a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a not found: ID does not exist" containerID="a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551373 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a"} err="failed to get container status \"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a\": rpc error: code = NotFound desc = could not find container \"a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a\": container with ID starting with a9887b054111f3b6dc20713d1311190a892ec59d9ce854124f7d2cf1ddbe7f4a not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551389 5030 scope.go:117] "RemoveContainer" containerID="03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.551643 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3\": container with ID starting with 03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3 not found: ID does not exist" containerID="03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551667 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3"} err="failed to get container status \"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3\": rpc error: code = NotFound desc = could not find container \"03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3\": container with ID starting with 03da68a3f6eb322cdfa302125d6bab53925d057b7f0e0006496292f5e10050c3 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551685 5030 scope.go:117] "RemoveContainer" containerID="e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.551902 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e\": container with ID starting with e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e not found: ID does not exist" containerID="e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551927 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e"} err="failed to get container status \"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e\": rpc error: code = NotFound desc = could not find container \"e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e\": container with ID starting with e25d57a015402ca911885a15faa95ecf5602e778d68caff555d8acc639e31b5e not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.551941 5030 scope.go:117] "RemoveContainer" containerID="3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.552165 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7\": container with ID starting with 3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7 not found: ID does not exist" containerID="3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552206 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7"} err="failed to get container status \"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7\": rpc error: code = NotFound desc = could not find container \"3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7\": container with ID starting with 3120d914ec073acc496d452d20f10aa43d661e1cfbc479395bb653cc40996ea7 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552222 5030 scope.go:117] "RemoveContainer" containerID="e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.552447 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef\": container with ID starting with e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef not found: ID does not exist" containerID="e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552500 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef"} err="failed to get container status \"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef\": rpc error: code = NotFound desc = could not find container \"e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef\": container with ID starting with e35b672da357f4cb10cb68e9e0c5a3e97c6bc965b13ce028a1bfec8b2bf631ef not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552515 5030 scope.go:117] "RemoveContainer" containerID="99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.552929 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac\": container with ID starting with 99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac not found: ID does not exist" containerID="99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552954 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac"} err="failed to get container status \"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac\": rpc error: code = NotFound desc = could not find container \"99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac\": container with ID starting with 99eb9107dbc1b93b1ef565d0a7fa124dfb72be347005d4303843d02791903cac not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.552968 5030 scope.go:117] "RemoveContainer" containerID="f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.553193 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3\": container with ID starting with f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3 not found: ID does not exist" containerID="f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553226 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3"} err="failed to get container status \"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3\": rpc error: code = NotFound desc = could not find container \"f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3\": container with ID starting with f0f384df8dde3415d745a5f344a74025c33ea0d58ed6dc8136b482eb8ac717c3 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553245 5030 scope.go:117] "RemoveContainer" containerID="05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.553451 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39\": container with ID starting with 05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39 not found: ID does not exist" containerID="05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553471 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39"} err="failed to get container status \"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39\": rpc error: code = NotFound desc = could not find container \"05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39\": container with ID starting with 05566245b1ba79206c8f9591a69cb48efa9ddd2e05a59a2e72197d5901953f39 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553483 5030 scope.go:117] "RemoveContainer" containerID="cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553651 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-594754ff8-k48hp"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.553696 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b\": container with ID starting with cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b not found: ID does not exist" containerID="cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553712 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b"} err="failed to get container status \"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b\": rpc error: code = NotFound desc = could not find container \"cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b\": container with ID starting with cfa17a1d6467bf05a5fdc9742a5522c0e9a2318d0ed93c59d62f41548605bc7b not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553723 5030 scope.go:117] "RemoveContainer" containerID="71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.553875 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a\": container with ID starting with 71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a not found: ID does not exist" containerID="71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553897 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a"} err="failed to get container status \"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a\": rpc error: code = NotFound desc = could not find container \"71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a\": container with ID starting with 71554d55f2b415aa9c37d25e9a8fd0fab0371db37292f0ec692947a21377ba2a not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.553912 5030 scope.go:117] "RemoveContainer" containerID="772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.554060 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055\": container with ID starting with 772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055 not found: ID does not exist" containerID="772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.554079 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055"} err="failed to get container status \"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055\": rpc error: code = NotFound desc = could not find container \"772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055\": container with ID starting with 772e4f8a0329780b1517692d365470369aae7b0ef94c3246de2f310f54fd7055 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.554108 5030 scope.go:117] "RemoveContainer" containerID="85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.554315 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a\": container with ID starting with 85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a not found: ID does not exist" containerID="85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.554340 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a"} err="failed to get container status \"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a\": rpc error: code = NotFound desc = could not find container \"85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a\": container with ID starting with 85b8e034101c5bae11ecc2d920b6bc047378d6e09c2285471cc336e19d1fb71a not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.554355 5030 scope.go:117] "RemoveContainer" containerID="145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.554605 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6\": container with ID starting with 145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6 not found: ID does not exist" containerID="145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.554633 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6"} err="failed to get container status \"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6\": rpc error: code = NotFound desc = could not find container \"145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6\": container with ID starting with 145f03ca571ff9da4ad267c763a0f916b049ad98367e0945b22763c0b40510d6 not found: ID does not exist" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.657749 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.753955 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhk74\" (UniqueName: \"kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74\") pod \"73a8fdc5-4144-429a-8954-d1e0f4baac91\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.754210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data\") pod \"73a8fdc5-4144-429a-8954-d1e0f4baac91\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.754487 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle\") pod \"73a8fdc5-4144-429a-8954-d1e0f4baac91\" (UID: \"73a8fdc5-4144-429a-8954-d1e0f4baac91\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.759668 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74" (OuterVolumeSpecName: "kube-api-access-zhk74") pod "73a8fdc5-4144-429a-8954-d1e0f4baac91" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91"). InnerVolumeSpecName "kube-api-access-zhk74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.772748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data" (OuterVolumeSpecName: "config-data") pod "73a8fdc5-4144-429a-8954-d1e0f4baac91" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.772884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "73a8fdc5-4144-429a-8954-d1e0f4baac91" (UID: "73a8fdc5-4144-429a-8954-d1e0f4baac91"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.850356 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.857313 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.857347 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhk74\" (UniqueName: \"kubernetes.io/projected/73a8fdc5-4144-429a-8954-d1e0f4baac91-kube-api-access-zhk74\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.857362 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/73a8fdc5-4144-429a-8954-d1e0f4baac91-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.880375 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 is running failed: container process not found" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.880838 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 is running failed: container process not found" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.881361 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 is running failed: container process not found" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:39:00 crc kubenswrapper[5030]: E0316 13:39:00.881397 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.958866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data\") pod \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.958939 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx9k8\" (UniqueName: \"kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8\") pod \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.959132 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle\") pod \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\" (UID: \"b950ae83-00a2-4a07-b2f7-674ccfda4f65\") " Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.963051 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8" (OuterVolumeSpecName: "kube-api-access-dx9k8") pod "b950ae83-00a2-4a07-b2f7-674ccfda4f65" (UID: "b950ae83-00a2-4a07-b2f7-674ccfda4f65"). InnerVolumeSpecName "kube-api-access-dx9k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.975663 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b950ae83-00a2-4a07-b2f7-674ccfda4f65" (UID: "b950ae83-00a2-4a07-b2f7-674ccfda4f65"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:00 crc kubenswrapper[5030]: I0316 13:39:00.976435 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data" (OuterVolumeSpecName: "config-data") pod "b950ae83-00a2-4a07-b2f7-674ccfda4f65" (UID: "b950ae83-00a2-4a07-b2f7-674ccfda4f65"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.039140 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.061138 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.061168 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx9k8\" (UniqueName: \"kubernetes.io/projected/b950ae83-00a2-4a07-b2f7-674ccfda4f65-kube-api-access-dx9k8\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.061192 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b950ae83-00a2-4a07-b2f7-674ccfda4f65-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.162030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5fqw\" (UniqueName: \"kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw\") pod \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.162746 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data\") pod \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.163196 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle\") pod \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\" (UID: \"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1\") " Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.166355 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw" (OuterVolumeSpecName: "kube-api-access-t5fqw") pod "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1"). InnerVolumeSpecName "kube-api-access-t5fqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.180203 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data" (OuterVolumeSpecName: "config-data") pod "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.180581 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" (UID: "84d9ecc3-01ae-4c5c-92d2-8688e1f241d1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.187845 5030 generic.go:358] "Generic (PLEG): container finished" podID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" exitCode=137 Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.187973 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.187974 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1","Type":"ContainerDied","Data":"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.188125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"84d9ecc3-01ae-4c5c-92d2-8688e1f241d1","Type":"ContainerDied","Data":"dc35bf10d7fcc33c863e043847a8f0926a5e5585aae92f6404a237972486124d"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.188159 5030 scope.go:117] "RemoveContainer" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.192205 5030 generic.go:358] "Generic (PLEG): container finished" podID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" exitCode=137 Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.192243 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"b950ae83-00a2-4a07-b2f7-674ccfda4f65","Type":"ContainerDied","Data":"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.192276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"b950ae83-00a2-4a07-b2f7-674ccfda4f65","Type":"ContainerDied","Data":"852ffe330bc6e8dea8be017a5d621d0cd270fdb478bb3097458309a933b36232"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.192565 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.195451 5030 generic.go:358] "Generic (PLEG): container finished" podID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" exitCode=137 Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.195608 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"73a8fdc5-4144-429a-8954-d1e0f4baac91","Type":"ContainerDied","Data":"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.195649 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"73a8fdc5-4144-429a-8954-d1e0f4baac91","Type":"ContainerDied","Data":"72cbe4578d05973758552485e1af916c9d2eb14af18c73cb044ca36d4ae7e708"} Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.195796 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.211812 5030 scope.go:117] "RemoveContainer" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" Mar 16 13:39:01 crc kubenswrapper[5030]: E0316 13:39:01.212172 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250\": container with ID starting with f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 not found: ID does not exist" containerID="f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.212242 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250"} err="failed to get container status \"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250\": rpc error: code = NotFound desc = could not find container \"f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250\": container with ID starting with f4a4df3b83e4b8211e7ed02ae061790922f45a956efa6a67d77435eb7a0f1250 not found: ID does not exist" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.212273 5030 scope.go:117] "RemoveContainer" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.238314 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.242598 5030 scope.go:117] "RemoveContainer" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" Mar 16 13:39:01 crc kubenswrapper[5030]: E0316 13:39:01.243153 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca\": container with ID starting with 60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca not found: ID does not exist" containerID="60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.243306 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca"} err="failed to get container status \"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca\": rpc error: code = NotFound desc = could not find container \"60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca\": container with ID starting with 60c175da6092846189c67acd03fb00dd03704abaf32c8b95397380fd87ffedca not found: ID does not exist" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.243437 5030 scope.go:117] "RemoveContainer" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.247653 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.253654 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.257739 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.261358 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.272092 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.272135 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5fqw\" (UniqueName: \"kubernetes.io/projected/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-kube-api-access-t5fqw\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.272149 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.272431 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.274000 5030 scope.go:117] "RemoveContainer" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" Mar 16 13:39:01 crc kubenswrapper[5030]: E0316 13:39:01.274450 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300\": container with ID starting with 6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300 not found: ID does not exist" containerID="6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.274495 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300"} err="failed to get container status \"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300\": rpc error: code = NotFound desc = could not find container \"6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300\": container with ID starting with 6f7e5fd31764cc2b3b4850528c5ee5162962732ab41f2e6ed4478194689d1300 not found: ID does not exist" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.954849 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" path="/var/lib/kubelet/pods/73a8fdc5-4144-429a-8954-d1e0f4baac91/volumes" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.955377 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" path="/var/lib/kubelet/pods/84d9ecc3-01ae-4c5c-92d2-8688e1f241d1/volumes" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.955916 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" path="/var/lib/kubelet/pods/93f3c38d-e63e-45e8-af66-a42cd159d7bb/volumes" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.957755 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" path="/var/lib/kubelet/pods/b950ae83-00a2-4a07-b2f7-674ccfda4f65/volumes" Mar 16 13:39:01 crc kubenswrapper[5030]: I0316 13:39:01.958618 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" path="/var/lib/kubelet/pods/f15c4ee7-89eb-4bb4-98ea-e399afa7a596/volumes" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.202113 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237612 5030 generic.go:358] "Generic (PLEG): container finished" podID="57366066-fd78-4066-b001-220d0c0f0c6e" containerID="4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" exitCode=137 Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237646 5030 generic.go:358] "Generic (PLEG): container finished" podID="57366066-fd78-4066-b001-220d0c0f0c6e" containerID="3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" exitCode=137 Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237690 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237683 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerDied","Data":"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764"} Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237746 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerDied","Data":"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8"} Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237762 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"57366066-fd78-4066-b001-220d0c0f0c6e","Type":"ContainerDied","Data":"d95d94215fd2409b281fdf46dcc089a114a0cf7c5d42ae75322941181083890d"} Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.237787 5030 scope.go:117] "RemoveContainer" containerID="4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.258675 5030 scope.go:117] "RemoveContainer" containerID="3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.279265 5030 scope.go:117] "RemoveContainer" containerID="4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" Mar 16 13:39:04 crc kubenswrapper[5030]: E0316 13:39:04.279785 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764\": container with ID starting with 4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764 not found: ID does not exist" containerID="4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.279819 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764"} err="failed to get container status \"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764\": rpc error: code = NotFound desc = could not find container \"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764\": container with ID starting with 4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764 not found: ID does not exist" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.279840 5030 scope.go:117] "RemoveContainer" containerID="3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" Mar 16 13:39:04 crc kubenswrapper[5030]: E0316 13:39:04.280596 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8\": container with ID starting with 3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8 not found: ID does not exist" containerID="3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.280623 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8"} err="failed to get container status \"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8\": rpc error: code = NotFound desc = could not find container \"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8\": container with ID starting with 3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8 not found: ID does not exist" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.280639 5030 scope.go:117] "RemoveContainer" containerID="4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.280985 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764"} err="failed to get container status \"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764\": rpc error: code = NotFound desc = could not find container \"4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764\": container with ID starting with 4dec84cbccb4946a95674ac5ffac5918a0a0c733f832d6df17a669fae439a764 not found: ID does not exist" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.281015 5030 scope.go:117] "RemoveContainer" containerID="3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.281340 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8"} err="failed to get container status \"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8\": rpc error: code = NotFound desc = could not find container \"3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8\": container with ID starting with 3a801fc9729bcf5282cbf7d680e9211f067b771ecd6d4e19a0c0fbf43ae0dec8 not found: ID does not exist" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.321594 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.321744 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.321830 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.321887 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.322398 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.322479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.322536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7cjk\" (UniqueName: \"kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk\") pod \"57366066-fd78-4066-b001-220d0c0f0c6e\" (UID: \"57366066-fd78-4066-b001-220d0c0f0c6e\") " Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.322886 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/57366066-fd78-4066-b001-220d0c0f0c6e-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.327920 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk" (OuterVolumeSpecName: "kube-api-access-j7cjk") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "kube-api-access-j7cjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.328034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.328324 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts" (OuterVolumeSpecName: "scripts") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.349109 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.374036 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data" (OuterVolumeSpecName: "config-data") pod "57366066-fd78-4066-b001-220d0c0f0c6e" (UID: "57366066-fd78-4066-b001-220d0c0f0c6e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.425347 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7cjk\" (UniqueName: \"kubernetes.io/projected/57366066-fd78-4066-b001-220d0c0f0c6e-kube-api-access-j7cjk\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.425384 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.425398 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.425410 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.425421 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/57366066-fd78-4066-b001-220d0c0f0c6e-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.567741 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:39:04 crc kubenswrapper[5030]: I0316 13:39:04.572688 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:39:05 crc kubenswrapper[5030]: I0316 13:39:05.956656 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" path="/var/lib/kubelet/pods/57366066-fd78-4066-b001-220d0c0f0c6e/volumes" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.013813 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-h65qf"] Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.020166 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-h65qf"] Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.112514 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-qxzqd"] Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113417 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113439 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113454 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="probe" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113460 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="probe" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113474 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113494 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113500 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113510 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54074f93-8762-4822-b3df-761133496584" containerName="setup-container" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113516 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="54074f93-8762-4822-b3df-761133496584" containerName="setup-container" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113524 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113529 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113539 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113560 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113568 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113579 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113588 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54074f93-8762-4822-b3df-761133496584" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113594 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="54074f93-8762-4822-b3df-761133496584" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113603 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113608 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113614 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113620 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113625 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113630 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113644 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113649 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113655 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113660 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113669 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113674 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113684 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="swift-recon-cron" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113691 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="swift-recon-cron" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113698 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113703 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113710 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113715 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113725 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d53072-e5ed-4045-8246-495440196ae5" containerName="keystone-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113730 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d53072-e5ed-4045-8246-495440196ae5" containerName="keystone-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113735 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113739 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113750 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113755 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113762 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113768 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113779 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-reaper" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113784 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-reaper" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113793 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="init" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113799 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="init" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113806 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113811 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113820 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113826 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113833 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-expirer" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-expirer" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113847 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="dnsmasq-dns" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113851 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="dnsmasq-dns" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113858 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113864 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113870 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113874 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113881 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7539dd93-cdc3-43c8-88ce-8da150c32bed" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113886 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7539dd93-cdc3-43c8-88ce-8da150c32bed" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113895 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="ovsdbserver-sb" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113899 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="ovsdbserver-sb" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113904 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113909 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113915 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113920 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113926 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="cinder-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113930 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="cinder-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113945 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113950 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113957 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="mysql-bootstrap" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113963 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="mysql-bootstrap" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113972 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="mysql-bootstrap" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113977 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="mysql-bootstrap" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113985 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158d5a38-dbc6-4c91-bcf3-873685dc8920" containerName="kube-state-metrics" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113991 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="158d5a38-dbc6-4c91-bcf3-873685dc8920" containerName="kube-state-metrics" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.113997 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114003 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114014 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114019 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114027 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114033 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114042 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114047 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114054 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114058 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114065 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="rsync" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114069 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="rsync" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114077 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114082 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114086 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114091 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114096 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114100 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114105 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114111 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114118 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="ovn-northd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114123 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="ovn-northd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114133 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114138 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114146 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114150 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114156 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114161 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114170 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-metadata" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114175 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-metadata" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114190 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114195 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114201 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114206 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114213 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0791789-3d38-4e71-9a25-71e7dc03962a" containerName="memcached" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114218 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0791789-3d38-4e71-9a25-71e7dc03962a" containerName="memcached" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114225 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114231 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114240 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114245 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114252 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="setup-container" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114257 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="setup-container" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114264 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114269 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114275 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114280 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114441 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="54074f93-8762-4822-b3df-761133496584" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114451 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114458 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b59dd8c8-d9e0-4210-8b44-04c130f53110" containerName="dnsmasq-dns" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114469 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114476 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114482 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114488 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114496 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="be778f00-60cf-413b-97d8-cd9a392fba6d" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114502 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114511 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114518 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="rsync" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114525 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114533 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114543 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="ovsdbserver-sb" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114596 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114612 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114618 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114626 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="73a8fdc5-4144-429a-8954-d1e0f4baac91" containerName="nova-cell0-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114635 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="swift-recon-cron" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114642 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e437910-2ec4-4783-b220-e8e6de0a240b" containerName="barbican-keystone-listener" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114649 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="ovn-northd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114654 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="container-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114660 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0791789-3d38-4e71-9a25-71e7dc03962a" containerName="memcached" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114668 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7398cd2a-34fe-4637-baf9-4c4872a59c29" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114676 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f88d14c0-1c53-416d-a0bb-31c9cf2411a7" containerName="galera" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114684 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114692 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114699 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="158d5a38-dbc6-4c91-bcf3-873685dc8920" containerName="kube-state-metrics" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114706 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="probe" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114715 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114727 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="968ed402-0d43-4b2a-9370-795d7a80b80c" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114733 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="addecf4e-78dc-4422-a876-fb21680aff5e" containerName="nova-api-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114741 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e96402f4-7e68-4609-90b3-9db6f070b013" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114746 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e1c091d-1b18-4cec-b78d-6c41368faf75" containerName="proxy-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114754 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7539dd93-cdc3-43c8-88ce-8da150c32bed" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114761 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f7040e1-0208-45fd-889d-3db3d5b29e11" containerName="barbican-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114767 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b0eecf3-9201-4b52-9de8-5ed6ae3bd76c" containerName="barbican-worker" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114774 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114781 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-updater" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114786 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="09c59e2c-5857-4602-8962-5b65860490cc" containerName="placement-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114794 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="57366066-fd78-4066-b001-220d0c0f0c6e" containerName="cinder-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114802 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef6fcda0-d709-4281-881b-62164c605971" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114807 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="04d53072-e5ed-4045-8246-495440196ae5" containerName="keystone-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114813 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-server" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114821 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-httpd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114827 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-reaper" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114833 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f15c4ee7-89eb-4bb4-98ea-e399afa7a596" containerName="neutron-api" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114841 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="account-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114849 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f12cfce-f080-4e4a-b2b7-9aaa7855d10e" containerName="rabbitmq" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114856 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="15ccecb2-b2b1-496d-9d38-e1357367b8d4" containerName="glance-log" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114864 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c41eef1-5e65-449f-99bd-1b3f6d4179fa" containerName="openstack-network-exporter" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114870 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-auditor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114876 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-expirer" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114882 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad4ffc6d-9012-4802-9061-04d5767e7583" containerName="nova-metadata-metadata" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114890 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b950ae83-00a2-4a07-b2f7-674ccfda4f65" containerName="nova-cell1-conductor-conductor" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114897 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93f3c38d-e63e-45e8-af66-a42cd159d7bb" containerName="object-replicator" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.114903 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="84d9ecc3-01ae-4c5c-92d2-8688e1f241d1" containerName="nova-scheduler-scheduler" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.118679 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.121157 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.122584 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.122888 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.122960 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qxzqd"] Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.124360 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.303784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.303837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.303887 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9d2\" (UniqueName: \"kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.405966 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.406015 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.406067 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9d2\" (UniqueName: \"kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.406433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.406807 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.425109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9d2\" (UniqueName: \"kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2\") pod \"crc-storage-crc-qxzqd\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.433746 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.819693 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-qxzqd"] Mar 16 13:39:09 crc kubenswrapper[5030]: I0316 13:39:09.954796 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28fdde74-84d5-4f97-a45c-2c6623e6cf3c" path="/var/lib/kubelet/pods/28fdde74-84d5-4f97-a45c-2c6623e6cf3c/volumes" Mar 16 13:39:10 crc kubenswrapper[5030]: I0316 13:39:10.297132 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qxzqd" event={"ID":"c0e2f256-72c2-4f75-b5fd-14e5b0069284","Type":"ContainerStarted","Data":"12a86f3d8d5f94df07a8b4f15b22e9663add500f3baa803c75e25aa50f9f8e65"} Mar 16 13:39:11 crc kubenswrapper[5030]: I0316 13:39:11.309760 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0e2f256-72c2-4f75-b5fd-14e5b0069284" containerID="e9def6e1d634313b4fe8b88883de934a46a973f714edf43e2bb78e0b8b3cda7d" exitCode=0 Mar 16 13:39:11 crc kubenswrapper[5030]: I0316 13:39:11.309807 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qxzqd" event={"ID":"c0e2f256-72c2-4f75-b5fd-14e5b0069284","Type":"ContainerDied","Data":"e9def6e1d634313b4fe8b88883de934a46a973f714edf43e2bb78e0b8b3cda7d"} Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.550508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.660574 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt\") pod \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.660709 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "c0e2f256-72c2-4f75-b5fd-14e5b0069284" (UID: "c0e2f256-72c2-4f75-b5fd-14e5b0069284"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.660941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd9d2\" (UniqueName: \"kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2\") pod \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.661001 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage\") pod \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\" (UID: \"c0e2f256-72c2-4f75-b5fd-14e5b0069284\") " Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.661607 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/c0e2f256-72c2-4f75-b5fd-14e5b0069284-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.668788 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2" (OuterVolumeSpecName: "kube-api-access-dd9d2") pod "c0e2f256-72c2-4f75-b5fd-14e5b0069284" (UID: "c0e2f256-72c2-4f75-b5fd-14e5b0069284"). InnerVolumeSpecName "kube-api-access-dd9d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.680201 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "c0e2f256-72c2-4f75-b5fd-14e5b0069284" (UID: "c0e2f256-72c2-4f75-b5fd-14e5b0069284"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.763675 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/c0e2f256-72c2-4f75-b5fd-14e5b0069284-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:12 crc kubenswrapper[5030]: I0316 13:39:12.763710 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd9d2\" (UniqueName: \"kubernetes.io/projected/c0e2f256-72c2-4f75-b5fd-14e5b0069284-kube-api-access-dd9d2\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:13 crc kubenswrapper[5030]: I0316 13:39:13.330487 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-qxzqd" Mar 16 13:39:13 crc kubenswrapper[5030]: I0316 13:39:13.330497 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-qxzqd" event={"ID":"c0e2f256-72c2-4f75-b5fd-14e5b0069284","Type":"ContainerDied","Data":"12a86f3d8d5f94df07a8b4f15b22e9663add500f3baa803c75e25aa50f9f8e65"} Mar 16 13:39:13 crc kubenswrapper[5030]: I0316 13:39:13.330875 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12a86f3d8d5f94df07a8b4f15b22e9663add500f3baa803c75e25aa50f9f8e65" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.456311 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-qxzqd"] Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.460605 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-qxzqd"] Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.564529 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-svcl2"] Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.566480 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e2f256-72c2-4f75-b5fd-14e5b0069284" containerName="storage" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.566538 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e2f256-72c2-4f75-b5fd-14e5b0069284" containerName="storage" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.566837 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0e2f256-72c2-4f75-b5fd-14e5b0069284" containerName="storage" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.571390 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.573660 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.573923 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.574267 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.574331 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.574513 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-svcl2"] Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.710638 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.711242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.711286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdx7\" (UniqueName: \"kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.812510 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.812663 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdx7\" (UniqueName: \"kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.812730 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.813014 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.813295 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.830420 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdx7\" (UniqueName: \"kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7\") pod \"crc-storage-crc-svcl2\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.892124 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:15 crc kubenswrapper[5030]: I0316 13:39:15.956426 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0e2f256-72c2-4f75-b5fd-14e5b0069284" path="/var/lib/kubelet/pods/c0e2f256-72c2-4f75-b5fd-14e5b0069284/volumes" Mar 16 13:39:16 crc kubenswrapper[5030]: I0316 13:39:16.278088 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-svcl2"] Mar 16 13:39:16 crc kubenswrapper[5030]: I0316 13:39:16.370339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-svcl2" event={"ID":"21a35d0a-5121-41d2-a0af-fa1db9169921","Type":"ContainerStarted","Data":"68e36dd6f5c1b2355c3db628d1ce71c755ed72423b226a2d4cc95258c6f5e277"} Mar 16 13:39:17 crc kubenswrapper[5030]: I0316 13:39:17.383166 5030 generic.go:358] "Generic (PLEG): container finished" podID="21a35d0a-5121-41d2-a0af-fa1db9169921" containerID="b20c2906693fa3b58bb912b70cdc7469321d3ba4257b0c0f8ea9ad757cc3eb2d" exitCode=0 Mar 16 13:39:17 crc kubenswrapper[5030]: I0316 13:39:17.383252 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-svcl2" event={"ID":"21a35d0a-5121-41d2-a0af-fa1db9169921","Type":"ContainerDied","Data":"b20c2906693fa3b58bb912b70cdc7469321d3ba4257b0c0f8ea9ad757cc3eb2d"} Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.528302 5030 scope.go:117] "RemoveContainer" containerID="899281aeae2ff69a7b79ab2070ee94c667666639412204c1a49e3aa2c3326d84" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.619685 5030 scope.go:117] "RemoveContainer" containerID="91190a136b062a0638890fcd76d7a0fd38f0453a546e506a72b3f6f0d849bc09" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.657840 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.763889 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt\") pod \"21a35d0a-5121-41d2-a0af-fa1db9169921\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.764037 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftdx7\" (UniqueName: \"kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7\") pod \"21a35d0a-5121-41d2-a0af-fa1db9169921\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.764072 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "21a35d0a-5121-41d2-a0af-fa1db9169921" (UID: "21a35d0a-5121-41d2-a0af-fa1db9169921"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.764235 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage\") pod \"21a35d0a-5121-41d2-a0af-fa1db9169921\" (UID: \"21a35d0a-5121-41d2-a0af-fa1db9169921\") " Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.764675 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/21a35d0a-5121-41d2-a0af-fa1db9169921-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.771408 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7" (OuterVolumeSpecName: "kube-api-access-ftdx7") pod "21a35d0a-5121-41d2-a0af-fa1db9169921" (UID: "21a35d0a-5121-41d2-a0af-fa1db9169921"). InnerVolumeSpecName "kube-api-access-ftdx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.785958 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "21a35d0a-5121-41d2-a0af-fa1db9169921" (UID: "21a35d0a-5121-41d2-a0af-fa1db9169921"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.866684 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftdx7\" (UniqueName: \"kubernetes.io/projected/21a35d0a-5121-41d2-a0af-fa1db9169921-kube-api-access-ftdx7\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:18 crc kubenswrapper[5030]: I0316 13:39:18.866715 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/21a35d0a-5121-41d2-a0af-fa1db9169921-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:19 crc kubenswrapper[5030]: I0316 13:39:19.408392 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-svcl2" Mar 16 13:39:19 crc kubenswrapper[5030]: I0316 13:39:19.408451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-svcl2" event={"ID":"21a35d0a-5121-41d2-a0af-fa1db9169921","Type":"ContainerDied","Data":"68e36dd6f5c1b2355c3db628d1ce71c755ed72423b226a2d4cc95258c6f5e277"} Mar 16 13:39:19 crc kubenswrapper[5030]: I0316 13:39:19.408910 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68e36dd6f5c1b2355c3db628d1ce71c755ed72423b226a2d4cc95258c6f5e277" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.781852 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.783176 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a35d0a-5121-41d2-a0af-fa1db9169921" containerName="storage" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.783197 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a35d0a-5121-41d2-a0af-fa1db9169921" containerName="storage" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.783351 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="21a35d0a-5121-41d2-a0af-fa1db9169921" containerName="storage" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.789320 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.791278 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-27s2q\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.792030 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.792282 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.792585 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.792811 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.792999 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.793208 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.795115 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.876827 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.876897 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.876930 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877278 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8c78\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877519 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877684 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.877729 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979492 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979538 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979622 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979674 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979694 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979713 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979737 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979803 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.979835 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8c78\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.980454 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.980667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.980749 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.981387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.981393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.981715 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.986423 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.987675 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.988319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.989441 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.994481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8c78\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:30 crc kubenswrapper[5030]: I0316 13:39:30.996388 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"rabbitmq-server-0\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.106628 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.501510 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.525891 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerStarted","Data":"8f82b6c4af7e4d3255415c8e10d296616dbf009483e049cd843c266b4a960a39"} Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.808803 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.813143 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816176 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816187 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816299 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816342 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816371 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816378 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.816486 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-w2kf9\"" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.820897 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.894763 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.894826 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfbmr\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895036 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895109 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895153 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895170 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895394 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895483 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895525 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.895575 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.997630 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.997750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.997859 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.997886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998256 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") device mount path \"/mnt/openstack/pv06\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998621 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998627 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998757 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfbmr\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998902 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.998988 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.999004 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.999031 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.999062 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:31 crc kubenswrapper[5030]: I0316 13:39:31.999773 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.000025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.000245 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.004658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.004679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.006420 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.006644 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.017914 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfbmr\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.019250 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.136106 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.541037 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerStarted","Data":"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b"} Mar 16 13:39:32 crc kubenswrapper[5030]: I0316 13:39:32.637123 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:39:32 crc kubenswrapper[5030]: W0316 13:39:32.637288 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6c1e85_68d7_448e_81c8_2efabf9e73ef.slice/crio-f3fac8bc37c915101c0a665c727974dd892d00b6913ba43d04edb344c0b41fb2 WatchSource:0}: Error finding container f3fac8bc37c915101c0a665c727974dd892d00b6913ba43d04edb344c0b41fb2: Status 404 returned error can't find the container with id f3fac8bc37c915101c0a665c727974dd892d00b6913ba43d04edb344c0b41fb2 Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.324078 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.329974 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.334205 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.334427 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.334575 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-46dh4\"" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.334724 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.336633 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.341488 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429239 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429561 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5vw\" (UniqueName: \"kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429724 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429866 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429928 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.429979 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.430010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5vw\" (UniqueName: \"kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531451 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531580 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531615 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531796 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.531924 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.532108 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") device mount path \"/mnt/openstack/pv16\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.532465 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.532780 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.532863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.534789 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.553226 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerStarted","Data":"f3fac8bc37c915101c0a665c727974dd892d00b6913ba43d04edb344c0b41fb2"} Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.632667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.632714 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.632876 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5vw\" (UniqueName: \"kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.654857 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"openstack-galera-0\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:33 crc kubenswrapper[5030]: I0316 13:39:33.957370 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.360361 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.564621 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerStarted","Data":"ed6801e3398cc288c14bbf6fd1c590b315c74b499bf4a57b7010437770f97910"} Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.564910 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerStarted","Data":"4d8e17bfcf25cf288c7ff6b11100fb5427966794d0da0f2c7cd21ee16035f6b2"} Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.566664 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerStarted","Data":"bfce237ce2b0f2cbcaca91f0eb408d1c095cd9539db7259c0acfc71b0de57581"} Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.616529 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.623082 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.625729 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.625755 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-xpcvw\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.626015 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.626448 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.627373 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.723126 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.729105 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.731501 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.731562 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.731859 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-sc2x2\"" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.736534 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760752 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckcr\" (UniqueName: \"kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760875 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760900 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760962 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.760980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.761017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.761038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862656 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862670 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckcr\" (UniqueName: \"kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.862920 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863123 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863244 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jddz\" (UniqueName: \"kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863335 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863437 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863925 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.863964 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.864049 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.864603 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.864948 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.865665 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.869171 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.870404 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.882107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckcr\" (UniqueName: \"kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.898815 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"openstack-cell1-galera-0\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.937352 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.966094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.966185 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.966252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jddz\" (UniqueName: \"kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.966450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.967297 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.967991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.968069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.972279 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.974381 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:34 crc kubenswrapper[5030]: I0316 13:39:34.981972 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jddz\" (UniqueName: \"kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz\") pod \"memcached-0\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.050049 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:35 crc kubenswrapper[5030]: W0316 13:39:35.357938 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeea15d11_b237_4437_a87c_bfcfd6ba2cd2.slice/crio-9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b WatchSource:0}: Error finding container 9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b: Status 404 returned error can't find the container with id 9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.363326 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:39:35 crc kubenswrapper[5030]: W0316 13:39:35.481064 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27c6f290_ff76_4884_8db6_075c353aa2df.slice/crio-499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac WatchSource:0}: Error finding container 499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac: Status 404 returned error can't find the container with id 499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.482504 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.576330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerStarted","Data":"b09da0ef7c40697186c1e8b0a1b2804f8b88a5212be35bae6c691ec49874f741"} Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.576385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerStarted","Data":"9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b"} Mar 16 13:39:35 crc kubenswrapper[5030]: I0316 13:39:35.577497 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"27c6f290-ff76-4884-8db6-075c353aa2df","Type":"ContainerStarted","Data":"499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac"} Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.589375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"27c6f290-ff76-4884-8db6-075c353aa2df","Type":"ContainerStarted","Data":"a52be5d468e9737e26bae8c052a17fcdc642093e60bed5709f31f1edc1e620d1"} Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.590029 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.609167 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.60914626 podStartE2EDuration="2.60914626s" podCreationTimestamp="2026-03-16 13:39:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:36.604216267 +0000 UTC m=+2021.003528813" watchObservedRunningTime="2026-03-16 13:39:36.60914626 +0000 UTC m=+2021.008458806" Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.914027 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.917610 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.919445 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-rn84f\"" Mar 16 13:39:36 crc kubenswrapper[5030]: I0316 13:39:36.923911 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:39:37 crc kubenswrapper[5030]: I0316 13:39:37.005108 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8sfz\" (UniqueName: \"kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz\") pod \"kube-state-metrics-0\" (UID: \"4ac07f5b-281f-4341-8497-a54bfea788eb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:37 crc kubenswrapper[5030]: I0316 13:39:37.106234 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8sfz\" (UniqueName: \"kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz\") pod \"kube-state-metrics-0\" (UID: \"4ac07f5b-281f-4341-8497-a54bfea788eb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:37 crc kubenswrapper[5030]: I0316 13:39:37.125543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8sfz\" (UniqueName: \"kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz\") pod \"kube-state-metrics-0\" (UID: \"4ac07f5b-281f-4341-8497-a54bfea788eb\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:37 crc kubenswrapper[5030]: I0316 13:39:37.242850 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:37 crc kubenswrapper[5030]: I0316 13:39:37.655875 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:39:37 crc kubenswrapper[5030]: W0316 13:39:37.661417 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ac07f5b_281f_4341_8497_a54bfea788eb.slice/crio-948842b165c2054414eb7784818404f6cd1d68c6d13c9a08db78945108a51834 WatchSource:0}: Error finding container 948842b165c2054414eb7784818404f6cd1d68c6d13c9a08db78945108a51834: Status 404 returned error can't find the container with id 948842b165c2054414eb7784818404f6cd1d68c6d13c9a08db78945108a51834 Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.604543 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"4ac07f5b-281f-4341-8497-a54bfea788eb","Type":"ContainerStarted","Data":"7f644b8a4de32bc55bc03169b2c043b99ee0b3db8afc08645e8d4e1c6cc776ea"} Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.604837 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.604850 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"4ac07f5b-281f-4341-8497-a54bfea788eb","Type":"ContainerStarted","Data":"948842b165c2054414eb7784818404f6cd1d68c6d13c9a08db78945108a51834"} Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.606534 5030 generic.go:358] "Generic (PLEG): container finished" podID="ee332a01-506b-449e-968e-8ada0f0470e4" containerID="ed6801e3398cc288c14bbf6fd1c590b315c74b499bf4a57b7010437770f97910" exitCode=0 Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.606573 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerDied","Data":"ed6801e3398cc288c14bbf6fd1c590b315c74b499bf4a57b7010437770f97910"} Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.608642 5030 generic.go:358] "Generic (PLEG): container finished" podID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerID="b09da0ef7c40697186c1e8b0a1b2804f8b88a5212be35bae6c691ec49874f741" exitCode=0 Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.608687 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerDied","Data":"b09da0ef7c40697186c1e8b0a1b2804f8b88a5212be35bae6c691ec49874f741"} Mar 16 13:39:38 crc kubenswrapper[5030]: I0316 13:39:38.626765 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.310143616 podStartE2EDuration="2.62672447s" podCreationTimestamp="2026-03-16 13:39:36 +0000 UTC" firstStartedPulling="2026-03-16 13:39:37.662983326 +0000 UTC m=+2022.062295874" lastFinishedPulling="2026-03-16 13:39:37.97956418 +0000 UTC m=+2022.378876728" observedRunningTime="2026-03-16 13:39:38.615893847 +0000 UTC m=+2023.015206393" watchObservedRunningTime="2026-03-16 13:39:38.62672447 +0000 UTC m=+2023.026037017" Mar 16 13:39:39 crc kubenswrapper[5030]: I0316 13:39:39.619572 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerStarted","Data":"1052f1d94b64dacb4245d627d76e0498e3eeacbc2f3ac8a2fe43735cbc098b4e"} Mar 16 13:39:39 crc kubenswrapper[5030]: I0316 13:39:39.622332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerStarted","Data":"d3297ede49c51ccf1261e055fd5c28cd006d991bb9a6dfe1a54440eee3b2d257"} Mar 16 13:39:39 crc kubenswrapper[5030]: I0316 13:39:39.645581 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.645563834 podStartE2EDuration="7.645563834s" podCreationTimestamp="2026-03-16 13:39:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:39.639866296 +0000 UTC m=+2024.039178844" watchObservedRunningTime="2026-03-16 13:39:39.645563834 +0000 UTC m=+2024.044876381" Mar 16 13:39:39 crc kubenswrapper[5030]: I0316 13:39:39.664723 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=6.664700671 podStartE2EDuration="6.664700671s" podCreationTimestamp="2026-03-16 13:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:39.659033591 +0000 UTC m=+2024.058346138" watchObservedRunningTime="2026-03-16 13:39:39.664700671 +0000 UTC m=+2024.064013219" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.508695 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.513860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.516095 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.517312 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.517907 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.517923 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.517913 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-xnmxg\"" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.518062 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.672883 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.672988 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673139 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673173 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673275 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673367 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673384 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphx5\" (UniqueName: \"kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.673425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.776473 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.776744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.776873 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.776991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777077 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nphx5\" (UniqueName: \"kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777196 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777217 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777564 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.777692 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.778695 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.778967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.783724 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.784076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.784448 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.795047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.804376 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphx5\" (UniqueName: \"kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5\") pod \"ovsdbserver-nb-0\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:40 crc kubenswrapper[5030]: I0316 13:39:40.832365 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:41 crc kubenswrapper[5030]: I0316 13:39:41.244888 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:39:41 crc kubenswrapper[5030]: I0316 13:39:41.643569 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerStarted","Data":"58540f742909b9c7d67366440fbde7d05d0e263af58a6725c443ddce79442b49"} Mar 16 13:39:41 crc kubenswrapper[5030]: I0316 13:39:41.643947 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerStarted","Data":"1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5"} Mar 16 13:39:41 crc kubenswrapper[5030]: I0316 13:39:41.643968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerStarted","Data":"166f0e095cadcc0be612298a6d25ad8d7015b20db6a7e30e1695fed4d7d6482c"} Mar 16 13:39:41 crc kubenswrapper[5030]: I0316 13:39:41.665073 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.665049962 podStartE2EDuration="2.665049962s" podCreationTimestamp="2026-03-16 13:39:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:41.661932698 +0000 UTC m=+2026.061245245" watchObservedRunningTime="2026-03-16 13:39:41.665049962 +0000 UTC m=+2026.064362509" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.051094 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.054831 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.057956 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.058072 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-f6jzp\"" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.058834 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.059234 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.060279 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.207532 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnc5c\" (UniqueName: \"kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.207646 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.207679 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.207719 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.207903 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.208162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.208259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.208323 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310082 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310144 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310230 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnc5c\" (UniqueName: \"kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310274 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310297 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310511 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.310827 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.311054 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") device mount path \"/mnt/openstack/pv02\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.311277 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.311755 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.311919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.315794 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.315941 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.319016 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.328711 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnc5c\" (UniqueName: \"kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.330522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"ovsdbserver-sb-0\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.371499 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.596659 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:39:42 crc kubenswrapper[5030]: I0316 13:39:42.778332 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.668477 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerStarted","Data":"531bfb3e1a951bc9f5c1f8d6920f737f51dd45ef67dbac259b97bfae251a0515"} Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.668856 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerStarted","Data":"84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400"} Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.668871 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerStarted","Data":"240d416eb8dd3d5e134cc85f2af757803406849d0135410bf9d224ff3fa2a41c"} Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.687730 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.687704089 podStartE2EDuration="2.687704089s" podCreationTimestamp="2026-03-16 13:39:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:43.685157509 +0000 UTC m=+2028.084470056" watchObservedRunningTime="2026-03-16 13:39:43.687704089 +0000 UTC m=+2028.087016637" Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.833254 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.958124 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:43 crc kubenswrapper[5030]: I0316 13:39:43.958176 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:44 crc kubenswrapper[5030]: I0316 13:39:44.031767 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:44 crc kubenswrapper[5030]: I0316 13:39:44.756152 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:39:44 crc kubenswrapper[5030]: I0316 13:39:44.938430 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:44 crc kubenswrapper[5030]: I0316 13:39:44.938495 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.206674 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.372714 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.403976 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.688356 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.766215 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:39:45 crc kubenswrapper[5030]: I0316 13:39:45.833403 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.117828 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-8rk44"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.122271 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.125852 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-8rk44"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.184797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.184952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6pkz\" (UniqueName: \"kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.252363 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.256243 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.258544 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.264133 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.287219 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.287410 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6pkz\" (UniqueName: \"kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.288038 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.304942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6pkz\" (UniqueName: \"kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz\") pod \"keystone-db-create-8rk44\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.349731 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-h2hws"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.355281 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.357976 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h2hws"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.389033 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.389111 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.389166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwngg\" (UniqueName: \"kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.389484 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmdnr\" (UniqueName: \"kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.440277 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.444257 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-j7467"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.452156 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.455627 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.463816 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-j7467"] Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492035 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbzvq\" (UniqueName: \"kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492400 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmdnr\" (UniqueName: \"kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492488 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492731 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492789 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.492855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwngg\" (UniqueName: \"kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.493679 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.493939 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.507543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwngg\" (UniqueName: \"kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg\") pod \"keystone-8fdc-account-create-update-trnw6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.511602 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmdnr\" (UniqueName: \"kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr\") pod \"placement-db-create-h2hws\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.571215 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.595605 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbzvq\" (UniqueName: \"kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.595692 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.596318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.613052 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbzvq\" (UniqueName: \"kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq\") pod \"placement-3ec7-account-create-update-j7467\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.683859 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.847293 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.865070 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-8rk44"] Mar 16 13:39:46 crc kubenswrapper[5030]: W0316 13:39:46.883529 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa624ca3_86a7_4768_95f0_f47ed77c6f7b.slice/crio-ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60 WatchSource:0}: Error finding container ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60: Status 404 returned error can't find the container with id ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60 Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.886093 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.922522 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:39:46 crc kubenswrapper[5030]: I0316 13:39:46.956437 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6"] Mar 16 13:39:46 crc kubenswrapper[5030]: W0316 13:39:46.962182 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded3e18b9_f416_49a3_be5d_8cf5c427b3a6.slice/crio-f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312 WatchSource:0}: Error finding container f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312: Status 404 returned error can't find the container with id f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.134937 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h2hws"] Mar 16 13:39:47 crc kubenswrapper[5030]: W0316 13:39:47.144502 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0a394c9_abf0_49f5_a294_9af598189768.slice/crio-18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90 WatchSource:0}: Error finding container 18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90: Status 404 returned error can't find the container with id 18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.295428 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-j7467"] Mar 16 13:39:47 crc kubenswrapper[5030]: W0316 13:39:47.309315 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58ae3158_67d7_486b_8274_d163c8a7031a.slice/crio-14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4 WatchSource:0}: Error finding container 14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4: Status 404 returned error can't find the container with id 14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.728079 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0a394c9-abf0-49f5-a294-9af598189768" containerID="49f05c10e499f257241d61f17af9ed3abdb4510d9e9e8c5f149db711edcfeee2" exitCode=0 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.728169 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h2hws" event={"ID":"c0a394c9-abf0-49f5-a294-9af598189768","Type":"ContainerDied","Data":"49f05c10e499f257241d61f17af9ed3abdb4510d9e9e8c5f149db711edcfeee2"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.728224 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h2hws" event={"ID":"c0a394c9-abf0-49f5-a294-9af598189768","Type":"ContainerStarted","Data":"18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.731130 5030 generic.go:358] "Generic (PLEG): container finished" podID="58ae3158-67d7-486b-8274-d163c8a7031a" containerID="92c4b328a870a223745d65ad5620b02dc7bcb39f55fe33fcb54dcd5ee9776f2a" exitCode=0 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.731246 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" event={"ID":"58ae3158-67d7-486b-8274-d163c8a7031a","Type":"ContainerDied","Data":"92c4b328a870a223745d65ad5620b02dc7bcb39f55fe33fcb54dcd5ee9776f2a"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.731288 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" event={"ID":"58ae3158-67d7-486b-8274-d163c8a7031a","Type":"ContainerStarted","Data":"14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.732649 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" containerID="1f06f3446a3e0c7091a601fd9757b75ecce7cac5f8b2263bb08486f0e4fd30ba" exitCode=0 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.732802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" event={"ID":"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6","Type":"ContainerDied","Data":"1f06f3446a3e0c7091a601fd9757b75ecce7cac5f8b2263bb08486f0e4fd30ba"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.732834 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" event={"ID":"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6","Type":"ContainerStarted","Data":"f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.736930 5030 generic.go:358] "Generic (PLEG): container finished" podID="aa624ca3-86a7-4768-95f0-f47ed77c6f7b" containerID="d829ea6354a1e1f20b21cb0bea22bdcad785de339be7d3be3fcaf3d344af4f2c" exitCode=0 Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.737020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-8rk44" event={"ID":"aa624ca3-86a7-4768-95f0-f47ed77c6f7b","Type":"ContainerDied","Data":"d829ea6354a1e1f20b21cb0bea22bdcad785de339be7d3be3fcaf3d344af4f2c"} Mar 16 13:39:47 crc kubenswrapper[5030]: I0316 13:39:47.737072 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-8rk44" event={"ID":"aa624ca3-86a7-4768-95f0-f47ed77c6f7b","Type":"ContainerStarted","Data":"ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60"} Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.198289 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.208074 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.209802 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.210930 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.210939 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.211224 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-vgvfz\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.220668 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231727 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231746 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231830 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.231857 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmj4r\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.334604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.334829 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.334871 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.334959 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.335004 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335047 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335074 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.335132 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift podName:46aa0fb6-44eb-478c-829a-7b9c13448128 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:48.835098617 +0000 UTC m=+2033.234411164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift") pod "swift-storage-0" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128") : configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335324 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") device mount path \"/mnt/openstack/pv04\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335417 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.335700 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmj4r\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.344265 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.351392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmj4r\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.354939 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.599873 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cpmhs"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.611500 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.614356 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cpmhs"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.616158 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.616339 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.616526 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.629538 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zqmcz"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642361 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642435 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhsdz\" (UniqueName: \"kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642455 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642499 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.642559 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.660170 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cpmhs"] Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.660323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.660994 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zqmcz"] Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.661631 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle dispersionconf etc-swift kube-api-access-vhsdz ring-data-devices scripts swiftconf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" podUID="f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.743806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744146 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744173 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744231 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhsdz\" (UniqueName: \"kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744253 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744299 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.744350 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.747315 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.747600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.749054 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.753653 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.761452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.763790 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.764270 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhsdz\" (UniqueName: \"kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz\") pod \"swift-ring-rebalance-cpmhs\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.807905 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.831326 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.846958 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g4f6\" (UniqueName: \"kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847170 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.847370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.847619 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.847639 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: E0316 13:39:48.847693 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift podName:46aa0fb6-44eb-478c-829a-7b9c13448128 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:49.847673974 +0000 UTC m=+2034.246986522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift") pod "swift-storage-0" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128") : configmap "swift-ring-files" not found Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.948883 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.949153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhsdz\" (UniqueName: \"kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.949776 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.949910 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950144 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950185 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts\") pod \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\" (UID: \"f8c6ccf8-1cbb-47eb-84c9-4068432b47e0\") " Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.950996 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951095 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g4f6\" (UniqueName: \"kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951092 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts" (OuterVolumeSpecName: "scripts") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951568 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951733 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.951452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.952044 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.952416 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.952433 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.954084 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.956002 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.956522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.956624 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.957603 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz" (OuterVolumeSpecName: "kube-api-access-vhsdz") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "kube-api-access-vhsdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.957656 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.958005 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.958320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.964666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" (UID: "f8c6ccf8-1cbb-47eb-84c9-4068432b47e0"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.968714 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g4f6\" (UniqueName: \"kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6\") pod \"swift-ring-rebalance-zqmcz\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:48 crc kubenswrapper[5030]: I0316 13:39:48.981378 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.054530 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.054574 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.054585 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.054596 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhsdz\" (UniqueName: \"kubernetes.io/projected/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0-kube-api-access-vhsdz\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.146234 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.258147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwngg\" (UniqueName: \"kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg\") pod \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.258394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts\") pod \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\" (UID: \"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.259358 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" (UID: "ed3e18b9-f416-49a3-be5d-8cf5c427b3a6"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.259788 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.263383 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.265777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg" (OuterVolumeSpecName: "kube-api-access-zwngg") pod "ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" (UID: "ed3e18b9-f416-49a3-be5d-8cf5c427b3a6"). InnerVolumeSpecName "kube-api-access-zwngg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.269708 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.361041 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6pkz\" (UniqueName: \"kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz\") pod \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.361364 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbzvq\" (UniqueName: \"kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq\") pod \"58ae3158-67d7-486b-8274-d163c8a7031a\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.361421 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmdnr\" (UniqueName: \"kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr\") pod \"c0a394c9-abf0-49f5-a294-9af598189768\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.361503 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts\") pod \"c0a394c9-abf0-49f5-a294-9af598189768\" (UID: \"c0a394c9-abf0-49f5-a294-9af598189768\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.362190 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c0a394c9-abf0-49f5-a294-9af598189768" (UID: "c0a394c9-abf0-49f5-a294-9af598189768"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.362756 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwngg\" (UniqueName: \"kubernetes.io/projected/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-kube-api-access-zwngg\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.362777 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c0a394c9-abf0-49f5-a294-9af598189768-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.362787 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.364368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz" (OuterVolumeSpecName: "kube-api-access-r6pkz") pod "aa624ca3-86a7-4768-95f0-f47ed77c6f7b" (UID: "aa624ca3-86a7-4768-95f0-f47ed77c6f7b"). InnerVolumeSpecName "kube-api-access-r6pkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.365068 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq" (OuterVolumeSpecName: "kube-api-access-jbzvq") pod "58ae3158-67d7-486b-8274-d163c8a7031a" (UID: "58ae3158-67d7-486b-8274-d163c8a7031a"). InnerVolumeSpecName "kube-api-access-jbzvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.365411 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr" (OuterVolumeSpecName: "kube-api-access-kmdnr") pod "c0a394c9-abf0-49f5-a294-9af598189768" (UID: "c0a394c9-abf0-49f5-a294-9af598189768"). InnerVolumeSpecName "kube-api-access-kmdnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.415511 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zqmcz"] Mar 16 13:39:49 crc kubenswrapper[5030]: W0316 13:39:49.420006 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode03348e0_1bbc_4738_984c_774c619ec0cf.slice/crio-9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d WatchSource:0}: Error finding container 9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d: Status 404 returned error can't find the container with id 9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.463941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts\") pod \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\" (UID: \"aa624ca3-86a7-4768-95f0-f47ed77c6f7b\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.464266 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts\") pod \"58ae3158-67d7-486b-8274-d163c8a7031a\" (UID: \"58ae3158-67d7-486b-8274-d163c8a7031a\") " Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.464722 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6pkz\" (UniqueName: \"kubernetes.io/projected/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-kube-api-access-r6pkz\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.464740 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbzvq\" (UniqueName: \"kubernetes.io/projected/58ae3158-67d7-486b-8274-d163c8a7031a-kube-api-access-jbzvq\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.464750 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmdnr\" (UniqueName: \"kubernetes.io/projected/c0a394c9-abf0-49f5-a294-9af598189768-kube-api-access-kmdnr\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.465172 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "58ae3158-67d7-486b-8274-d163c8a7031a" (UID: "58ae3158-67d7-486b-8274-d163c8a7031a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.465591 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "aa624ca3-86a7-4768-95f0-f47ed77c6f7b" (UID: "aa624ca3-86a7-4768-95f0-f47ed77c6f7b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.566323 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/aa624ca3-86a7-4768-95f0-f47ed77c6f7b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.566355 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/58ae3158-67d7-486b-8274-d163c8a7031a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.626852 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.812389 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-h2hws" event={"ID":"c0a394c9-abf0-49f5-a294-9af598189768","Type":"ContainerDied","Data":"18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.812439 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18dc04db848b2aaa1c758da8975ec092d10c71cc45a94aac8d082cddf537bf90" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.812415 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-h2hws" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.816873 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" event={"ID":"58ae3158-67d7-486b-8274-d163c8a7031a","Type":"ContainerDied","Data":"14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.816915 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14b00d45b800e5d08df619f59ac0635f7bd414f9dd8da102cf5fdc94c508d7c4" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.816993 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-j7467" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.819670 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.819794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6" event={"ID":"ed3e18b9-f416-49a3-be5d-8cf5c427b3a6","Type":"ContainerDied","Data":"f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.819882 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9e71869cb47b1c37ad57ac70a9a39baa80690d0070080a807d5943cd8f74312" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.821448 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-8rk44" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.821449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-8rk44" event={"ID":"aa624ca3-86a7-4768-95f0-f47ed77c6f7b","Type":"ContainerDied","Data":"ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.821906 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce2c38f2e0f9e3d957db153b38536ef8eb0a78effcfb41a80e017bc449ff9b60" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.823466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" event={"ID":"e03348e0-1bbc-4738-984c-774c619ec0cf","Type":"ContainerStarted","Data":"aae6ed44cf0342264ca94e4115612511d19026671de98dd42589cacbf8cca1ff"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.823487 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-cpmhs" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.823495 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" event={"ID":"e03348e0-1bbc-4738-984c-774c619ec0cf","Type":"ContainerStarted","Data":"9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d"} Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.852800 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" podStartSLOduration=1.852783914 podStartE2EDuration="1.852783914s" podCreationTimestamp="2026-03-16 13:39:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:49.843064291 +0000 UTC m=+2034.242376838" watchObservedRunningTime="2026-03-16 13:39:49.852783914 +0000 UTC m=+2034.252096461" Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.877524 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:49 crc kubenswrapper[5030]: E0316 13:39:49.878059 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:39:49 crc kubenswrapper[5030]: E0316 13:39:49.878076 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:39:49 crc kubenswrapper[5030]: E0316 13:39:49.878145 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift podName:46aa0fb6-44eb-478c-829a-7b9c13448128 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:51.878108421 +0000 UTC m=+2036.277420968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift") pod "swift-storage-0" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128") : configmap "swift-ring-files" not found Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.902162 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cpmhs"] Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.908263 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-cpmhs"] Mar 16 13:39:49 crc kubenswrapper[5030]: I0316 13:39:49.957018 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c6ccf8-1cbb-47eb-84c9-4068432b47e0" path="/var/lib/kubelet/pods/f8c6ccf8-1cbb-47eb-84c9-4068432b47e0/volumes" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.614486 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615594 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0a394c9-abf0-49f5-a294-9af598189768" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615608 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0a394c9-abf0-49f5-a294-9af598189768" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615630 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa624ca3-86a7-4768-95f0-f47ed77c6f7b" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615636 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa624ca3-86a7-4768-95f0-f47ed77c6f7b" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615643 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ae3158-67d7-486b-8274-d163c8a7031a" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615649 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ae3158-67d7-486b-8274-d163c8a7031a" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615665 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615670 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615831 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615842 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="58ae3158-67d7-486b-8274-d163c8a7031a" containerName="mariadb-account-create-update" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615853 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0a394c9-abf0-49f5-a294-9af598189768" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.615865 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa624ca3-86a7-4768-95f0-f47ed77c6f7b" containerName="mariadb-database-create" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.619638 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.624775 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.692221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.692405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbrz9\" (UniqueName: \"kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.692513 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.794837 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbrz9\" (UniqueName: \"kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.794936 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.795232 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.795481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.795707 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.812623 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbrz9\" (UniqueName: \"kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9\") pod \"redhat-operators-2f2dv\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:50 crc kubenswrapper[5030]: I0316 13:39:50.948265 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.373365 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.736126 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.839232 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerID="c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3" exitCode=0 Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.839437 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerDied","Data":"c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3"} Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.839563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerStarted","Data":"b116a24f574e26d2e9604e63685ae9784f0240d8618a786c63c22772f361132c"} Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.916202 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.918058 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:51 crc kubenswrapper[5030]: E0316 13:39:51.918255 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:39:51 crc kubenswrapper[5030]: E0316 13:39:51.918301 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:39:51 crc kubenswrapper[5030]: E0316 13:39:51.918386 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift podName:46aa0fb6-44eb-478c-829a-7b9c13448128 nodeName:}" failed. No retries permitted until 2026-03-16 13:39:55.918357966 +0000 UTC m=+2040.317670703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift") pod "swift-storage-0" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128") : configmap "swift-ring-files" not found Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.923845 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.930520 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.931168 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.932484 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-vgbpb\"" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.935737 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 13:39:51 crc kubenswrapper[5030]: I0316 13:39:51.936375 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020129 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020569 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020654 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6t67\" (UniqueName: \"kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.020971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.021076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124334 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6t67\" (UniqueName: \"kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124685 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124720 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124784 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124896 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.124953 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.125472 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.126064 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.126093 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.139727 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.142133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.142474 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6t67\" (UniqueName: \"kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.149037 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.254323 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k5k7q"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.254756 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.269169 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k5k7q"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.269358 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.272274 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.329946 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.330232 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8rmm\" (UniqueName: \"kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.431838 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8rmm\" (UniqueName: \"kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.431986 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.432795 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.449513 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8rmm\" (UniqueName: \"kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm\") pod \"root-account-create-update-k5k7q\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.613172 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.682534 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:39:52 crc kubenswrapper[5030]: W0316 13:39:52.692059 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e507f45_9b3e_4be2_ae26_341712344d66.slice/crio-a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83 WatchSource:0}: Error finding container a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83: Status 404 returned error can't find the container with id a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83 Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.715376 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-j96tf"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.720084 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.729506 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-j96tf"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.841222 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.841538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvrtc\" (UniqueName: \"kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.849203 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.854344 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.859229 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg"] Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.859424 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.875315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerStarted","Data":"a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83"} Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.943780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.943987 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.944174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvrtc\" (UniqueName: \"kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.944243 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbl2p\" (UniqueName: \"kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.945896 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:52 crc kubenswrapper[5030]: I0316 13:39:52.968570 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvrtc\" (UniqueName: \"kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc\") pod \"glance-db-create-j96tf\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.037084 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k5k7q"] Mar 16 13:39:53 crc kubenswrapper[5030]: W0316 13:39:53.037373 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode40b5e6d_a88f_4c0c_bf59_71e81289cc93.slice/crio-18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34 WatchSource:0}: Error finding container 18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34: Status 404 returned error can't find the container with id 18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.042759 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.046965 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.047221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbl2p\" (UniqueName: \"kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.049753 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.064466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbl2p\" (UniqueName: \"kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p\") pod \"glance-3f90-account-create-update-mg2tg\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.173815 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.415385 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-j96tf"] Mar 16 13:39:53 crc kubenswrapper[5030]: W0316 13:39:53.437627 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd67e71e_b64e_4d9a_b7c4_8c0c187c1bbe.slice/crio-a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16 WatchSource:0}: Error finding container a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16: Status 404 returned error can't find the container with id a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.588067 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg"] Mar 16 13:39:53 crc kubenswrapper[5030]: W0316 13:39:53.606264 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc29141c8_6f47_4ef8_a908_ca7681c673c1.slice/crio-ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34 WatchSource:0}: Error finding container ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34: Status 404 returned error can't find the container with id ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.890340 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerStarted","Data":"95fbb4006226b7a376cba582e792561c2c545e4b5048ee1d55c1da49b7564735"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.890768 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerStarted","Data":"f528204e7ce812978b1b4c5c0816bfc669ec75a9157881de1e574df2705fe754"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.890826 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.894701 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerID="1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90" exitCode=0 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.894928 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerDied","Data":"1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.899972 5030 generic.go:358] "Generic (PLEG): container finished" podID="bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" containerID="759b622a148dd2e33f826c0cf69e4aaac01d97fca2125fd28de509d21fd6b02c" exitCode=0 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.902281 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-j96tf" event={"ID":"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe","Type":"ContainerDied","Data":"759b622a148dd2e33f826c0cf69e4aaac01d97fca2125fd28de509d21fd6b02c"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.902329 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-j96tf" event={"ID":"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe","Type":"ContainerStarted","Data":"a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.905573 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" event={"ID":"c29141c8-6f47-4ef8-a908-ca7681c673c1","Type":"ContainerStarted","Data":"b18154b45383b351cbe47196ec5be89b7a4198ee1c5d107dd602c2085e2cdd0b"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.905602 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" event={"ID":"c29141c8-6f47-4ef8-a908-ca7681c673c1","Type":"ContainerStarted","Data":"ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.907315 5030 generic.go:358] "Generic (PLEG): container finished" podID="e40b5e6d-a88f-4c0c-bf59-71e81289cc93" containerID="93ab8ec6277e313313c7fe2e5ca6d5d574d0ea9d7002f7288dfba307b34a2eb2" exitCode=0 Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.907411 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" event={"ID":"e40b5e6d-a88f-4c0c-bf59-71e81289cc93","Type":"ContainerDied","Data":"93ab8ec6277e313313c7fe2e5ca6d5d574d0ea9d7002f7288dfba307b34a2eb2"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.907428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" event={"ID":"e40b5e6d-a88f-4c0c-bf59-71e81289cc93","Type":"ContainerStarted","Data":"18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34"} Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.918442 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.918433081 podStartE2EDuration="2.918433081s" podCreationTimestamp="2026-03-16 13:39:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:53.916124038 +0000 UTC m=+2038.315436585" watchObservedRunningTime="2026-03-16 13:39:53.918433081 +0000 UTC m=+2038.317745627" Mar 16 13:39:53 crc kubenswrapper[5030]: I0316 13:39:53.978244 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" podStartSLOduration=1.9782287589999998 podStartE2EDuration="1.978228759s" podCreationTimestamp="2026-03-16 13:39:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:53.973635549 +0000 UTC m=+2038.372948096" watchObservedRunningTime="2026-03-16 13:39:53.978228759 +0000 UTC m=+2038.377541306" Mar 16 13:39:54 crc kubenswrapper[5030]: E0316 13:39:54.166628 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1412569 actualBytes=10240 Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.286867 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.286955 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.918020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerStarted","Data":"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef"} Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.927309 5030 generic.go:358] "Generic (PLEG): container finished" podID="c29141c8-6f47-4ef8-a908-ca7681c673c1" containerID="b18154b45383b351cbe47196ec5be89b7a4198ee1c5d107dd602c2085e2cdd0b" exitCode=0 Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.927466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" event={"ID":"c29141c8-6f47-4ef8-a908-ca7681c673c1","Type":"ContainerDied","Data":"b18154b45383b351cbe47196ec5be89b7a4198ee1c5d107dd602c2085e2cdd0b"} Mar 16 13:39:54 crc kubenswrapper[5030]: I0316 13:39:54.947793 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-2f2dv" podStartSLOduration=3.9292361209999997 podStartE2EDuration="4.947776474s" podCreationTimestamp="2026-03-16 13:39:50 +0000 UTC" firstStartedPulling="2026-03-16 13:39:51.840290507 +0000 UTC m=+2036.239603054" lastFinishedPulling="2026-03-16 13:39:52.858830859 +0000 UTC m=+2037.258143407" observedRunningTime="2026-03-16 13:39:54.941237794 +0000 UTC m=+2039.340550342" watchObservedRunningTime="2026-03-16 13:39:54.947776474 +0000 UTC m=+2039.347089021" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.344440 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.348831 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.498044 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvrtc\" (UniqueName: \"kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc\") pod \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.498451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts\") pod \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.498645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts\") pod \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\" (UID: \"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe\") " Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.498704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8rmm\" (UniqueName: \"kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm\") pod \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\" (UID: \"e40b5e6d-a88f-4c0c-bf59-71e81289cc93\") " Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.499113 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" (UID: "bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.499341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e40b5e6d-a88f-4c0c-bf59-71e81289cc93" (UID: "e40b5e6d-a88f-4c0c-bf59-71e81289cc93"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.499745 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.499769 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.505539 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc" (OuterVolumeSpecName: "kube-api-access-cvrtc") pod "bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" (UID: "bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe"). InnerVolumeSpecName "kube-api-access-cvrtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.506263 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm" (OuterVolumeSpecName: "kube-api-access-t8rmm") pod "e40b5e6d-a88f-4c0c-bf59-71e81289cc93" (UID: "e40b5e6d-a88f-4c0c-bf59-71e81289cc93"). InnerVolumeSpecName "kube-api-access-t8rmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.601735 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8rmm\" (UniqueName: \"kubernetes.io/projected/e40b5e6d-a88f-4c0c-bf59-71e81289cc93-kube-api-access-t8rmm\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.601770 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvrtc\" (UniqueName: \"kubernetes.io/projected/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe-kube-api-access-cvrtc\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.938832 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-j96tf" event={"ID":"bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe","Type":"ContainerDied","Data":"a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16"} Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.938894 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8033c6fdb1f6aa3823d14901796d0ac3aee5733a8d94313329c37c89a844f16" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.938891 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-j96tf" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.941240 5030 generic.go:358] "Generic (PLEG): container finished" podID="e03348e0-1bbc-4738-984c-774c619ec0cf" containerID="aae6ed44cf0342264ca94e4115612511d19026671de98dd42589cacbf8cca1ff" exitCode=0 Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.941316 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" event={"ID":"e03348e0-1bbc-4738-984c-774c619ec0cf","Type":"ContainerDied","Data":"aae6ed44cf0342264ca94e4115612511d19026671de98dd42589cacbf8cca1ff"} Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.943683 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" event={"ID":"e40b5e6d-a88f-4c0c-bf59-71e81289cc93","Type":"ContainerDied","Data":"18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34"} Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.943710 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18b3c170950562ef45292e42ed968fbbd758644af8867c8c4e7856f4721c8e34" Mar 16 13:39:55 crc kubenswrapper[5030]: I0316 13:39:55.943746 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-k5k7q" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.009005 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.020232 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"swift-storage-0\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.022976 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.283242 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.418316 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbl2p\" (UniqueName: \"kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p\") pod \"c29141c8-6f47-4ef8-a908-ca7681c673c1\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.418697 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts\") pod \"c29141c8-6f47-4ef8-a908-ca7681c673c1\" (UID: \"c29141c8-6f47-4ef8-a908-ca7681c673c1\") " Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.419368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c29141c8-6f47-4ef8-a908-ca7681c673c1" (UID: "c29141c8-6f47-4ef8-a908-ca7681c673c1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.422949 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p" (OuterVolumeSpecName: "kube-api-access-kbl2p") pod "c29141c8-6f47-4ef8-a908-ca7681c673c1" (UID: "c29141c8-6f47-4ef8-a908-ca7681c673c1"). InnerVolumeSpecName "kube-api-access-kbl2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.439338 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.521438 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbl2p\" (UniqueName: \"kubernetes.io/projected/c29141c8-6f47-4ef8-a908-ca7681c673c1-kube-api-access-kbl2p\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.521482 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c29141c8-6f47-4ef8-a908-ca7681c673c1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.959702 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178"} Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.960160 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182"} Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.960184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa"} Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.960198 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"410492c0a6d873c1751654e542b22962ade3799be7a5a105484b055dc71ac9dd"} Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.979637 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.981083 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg" event={"ID":"c29141c8-6f47-4ef8-a908-ca7681c673c1","Type":"ContainerDied","Data":"ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34"} Mar 16 13:39:56 crc kubenswrapper[5030]: I0316 13:39:56.981130 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ade8ebf24cd02be76360cdc1ec39263b2200389ce18a21704f567dce0ed23e34" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.311392 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.442532 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.442700 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.442802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.443114 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.443245 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.443292 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.443362 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g4f6\" (UniqueName: \"kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6\") pod \"e03348e0-1bbc-4738-984c-774c619ec0cf\" (UID: \"e03348e0-1bbc-4738-984c-774c619ec0cf\") " Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.445510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.445648 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.447693 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6" (OuterVolumeSpecName: "kube-api-access-4g4f6") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "kube-api-access-4g4f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.454364 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.470240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts" (OuterVolumeSpecName: "scripts") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.471662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.471849 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e03348e0-1bbc-4738-984c-774c619ec0cf" (UID: "e03348e0-1bbc-4738-984c-774c619ec0cf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.546584 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.546817 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g4f6\" (UniqueName: \"kubernetes.io/projected/e03348e0-1bbc-4738-984c-774c619ec0cf-kube-api-access-4g4f6\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.546914 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.546996 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.547052 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e03348e0-1bbc-4738-984c-774c619ec0cf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.547100 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/e03348e0-1bbc-4738-984c-774c619ec0cf-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.547153 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/e03348e0-1bbc-4738-984c-774c619ec0cf-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.977909 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-jgqkp"] Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979144 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e03348e0-1bbc-4738-984c-774c619ec0cf" containerName="swift-ring-rebalance" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979165 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e03348e0-1bbc-4738-984c-774c619ec0cf" containerName="swift-ring-rebalance" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979182 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c29141c8-6f47-4ef8-a908-ca7681c673c1" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979189 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c29141c8-6f47-4ef8-a908-ca7681c673c1" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979213 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" containerName="mariadb-database-create" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979225 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" containerName="mariadb-database-create" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979235 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40b5e6d-a88f-4c0c-bf59-71e81289cc93" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979240 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40b5e6d-a88f-4c0c-bf59-71e81289cc93" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979382 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e40b5e6d-a88f-4c0c-bf59-71e81289cc93" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979407 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e03348e0-1bbc-4738-984c-774c619ec0cf" containerName="swift-ring-rebalance" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979416 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c29141c8-6f47-4ef8-a908-ca7681c673c1" containerName="mariadb-account-create-update" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.979424 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" containerName="mariadb-database-create" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.982631 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.984069 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9gklp\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.987503 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.990635 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.991297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-zqmcz" event={"ID":"e03348e0-1bbc-4738-984c-774c619ec0cf","Type":"ContainerDied","Data":"9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.991334 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a2832c94311df45d33f365a39a5db8943f8e105237918ac57c4c79a116ec74d" Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996229 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996282 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996300 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996309 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996319 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6"} Mar 16 13:39:57 crc kubenswrapper[5030]: I0316 13:39:57.996330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7"} Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.000760 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-jgqkp"] Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.158051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9llb7\" (UniqueName: \"kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.158282 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.158380 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.158528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.260387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9llb7\" (UniqueName: \"kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.260778 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.260814 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.260895 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.265230 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.265808 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.266037 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.282669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9llb7\" (UniqueName: \"kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7\") pod \"glance-db-sync-jgqkp\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.299672 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.595301 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k5k7q"] Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.602299 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-k5k7q"] Mar 16 13:39:58 crc kubenswrapper[5030]: I0316 13:39:58.751639 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-jgqkp"] Mar 16 13:39:58 crc kubenswrapper[5030]: W0316 13:39:58.752479 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a4ea528_ba89_46f5_a41f_c2e75ed380fe.slice/crio-060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0 WatchSource:0}: Error finding container 060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0: Status 404 returned error can't find the container with id 060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0 Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019170 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019197 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019206 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.019222 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerStarted","Data":"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.022931 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" event={"ID":"2a4ea528-ba89-46f5-a41f-c2e75ed380fe","Type":"ContainerStarted","Data":"060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0"} Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.050895 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=12.05087732 podStartE2EDuration="12.05087732s" podCreationTimestamp="2026-03-16 13:39:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:39:59.049334147 +0000 UTC m=+2043.448646693" watchObservedRunningTime="2026-03-16 13:39:59.05087732 +0000 UTC m=+2043.450189867" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.165516 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.170266 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.172361 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.172447 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.289955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.290040 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.290176 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4vfn\" (UniqueName: \"kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.290322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.391518 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.391608 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4vfn\" (UniqueName: \"kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.391686 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.391884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.392469 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.392515 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.392768 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.406936 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4vfn\" (UniqueName: \"kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn\") pod \"dnsmasq-dnsmasq-6bc57886f5-6j7z5\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.501584 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:39:59 crc kubenswrapper[5030]: I0316 13:39:59.957952 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40b5e6d-a88f-4c0c-bf59-71e81289cc93" path="/var/lib/kubelet/pods/e40b5e6d-a88f-4c0c-bf59-71e81289cc93/volumes" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.041574 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" event={"ID":"2a4ea528-ba89-46f5-a41f-c2e75ed380fe","Type":"ContainerStarted","Data":"50a080e443229b9e659e8e56bce945023aede62f3e4e686c83419286600654fa"} Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.041846 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.063052 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" podStartSLOduration=3.063036769 podStartE2EDuration="3.063036769s" podCreationTimestamp="2026-03-16 13:39:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:00.056990505 +0000 UTC m=+2044.456303062" watchObservedRunningTime="2026-03-16 13:40:00.063036769 +0000 UTC m=+2044.462349315" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.124586 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561140-5l6vr"] Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.129880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.131299 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561140-5l6vr"] Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.132072 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.135910 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.137849 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.214965 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5qrq\" (UniqueName: \"kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq\") pod \"auto-csr-approver-29561140-5l6vr\" (UID: \"ab88cf12-1d1a-4467-be46-59018f5ce7d8\") " pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.316443 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5qrq\" (UniqueName: \"kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq\") pod \"auto-csr-approver-29561140-5l6vr\" (UID: \"ab88cf12-1d1a-4467-be46-59018f5ce7d8\") " pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.335975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5qrq\" (UniqueName: \"kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq\") pod \"auto-csr-approver-29561140-5l6vr\" (UID: \"ab88cf12-1d1a-4467-be46-59018f5ce7d8\") " pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.468053 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.867917 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561140-5l6vr"] Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.949637 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.949695 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:00 crc kubenswrapper[5030]: I0316 13:40:00.988695 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.056143 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" event={"ID":"ab88cf12-1d1a-4467-be46-59018f5ce7d8","Type":"ContainerStarted","Data":"689959e07438b66d27b67546b83aed88c81aaada3dd5c27fd178d9d993f4659e"} Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.059091 5030 generic.go:358] "Generic (PLEG): container finished" podID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerID="f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff" exitCode=0 Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.060680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" event={"ID":"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38","Type":"ContainerDied","Data":"f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff"} Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.060712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" event={"ID":"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38","Type":"ContainerStarted","Data":"fd96ff05b7c2241c638834b87303273aecf5ec2e3fcf78e0424b08c53ffcd982"} Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.099160 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:01 crc kubenswrapper[5030]: I0316 13:40:01.227895 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:40:02 crc kubenswrapper[5030]: I0316 13:40:02.074339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" event={"ID":"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38","Type":"ContainerStarted","Data":"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54"} Mar 16 13:40:02 crc kubenswrapper[5030]: I0316 13:40:02.074520 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:40:02 crc kubenswrapper[5030]: I0316 13:40:02.100397 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" podStartSLOduration=3.100376851 podStartE2EDuration="3.100376851s" podCreationTimestamp="2026-03-16 13:39:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:02.09128565 +0000 UTC m=+2046.490598198" watchObservedRunningTime="2026-03-16 13:40:02.100376851 +0000 UTC m=+2046.499689398" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.087017 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-2f2dv" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="registry-server" containerID="cri-o://71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef" gracePeriod=2 Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.517255 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.587521 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities\") pod \"c0583439-7b8a-425e-821f-267cf75ac5b7\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.587764 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content\") pod \"c0583439-7b8a-425e-821f-267cf75ac5b7\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.587911 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbrz9\" (UniqueName: \"kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9\") pod \"c0583439-7b8a-425e-821f-267cf75ac5b7\" (UID: \"c0583439-7b8a-425e-821f-267cf75ac5b7\") " Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.588662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities" (OuterVolumeSpecName: "utilities") pod "c0583439-7b8a-425e-821f-267cf75ac5b7" (UID: "c0583439-7b8a-425e-821f-267cf75ac5b7"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.595916 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9" (OuterVolumeSpecName: "kube-api-access-kbrz9") pod "c0583439-7b8a-425e-821f-267cf75ac5b7" (UID: "c0583439-7b8a-425e-821f-267cf75ac5b7"). InnerVolumeSpecName "kube-api-access-kbrz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.620954 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4xhx8"] Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622114 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="extract-content" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622132 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="extract-content" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622175 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="extract-utilities" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622183 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="extract-utilities" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="registry-server" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622203 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="registry-server" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.622390 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerName="registry-server" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.626788 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.627812 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4xhx8"] Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.628397 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.691074 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.691374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.691926 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.691950 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbrz9\" (UniqueName: \"kubernetes.io/projected/c0583439-7b8a-425e-821f-267cf75ac5b7-kube-api-access-kbrz9\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.793534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.794179 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.794931 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.811438 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k\") pod \"root-account-create-update-4xhx8\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:03 crc kubenswrapper[5030]: I0316 13:40:03.995577 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.102074 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0583439-7b8a-425e-821f-267cf75ac5b7" containerID="71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef" exitCode=0 Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.102289 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerDied","Data":"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef"} Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.102328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-2f2dv" event={"ID":"c0583439-7b8a-425e-821f-267cf75ac5b7","Type":"ContainerDied","Data":"b116a24f574e26d2e9604e63685ae9784f0240d8618a786c63c22772f361132c"} Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.102349 5030 scope.go:117] "RemoveContainer" containerID="71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.102541 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-2f2dv" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.107988 5030 generic.go:358] "Generic (PLEG): container finished" podID="ab88cf12-1d1a-4467-be46-59018f5ce7d8" containerID="9e1564d8caf887bd9da1e282e39228f2391a87545f9b78098d196ee429ececed" exitCode=0 Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.108263 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" event={"ID":"ab88cf12-1d1a-4467-be46-59018f5ce7d8","Type":"ContainerDied","Data":"9e1564d8caf887bd9da1e282e39228f2391a87545f9b78098d196ee429ececed"} Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.112644 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a4ea528-ba89-46f5-a41f-c2e75ed380fe" containerID="50a080e443229b9e659e8e56bce945023aede62f3e4e686c83419286600654fa" exitCode=0 Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.112728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" event={"ID":"2a4ea528-ba89-46f5-a41f-c2e75ed380fe","Type":"ContainerDied","Data":"50a080e443229b9e659e8e56bce945023aede62f3e4e686c83419286600654fa"} Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.140212 5030 scope.go:117] "RemoveContainer" containerID="1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.175969 5030 scope.go:117] "RemoveContainer" containerID="c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.197062 5030 scope.go:117] "RemoveContainer" containerID="71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef" Mar 16 13:40:04 crc kubenswrapper[5030]: E0316 13:40:04.197436 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef\": container with ID starting with 71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef not found: ID does not exist" containerID="71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.197469 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef"} err="failed to get container status \"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef\": rpc error: code = NotFound desc = could not find container \"71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef\": container with ID starting with 71f4fb9f40065ecd4908df8c6681742955176b73cdbb8c2fe7a13924915c38ef not found: ID does not exist" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.197491 5030 scope.go:117] "RemoveContainer" containerID="1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90" Mar 16 13:40:04 crc kubenswrapper[5030]: E0316 13:40:04.197727 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90\": container with ID starting with 1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90 not found: ID does not exist" containerID="1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.197754 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90"} err="failed to get container status \"1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90\": rpc error: code = NotFound desc = could not find container \"1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90\": container with ID starting with 1ee860c26119aaa0c96b322dee8f68bba4e70f061f8bec523d4070d470d17e90 not found: ID does not exist" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.197768 5030 scope.go:117] "RemoveContainer" containerID="c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3" Mar 16 13:40:04 crc kubenswrapper[5030]: E0316 13:40:04.197990 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3\": container with ID starting with c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3 not found: ID does not exist" containerID="c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.198012 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3"} err="failed to get container status \"c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3\": rpc error: code = NotFound desc = could not find container \"c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3\": container with ID starting with c8cbf84c94d68ccd4958e03bd137619112998f5562981f380b03c18b7dbd38a3 not found: ID does not exist" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.289986 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "c0583439-7b8a-425e-821f-267cf75ac5b7" (UID: "c0583439-7b8a-425e-821f-267cf75ac5b7"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.305629 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/c0583439-7b8a-425e-821f-267cf75ac5b7-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:04 crc kubenswrapper[5030]: W0316 13:40:04.426480 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e2dc120_8674_46a7_91ba_6952fc676165.slice/crio-c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d WatchSource:0}: Error finding container c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d: Status 404 returned error can't find the container with id c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.427017 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4xhx8"] Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.477999 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.489567 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-2f2dv"] Mar 16 13:40:04 crc kubenswrapper[5030]: I0316 13:40:04.976007 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.126522 5030 generic.go:358] "Generic (PLEG): container finished" podID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerID="e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b" exitCode=0 Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.126628 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerDied","Data":"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b"} Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.131437 5030 generic.go:358] "Generic (PLEG): container finished" podID="8e2dc120-8674-46a7-91ba-6952fc676165" containerID="2540b9f55f5dd5210d2023b712015c59bc01114c91b473bb7262592899b29ed5" exitCode=0 Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.131513 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" event={"ID":"8e2dc120-8674-46a7-91ba-6952fc676165","Type":"ContainerDied","Data":"2540b9f55f5dd5210d2023b712015c59bc01114c91b473bb7262592899b29ed5"} Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.131646 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" event={"ID":"8e2dc120-8674-46a7-91ba-6952fc676165","Type":"ContainerStarted","Data":"c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d"} Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.519416 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.527888 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.636410 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle\") pod \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.636932 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data\") pod \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.637005 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5qrq\" (UniqueName: \"kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq\") pod \"ab88cf12-1d1a-4467-be46-59018f5ce7d8\" (UID: \"ab88cf12-1d1a-4467-be46-59018f5ce7d8\") " Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.637143 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data\") pod \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.637293 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9llb7\" (UniqueName: \"kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7\") pod \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\" (UID: \"2a4ea528-ba89-46f5-a41f-c2e75ed380fe\") " Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.643883 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "2a4ea528-ba89-46f5-a41f-c2e75ed380fe" (UID: "2a4ea528-ba89-46f5-a41f-c2e75ed380fe"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.644141 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq" (OuterVolumeSpecName: "kube-api-access-f5qrq") pod "ab88cf12-1d1a-4467-be46-59018f5ce7d8" (UID: "ab88cf12-1d1a-4467-be46-59018f5ce7d8"). InnerVolumeSpecName "kube-api-access-f5qrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.644207 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7" (OuterVolumeSpecName: "kube-api-access-9llb7") pod "2a4ea528-ba89-46f5-a41f-c2e75ed380fe" (UID: "2a4ea528-ba89-46f5-a41f-c2e75ed380fe"). InnerVolumeSpecName "kube-api-access-9llb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.661942 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2a4ea528-ba89-46f5-a41f-c2e75ed380fe" (UID: "2a4ea528-ba89-46f5-a41f-c2e75ed380fe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.675219 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data" (OuterVolumeSpecName: "config-data") pod "2a4ea528-ba89-46f5-a41f-c2e75ed380fe" (UID: "2a4ea528-ba89-46f5-a41f-c2e75ed380fe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.739893 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.739927 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9llb7\" (UniqueName: \"kubernetes.io/projected/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-kube-api-access-9llb7\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.739940 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.739950 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a4ea528-ba89-46f5-a41f-c2e75ed380fe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.739962 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5qrq\" (UniqueName: \"kubernetes.io/projected/ab88cf12-1d1a-4467-be46-59018f5ce7d8-kube-api-access-f5qrq\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:05 crc kubenswrapper[5030]: I0316 13:40:05.958182 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0583439-7b8a-425e-821f-267cf75ac5b7" path="/var/lib/kubelet/pods/c0583439-7b8a-425e-821f-267cf75ac5b7/volumes" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.149071 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerID="bfce237ce2b0f2cbcaca91f0eb408d1c095cd9539db7259c0acfc71b0de57581" exitCode=0 Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.149183 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerDied","Data":"bfce237ce2b0f2cbcaca91f0eb408d1c095cd9539db7259c0acfc71b0de57581"} Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.152514 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.152508 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561140-5l6vr" event={"ID":"ab88cf12-1d1a-4467-be46-59018f5ce7d8","Type":"ContainerDied","Data":"689959e07438b66d27b67546b83aed88c81aaada3dd5c27fd178d9d993f4659e"} Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.152646 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="689959e07438b66d27b67546b83aed88c81aaada3dd5c27fd178d9d993f4659e" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.154719 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.154718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-jgqkp" event={"ID":"2a4ea528-ba89-46f5-a41f-c2e75ed380fe","Type":"ContainerDied","Data":"060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0"} Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.154896 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="060e6233d6bc3fef61d643e258eec0fc3a38949b6e8bed7893ab4bc3bd8c57e0" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.157193 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerStarted","Data":"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7"} Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.157941 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.206055 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=37.206036761 podStartE2EDuration="37.206036761s" podCreationTimestamp="2026-03-16 13:39:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:06.20601035 +0000 UTC m=+2050.605322897" watchObservedRunningTime="2026-03-16 13:40:06.206036761 +0000 UTC m=+2050.605349307" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.488427 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.555912 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts\") pod \"8e2dc120-8674-46a7-91ba-6952fc676165\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.556317 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k\") pod \"8e2dc120-8674-46a7-91ba-6952fc676165\" (UID: \"8e2dc120-8674-46a7-91ba-6952fc676165\") " Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.562467 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8e2dc120-8674-46a7-91ba-6952fc676165" (UID: "8e2dc120-8674-46a7-91ba-6952fc676165"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.564162 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8e2dc120-8674-46a7-91ba-6952fc676165-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.574108 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k" (OuterVolumeSpecName: "kube-api-access-6k78k") pod "8e2dc120-8674-46a7-91ba-6952fc676165" (UID: "8e2dc120-8674-46a7-91ba-6952fc676165"). InnerVolumeSpecName "kube-api-access-6k78k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.594028 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561134-cphvg"] Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.609874 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561134-cphvg"] Mar 16 13:40:06 crc kubenswrapper[5030]: I0316 13:40:06.666279 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k78k\" (UniqueName: \"kubernetes.io/projected/8e2dc120-8674-46a7-91ba-6952fc676165-kube-api-access-6k78k\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.171775 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerStarted","Data":"f8f9a228c39d74f6171e07f48041b560bd59771df3190e00fdcc1f3f427d342b"} Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.173437 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.176910 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" event={"ID":"8e2dc120-8674-46a7-91ba-6952fc676165","Type":"ContainerDied","Data":"c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d"} Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.176983 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9da27b0614a5aa3a7c63a7bfad27f1d85c7d900145829d8e1cf030b13dfcd6d" Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.176929 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-4xhx8" Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.203349 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=37.203325247 podStartE2EDuration="37.203325247s" podCreationTimestamp="2026-03-16 13:39:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:07.198487707 +0000 UTC m=+2051.597800254" watchObservedRunningTime="2026-03-16 13:40:07.203325247 +0000 UTC m=+2051.602637794" Mar 16 13:40:07 crc kubenswrapper[5030]: I0316 13:40:07.956909 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="063c2a0a-7162-4a05-8e4c-bd62892d96fa" path="/var/lib/kubelet/pods/063c2a0a-7162-4a05-8e4c-bd62892d96fa/volumes" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.088808 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.138994 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.139244 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="dnsmasq-dns" containerID="cri-o://343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731" gracePeriod=10 Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.602918 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.707455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc\") pod \"06859e34-1622-4e83-9610-5db910da5a99\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.707820 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grq67\" (UniqueName: \"kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67\") pod \"06859e34-1622-4e83-9610-5db910da5a99\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.708344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config\") pod \"06859e34-1622-4e83-9610-5db910da5a99\" (UID: \"06859e34-1622-4e83-9610-5db910da5a99\") " Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.713285 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67" (OuterVolumeSpecName: "kube-api-access-grq67") pod "06859e34-1622-4e83-9610-5db910da5a99" (UID: "06859e34-1622-4e83-9610-5db910da5a99"). InnerVolumeSpecName "kube-api-access-grq67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.743430 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "06859e34-1622-4e83-9610-5db910da5a99" (UID: "06859e34-1622-4e83-9610-5db910da5a99"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.750245 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config" (OuterVolumeSpecName: "config") pod "06859e34-1622-4e83-9610-5db910da5a99" (UID: "06859e34-1622-4e83-9610-5db910da5a99"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.812096 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.812134 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/06859e34-1622-4e83-9610-5db910da5a99-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:08 crc kubenswrapper[5030]: I0316 13:40:08.812147 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grq67\" (UniqueName: \"kubernetes.io/projected/06859e34-1622-4e83-9610-5db910da5a99-kube-api-access-grq67\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.196436 5030 generic.go:358] "Generic (PLEG): container finished" podID="06859e34-1622-4e83-9610-5db910da5a99" containerID="343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731" exitCode=0 Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.196515 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.196591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" event={"ID":"06859e34-1622-4e83-9610-5db910da5a99","Type":"ContainerDied","Data":"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731"} Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.196658 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7" event={"ID":"06859e34-1622-4e83-9610-5db910da5a99","Type":"ContainerDied","Data":"96c1cd2dffa1b15443278535991ecbe472c5e85954bfacb9b6a59a5cb96896ee"} Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.196681 5030 scope.go:117] "RemoveContainer" containerID="343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.215313 5030 scope.go:117] "RemoveContainer" containerID="21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.224258 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.230143 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-tdht7"] Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.246165 5030 scope.go:117] "RemoveContainer" containerID="343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731" Mar 16 13:40:09 crc kubenswrapper[5030]: E0316 13:40:09.246449 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731\": container with ID starting with 343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731 not found: ID does not exist" containerID="343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.246487 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731"} err="failed to get container status \"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731\": rpc error: code = NotFound desc = could not find container \"343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731\": container with ID starting with 343c8a263a9953f2b9510e7be1210d00d7b7996b73d45ef34e38acdcd7ee9731 not found: ID does not exist" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.246506 5030 scope.go:117] "RemoveContainer" containerID="21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233" Mar 16 13:40:09 crc kubenswrapper[5030]: E0316 13:40:09.246800 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233\": container with ID starting with 21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233 not found: ID does not exist" containerID="21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.246851 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233"} err="failed to get container status \"21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233\": rpc error: code = NotFound desc = could not find container \"21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233\": container with ID starting with 21060b41f5fc7edc831440e1e29de23e2e813917ecb27e4525b8d7def42d8233 not found: ID does not exist" Mar 16 13:40:09 crc kubenswrapper[5030]: I0316 13:40:09.956763 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06859e34-1622-4e83-9610-5db910da5a99" path="/var/lib/kubelet/pods/06859e34-1622-4e83-9610-5db910da5a99/volumes" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.180832 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.431642 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-dkv6n"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432588 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="dnsmasq-dns" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432608 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="dnsmasq-dns" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432620 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab88cf12-1d1a-4467-be46-59018f5ce7d8" containerName="oc" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432626 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab88cf12-1d1a-4467-be46-59018f5ce7d8" containerName="oc" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432639 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2dc120-8674-46a7-91ba-6952fc676165" containerName="mariadb-account-create-update" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432647 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2dc120-8674-46a7-91ba-6952fc676165" containerName="mariadb-account-create-update" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432687 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="init" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432693 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="init" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432704 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4ea528-ba89-46f5-a41f-c2e75ed380fe" containerName="glance-db-sync" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432709 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4ea528-ba89-46f5-a41f-c2e75ed380fe" containerName="glance-db-sync" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432852 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="06859e34-1622-4e83-9610-5db910da5a99" containerName="dnsmasq-dns" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432865 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab88cf12-1d1a-4467-be46-59018f5ce7d8" containerName="oc" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432874 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e2dc120-8674-46a7-91ba-6952fc676165" containerName="mariadb-account-create-update" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.432883 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a4ea528-ba89-46f5-a41f-c2e75ed380fe" containerName="glance-db-sync" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.436581 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.452180 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-dkv6n"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.479983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gdt\" (UniqueName: \"kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.480146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.550513 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-vwcgx"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.554465 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.574420 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-vwcgx"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.582473 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gdt\" (UniqueName: \"kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.582538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbnw\" (UniqueName: \"kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.582599 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.582621 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.583317 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.633042 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gdt\" (UniqueName: \"kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt\") pod \"cinder-db-create-dkv6n\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.659655 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-m4hnk"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.663804 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.668978 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.673949 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.675173 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-m4hnk"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.677729 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.679114 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.684212 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.684263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbnw\" (UniqueName: \"kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.684395 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.684652 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnlf5\" (UniqueName: \"kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.685067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.737080 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbnw\" (UniqueName: \"kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw\") pod \"neutron-db-create-vwcgx\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.752388 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.781648 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.789402 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.805853 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.808988 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnlf5\" (UniqueName: \"kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.809086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jfd\" (UniqueName: \"kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.809166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.809190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.810132 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.840675 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.857336 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnlf5\" (UniqueName: \"kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5\") pod \"barbican-db-create-m4hnk\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.874827 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.910998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.911093 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.911279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72ck\" (UniqueName: \"kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.911643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jfd\" (UniqueName: \"kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.911717 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.911731 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.916880 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.919493 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.925382 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.936614 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h7nwp"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.951713 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h7nwp"] Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.953668 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.954175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jfd\" (UniqueName: \"kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd\") pod \"neutron-027c-account-create-update-gh8jg\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.957130 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-drfrr\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.957141 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.957180 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.957485 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.982151 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:17 crc kubenswrapper[5030]: I0316 13:40:17.997468 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.015850 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9czr\" (UniqueName: \"kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.015941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.015977 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.016121 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.016164 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9mw8\" (UniqueName: \"kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.016317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c72ck\" (UniqueName: \"kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.016513 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.019270 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.039667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72ck\" (UniqueName: \"kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck\") pod \"cinder-7f17-account-create-update-wjwmh\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.118393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9czr\" (UniqueName: \"kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.118450 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.118483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.118623 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mw8\" (UniqueName: \"kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.118753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.120985 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.121927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.123311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.135202 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9mw8\" (UniqueName: \"kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8\") pod \"barbican-0b53-account-create-update-mtmqt\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.136792 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9czr\" (UniqueName: \"kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr\") pod \"keystone-db-sync-h7nwp\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.189809 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.202461 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.247844 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.265401 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.389044 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-vwcgx"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.405606 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-dkv6n"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.478808 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.492468 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-m4hnk"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.688211 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.789342 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h7nwp"] Mar 16 13:40:18 crc kubenswrapper[5030]: I0316 13:40:18.867087 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt"] Mar 16 13:40:18 crc kubenswrapper[5030]: W0316 13:40:18.954205 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb97dd349_8786_43a7_b5d6_938548d988cf.slice/crio-8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190 WatchSource:0}: Error finding container 8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190: Status 404 returned error can't find the container with id 8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.238906 5030 scope.go:117] "RemoveContainer" containerID="3a2c603fb083354ec328e7101816b0e7e3d0429d6c89aacdf057b135fc635f63" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.305827 5030 generic.go:358] "Generic (PLEG): container finished" podID="b97dd349-8786-43a7-b5d6-938548d988cf" containerID="9facb9baec27c82da7cce05bdd3ac24effe523b84cf912c82da1101ca1f85d38" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.306093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" event={"ID":"b97dd349-8786-43a7-b5d6-938548d988cf","Type":"ContainerDied","Data":"9facb9baec27c82da7cce05bdd3ac24effe523b84cf912c82da1101ca1f85d38"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.306125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" event={"ID":"b97dd349-8786-43a7-b5d6-938548d988cf","Type":"ContainerStarted","Data":"8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.309963 5030 generic.go:358] "Generic (PLEG): container finished" podID="ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" containerID="aba762d97e4630a834be496441a66fa8a982b3ca2f1eeaec502c242437de81cd" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.310053 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" event={"ID":"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8","Type":"ContainerDied","Data":"aba762d97e4630a834be496441a66fa8a982b3ca2f1eeaec502c242437de81cd"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.310074 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" event={"ID":"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8","Type":"ContainerStarted","Data":"2edfd815320b39b570f5c1946b42994e3038669a19d2eb1ef9a49427696c4b6a"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.313268 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" event={"ID":"2745c69e-440c-405d-b62b-5cbf56739ef5","Type":"ContainerStarted","Data":"255f41b41c2f1917725cfb73e48190234aef3c673d3145965f8d12cdc8afd76b"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.313290 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" event={"ID":"2745c69e-440c-405d-b62b-5cbf56739ef5","Type":"ContainerStarted","Data":"4640bd3d56e937d50f87a59d71e21b8f750ef9805db53eb00b76c2db28985357"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.315136 5030 generic.go:358] "Generic (PLEG): container finished" podID="e220c63b-56ff-405d-b04c-30b005b3bdd1" containerID="9292b9d45c29df81747eaf49ceaf4e33f2ed3e2ee938b3dcaf1ab5dc2953f8aa" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.315179 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" event={"ID":"e220c63b-56ff-405d-b04c-30b005b3bdd1","Type":"ContainerDied","Data":"9292b9d45c29df81747eaf49ceaf4e33f2ed3e2ee938b3dcaf1ab5dc2953f8aa"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.315194 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" event={"ID":"e220c63b-56ff-405d-b04c-30b005b3bdd1","Type":"ContainerStarted","Data":"38c64bce82a3500aae696235f3f3646478a68086c8b98b69c626b89065ed4429"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.316456 5030 generic.go:358] "Generic (PLEG): container finished" podID="c730090b-37b1-40db-90d3-263b055709f3" containerID="ee474b73147b07b54ed3dd5adad0b72ed6061f1b7dcf3684c7c525acfed80170" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.316527 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" event={"ID":"c730090b-37b1-40db-90d3-263b055709f3","Type":"ContainerDied","Data":"ee474b73147b07b54ed3dd5adad0b72ed6061f1b7dcf3684c7c525acfed80170"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.316542 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" event={"ID":"c730090b-37b1-40db-90d3-263b055709f3","Type":"ContainerStarted","Data":"3b95908ea060d503cd48e54113aab13dcd07a954096d4fca98bab6cb9f1e497b"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.320045 5030 generic.go:358] "Generic (PLEG): container finished" podID="b98c7910-5683-418f-81c8-e0174aa4ed85" containerID="416aee296fca8e5d91acc1fc611a6a4c6e6613d075bc4b15b51d2d09cb9c91c9" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.320189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" event={"ID":"b98c7910-5683-418f-81c8-e0174aa4ed85","Type":"ContainerDied","Data":"416aee296fca8e5d91acc1fc611a6a4c6e6613d075bc4b15b51d2d09cb9c91c9"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.320257 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" event={"ID":"b98c7910-5683-418f-81c8-e0174aa4ed85","Type":"ContainerStarted","Data":"59c96bb911c0938fe02d256d0e1d51e22ac7738dad9e29ed5bfdcc66c10d8025"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.321588 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ad13737-f305-4cc7-bf80-dd80c873c5d9" containerID="55b0dd9cbe7c78a059ff94488ede93b2263143907abfd15feeb231f25ac1960a" exitCode=0 Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.321669 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" event={"ID":"4ad13737-f305-4cc7-bf80-dd80c873c5d9","Type":"ContainerDied","Data":"55b0dd9cbe7c78a059ff94488ede93b2263143907abfd15feeb231f25ac1960a"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.321699 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" event={"ID":"4ad13737-f305-4cc7-bf80-dd80c873c5d9","Type":"ContainerStarted","Data":"db9f2c77ee9fe3eeac9a937680a92428e1ff6a898528e57a670fe4d0e9dbbb4f"} Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.334815 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" podStartSLOduration=2.3347990579999998 podStartE2EDuration="2.334799058s" podCreationTimestamp="2026-03-16 13:40:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:19.330802861 +0000 UTC m=+2063.730115408" watchObservedRunningTime="2026-03-16 13:40:19.334799058 +0000 UTC m=+2063.734111605" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.369395 5030 scope.go:117] "RemoveContainer" containerID="c928eef8ad4f79b54e99525b4b7f412bbd972206c19668939b49928c41ee6d04" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.390670 5030 scope.go:117] "RemoveContainer" containerID="5fffd0cb79b4311e513afc4aa4747120c11bfb60b458083ca162a254ffcabdf3" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.411685 5030 scope.go:117] "RemoveContainer" containerID="ea7b98efea152e56043bb66d8872319250d9519e67d9665d3840beb53a60cc87" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.538668 5030 scope.go:117] "RemoveContainer" containerID="646df5274c6f3a348769458c49269411688195a9eae5b5f84ffec2fd9d4199e2" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.571941 5030 scope.go:117] "RemoveContainer" containerID="dcac50c93122f2d6a571f3b1f0522bc5c4633613b37446928cee916b94be5dc6" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.592205 5030 scope.go:117] "RemoveContainer" containerID="0e5f5078a310bbb0a0a32571573622e198c6023b68b9f89e20a70ca12bc2517c" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.614495 5030 scope.go:117] "RemoveContainer" containerID="b003aa9c236de7b95d92c63911a3ff69346f244065bf038f6eddc931f8ee36bb" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.665624 5030 scope.go:117] "RemoveContainer" containerID="ec990e040afe2891145524ddf9eca283d5e045d567c5c60df75a51c46d82e1d0" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.694809 5030 scope.go:117] "RemoveContainer" containerID="41c528453be256884b824b1cc5b27ac96e4e76e07fd1cb6d97211af13ea7b9cf" Mar 16 13:40:19 crc kubenswrapper[5030]: I0316 13:40:19.770742 5030 scope.go:117] "RemoveContainer" containerID="be58854d27f3f095f34ea4123d7ac19b5198d7b0501b0fe6019f29f6109a5e02" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.709778 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.889568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts\") pod \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.889894 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5jfd\" (UniqueName: \"kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd\") pod \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\" (UID: \"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8\") " Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.890169 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" (UID: "ebd873fb-2f7f-4fb8-a683-e4e642ad89b8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.891001 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.896845 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd" (OuterVolumeSpecName: "kube-api-access-s5jfd") pod "ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" (UID: "ebd873fb-2f7f-4fb8-a683-e4e642ad89b8"). InnerVolumeSpecName "kube-api-access-s5jfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.968881 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.974210 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.977308 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.983778 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.990155 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:20 crc kubenswrapper[5030]: I0316 13:40:20.993172 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5jfd\" (UniqueName: \"kubernetes.io/projected/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8-kube-api-access-s5jfd\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.095036 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c72ck\" (UniqueName: \"kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck\") pod \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.095617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnlf5\" (UniqueName: \"kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5\") pod \"b98c7910-5683-418f-81c8-e0174aa4ed85\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.095762 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts\") pod \"e220c63b-56ff-405d-b04c-30b005b3bdd1\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096060 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts\") pod \"b97dd349-8786-43a7-b5d6-938548d988cf\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9mw8\" (UniqueName: \"kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8\") pod \"b97dd349-8786-43a7-b5d6-938548d988cf\" (UID: \"b97dd349-8786-43a7-b5d6-938548d988cf\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096285 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts\") pod \"c730090b-37b1-40db-90d3-263b055709f3\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096361 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e220c63b-56ff-405d-b04c-30b005b3bdd1" (UID: "e220c63b-56ff-405d-b04c-30b005b3bdd1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096486 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts\") pod \"b98c7910-5683-418f-81c8-e0174aa4ed85\" (UID: \"b98c7910-5683-418f-81c8-e0174aa4ed85\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096670 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8gdt\" (UniqueName: \"kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt\") pod \"e220c63b-56ff-405d-b04c-30b005b3bdd1\" (UID: \"e220c63b-56ff-405d-b04c-30b005b3bdd1\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096882 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tbnw\" (UniqueName: \"kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw\") pod \"c730090b-37b1-40db-90d3-263b055709f3\" (UID: \"c730090b-37b1-40db-90d3-263b055709f3\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096497 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b97dd349-8786-43a7-b5d6-938548d988cf" (UID: "b97dd349-8786-43a7-b5d6-938548d988cf"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.097047 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts\") pod \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\" (UID: \"4ad13737-f305-4cc7-bf80-dd80c873c5d9\") " Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096856 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c730090b-37b1-40db-90d3-263b055709f3" (UID: "c730090b-37b1-40db-90d3-263b055709f3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.096875 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b98c7910-5683-418f-81c8-e0174aa4ed85" (UID: "b98c7910-5683-418f-81c8-e0174aa4ed85"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.097818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "4ad13737-f305-4cc7-bf80-dd80c873c5d9" (UID: "4ad13737-f305-4cc7-bf80-dd80c873c5d9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.098217 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e220c63b-56ff-405d-b04c-30b005b3bdd1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.098316 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b97dd349-8786-43a7-b5d6-938548d988cf-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.098398 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c730090b-37b1-40db-90d3-263b055709f3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.098463 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b98c7910-5683-418f-81c8-e0174aa4ed85-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.098531 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/4ad13737-f305-4cc7-bf80-dd80c873c5d9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.099151 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck" (OuterVolumeSpecName: "kube-api-access-c72ck") pod "4ad13737-f305-4cc7-bf80-dd80c873c5d9" (UID: "4ad13737-f305-4cc7-bf80-dd80c873c5d9"). InnerVolumeSpecName "kube-api-access-c72ck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.099579 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8" (OuterVolumeSpecName: "kube-api-access-p9mw8") pod "b97dd349-8786-43a7-b5d6-938548d988cf" (UID: "b97dd349-8786-43a7-b5d6-938548d988cf"). InnerVolumeSpecName "kube-api-access-p9mw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.100146 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5" (OuterVolumeSpecName: "kube-api-access-xnlf5") pod "b98c7910-5683-418f-81c8-e0174aa4ed85" (UID: "b98c7910-5683-418f-81c8-e0174aa4ed85"). InnerVolumeSpecName "kube-api-access-xnlf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.101314 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw" (OuterVolumeSpecName: "kube-api-access-9tbnw") pod "c730090b-37b1-40db-90d3-263b055709f3" (UID: "c730090b-37b1-40db-90d3-263b055709f3"). InnerVolumeSpecName "kube-api-access-9tbnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.101739 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt" (OuterVolumeSpecName: "kube-api-access-l8gdt") pod "e220c63b-56ff-405d-b04c-30b005b3bdd1" (UID: "e220c63b-56ff-405d-b04c-30b005b3bdd1"). InnerVolumeSpecName "kube-api-access-l8gdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.199789 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnlf5\" (UniqueName: \"kubernetes.io/projected/b98c7910-5683-418f-81c8-e0174aa4ed85-kube-api-access-xnlf5\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.199816 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9mw8\" (UniqueName: \"kubernetes.io/projected/b97dd349-8786-43a7-b5d6-938548d988cf-kube-api-access-p9mw8\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.199831 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8gdt\" (UniqueName: \"kubernetes.io/projected/e220c63b-56ff-405d-b04c-30b005b3bdd1-kube-api-access-l8gdt\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.199841 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tbnw\" (UniqueName: \"kubernetes.io/projected/c730090b-37b1-40db-90d3-263b055709f3-kube-api-access-9tbnw\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.199850 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c72ck\" (UniqueName: \"kubernetes.io/projected/4ad13737-f305-4cc7-bf80-dd80c873c5d9-kube-api-access-c72ck\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.347649 5030 generic.go:358] "Generic (PLEG): container finished" podID="2745c69e-440c-405d-b62b-5cbf56739ef5" containerID="255f41b41c2f1917725cfb73e48190234aef3c673d3145965f8d12cdc8afd76b" exitCode=0 Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.347734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" event={"ID":"2745c69e-440c-405d-b62b-5cbf56739ef5","Type":"ContainerDied","Data":"255f41b41c2f1917725cfb73e48190234aef3c673d3145965f8d12cdc8afd76b"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.351341 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" event={"ID":"e220c63b-56ff-405d-b04c-30b005b3bdd1","Type":"ContainerDied","Data":"38c64bce82a3500aae696235f3f3646478a68086c8b98b69c626b89065ed4429"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.351404 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38c64bce82a3500aae696235f3f3646478a68086c8b98b69c626b89065ed4429" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.351406 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-dkv6n" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.353135 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.353122 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-vwcgx" event={"ID":"c730090b-37b1-40db-90d3-263b055709f3","Type":"ContainerDied","Data":"3b95908ea060d503cd48e54113aab13dcd07a954096d4fca98bab6cb9f1e497b"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.353276 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b95908ea060d503cd48e54113aab13dcd07a954096d4fca98bab6cb9f1e497b" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.354400 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.354465 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-m4hnk" event={"ID":"b98c7910-5683-418f-81c8-e0174aa4ed85","Type":"ContainerDied","Data":"59c96bb911c0938fe02d256d0e1d51e22ac7738dad9e29ed5bfdcc66c10d8025"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.354494 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59c96bb911c0938fe02d256d0e1d51e22ac7738dad9e29ed5bfdcc66c10d8025" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.355981 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.356008 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh" event={"ID":"4ad13737-f305-4cc7-bf80-dd80c873c5d9","Type":"ContainerDied","Data":"db9f2c77ee9fe3eeac9a937680a92428e1ff6a898528e57a670fe4d0e9dbbb4f"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.356052 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db9f2c77ee9fe3eeac9a937680a92428e1ff6a898528e57a670fe4d0e9dbbb4f" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.357676 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.357728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt" event={"ID":"b97dd349-8786-43a7-b5d6-938548d988cf","Type":"ContainerDied","Data":"8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.357894 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c89abb8ac75d73419693ad4b42c8c9130fcb974f67bc905174717fd9f5d6190" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.359380 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" event={"ID":"ebd873fb-2f7f-4fb8-a683-e4e642ad89b8","Type":"ContainerDied","Data":"2edfd815320b39b570f5c1946b42994e3038669a19d2eb1ef9a49427696c4b6a"} Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.359395 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg" Mar 16 13:40:21 crc kubenswrapper[5030]: I0316 13:40:21.359403 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2edfd815320b39b570f5c1946b42994e3038669a19d2eb1ef9a49427696c4b6a" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.679062 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.734481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data\") pod \"2745c69e-440c-405d-b62b-5cbf56739ef5\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.735041 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9czr\" (UniqueName: \"kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr\") pod \"2745c69e-440c-405d-b62b-5cbf56739ef5\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.735270 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle\") pod \"2745c69e-440c-405d-b62b-5cbf56739ef5\" (UID: \"2745c69e-440c-405d-b62b-5cbf56739ef5\") " Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.743562 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr" (OuterVolumeSpecName: "kube-api-access-s9czr") pod "2745c69e-440c-405d-b62b-5cbf56739ef5" (UID: "2745c69e-440c-405d-b62b-5cbf56739ef5"). InnerVolumeSpecName "kube-api-access-s9czr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.759851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2745c69e-440c-405d-b62b-5cbf56739ef5" (UID: "2745c69e-440c-405d-b62b-5cbf56739ef5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.782320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data" (OuterVolumeSpecName: "config-data") pod "2745c69e-440c-405d-b62b-5cbf56739ef5" (UID: "2745c69e-440c-405d-b62b-5cbf56739ef5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.837786 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9czr\" (UniqueName: \"kubernetes.io/projected/2745c69e-440c-405d-b62b-5cbf56739ef5-kube-api-access-s9czr\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.837822 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:22 crc kubenswrapper[5030]: I0316 13:40:22.837832 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2745c69e-440c-405d-b62b-5cbf56739ef5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.384080 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.384064 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-h7nwp" event={"ID":"2745c69e-440c-405d-b62b-5cbf56739ef5","Type":"ContainerDied","Data":"4640bd3d56e937d50f87a59d71e21b8f750ef9805db53eb00b76c2db28985357"} Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.384256 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4640bd3d56e937d50f87a59d71e21b8f750ef9805db53eb00b76c2db28985357" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.549437 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qtdpv"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550406 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c730090b-37b1-40db-90d3-263b055709f3" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550439 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c730090b-37b1-40db-90d3-263b055709f3" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550473 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad13737-f305-4cc7-bf80-dd80c873c5d9" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550479 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad13737-f305-4cc7-bf80-dd80c873c5d9" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550489 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550495 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550512 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b98c7910-5683-418f-81c8-e0174aa4ed85" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550517 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b98c7910-5683-418f-81c8-e0174aa4ed85" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550528 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97dd349-8786-43a7-b5d6-938548d988cf" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550533 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97dd349-8786-43a7-b5d6-938548d988cf" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550543 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e220c63b-56ff-405d-b04c-30b005b3bdd1" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550563 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e220c63b-56ff-405d-b04c-30b005b3bdd1" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550577 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2745c69e-440c-405d-b62b-5cbf56739ef5" containerName="keystone-db-sync" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550582 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2745c69e-440c-405d-b62b-5cbf56739ef5" containerName="keystone-db-sync" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550731 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ad13737-f305-4cc7-bf80-dd80c873c5d9" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550743 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550749 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b98c7910-5683-418f-81c8-e0174aa4ed85" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550762 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e220c63b-56ff-405d-b04c-30b005b3bdd1" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550772 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2745c69e-440c-405d-b62b-5cbf56739ef5" containerName="keystone-db-sync" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550783 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b97dd349-8786-43a7-b5d6-938548d988cf" containerName="mariadb-account-create-update" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.550790 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c730090b-37b1-40db-90d3-263b055709f3" containerName="mariadb-database-create" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.554956 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.557302 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.557814 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-drfrr\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.557875 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.558112 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.558340 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.558899 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qtdpv"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.652693 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.652782 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.652901 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.652931 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.652971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgntr\" (UniqueName: \"kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.653010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.664511 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.672130 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.674271 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.674731 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.689757 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.737501 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-86mwm"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.741919 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.746021 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.746044 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-dfsvm\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.746330 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.750763 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-86mwm"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.754941 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755087 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755216 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755360 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755657 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755796 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755868 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.755955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.756070 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgntr\" (UniqueName: \"kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.756170 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.756234 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.756348 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrl2\" (UniqueName: \"kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.758532 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5mdzd"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.762517 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.762583 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.763030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.767777 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5mdzd"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.770337 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.770490 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.770681 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.770833 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-vz7xz\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.771031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.771258 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.793311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgntr\" (UniqueName: \"kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr\") pod \"keystone-bootstrap-qtdpv\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.836895 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-ctqw8"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.854902 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.856250 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-ctqw8"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.858086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859396 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859646 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859728 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859804 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860030 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860124 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860209 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860310 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhzt\" (UniqueName: \"kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860416 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkmbm\" (UniqueName: \"kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860601 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.860699 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859424 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.861273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrl2\" (UniqueName: \"kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.861381 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.859626 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-w66lc\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.861647 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.858669 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.862125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.865291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.872662 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.875723 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.875915 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-l8ncv"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.881333 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.882213 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.884101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrl2\" (UniqueName: \"kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.885251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data\") pod \"ceilometer-0\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.885397 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-l8ncv"] Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.885874 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.886910 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.887837 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-m7jfd\"" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966714 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966831 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966914 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966938 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.966986 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.967010 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8fk\" (UniqueName: \"kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.967715 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.967967 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.968098 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.970757 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flhzt\" (UniqueName: \"kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.970819 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.970862 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8zcn\" (UniqueName: \"kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.970897 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkmbm\" (UniqueName: \"kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.970933 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.971071 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.971118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.971717 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.973324 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.974407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.976758 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.979183 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.987974 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.989524 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhzt\" (UniqueName: \"kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:23 crc kubenswrapper[5030]: I0316 13:40:23.997126 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkmbm\" (UniqueName: \"kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm\") pod \"neutron-db-sync-86mwm\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.008143 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle\") pod \"cinder-db-sync-5mdzd\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.065350 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073777 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xg8fk\" (UniqueName: \"kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073917 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073938 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zcn\" (UniqueName: \"kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.073986 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.078853 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.080325 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.080963 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.081706 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.086233 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.092125 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.097391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zcn\" (UniqueName: \"kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn\") pod \"placement-db-sync-l8ncv\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.097582 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg8fk\" (UniqueName: \"kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk\") pod \"barbican-db-sync-ctqw8\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.140137 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.220540 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.248622 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.287161 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.287232 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.345701 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qtdpv"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.416728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" event={"ID":"be78d942-5990-44dc-ab04-a991ee961b4d","Type":"ContainerStarted","Data":"86dc37fa4a716727a04a83276e94f43cf3cf690818a224a9ad63415b49ddbf15"} Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.451849 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:24 crc kubenswrapper[5030]: W0316 13:40:24.464588 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3d58bd1_cd3c_4232_a145_b40c6710105f.slice/crio-271c0d12b6f6065a49282db7b653a9e226cfa16ad8706820fbda93a3a5237fe1 WatchSource:0}: Error finding container 271c0d12b6f6065a49282db7b653a9e226cfa16ad8706820fbda93a3a5237fe1: Status 404 returned error can't find the container with id 271c0d12b6f6065a49282db7b653a9e226cfa16ad8706820fbda93a3a5237fe1 Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.523533 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-86mwm"] Mar 16 13:40:24 crc kubenswrapper[5030]: W0316 13:40:24.526755 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod185e70b6_3cae_460c_8e00_a3eb4f0993c0.slice/crio-3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7 WatchSource:0}: Error finding container 3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7: Status 404 returned error can't find the container with id 3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7 Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.601229 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5mdzd"] Mar 16 13:40:24 crc kubenswrapper[5030]: W0316 13:40:24.609403 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54f65948_2704_42ed_a4b7_4dcfd7e87780.slice/crio-8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327 WatchSource:0}: Error finding container 8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327: Status 404 returned error can't find the container with id 8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327 Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.634221 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.639278 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.642465 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.642596 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.642647 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.642719 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9gklp\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.648408 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.690763 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.690845 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.690998 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.691162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.691254 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.691600 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.691822 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xkz\" (UniqueName: \"kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.691928 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.711154 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-ctqw8"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.736863 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.756743 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.756918 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.762735 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.763513 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.768246 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-l8ncv"] Mar 16 13:40:24 crc kubenswrapper[5030]: W0316 13:40:24.771761 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c372d53_949c_4ea3_9638_2eb752b13ad3.slice/crio-500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91 WatchSource:0}: Error finding container 500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91: Status 404 returned error can't find the container with id 500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91 Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793794 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bhcn\" (UniqueName: \"kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793840 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793878 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793910 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793947 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.793989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794006 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794032 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794072 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794146 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794202 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794229 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xkz\" (UniqueName: \"kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794270 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.794524 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.797184 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.798019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.800593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.802681 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.811319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.815037 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.818139 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xkz\" (UniqueName: \"kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.832926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.896687 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.896858 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.896977 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897056 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897136 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897348 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bhcn\" (UniqueName: \"kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897448 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897725 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.897951 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.899375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.904150 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.904283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.905817 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.912029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bhcn\" (UniqueName: \"kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.914119 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.930823 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:24 crc kubenswrapper[5030]: I0316 13:40:24.960816 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.189894 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.228318 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.297772 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.324311 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.439289 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.440748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" event={"ID":"e593cea5-6037-4818-8c8d-37046d90f034","Type":"ContainerStarted","Data":"d7aaf5653af2c3b0e4504e9821685d5cbb2d8c6af31ed7f6057b9f7107d72305"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.440889 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" event={"ID":"e593cea5-6037-4818-8c8d-37046d90f034","Type":"ContainerStarted","Data":"5d38bed8d65f85155b5c1beb67a9943636e17dadb3f7b2e5a999a2b8b0f44f5f"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.446918 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerStarted","Data":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.446963 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerStarted","Data":"271c0d12b6f6065a49282db7b653a9e226cfa16ad8706820fbda93a3a5237fe1"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.467793 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" event={"ID":"be78d942-5990-44dc-ab04-a991ee961b4d","Type":"ContainerStarted","Data":"63aa8dabdfcad39c36035d74bb70a939093ac0d9ca18868bcd6adf9ccb011454"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.472352 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" podStartSLOduration=2.472338608 podStartE2EDuration="2.472338608s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:25.467982985 +0000 UTC m=+2069.867295532" watchObservedRunningTime="2026-03-16 13:40:25.472338608 +0000 UTC m=+2069.871651155" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.477605 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" event={"ID":"54f65948-2704-42ed-a4b7-4dcfd7e87780","Type":"ContainerStarted","Data":"8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.487935 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" event={"ID":"4c372d53-949c-4ea3-9638-2eb752b13ad3","Type":"ContainerStarted","Data":"880f0da0d08d80bc36327e02f2290993b6d05572dcbe8f2cc51c738b85f3b8a9"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.487965 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" event={"ID":"4c372d53-949c-4ea3-9638-2eb752b13ad3","Type":"ContainerStarted","Data":"500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.495190 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" event={"ID":"185e70b6-3cae-460c-8e00-a3eb4f0993c0","Type":"ContainerStarted","Data":"b4b81634f0cf5ec18f6a4a859e3404f2129691cca4aff72511100ee179541d79"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.495219 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" event={"ID":"185e70b6-3cae-460c-8e00-a3eb4f0993c0","Type":"ContainerStarted","Data":"3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7"} Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.497865 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" podStartSLOduration=2.497849034 podStartE2EDuration="2.497849034s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:25.494722002 +0000 UTC m=+2069.894034549" watchObservedRunningTime="2026-03-16 13:40:25.497849034 +0000 UTC m=+2069.897161582" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.543902 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" podStartSLOduration=2.54388448 podStartE2EDuration="2.54388448s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:25.532267077 +0000 UTC m=+2069.931579624" watchObservedRunningTime="2026-03-16 13:40:25.54388448 +0000 UTC m=+2069.943197026" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.568362 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" podStartSLOduration=2.568345762 podStartE2EDuration="2.568345762s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:25.547780257 +0000 UTC m=+2069.947092805" watchObservedRunningTime="2026-03-16 13:40:25.568345762 +0000 UTC m=+2069.967658309" Mar 16 13:40:25 crc kubenswrapper[5030]: I0316 13:40:25.833600 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.516740 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerStarted","Data":"3b1164189612717f820563473a5b49307374a3becd1fb08729552e9e7977b877"} Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.528141 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" event={"ID":"54f65948-2704-42ed-a4b7-4dcfd7e87780","Type":"ContainerStarted","Data":"1d94c1df2d8f3777dacd2247cd7c0f810cff7d0284f5a7d4dae540b8af7b3f7e"} Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.534880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerStarted","Data":"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c"} Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.534932 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerStarted","Data":"31d05a6ceb85eebbb9919ae4af618edcd53b3288b308c91eb37dc949a68fd2c5"} Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.547589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerStarted","Data":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} Mar 16 13:40:26 crc kubenswrapper[5030]: I0316 13:40:26.555857 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" podStartSLOduration=3.555827822 podStartE2EDuration="3.555827822s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:26.542799165 +0000 UTC m=+2070.942111712" watchObservedRunningTime="2026-03-16 13:40:26.555827822 +0000 UTC m=+2070.955140370" Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.558282 5030 generic.go:358] "Generic (PLEG): container finished" podID="e593cea5-6037-4818-8c8d-37046d90f034" containerID="d7aaf5653af2c3b0e4504e9821685d5cbb2d8c6af31ed7f6057b9f7107d72305" exitCode=0 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.558459 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" event={"ID":"e593cea5-6037-4818-8c8d-37046d90f034","Type":"ContainerDied","Data":"d7aaf5653af2c3b0e4504e9821685d5cbb2d8c6af31ed7f6057b9f7107d72305"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.561699 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-log" containerID="cri-o://18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" gracePeriod=30 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.561730 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerStarted","Data":"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.561865 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-httpd" containerID="cri-o://e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" gracePeriod=30 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.568401 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerStarted","Data":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.573742 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerStarted","Data":"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.573778 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerStarted","Data":"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.573851 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-log" containerID="cri-o://7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" gracePeriod=30 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.573855 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-httpd" containerID="cri-o://2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" gracePeriod=30 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.579971 5030 generic.go:358] "Generic (PLEG): container finished" podID="4c372d53-949c-4ea3-9638-2eb752b13ad3" containerID="880f0da0d08d80bc36327e02f2290993b6d05572dcbe8f2cc51c738b85f3b8a9" exitCode=0 Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.580714 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" event={"ID":"4c372d53-949c-4ea3-9638-2eb752b13ad3","Type":"ContainerDied","Data":"880f0da0d08d80bc36327e02f2290993b6d05572dcbe8f2cc51c738b85f3b8a9"} Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.598455 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.598443011 podStartE2EDuration="4.598443011s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:27.595863107 +0000 UTC m=+2071.995175654" watchObservedRunningTime="2026-03-16 13:40:27.598443011 +0000 UTC m=+2071.997755558" Mar 16 13:40:27 crc kubenswrapper[5030]: I0316 13:40:27.617377 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.617367939 podStartE2EDuration="4.617367939s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:27.614035731 +0000 UTC m=+2072.013348277" watchObservedRunningTime="2026-03-16 13:40:27.617367939 +0000 UTC m=+2072.016680486" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.359181 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.444350 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508008 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bhcn\" (UniqueName: \"kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508660 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508710 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508813 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508885 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.508999 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509025 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509053 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509084 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2xkz\" (UniqueName: \"kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509188 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509205 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509231 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run\") pod \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\" (UID: \"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.509304 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"29094245-f1c1-4118-8d7d-8c98cc75cac9\" (UID: \"29094245-f1c1-4118-8d7d-8c98cc75cac9\") " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.511362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.512323 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.516219 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts" (OuterVolumeSpecName: "scripts") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.517292 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn" (OuterVolumeSpecName: "kube-api-access-9bhcn") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "kube-api-access-9bhcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.518092 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs" (OuterVolumeSpecName: "logs") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.518142 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.520619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts" (OuterVolumeSpecName: "scripts") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.520800 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs" (OuterVolumeSpecName: "logs") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.521710 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz" (OuterVolumeSpecName: "kube-api-access-k2xkz") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "kube-api-access-k2xkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522073 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522825 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522848 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522883 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522899 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2xkz\" (UniqueName: \"kubernetes.io/projected/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-kube-api-access-k2xkz\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522911 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29094245-f1c1-4118-8d7d-8c98cc75cac9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522919 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522937 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522949 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bhcn\" (UniqueName: \"kubernetes.io/projected/29094245-f1c1-4118-8d7d-8c98cc75cac9-kube-api-access-9bhcn\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522957 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.522968 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.541624 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.543600 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.545208 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.550739 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.566761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.571320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data" (OuterVolumeSpecName: "config-data") pod "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" (UID: "6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.587883 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.590619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data" (OuterVolumeSpecName: "config-data") pod "29094245-f1c1-4118-8d7d-8c98cc75cac9" (UID: "29094245-f1c1-4118-8d7d-8c98cc75cac9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.594695 5030 generic.go:358] "Generic (PLEG): container finished" podID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerID="e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" exitCode=0 Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.594743 5030 generic.go:358] "Generic (PLEG): container finished" podID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerID="18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" exitCode=143 Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.595013 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerDied","Data":"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.595072 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerDied","Data":"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.595085 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a","Type":"ContainerDied","Data":"31d05a6ceb85eebbb9919ae4af618edcd53b3288b308c91eb37dc949a68fd2c5"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.595100 5030 scope.go:117] "RemoveContainer" containerID="e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.595351 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.598089 5030 generic.go:358] "Generic (PLEG): container finished" podID="be78d942-5990-44dc-ab04-a991ee961b4d" containerID="63aa8dabdfcad39c36035d74bb70a939093ac0d9ca18868bcd6adf9ccb011454" exitCode=0 Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.598278 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" event={"ID":"be78d942-5990-44dc-ab04-a991ee961b4d","Type":"ContainerDied","Data":"63aa8dabdfcad39c36035d74bb70a939093ac0d9ca18868bcd6adf9ccb011454"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.603451 5030 generic.go:358] "Generic (PLEG): container finished" podID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerID="2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" exitCode=143 Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.603484 5030 generic.go:358] "Generic (PLEG): container finished" podID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerID="7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" exitCode=143 Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.603519 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.603541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerDied","Data":"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.603596 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerDied","Data":"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.604045 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"29094245-f1c1-4118-8d7d-8c98cc75cac9","Type":"ContainerDied","Data":"3b1164189612717f820563473a5b49307374a3becd1fb08729552e9e7977b877"} Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626598 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626624 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626633 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626646 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626657 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626669 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626677 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29094245-f1c1-4118-8d7d-8c98cc75cac9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.626686 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.662626 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.663876 5030 scope.go:117] "RemoveContainer" containerID="18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.681044 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.712875 5030 scope.go:117] "RemoveContainer" containerID="e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.712996 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: E0316 13:40:28.713701 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28\": container with ID starting with e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28 not found: ID does not exist" containerID="e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.713737 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28"} err="failed to get container status \"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28\": rpc error: code = NotFound desc = could not find container \"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28\": container with ID starting with e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28 not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.713759 5030 scope.go:117] "RemoveContainer" containerID="18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" Mar 16 13:40:28 crc kubenswrapper[5030]: E0316 13:40:28.714809 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c\": container with ID starting with 18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c not found: ID does not exist" containerID="18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.714856 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c"} err="failed to get container status \"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c\": rpc error: code = NotFound desc = could not find container \"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c\": container with ID starting with 18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.714886 5030 scope.go:117] "RemoveContainer" containerID="e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.715184 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28"} err="failed to get container status \"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28\": rpc error: code = NotFound desc = could not find container \"e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28\": container with ID starting with e1a9c47b6ac1a965ce09f8f8aa557ebb7f53058f794e4b81c66d4d4505d52a28 not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.715203 5030 scope.go:117] "RemoveContainer" containerID="18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.715639 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c"} err="failed to get container status \"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c\": rpc error: code = NotFound desc = could not find container \"18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c\": container with ID starting with 18b536cb684dcd34f494965e69dcf10f039c37f6a34c5c77ff60784d9d0bcf3c not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.715654 5030 scope.go:117] "RemoveContainer" containerID="2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.728298 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729471 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729494 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729516 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729522 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729640 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729648 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729669 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729862 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729874 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-httpd" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729887 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.729895 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" containerName="glance-log" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.733090 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.737191 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.737635 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9gklp\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.737709 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.738077 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.738253 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.746042 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.750323 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.759215 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.759598 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.763009 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.763049 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.768598 5030 scope.go:117] "RemoveContainer" containerID="7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830321 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830651 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830678 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830728 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830841 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbdpx\" (UniqueName: \"kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.830963 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831039 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48gh\" (UniqueName: \"kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831088 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831152 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831195 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.831220 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.842056 5030 scope.go:117] "RemoveContainer" containerID="2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" Mar 16 13:40:28 crc kubenswrapper[5030]: E0316 13:40:28.843482 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f\": container with ID starting with 2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f not found: ID does not exist" containerID="2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.843570 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f"} err="failed to get container status \"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f\": rpc error: code = NotFound desc = could not find container \"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f\": container with ID starting with 2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.843627 5030 scope.go:117] "RemoveContainer" containerID="7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" Mar 16 13:40:28 crc kubenswrapper[5030]: E0316 13:40:28.849051 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55\": container with ID starting with 7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55 not found: ID does not exist" containerID="7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.849116 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55"} err="failed to get container status \"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55\": rpc error: code = NotFound desc = could not find container \"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55\": container with ID starting with 7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55 not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.849176 5030 scope.go:117] "RemoveContainer" containerID="2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.851617 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f"} err="failed to get container status \"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f\": rpc error: code = NotFound desc = could not find container \"2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f\": container with ID starting with 2750a27b5917c8caa0fcf68997036129bd0297a37dc4f377a69c385545220a4f not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.851642 5030 scope.go:117] "RemoveContainer" containerID="7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.851834 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55"} err="failed to get container status \"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55\": rpc error: code = NotFound desc = could not find container \"7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55\": container with ID starting with 7d182db99c854f87b187a7061723b72d547e2128a1f13524bd18730806174c55 not found: ID does not exist" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933183 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933234 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c48gh\" (UniqueName: \"kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933333 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933385 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933429 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933515 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933539 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933608 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933635 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933673 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbdpx\" (UniqueName: \"kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.933708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.941322 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.942702 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.943220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.943868 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.946632 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.947294 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.948717 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.950045 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.957279 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.957823 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.958943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.960066 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.960601 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.960780 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.963930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48gh\" (UniqueName: \"kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.965939 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbdpx\" (UniqueName: \"kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.986926 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:28 crc kubenswrapper[5030]: I0316 13:40:28.987977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.064999 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.071578 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.079308 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.095789 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data\") pod \"e593cea5-6037-4818-8c8d-37046d90f034\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137527 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle\") pod \"e593cea5-6037-4818-8c8d-37046d90f034\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137661 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts\") pod \"4c372d53-949c-4ea3-9638-2eb752b13ad3\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data\") pod \"4c372d53-949c-4ea3-9638-2eb752b13ad3\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137879 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8zcn\" (UniqueName: \"kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn\") pod \"4c372d53-949c-4ea3-9638-2eb752b13ad3\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.137930 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs\") pod \"4c372d53-949c-4ea3-9638-2eb752b13ad3\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.138075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle\") pod \"4c372d53-949c-4ea3-9638-2eb752b13ad3\" (UID: \"4c372d53-949c-4ea3-9638-2eb752b13ad3\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.138105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg8fk\" (UniqueName: \"kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk\") pod \"e593cea5-6037-4818-8c8d-37046d90f034\" (UID: \"e593cea5-6037-4818-8c8d-37046d90f034\") " Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.138495 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs" (OuterVolumeSpecName: "logs") pod "4c372d53-949c-4ea3-9638-2eb752b13ad3" (UID: "4c372d53-949c-4ea3-9638-2eb752b13ad3"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.142235 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn" (OuterVolumeSpecName: "kube-api-access-m8zcn") pod "4c372d53-949c-4ea3-9638-2eb752b13ad3" (UID: "4c372d53-949c-4ea3-9638-2eb752b13ad3"). InnerVolumeSpecName "kube-api-access-m8zcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.143348 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts" (OuterVolumeSpecName: "scripts") pod "4c372d53-949c-4ea3-9638-2eb752b13ad3" (UID: "4c372d53-949c-4ea3-9638-2eb752b13ad3"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.144497 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "e593cea5-6037-4818-8c8d-37046d90f034" (UID: "e593cea5-6037-4818-8c8d-37046d90f034"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.157906 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk" (OuterVolumeSpecName: "kube-api-access-xg8fk") pod "e593cea5-6037-4818-8c8d-37046d90f034" (UID: "e593cea5-6037-4818-8c8d-37046d90f034"). InnerVolumeSpecName "kube-api-access-xg8fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.175028 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4c372d53-949c-4ea3-9638-2eb752b13ad3" (UID: "4c372d53-949c-4ea3-9638-2eb752b13ad3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.181153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data" (OuterVolumeSpecName: "config-data") pod "4c372d53-949c-4ea3-9638-2eb752b13ad3" (UID: "4c372d53-949c-4ea3-9638-2eb752b13ad3"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.211971 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e593cea5-6037-4818-8c8d-37046d90f034" (UID: "e593cea5-6037-4818-8c8d-37046d90f034"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240695 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240730 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg8fk\" (UniqueName: \"kubernetes.io/projected/e593cea5-6037-4818-8c8d-37046d90f034-kube-api-access-xg8fk\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240743 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240751 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e593cea5-6037-4818-8c8d-37046d90f034-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240760 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240768 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4c372d53-949c-4ea3-9638-2eb752b13ad3-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240777 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8zcn\" (UniqueName: \"kubernetes.io/projected/4c372d53-949c-4ea3-9638-2eb752b13ad3-kube-api-access-m8zcn\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.240786 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4c372d53-949c-4ea3-9638-2eb752b13ad3-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.542869 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:40:29 crc kubenswrapper[5030]: W0316 13:40:29.549159 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f81a028_5f33_4c5c_8ff7_ede7801495a9.slice/crio-518be3abec5ec71b1ef983b47ab7bb530abdab5f64a591f4457434736e073675 WatchSource:0}: Error finding container 518be3abec5ec71b1ef983b47ab7bb530abdab5f64a591f4457434736e073675: Status 404 returned error can't find the container with id 518be3abec5ec71b1ef983b47ab7bb530abdab5f64a591f4457434736e073675 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.593270 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:40:29 crc kubenswrapper[5030]: W0316 13:40:29.610683 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7441fa6c_2845_416e_b1c6_4bb20dcc0752.slice/crio-5a3f710cb7bc1f8ff86a862504452b938e3a253e859ff3d5eab39d674b3984a4 WatchSource:0}: Error finding container 5a3f710cb7bc1f8ff86a862504452b938e3a253e859ff3d5eab39d674b3984a4: Status 404 returned error can't find the container with id 5a3f710cb7bc1f8ff86a862504452b938e3a253e859ff3d5eab39d674b3984a4 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.625513 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="proxy-httpd" containerID="cri-o://093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" gracePeriod=30 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.625664 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-notification-agent" containerID="cri-o://dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" gracePeriod=30 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.625803 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerStarted","Data":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.625846 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.625372 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-central-agent" containerID="cri-o://8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" gracePeriod=30 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.627524 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="sg-core" containerID="cri-o://0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" gracePeriod=30 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.638266 5030 generic.go:358] "Generic (PLEG): container finished" podID="54f65948-2704-42ed-a4b7-4dcfd7e87780" containerID="1d94c1df2d8f3777dacd2247cd7c0f810cff7d0284f5a7d4dae540b8af7b3f7e" exitCode=0 Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.639052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" event={"ID":"54f65948-2704-42ed-a4b7-4dcfd7e87780","Type":"ContainerDied","Data":"1d94c1df2d8f3777dacd2247cd7c0f810cff7d0284f5a7d4dae540b8af7b3f7e"} Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.649166 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.243171974 podStartE2EDuration="6.649147461s" podCreationTimestamp="2026-03-16 13:40:23 +0000 UTC" firstStartedPulling="2026-03-16 13:40:24.467708602 +0000 UTC m=+2068.867021149" lastFinishedPulling="2026-03-16 13:40:28.873684088 +0000 UTC m=+2073.272996636" observedRunningTime="2026-03-16 13:40:29.646130536 +0000 UTC m=+2074.045443084" watchObservedRunningTime="2026-03-16 13:40:29.649147461 +0000 UTC m=+2074.048460008" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.650466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" event={"ID":"4c372d53-949c-4ea3-9638-2eb752b13ad3","Type":"ContainerDied","Data":"500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91"} Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.650498 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="500c5e6b659a7103a80ebbf1fa9a7f64a639e5b18906b06b223dad98ab374e91" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.650540 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-l8ncv" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.677409 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerStarted","Data":"518be3abec5ec71b1ef983b47ab7bb530abdab5f64a591f4457434736e073675"} Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.680949 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.681006 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-ctqw8" event={"ID":"e593cea5-6037-4818-8c8d-37046d90f034","Type":"ContainerDied","Data":"5d38bed8d65f85155b5c1beb67a9943636e17dadb3f7b2e5a999a2b8b0f44f5f"} Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.681051 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d38bed8d65f85155b5c1beb67a9943636e17dadb3f7b2e5a999a2b8b0f44f5f" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.772561 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774527 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c372d53-949c-4ea3-9638-2eb752b13ad3" containerName="placement-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774593 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c372d53-949c-4ea3-9638-2eb752b13ad3" containerName="placement-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774625 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e593cea5-6037-4818-8c8d-37046d90f034" containerName="barbican-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774632 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e593cea5-6037-4818-8c8d-37046d90f034" containerName="barbican-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774860 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e593cea5-6037-4818-8c8d-37046d90f034" containerName="barbican-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.774879 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4c372d53-949c-4ea3-9638-2eb752b13ad3" containerName="placement-db-sync" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.798696 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.798831 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.801589 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.801905 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.822420 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.822873 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.827459 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-m7jfd\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.843619 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.851267 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.853891 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-w66lc\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.855360 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.855599 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867011 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmj9\" (UniqueName: \"kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867324 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867689 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.867845 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.894106 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.894314 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.906421 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.910976 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973061 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973120 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973144 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973212 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973239 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973269 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973315 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973338 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9j9\" (UniqueName: \"kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973442 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfkx\" (UniqueName: \"kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973461 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmj9\" (UniqueName: \"kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973515 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973574 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973595 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973632 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.973654 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.978963 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.984209 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.985648 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.986188 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:29 crc kubenswrapper[5030]: I0316 13:40:29.986922 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.009576 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmj9\" (UniqueName: \"kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.025743 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29094245-f1c1-4118-8d7d-8c98cc75cac9" path="/var/lib/kubelet/pods/29094245-f1c1-4118-8d7d-8c98cc75cac9/volumes" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.026777 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a" path="/var/lib/kubelet/pods/6d16cd57-8ae3-4cc1-80d1-e8c67dc8e30a/volumes" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.027818 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.031081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle\") pod \"placement-59896dc98b-46bjr\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.034153 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.034268 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.041106 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.075941 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.076101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfkx\" (UniqueName: \"kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.076299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.076619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.076759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.076793 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.077068 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.077131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.077150 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.077367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.077407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9j9\" (UniqueName: \"kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.081200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.084130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.084911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.085017 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.085751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.096814 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.100226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfkx\" (UniqueName: \"kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx\") pod \"barbican-worker-679fffb6f5-2wcxj\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.100678 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9j9\" (UniqueName: \"kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.114174 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data\") pod \"barbican-keystone-listener-5ff77cb854-wq59j\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.179138 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fk69\" (UniqueName: \"kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.179361 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.179582 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.179636 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.179704 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.208078 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.219875 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.265230 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.280584 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.280621 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.280731 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.280893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.281046 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgntr\" (UniqueName: \"kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.281149 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys\") pod \"be78d942-5990-44dc-ab04-a991ee961b4d\" (UID: \"be78d942-5990-44dc-ab04-a991ee961b4d\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.281475 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.281505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.281540 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.282447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fk69\" (UniqueName: \"kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.282523 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.282522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.285879 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.287189 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts" (OuterVolumeSpecName: "scripts") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.288849 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.296033 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr" (OuterVolumeSpecName: "kube-api-access-fgntr") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "kube-api-access-fgntr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.297794 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.298038 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.298076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.302013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fk69\" (UniqueName: \"kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69\") pod \"barbican-api-7c6d7bd988-dhcd4\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.305679 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data" (OuterVolumeSpecName: "config-data") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.358772 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "be78d942-5990-44dc-ab04-a991ee961b4d" (UID: "be78d942-5990-44dc-ab04-a991ee961b4d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.377532 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384853 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384877 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384886 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384912 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384921 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/be78d942-5990-44dc-ab04-a991ee961b4d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.384929 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgntr\" (UniqueName: \"kubernetes.io/projected/be78d942-5990-44dc-ab04-a991ee961b4d-kube-api-access-fgntr\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.409805 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.438527 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.587852 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrrl2\" (UniqueName: \"kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588082 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588130 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588177 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588454 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588590 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.588650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml\") pod \"b3d58bd1-cd3c-4232-a145-b40c6710105f\" (UID: \"b3d58bd1-cd3c-4232-a145-b40c6710105f\") " Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.590878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.592304 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.592504 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2" (OuterVolumeSpecName: "kube-api-access-rrrl2") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "kube-api-access-rrrl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.596270 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts" (OuterVolumeSpecName: "scripts") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.623735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.692530 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.699777 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrrl2\" (UniqueName: \"kubernetes.io/projected/b3d58bd1-cd3c-4232-a145-b40c6710105f-kube-api-access-rrrl2\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.699812 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.699826 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.699835 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/b3d58bd1-cd3c-4232-a145-b40c6710105f-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.699845 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.709627 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data" (OuterVolumeSpecName: "config-data") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.716385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b3d58bd1-cd3c-4232-a145-b40c6710105f" (UID: "b3d58bd1-cd3c-4232-a145-b40c6710105f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.735221 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.735336 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" event={"ID":"be78d942-5990-44dc-ab04-a991ee961b4d","Type":"ContainerDied","Data":"86dc37fa4a716727a04a83276e94f43cf3cf690818a224a9ad63415b49ddbf15"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.735376 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86dc37fa4a716727a04a83276e94f43cf3cf690818a224a9ad63415b49ddbf15" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.739145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerStarted","Data":"e5f66d5a17aa763e105571c7614a462722495dbe3df592e20e640df2f8ba30a4"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.743210 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerStarted","Data":"5a3f710cb7bc1f8ff86a862504452b938e3a253e859ff3d5eab39d674b3984a4"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.746296 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qtdpv"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.754630 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-qtdpv"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755450 5030 generic.go:358] "Generic (PLEG): container finished" podID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" exitCode=0 Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755479 5030 generic.go:358] "Generic (PLEG): container finished" podID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" exitCode=2 Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755486 5030 generic.go:358] "Generic (PLEG): container finished" podID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" exitCode=0 Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755492 5030 generic.go:358] "Generic (PLEG): container finished" podID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" exitCode=0 Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755663 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerDied","Data":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755711 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerDied","Data":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755712 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755723 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerDied","Data":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755738 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerDied","Data":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755747 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"b3d58bd1-cd3c-4232-a145-b40c6710105f","Type":"ContainerDied","Data":"271c0d12b6f6065a49282db7b653a9e226cfa16ad8706820fbda93a3a5237fe1"} Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.755765 5030 scope.go:117] "RemoveContainer" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.761749 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.784305 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.802111 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.802139 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b3d58bd1-cd3c-4232-a145-b40c6710105f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.815206 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.824365 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.836489 5030 scope.go:117] "RemoveContainer" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.859389 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880446 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="sg-core" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="sg-core" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880516 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" containerName="keystone-bootstrap" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880523 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" containerName="keystone-bootstrap" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880532 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-notification-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880538 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-notification-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880592 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="proxy-httpd" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880598 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="proxy-httpd" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880610 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-central-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880617 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-central-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880894 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-notification-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880909 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="ceilometer-central-agent" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880919 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="sg-core" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880926 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" containerName="keystone-bootstrap" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.880948 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" containerName="proxy-httpd" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.925618 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.925659 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lft2n"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.925935 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.930109 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.931630 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.941078 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.941128 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lft2n"] Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.941260 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.943759 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.948034 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.948120 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.948351 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.948586 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.961867 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-drfrr\"" Mar 16 13:40:30 crc kubenswrapper[5030]: I0316 13:40:30.972241 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.004358 5030 scope.go:117] "RemoveContainer" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.005941 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.011602 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024328 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024467 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024510 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024544 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zhrh\" (UniqueName: \"kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024606 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.024624 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.099253 5030 scope.go:117] "RemoveContainer" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5tk\" (UniqueName: \"kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134622 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134689 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134740 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134799 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134852 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134899 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134934 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zhrh\" (UniqueName: \"kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134967 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134983 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.134998 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.135388 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.142137 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.145937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.147205 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.147638 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.148140 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.160171 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zhrh\" (UniqueName: \"kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh\") pod \"ceilometer-0\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.176653 5030 scope.go:117] "RemoveContainer" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:31 crc kubenswrapper[5030]: E0316 13:40:31.177152 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": container with ID starting with 093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d not found: ID does not exist" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.177216 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} err="failed to get container status \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": rpc error: code = NotFound desc = could not find container \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": container with ID starting with 093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.177253 5030 scope.go:117] "RemoveContainer" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:31 crc kubenswrapper[5030]: E0316 13:40:31.177917 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": container with ID starting with 0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2 not found: ID does not exist" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.177941 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} err="failed to get container status \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": rpc error: code = NotFound desc = could not find container \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": container with ID starting with 0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.177982 5030 scope.go:117] "RemoveContainer" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: E0316 13:40:31.178262 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": container with ID starting with dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41 not found: ID does not exist" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178277 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} err="failed to get container status \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": rpc error: code = NotFound desc = could not find container \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": container with ID starting with dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178299 5030 scope.go:117] "RemoveContainer" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: E0316 13:40:31.178541 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": container with ID starting with 8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86 not found: ID does not exist" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178571 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} err="failed to get container status \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": rpc error: code = NotFound desc = could not find container \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": container with ID starting with 8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178585 5030 scope.go:117] "RemoveContainer" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178816 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} err="failed to get container status \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": rpc error: code = NotFound desc = could not find container \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": container with ID starting with 093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.178830 5030 scope.go:117] "RemoveContainer" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179126 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} err="failed to get container status \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": rpc error: code = NotFound desc = could not find container \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": container with ID starting with 0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179143 5030 scope.go:117] "RemoveContainer" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179519 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} err="failed to get container status \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": rpc error: code = NotFound desc = could not find container \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": container with ID starting with dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179535 5030 scope.go:117] "RemoveContainer" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179825 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} err="failed to get container status \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": rpc error: code = NotFound desc = could not find container \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": container with ID starting with 8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.179863 5030 scope.go:117] "RemoveContainer" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183056 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} err="failed to get container status \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": rpc error: code = NotFound desc = could not find container \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": container with ID starting with 093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183097 5030 scope.go:117] "RemoveContainer" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183639 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} err="failed to get container status \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": rpc error: code = NotFound desc = could not find container \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": container with ID starting with 0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183665 5030 scope.go:117] "RemoveContainer" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183896 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} err="failed to get container status \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": rpc error: code = NotFound desc = could not find container \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": container with ID starting with dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.183911 5030 scope.go:117] "RemoveContainer" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.187641 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} err="failed to get container status \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": rpc error: code = NotFound desc = could not find container \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": container with ID starting with 8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.187670 5030 scope.go:117] "RemoveContainer" containerID="093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.187994 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d"} err="failed to get container status \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": rpc error: code = NotFound desc = could not find container \"093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d\": container with ID starting with 093a7d8e3e5a6eb0a99582b1635b79ffc409730c08a14d3f947a85ae9501d91d not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.188038 5030 scope.go:117] "RemoveContainer" containerID="0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.189182 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2"} err="failed to get container status \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": rpc error: code = NotFound desc = could not find container \"0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2\": container with ID starting with 0f0a8340efd499b67366ad482b02d598a9d910a224692c73b004b08e0b5841f2 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.189213 5030 scope.go:117] "RemoveContainer" containerID="dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.189757 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41"} err="failed to get container status \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": rpc error: code = NotFound desc = could not find container \"dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41\": container with ID starting with dba1d7b1e89e806eb68b7988d79f85e2a4632c1ea5a977108dba0287d7e2de41 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.189782 5030 scope.go:117] "RemoveContainer" containerID="8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.190739 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86"} err="failed to get container status \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": rpc error: code = NotFound desc = could not find container \"8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86\": container with ID starting with 8438309a3c2d3fb32e9c9a33422369a23eb97dfeda83d362fcf1e563a75f0d86 not found: ID does not exist" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.237690 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.237936 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.237989 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5tk\" (UniqueName: \"kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.238019 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.238114 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.238148 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.243999 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.248146 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.248391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.251029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.251238 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.254206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5tk\" (UniqueName: \"kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk\") pod \"keystone-bootstrap-lft2n\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.268427 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.269404 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.292068 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.311169 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.440893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.441453 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.441608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flhzt\" (UniqueName: \"kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.441667 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.441786 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.441835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id\") pod \"54f65948-2704-42ed-a4b7-4dcfd7e87780\" (UID: \"54f65948-2704-42ed-a4b7-4dcfd7e87780\") " Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.442233 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.445435 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/54f65948-2704-42ed-a4b7-4dcfd7e87780-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.445730 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.447386 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts" (OuterVolumeSpecName: "scripts") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.447543 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt" (OuterVolumeSpecName: "kube-api-access-flhzt") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "kube-api-access-flhzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.538586 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.548311 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.548340 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.548349 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.548358 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flhzt\" (UniqueName: \"kubernetes.io/projected/54f65948-2704-42ed-a4b7-4dcfd7e87780-kube-api-access-flhzt\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.623578 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data" (OuterVolumeSpecName: "config-data") pod "54f65948-2704-42ed-a4b7-4dcfd7e87780" (UID: "54f65948-2704-42ed-a4b7-4dcfd7e87780"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.651404 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54f65948-2704-42ed-a4b7-4dcfd7e87780-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.750335 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lft2n"] Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.775409 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerStarted","Data":"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.779713 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerStarted","Data":"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.779744 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerStarted","Data":"ef867e0165baa3421a3a70a873d6ebf4d284afc0f191279d919a9dba9445ea65"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.781617 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.786652 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerStarted","Data":"a36b51f4c552ef39669aef91c8141169c8f40bdb6dc678695780fa792ac26186"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.786684 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerStarted","Data":"472a96bce0cbda024c389221019d833a5314473ce3b1a1e0b4faa32691c4e890"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.786693 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerStarted","Data":"276b44a35de6b1bd27b11eba8257924bc7555bf8c5aad08348b997d1a6d0a3e4"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.806255 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerStarted","Data":"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.806288 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerStarted","Data":"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.806299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerStarted","Data":"4367736a0f7b667c89e77de0ad98e44d6c9032f16e3b095644d75bfcc2433c21"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.806879 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" podStartSLOduration=2.806856554 podStartE2EDuration="2.806856554s" podCreationTimestamp="2026-03-16 13:40:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:31.794131136 +0000 UTC m=+2076.193443684" watchObservedRunningTime="2026-03-16 13:40:31.806856554 +0000 UTC m=+2076.206169101" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.807464 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.807495 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.823681 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" event={"ID":"54f65948-2704-42ed-a4b7-4dcfd7e87780","Type":"ContainerDied","Data":"8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.823724 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8440a333858c0ec9ebeda66c330ecc88bcc29f1158ea3225d728827306736327" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.823793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-5mdzd" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.826917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerStarted","Data":"8c38b9d67c7bd98247a893313b2b229d08c639e50cc0c7c7e533edc3094ee2ef"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.831004 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerStarted","Data":"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.831032 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerStarted","Data":"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.831044 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerStarted","Data":"c153a572506383f7606874308b8f2ccb18eb98c14192f09b2a8d1fde3b1fe629"} Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.831516 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.831561 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.838879 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.846326 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" podStartSLOduration=2.846291974 podStartE2EDuration="2.846291974s" podCreationTimestamp="2026-03-16 13:40:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:31.837484917 +0000 UTC m=+2076.236797463" watchObservedRunningTime="2026-03-16 13:40:31.846291974 +0000 UTC m=+2076.245604521" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.882507 5030 status_manager.go:895] "Failed to get status for pod" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" pod="openstack-kuttl-tests/keystone-bootstrap-qtdpv" err="pods \"keystone-bootstrap-qtdpv\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.883118 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" podStartSLOduration=2.883098047 podStartE2EDuration="2.883098047s" podCreationTimestamp="2026-03-16 13:40:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:31.868430897 +0000 UTC m=+2076.267743444" watchObservedRunningTime="2026-03-16 13:40:31.883098047 +0000 UTC m=+2076.282410595" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.976845 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" podStartSLOduration=2.976826124 podStartE2EDuration="2.976826124s" podCreationTimestamp="2026-03-16 13:40:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:31.930219704 +0000 UTC m=+2076.329532252" watchObservedRunningTime="2026-03-16 13:40:31.976826124 +0000 UTC m=+2076.376138671" Mar 16 13:40:31 crc kubenswrapper[5030]: I0316 13:40:31.987540 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.9875307700000002 podStartE2EDuration="3.98753077s" podCreationTimestamp="2026-03-16 13:40:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:31.977323349 +0000 UTC m=+2076.376635886" watchObservedRunningTime="2026-03-16 13:40:31.98753077 +0000 UTC m=+2076.386843318" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.055447 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d58bd1-cd3c-4232-a145-b40c6710105f" path="/var/lib/kubelet/pods/b3d58bd1-cd3c-4232-a145-b40c6710105f/volumes" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.059625 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be78d942-5990-44dc-ab04-a991ee961b4d" path="/var/lib/kubelet/pods/be78d942-5990-44dc-ab04-a991ee961b4d/volumes" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.060479 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.060570 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.061500 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f65948-2704-42ed-a4b7-4dcfd7e87780" containerName="cinder-db-sync" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.061519 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f65948-2704-42ed-a4b7-4dcfd7e87780" containerName="cinder-db-sync" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.061726 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="54f65948-2704-42ed-a4b7-4dcfd7e87780" containerName="cinder-db-sync" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.072312 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.072355 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.072523 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.075129 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.078428 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.078505 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.080522 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.081112 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-vz7xz\"" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.081269 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.082168 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180318 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvfl\" (UniqueName: \"kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbr5\" (UniqueName: \"kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180443 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180497 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180539 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180573 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180619 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180665 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180702 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180753 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.180774 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.282417 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.283426 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.283720 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.284070 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.284653 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.284781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.284929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.284965 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.285037 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvfl\" (UniqueName: \"kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.285109 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbr5\" (UniqueName: \"kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.285182 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.285221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.285263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.286624 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.286975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.287096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.289241 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.292969 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.293296 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.294364 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.294376 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.294867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.303542 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.303984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.304303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbr5\" (UniqueName: \"kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5\") pod \"cinder-api-0\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.304913 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvfl\" (UniqueName: \"kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl\") pod \"cinder-scheduler-0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.394213 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.453950 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:32 crc kubenswrapper[5030]: W0316 13:40:32.824397 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc49b7c40_b933_4017_8ceb_5cd01f190fd0.slice/crio-806fd1492fe743fa1c0424f1d09a949289c81a960ec1e20ed753e31ef10b3f86 WatchSource:0}: Error finding container 806fd1492fe743fa1c0424f1d09a949289c81a960ec1e20ed753e31ef10b3f86: Status 404 returned error can't find the container with id 806fd1492fe743fa1c0424f1d09a949289c81a960ec1e20ed753e31ef10b3f86 Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.826641 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.850593 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerStarted","Data":"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.853663 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerStarted","Data":"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.855972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerStarted","Data":"fa161805b7113c1048f16c1849c9aa7347f765cd95724324f2a5d14e423aa148"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.856011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerStarted","Data":"31c112ff8ab3ed35a0ca8dce818459552250e45475498e60338729f450051e6b"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.865469 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" event={"ID":"1cbeaa27-2788-4e32-bc50-ffd14095486a","Type":"ContainerStarted","Data":"57b965efcf0dac146c0045cccc6ffe7a12468f11d383da1342d478d057c18714"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.865611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" event={"ID":"1cbeaa27-2788-4e32-bc50-ffd14095486a","Type":"ContainerStarted","Data":"2cb5a92ff4962b6ab6617b864cd10597ef1ed2349a3988807c67f6f24754a389"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.869573 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerStarted","Data":"806fd1492fe743fa1c0424f1d09a949289c81a960ec1e20ed753e31ef10b3f86"} Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.879374 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.879356145 podStartE2EDuration="4.879356145s" podCreationTimestamp="2026-03-16 13:40:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:32.874400644 +0000 UTC m=+2077.273713190" watchObservedRunningTime="2026-03-16 13:40:32.879356145 +0000 UTC m=+2077.278668693" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.903046 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" podStartSLOduration=2.903030728 podStartE2EDuration="2.903030728s" podCreationTimestamp="2026-03-16 13:40:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:32.902325131 +0000 UTC m=+2077.301637677" watchObservedRunningTime="2026-03-16 13:40:32.903030728 +0000 UTC m=+2077.302343276" Mar 16 13:40:32 crc kubenswrapper[5030]: I0316 13:40:32.926748 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:33 crc kubenswrapper[5030]: I0316 13:40:33.878475 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerStarted","Data":"098435688b56dd5773e8986f2d7f91bb7523c4b13d7850e5c1b9671ec398a545"} Mar 16 13:40:33 crc kubenswrapper[5030]: I0316 13:40:33.880482 5030 generic.go:358] "Generic (PLEG): container finished" podID="185e70b6-3cae-460c-8e00-a3eb4f0993c0" containerID="b4b81634f0cf5ec18f6a4a859e3404f2129691cca4aff72511100ee179541d79" exitCode=0 Mar 16 13:40:33 crc kubenswrapper[5030]: I0316 13:40:33.880595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" event={"ID":"185e70b6-3cae-460c-8e00-a3eb4f0993c0","Type":"ContainerDied","Data":"b4b81634f0cf5ec18f6a4a859e3404f2129691cca4aff72511100ee179541d79"} Mar 16 13:40:33 crc kubenswrapper[5030]: I0316 13:40:33.883187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerStarted","Data":"b776a249166ed6f7ec66b9c9d1cb03779d012b97194bfe5fc4674bc0a0425c3f"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.897286 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerStarted","Data":"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.897788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerStarted","Data":"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.897818 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.901582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerStarted","Data":"215d0f93a1e5b3460aabf485b5936b9402f54667f87c356b9d614d3e9eeb3ca0"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.905217 5030 generic.go:358] "Generic (PLEG): container finished" podID="1cbeaa27-2788-4e32-bc50-ffd14095486a" containerID="57b965efcf0dac146c0045cccc6ffe7a12468f11d383da1342d478d057c18714" exitCode=0 Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.905317 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" event={"ID":"1cbeaa27-2788-4e32-bc50-ffd14095486a","Type":"ContainerDied","Data":"57b965efcf0dac146c0045cccc6ffe7a12468f11d383da1342d478d057c18714"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.909471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerStarted","Data":"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.909500 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerStarted","Data":"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c"} Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.928403 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=2.928385896 podStartE2EDuration="2.928385896s" podCreationTimestamp="2026-03-16 13:40:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:34.921100262 +0000 UTC m=+2079.320412809" watchObservedRunningTime="2026-03-16 13:40:34.928385896 +0000 UTC m=+2079.327698444" Mar 16 13:40:34 crc kubenswrapper[5030]: I0316 13:40:34.947475 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.947464695 podStartE2EDuration="3.947464695s" podCreationTimestamp="2026-03-16 13:40:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:34.945004086 +0000 UTC m=+2079.344316633" watchObservedRunningTime="2026-03-16 13:40:34.947464695 +0000 UTC m=+2079.346777232" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.247989 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.367649 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkmbm\" (UniqueName: \"kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm\") pod \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.368462 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config\") pod \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.368620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle\") pod \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\" (UID: \"185e70b6-3cae-460c-8e00-a3eb4f0993c0\") " Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.373204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm" (OuterVolumeSpecName: "kube-api-access-qkmbm") pod "185e70b6-3cae-460c-8e00-a3eb4f0993c0" (UID: "185e70b6-3cae-460c-8e00-a3eb4f0993c0"). InnerVolumeSpecName "kube-api-access-qkmbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.388789 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config" (OuterVolumeSpecName: "config") pod "185e70b6-3cae-460c-8e00-a3eb4f0993c0" (UID: "185e70b6-3cae-460c-8e00-a3eb4f0993c0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.390926 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "185e70b6-3cae-460c-8e00-a3eb4f0993c0" (UID: "185e70b6-3cae-460c-8e00-a3eb4f0993c0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.471828 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkmbm\" (UniqueName: \"kubernetes.io/projected/185e70b6-3cae-460c-8e00-a3eb4f0993c0-kube-api-access-qkmbm\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.471872 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.471888 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/185e70b6-3cae-460c-8e00-a3eb4f0993c0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.923950 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.924157 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-86mwm" event={"ID":"185e70b6-3cae-460c-8e00-a3eb4f0993c0","Type":"ContainerDied","Data":"3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7"} Mar 16 13:40:35 crc kubenswrapper[5030]: I0316 13:40:35.924233 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3dd8f90566832885ef10d6f9a372969dc4f9ffd2c48049ec95057b30886d66a7" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.061397 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.062612 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="185e70b6-3cae-460c-8e00-a3eb4f0993c0" containerName="neutron-db-sync" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.062633 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="185e70b6-3cae-460c-8e00-a3eb4f0993c0" containerName="neutron-db-sync" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.062870 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="185e70b6-3cae-460c-8e00-a3eb4f0993c0" containerName="neutron-db-sync" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.066781 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.068696 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.068776 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.070113 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.070296 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-dfsvm\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.072874 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.190580 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.190665 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.190916 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmbmn\" (UniqueName: \"kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.191029 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.191138 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.293476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.293512 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.293605 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmbmn\" (UniqueName: \"kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.293637 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.293675 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.300006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.300160 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.306318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.310288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmbmn\" (UniqueName: \"kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.311504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config\") pod \"neutron-549cc5bf65-2np7b\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.376585 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.385469 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.502366 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz5tk\" (UniqueName: \"kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.502736 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.502781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.502814 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.502907 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.503087 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle\") pod \"1cbeaa27-2788-4e32-bc50-ffd14095486a\" (UID: \"1cbeaa27-2788-4e32-bc50-ffd14095486a\") " Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.513884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts" (OuterVolumeSpecName: "scripts") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.517808 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.519644 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.531034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk" (OuterVolumeSpecName: "kube-api-access-sz5tk") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "kube-api-access-sz5tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.542950 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data" (OuterVolumeSpecName: "config-data") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.576875 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.584345 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1cbeaa27-2788-4e32-bc50-ffd14095486a" (UID: "1cbeaa27-2788-4e32-bc50-ffd14095486a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609765 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609793 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609805 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609816 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609824 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1cbeaa27-2788-4e32-bc50-ffd14095486a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.609833 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz5tk\" (UniqueName: \"kubernetes.io/projected/1cbeaa27-2788-4e32-bc50-ffd14095486a-kube-api-access-sz5tk\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.871033 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:40:36 crc kubenswrapper[5030]: W0316 13:40:36.873427 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaad9fe8_f71c_4675_9eba_1d061b629232.slice/crio-af845c2dc86df40ef58999990ccff60e8fead81b0cbf622ba1bbef99a768b0b1 WatchSource:0}: Error finding container af845c2dc86df40ef58999990ccff60e8fead81b0cbf622ba1bbef99a768b0b1: Status 404 returned error can't find the container with id af845c2dc86df40ef58999990ccff60e8fead81b0cbf622ba1bbef99a768b0b1 Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.938902 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerStarted","Data":"af845c2dc86df40ef58999990ccff60e8fead81b0cbf622ba1bbef99a768b0b1"} Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.941491 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.941504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-lft2n" event={"ID":"1cbeaa27-2788-4e32-bc50-ffd14095486a","Type":"ContainerDied","Data":"2cb5a92ff4962b6ab6617b864cd10597ef1ed2349a3988807c67f6f24754a389"} Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.941579 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb5a92ff4962b6ab6617b864cd10597ef1ed2349a3988807c67f6f24754a389" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.950429 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api-log" containerID="cri-o://de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" gracePeriod=30 Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.951827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerStarted","Data":"cfee67ac0098cd1edbc29e9dd8f8d7467ede9c95674ac337617c53c55cd31c52"} Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.951856 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:36 crc kubenswrapper[5030]: I0316 13:40:36.952295 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api" containerID="cri-o://9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" gracePeriod=30 Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.008913 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.649894757 podStartE2EDuration="7.008895813s" podCreationTimestamp="2026-03-16 13:40:30 +0000 UTC" firstStartedPulling="2026-03-16 13:40:31.945637346 +0000 UTC m=+2076.344949883" lastFinishedPulling="2026-03-16 13:40:36.304638392 +0000 UTC m=+2080.703950939" observedRunningTime="2026-03-16 13:40:36.988795984 +0000 UTC m=+2081.388108531" watchObservedRunningTime="2026-03-16 13:40:37.008895813 +0000 UTC m=+2081.408208350" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.132595 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.135498 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbeaa27-2788-4e32-bc50-ffd14095486a" containerName="keystone-bootstrap" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.135521 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbeaa27-2788-4e32-bc50-ffd14095486a" containerName="keystone-bootstrap" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.135908 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cbeaa27-2788-4e32-bc50-ffd14095486a" containerName="keystone-bootstrap" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.144980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.146659 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.147505 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-drfrr\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.147728 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.148052 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.148405 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.150660 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.151930 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.225407 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.225457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.225854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.226021 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.226066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.226104 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.226373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.226433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z2b\" (UniqueName: \"kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328228 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z2b\" (UniqueName: \"kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328588 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328613 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328786 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.328805 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.333140 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.333824 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.334953 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.335082 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.338058 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.340834 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.343414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z2b\" (UniqueName: \"kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.343735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data\") pod \"keystone-7ddbbdf7b9-8v9z4\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.395305 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.618044 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.695660 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.741612 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742323 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742466 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742626 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742768 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742796 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742899 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.742977 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjbr5\" (UniqueName: \"kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5\") pod \"3117c70d-6269-4bc6-9cd3-345baa8aa543\" (UID: \"3117c70d-6269-4bc6-9cd3-345baa8aa543\") " Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.743498 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs" (OuterVolumeSpecName: "logs") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.744755 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/3117c70d-6269-4bc6-9cd3-345baa8aa543-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.744777 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3117c70d-6269-4bc6-9cd3-345baa8aa543-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.746867 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts" (OuterVolumeSpecName: "scripts") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.750072 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5" (OuterVolumeSpecName: "kube-api-access-mjbr5") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "kube-api-access-mjbr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.757642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.769013 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.839271 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data" (OuterVolumeSpecName: "config-data") pod "3117c70d-6269-4bc6-9cd3-345baa8aa543" (UID: "3117c70d-6269-4bc6-9cd3-345baa8aa543"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.846833 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.847002 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.847062 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.847113 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3117c70d-6269-4bc6-9cd3-345baa8aa543-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:37 crc kubenswrapper[5030]: I0316 13:40:37.847170 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjbr5\" (UniqueName: \"kubernetes.io/projected/3117c70d-6269-4bc6-9cd3-345baa8aa543-kube-api-access-mjbr5\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020518 5030 generic.go:358] "Generic (PLEG): container finished" podID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerID="9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" exitCode=0 Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020566 5030 generic.go:358] "Generic (PLEG): container finished" podID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerID="de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" exitCode=143 Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020649 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020845 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerDied","Data":"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a"} Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerDied","Data":"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b"} Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020889 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"3117c70d-6269-4bc6-9cd3-345baa8aa543","Type":"ContainerDied","Data":"098435688b56dd5773e8986f2d7f91bb7523c4b13d7850e5c1b9671ec398a545"} Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.020906 5030 scope.go:117] "RemoveContainer" containerID="9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.025473 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerStarted","Data":"00360eccab6b27e1d4f2d26e9318d6d10eceb35383f2c8055da34e26e4108110"} Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.025503 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerStarted","Data":"a6dfb1cf00c1cfd9e6fac7224c2e65107e113903caaed803cf4174c19c215985"} Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.025659 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.050838 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" podStartSLOduration=2.050818558 podStartE2EDuration="2.050818558s" podCreationTimestamp="2026-03-16 13:40:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:38.048999236 +0000 UTC m=+2082.448311783" watchObservedRunningTime="2026-03-16 13:40:38.050818558 +0000 UTC m=+2082.450131105" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.060608 5030 scope.go:117] "RemoveContainer" containerID="de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.088266 5030 scope.go:117] "RemoveContainer" containerID="9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" Mar 16 13:40:38 crc kubenswrapper[5030]: E0316 13:40:38.088707 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a\": container with ID starting with 9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a not found: ID does not exist" containerID="9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.088743 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a"} err="failed to get container status \"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a\": rpc error: code = NotFound desc = could not find container \"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a\": container with ID starting with 9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a not found: ID does not exist" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.088765 5030 scope.go:117] "RemoveContainer" containerID="de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" Mar 16 13:40:38 crc kubenswrapper[5030]: E0316 13:40:38.089023 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b\": container with ID starting with de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b not found: ID does not exist" containerID="de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.089058 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b"} err="failed to get container status \"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b\": rpc error: code = NotFound desc = could not find container \"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b\": container with ID starting with de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b not found: ID does not exist" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.089085 5030 scope.go:117] "RemoveContainer" containerID="9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.089379 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a"} err="failed to get container status \"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a\": rpc error: code = NotFound desc = could not find container \"9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a\": container with ID starting with 9895d2eb5989b53be209c96b93c3aabbf0afcf6847a9ecd216247ba933167e2a not found: ID does not exist" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.089419 5030 scope.go:117] "RemoveContainer" containerID="de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.089791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b"} err="failed to get container status \"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b\": rpc error: code = NotFound desc = could not find container \"de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b\": container with ID starting with de1f5284ae67d5258b126c54d5ab84b53d863349f9e364409cc253cec76e1d6b not found: ID does not exist" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.093364 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.114132 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.119833 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.125447 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126654 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api-log" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126678 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api-log" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126709 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126715 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126940 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.126955 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" containerName="cinder-api-log" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.132376 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.135040 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.136034 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.136274 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.136311 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.158480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.158579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.158611 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.158820 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.159055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.159378 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7v6\" (UniqueName: \"kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.159484 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.159743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.159831 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261575 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261723 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261780 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261924 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261947 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.261986 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7v6\" (UniqueName: \"kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.262010 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.262363 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.262471 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.267269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.267416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.267431 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.267930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.268659 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.269122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.277202 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7v6\" (UniqueName: \"kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6\") pod \"cinder-api-0\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.456272 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:38 crc kubenswrapper[5030]: I0316 13:40:38.879270 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.042115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerStarted","Data":"61d0f51fd65e82df488463d4c668ad17390ce63d5fdcb16144a18e38cd7fb98c"} Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.049131 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" event={"ID":"c95e47e9-8db9-48d4-903e-5f61151a5dff","Type":"ContainerStarted","Data":"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6"} Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.049245 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.049280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" event={"ID":"c95e47e9-8db9-48d4-903e-5f61151a5dff","Type":"ContainerStarted","Data":"38b2f8ee294a96e168ae6a2bbbb88127ebeec784a532d7c643469829d96463eb"} Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.076092 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" podStartSLOduration=2.076071839 podStartE2EDuration="2.076071839s" podCreationTimestamp="2026-03-16 13:40:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:39.069658936 +0000 UTC m=+2083.468971482" watchObservedRunningTime="2026-03-16 13:40:39.076071839 +0000 UTC m=+2083.475384385" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.079847 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.080573 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.096753 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.096812 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.118471 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.126429 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.132950 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.147563 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:39 crc kubenswrapper[5030]: I0316 13:40:39.962620 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3117c70d-6269-4bc6-9cd3-345baa8aa543" path="/var/lib/kubelet/pods/3117c70d-6269-4bc6-9cd3-345baa8aa543/volumes" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.072021 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerStarted","Data":"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49"} Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.072095 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.072114 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.073033 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.073222 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.120188 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.120795 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-central-agent" containerID="cri-o://fa161805b7113c1048f16c1849c9aa7347f765cd95724324f2a5d14e423aa148" gracePeriod=30 Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.121536 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="proxy-httpd" containerID="cri-o://cfee67ac0098cd1edbc29e9dd8f8d7467ede9c95674ac337617c53c55cd31c52" gracePeriod=30 Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.121630 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-notification-agent" containerID="cri-o://b776a249166ed6f7ec66b9c9d1cb03779d012b97194bfe5fc4674bc0a0425c3f" gracePeriod=30 Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.121689 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="sg-core" containerID="cri-o://215d0f93a1e5b3460aabf485b5936b9402f54667f87c356b9d614d3e9eeb3ca0" gracePeriod=30 Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.175844 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.231142 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.414982 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.477111 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.477286 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.483828 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.484038 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.537441 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543276 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543389 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543414 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543498 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.543632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4tzx\" (UniqueName: \"kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.558293 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.574656 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.586649 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.595595 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.609175 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.640026 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648753 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648782 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648869 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648885 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648936 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648962 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.648978 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649008 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649037 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649053 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649089 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649112 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmbf\" (UniqueName: \"kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649138 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4tzx\" (UniqueName: \"kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649277 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.649295 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89v95\" (UniqueName: \"kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.658312 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.668100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.668225 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.670065 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.681156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4tzx\" (UniqueName: \"kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.681851 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.686063 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs\") pod \"neutron-74856dd69d-2fjk6\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.752618 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p5lf\" (UniqueName: \"kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753073 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753176 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753363 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753458 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmbf\" (UniqueName: \"kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753583 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753690 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753792 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753867 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753966 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.753991 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89v95\" (UniqueName: \"kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.754088 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.754120 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.754672 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.756296 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.763217 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.764121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.764130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.764511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.769513 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.770478 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.775966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89v95\" (UniqueName: \"kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95\") pod \"barbican-worker-68b6d4cb87-pzfr8\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.776497 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmbf\" (UniqueName: \"kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf\") pod \"barbican-keystone-listener-6b4d547578-vdpnw\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.804833 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.855966 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.856672 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.856718 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.856810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p5lf\" (UniqueName: \"kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.856850 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.858973 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.860882 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.861361 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.861769 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.893368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p5lf\" (UniqueName: \"kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf\") pod \"barbican-api-55ddf7b54d-jmn7s\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.909871 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:40:40 crc kubenswrapper[5030]: I0316 13:40:40.935604 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.103392 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104715 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb44495f-f224-4e88-89c5-7b79fb821293" containerID="cfee67ac0098cd1edbc29e9dd8f8d7467ede9c95674ac337617c53c55cd31c52" exitCode=0 Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104729 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb44495f-f224-4e88-89c5-7b79fb821293" containerID="215d0f93a1e5b3460aabf485b5936b9402f54667f87c356b9d614d3e9eeb3ca0" exitCode=2 Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104735 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb44495f-f224-4e88-89c5-7b79fb821293" containerID="b776a249166ed6f7ec66b9c9d1cb03779d012b97194bfe5fc4674bc0a0425c3f" exitCode=0 Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104741 5030 generic.go:358] "Generic (PLEG): container finished" podID="eb44495f-f224-4e88-89c5-7b79fb821293" containerID="fa161805b7113c1048f16c1849c9aa7347f765cd95724324f2a5d14e423aa148" exitCode=0 Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104966 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerDied","Data":"cfee67ac0098cd1edbc29e9dd8f8d7467ede9c95674ac337617c53c55cd31c52"} Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.104991 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerDied","Data":"215d0f93a1e5b3460aabf485b5936b9402f54667f87c356b9d614d3e9eeb3ca0"} Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.105001 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerDied","Data":"b776a249166ed6f7ec66b9c9d1cb03779d012b97194bfe5fc4674bc0a0425c3f"} Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.105008 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerDied","Data":"fa161805b7113c1048f16c1849c9aa7347f765cd95724324f2a5d14e423aa148"} Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.130738 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerStarted","Data":"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c"} Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.132212 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.158854 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.158823441 podStartE2EDuration="3.158823441s" podCreationTimestamp="2026-03-16 13:40:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:41.157905775 +0000 UTC m=+2085.557218323" watchObservedRunningTime="2026-03-16 13:40:41.158823441 +0000 UTC m=+2085.558135989" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.209331 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.265823 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.265893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.265934 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zhrh\" (UniqueName: \"kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.266015 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.266111 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.266127 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.266185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd\") pod \"eb44495f-f224-4e88-89c5-7b79fb821293\" (UID: \"eb44495f-f224-4e88-89c5-7b79fb821293\") " Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.278726 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.280416 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.282699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh" (OuterVolumeSpecName: "kube-api-access-5zhrh") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "kube-api-access-5zhrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.287185 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts" (OuterVolumeSpecName: "scripts") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.304527 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.363794 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.368901 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.369162 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.369231 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zhrh\" (UniqueName: \"kubernetes.io/projected/eb44495f-f224-4e88-89c5-7b79fb821293-kube-api-access-5zhrh\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.369295 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.369361 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/eb44495f-f224-4e88-89c5-7b79fb821293-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.431478 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data" (OuterVolumeSpecName: "config-data") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.487294 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.508081 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eb44495f-f224-4e88-89c5-7b79fb821293" (UID: "eb44495f-f224-4e88-89c5-7b79fb821293"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:41 crc kubenswrapper[5030]: W0316 13:40:41.556210 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fdd17b2_757d_481f_a166_e552973c1bba.slice/crio-40b7432e746b4c6a48a9185169a3312c0b1d7fcee60586b22290ac192173557b WatchSource:0}: Error finding container 40b7432e746b4c6a48a9185169a3312c0b1d7fcee60586b22290ac192173557b: Status 404 returned error can't find the container with id 40b7432e746b4c6a48a9185169a3312c0b1d7fcee60586b22290ac192173557b Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.589078 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb44495f-f224-4e88-89c5-7b79fb821293-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.598017 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.637404 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:40:41 crc kubenswrapper[5030]: I0316 13:40:41.817237 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:41 crc kubenswrapper[5030]: W0316 13:40:41.825117 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5ddb8dd_8a92_40f6_9c3e_918cf38e0713.slice/crio-134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9 WatchSource:0}: Error finding container 134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9: Status 404 returned error can't find the container with id 134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9 Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.149923 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"eb44495f-f224-4e88-89c5-7b79fb821293","Type":"ContainerDied","Data":"31c112ff8ab3ed35a0ca8dce818459552250e45475498e60338729f450051e6b"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.150008 5030 scope.go:117] "RemoveContainer" containerID="cfee67ac0098cd1edbc29e9dd8f8d7467ede9c95674ac337617c53c55cd31c52" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.150008 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.152992 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerStarted","Data":"e272c747a9e069784c4b7572752e27d9ef35253b15109a62b81a237de16ba5bc"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.153026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerStarted","Data":"134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.160160 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerStarted","Data":"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.160274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerStarted","Data":"30614293e0cb68535e326c3c0fe1a3abbd59cd99be176ac7c2e5191b3f8a8e31"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.171917 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerStarted","Data":"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.171970 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerStarted","Data":"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.171981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerStarted","Data":"74c2b77f3844e74146d8679e5eb52727cd02585a08b19b4df022e91504844ef1"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.179925 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.180431 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.180590 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerStarted","Data":"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.180637 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerStarted","Data":"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.180647 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerStarted","Data":"40b7432e746b4c6a48a9185169a3312c0b1d7fcee60586b22290ac192173557b"} Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.181154 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.181171 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.185608 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.204194 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.205870 5030 scope.go:117] "RemoveContainer" containerID="215d0f93a1e5b3460aabf485b5936b9402f54667f87c356b9d614d3e9eeb3ca0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.228282 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230419 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="sg-core" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230441 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="sg-core" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230483 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-central-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230490 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-central-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230530 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-notification-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230537 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-notification-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230647 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="proxy-httpd" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.230655 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="proxy-httpd" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.231093 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="sg-core" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.231118 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-notification-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.231134 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="proxy-httpd" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.231157 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" containerName="ceilometer-central-agent" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.274592 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.289016 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.295332 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" podStartSLOduration=2.295309776 podStartE2EDuration="2.295309776s" podCreationTimestamp="2026-03-16 13:40:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:42.194996752 +0000 UTC m=+2086.594309299" watchObservedRunningTime="2026-03-16 13:40:42.295309776 +0000 UTC m=+2086.694622322" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.301993 5030 scope.go:117] "RemoveContainer" containerID="b776a249166ed6f7ec66b9c9d1cb03779d012b97194bfe5fc4674bc0a0425c3f" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.302540 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.302989 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.362889 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.367871 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" podStartSLOduration=2.367847332 podStartE2EDuration="2.367847332s" podCreationTimestamp="2026-03-16 13:40:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:42.215934768 +0000 UTC m=+2086.615247315" watchObservedRunningTime="2026-03-16 13:40:42.367847332 +0000 UTC m=+2086.767159880" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.373802 5030 scope.go:117] "RemoveContainer" containerID="fa161805b7113c1048f16c1849c9aa7347f765cd95724324f2a5d14e423aa148" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.391624 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.391949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker-log" containerID="cri-o://74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d" gracePeriod=30 Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.392416 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker" containerID="cri-o://1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c" gracePeriod=30 Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.406610 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.406868 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener-log" containerID="cri-o://472a96bce0cbda024c389221019d833a5314473ce3b1a1e0b4faa32691c4e890" gracePeriod=30 Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.407609 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener" containerID="cri-o://a36b51f4c552ef39669aef91c8141169c8f40bdb6dc678695780fa792ac26186" gracePeriod=30 Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538064 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtv9n\" (UniqueName: \"kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538802 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.538864 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640411 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640493 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtv9n\" (UniqueName: \"kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640558 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640619 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640638 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.640650 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.642055 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.642071 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.649237 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.649631 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.650531 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.654966 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.663658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtv9n\" (UniqueName: \"kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n\") pod \"ceilometer-0\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.681485 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.686104 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.727921 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.748150 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.769636 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.782044 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.782198 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.789010 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.790681 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.901998 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.921140 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946727 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946877 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946925 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.946952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wxgw\" (UniqueName: \"kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:42 crc kubenswrapper[5030]: I0316 13:40:42.948967 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.048981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049327 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049572 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049695 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049791 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wxgw\" (UniqueName: \"kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.049886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.050731 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.063249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.064214 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.067987 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.070499 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.071532 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wxgw\" (UniqueName: \"kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.073564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data\") pod \"barbican-api-7645ddb574-r8cpj\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.118993 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.209152 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerStarted","Data":"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f"} Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.209408 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.219840 5030 generic.go:358] "Generic (PLEG): container finished" podID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerID="74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d" exitCode=143 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.219943 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerDied","Data":"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d"} Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.246613 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.250764 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" podStartSLOduration=3.250743701 podStartE2EDuration="3.250743701s" podCreationTimestamp="2026-03-16 13:40:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:43.237667866 +0000 UTC m=+2087.636980413" watchObservedRunningTime="2026-03-16 13:40:43.250743701 +0000 UTC m=+2087.650056248" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.252696 5030 generic.go:358] "Generic (PLEG): container finished" podID="1085d824-7231-4057-b19f-e8baece8d55f" containerID="a36b51f4c552ef39669aef91c8141169c8f40bdb6dc678695780fa792ac26186" exitCode=0 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.252720 5030 generic.go:358] "Generic (PLEG): container finished" podID="1085d824-7231-4057-b19f-e8baece8d55f" containerID="472a96bce0cbda024c389221019d833a5314473ce3b1a1e0b4faa32691c4e890" exitCode=143 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.252797 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerDied","Data":"a36b51f4c552ef39669aef91c8141169c8f40bdb6dc678695780fa792ac26186"} Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.252822 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerDied","Data":"472a96bce0cbda024c389221019d833a5314473ce3b1a1e0b4faa32691c4e890"} Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.264793 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerStarted","Data":"d7a46c98af4d8254d6ce592a8ef1c617646a4a8e2aa3a8722f21842dac09f0a5"} Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.264889 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.264909 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.264957 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.265908 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="cinder-scheduler" containerID="cri-o://73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c" gracePeriod=30 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.266035 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="probe" containerID="cri-o://daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434" gracePeriod=30 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.293389 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" podStartSLOduration=3.29336823 podStartE2EDuration="3.29336823s" podCreationTimestamp="2026-03-16 13:40:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:43.284229861 +0000 UTC m=+2087.683542408" watchObservedRunningTime="2026-03-16 13:40:43.29336823 +0000 UTC m=+2087.692680768" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.311716 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.541870 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.615188 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:40:43 crc kubenswrapper[5030]: W0316 13:40:43.619365 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6dfb78f_7fbe_4daf_a462_c2523b7ff8c5.slice/crio-24028acc62ae3bf77de0dcda54499ae2a72a01c1ffd82e1deaa20f180ad04222 WatchSource:0}: Error finding container 24028acc62ae3bf77de0dcda54499ae2a72a01c1ffd82e1deaa20f180ad04222: Status 404 returned error can't find the container with id 24028acc62ae3bf77de0dcda54499ae2a72a01c1ffd82e1deaa20f180ad04222 Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.664669 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom\") pod \"1085d824-7231-4057-b19f-e8baece8d55f\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.664805 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh9j9\" (UniqueName: \"kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9\") pod \"1085d824-7231-4057-b19f-e8baece8d55f\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.665016 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs\") pod \"1085d824-7231-4057-b19f-e8baece8d55f\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.665155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle\") pod \"1085d824-7231-4057-b19f-e8baece8d55f\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.665203 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data\") pod \"1085d824-7231-4057-b19f-e8baece8d55f\" (UID: \"1085d824-7231-4057-b19f-e8baece8d55f\") " Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.666201 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs" (OuterVolumeSpecName: "logs") pod "1085d824-7231-4057-b19f-e8baece8d55f" (UID: "1085d824-7231-4057-b19f-e8baece8d55f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.671148 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "1085d824-7231-4057-b19f-e8baece8d55f" (UID: "1085d824-7231-4057-b19f-e8baece8d55f"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.672267 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9" (OuterVolumeSpecName: "kube-api-access-gh9j9") pod "1085d824-7231-4057-b19f-e8baece8d55f" (UID: "1085d824-7231-4057-b19f-e8baece8d55f"). InnerVolumeSpecName "kube-api-access-gh9j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.696238 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1085d824-7231-4057-b19f-e8baece8d55f" (UID: "1085d824-7231-4057-b19f-e8baece8d55f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.721098 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data" (OuterVolumeSpecName: "config-data") pod "1085d824-7231-4057-b19f-e8baece8d55f" (UID: "1085d824-7231-4057-b19f-e8baece8d55f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.767504 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.767541 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.767568 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/1085d824-7231-4057-b19f-e8baece8d55f-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.767579 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh9j9\" (UniqueName: \"kubernetes.io/projected/1085d824-7231-4057-b19f-e8baece8d55f-kube-api-access-gh9j9\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.767590 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1085d824-7231-4057-b19f-e8baece8d55f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:43 crc kubenswrapper[5030]: I0316 13:40:43.956953 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb44495f-f224-4e88-89c5-7b79fb821293" path="/var/lib/kubelet/pods/eb44495f-f224-4e88-89c5-7b79fb821293/volumes" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.296219 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerStarted","Data":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.296283 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerStarted","Data":"dbb39911df101a0e4129c43dd1987dbd9b76711ef5ebbcf299cea1e59ee764b5"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.305324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" event={"ID":"1085d824-7231-4057-b19f-e8baece8d55f","Type":"ContainerDied","Data":"276b44a35de6b1bd27b11eba8257924bc7555bf8c5aad08348b997d1a6d0a3e4"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.305393 5030 scope.go:117] "RemoveContainer" containerID="a36b51f4c552ef39669aef91c8141169c8f40bdb6dc678695780fa792ac26186" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.305676 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.312400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerStarted","Data":"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.312455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerStarted","Data":"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.312468 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerStarted","Data":"24028acc62ae3bf77de0dcda54499ae2a72a01c1ffd82e1deaa20f180ad04222"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.313508 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.313538 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.333417 5030 generic.go:358] "Generic (PLEG): container finished" podID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerID="daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434" exitCode=0 Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.335282 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerDied","Data":"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434"} Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.335481 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api-log" containerID="cri-o://e272c747a9e069784c4b7572752e27d9ef35253b15109a62b81a237de16ba5bc" gracePeriod=30 Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.335973 5030 scope.go:117] "RemoveContainer" containerID="472a96bce0cbda024c389221019d833a5314473ce3b1a1e0b4faa32691c4e890" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.338585 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api-log" containerID="cri-o://c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" gracePeriod=30 Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.338701 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api" containerID="cri-o://52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" gracePeriod=30 Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.341024 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api" containerID="cri-o://d7a46c98af4d8254d6ce592a8ef1c617646a4a8e2aa3a8722f21842dac09f0a5" gracePeriod=30 Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.349543 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" podStartSLOduration=2.349532706 podStartE2EDuration="2.349532706s" podCreationTimestamp="2026-03-16 13:40:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:44.34749894 +0000 UTC m=+2088.746811487" watchObservedRunningTime="2026-03-16 13:40:44.349532706 +0000 UTC m=+2088.748845252" Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.385069 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:44 crc kubenswrapper[5030]: I0316 13:40:44.394320 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-5ff77cb854-wq59j"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.036136 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.211798 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221399 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221659 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221696 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.221804 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.222144 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkvfl\" (UniqueName: \"kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl\") pod \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\" (UID: \"c49b7c40-b933-4017-8ceb-5cd01f190fd0\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.223155 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/c49b7c40-b933-4017-8ceb-5cd01f190fd0-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.232028 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts" (OuterVolumeSpecName: "scripts") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.232789 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.235736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl" (OuterVolumeSpecName: "kube-api-access-rkvfl") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "kube-api-access-rkvfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.303813 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324324 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc7v6\" (UniqueName: \"kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324358 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324421 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324439 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324636 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324667 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.324683 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle\") pod \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\" (UID: \"7bc7ebd5-cdcb-4163-b194-7a7125eb893c\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.325095 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkvfl\" (UniqueName: \"kubernetes.io/projected/c49b7c40-b933-4017-8ceb-5cd01f190fd0-kube-api-access-rkvfl\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.325106 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.325114 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.325121 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.329867 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs" (OuterVolumeSpecName: "logs") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.331754 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.332039 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts" (OuterVolumeSpecName: "scripts") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.343163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.353209 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6" (OuterVolumeSpecName: "kube-api-access-cc7v6") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "kube-api-access-cc7v6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.375487 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382638 5030 generic.go:358] "Generic (PLEG): container finished" podID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerID="d7a46c98af4d8254d6ce592a8ef1c617646a4a8e2aa3a8722f21842dac09f0a5" exitCode=0 Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382670 5030 generic.go:358] "Generic (PLEG): container finished" podID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerID="e272c747a9e069784c4b7572752e27d9ef35253b15109a62b81a237de16ba5bc" exitCode=143 Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382913 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerDied","Data":"d7a46c98af4d8254d6ce592a8ef1c617646a4a8e2aa3a8722f21842dac09f0a5"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382971 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerDied","Data":"e272c747a9e069784c4b7572752e27d9ef35253b15109a62b81a237de16ba5bc"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382983 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" event={"ID":"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713","Type":"ContainerDied","Data":"134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.382992 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="134e53b2132911e5feb1290302731ec1b5773c77c4f1b8a96cf739d4c4ec35e9" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.385815 5030 generic.go:358] "Generic (PLEG): container finished" podID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerID="73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c" exitCode=0 Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.386082 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerDied","Data":"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.386106 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"c49b7c40-b933-4017-8ceb-5cd01f190fd0","Type":"ContainerDied","Data":"806fd1492fe743fa1c0424f1d09a949289c81a960ec1e20ed753e31ef10b3f86"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.386124 5030 scope.go:117] "RemoveContainer" containerID="daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.386252 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398006 5030 generic.go:358] "Generic (PLEG): container finished" podID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerID="52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" exitCode=0 Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398022 5030 generic.go:358] "Generic (PLEG): container finished" podID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerID="c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" exitCode=143 Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398140 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerDied","Data":"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398155 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerDied","Data":"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398164 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7bc7ebd5-cdcb-4163-b194-7a7125eb893c","Type":"ContainerDied","Data":"61d0f51fd65e82df488463d4c668ad17390ce63d5fdcb16144a18e38cd7fb98c"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.398213 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.401624 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerStarted","Data":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428851 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc7v6\" (UniqueName: \"kubernetes.io/projected/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-kube-api-access-cc7v6\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428876 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428886 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428897 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428905 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.428913 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.440017 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data" (OuterVolumeSpecName: "config-data") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.445429 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data" (OuterVolumeSpecName: "config-data") pod "c49b7c40-b933-4017-8ceb-5cd01f190fd0" (UID: "c49b7c40-b933-4017-8ceb-5cd01f190fd0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.447204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.450697 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.471076 5030 scope.go:117] "RemoveContainer" containerID="73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.478784 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7bc7ebd5-cdcb-4163-b194-7a7125eb893c" (UID: "7bc7ebd5-cdcb-4163-b194-7a7125eb893c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.516702 5030 scope.go:117] "RemoveContainer" containerID="daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434" Mar 16 13:40:45 crc kubenswrapper[5030]: E0316 13:40:45.517088 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434\": container with ID starting with daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434 not found: ID does not exist" containerID="daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.517137 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434"} err="failed to get container status \"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434\": rpc error: code = NotFound desc = could not find container \"daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434\": container with ID starting with daa6f92d38b28b9377dabadbcc3ec3c3cbcc337791fc41eb6c34270ef44d9434 not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.517165 5030 scope.go:117] "RemoveContainer" containerID="73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c" Mar 16 13:40:45 crc kubenswrapper[5030]: E0316 13:40:45.517653 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c\": container with ID starting with 73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c not found: ID does not exist" containerID="73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.517697 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c"} err="failed to get container status \"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c\": rpc error: code = NotFound desc = could not find container \"73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c\": container with ID starting with 73d6f43eb3d943f010c05dfc0cbd8f363bb67d62c849527211c2d15ed0bc5b7c not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.517722 5030 scope.go:117] "RemoveContainer" containerID="52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.530479 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data\") pod \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.530571 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom\") pod \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.530717 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs\") pod \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.530879 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle\") pod \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.530954 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p5lf\" (UniqueName: \"kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf\") pod \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\" (UID: \"b5ddb8dd-8a92-40f6-9c3e-918cf38e0713\") " Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531315 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs" (OuterVolumeSpecName: "logs") pod "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" (UID: "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531832 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531855 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531865 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531877 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c49b7c40-b933-4017-8ceb-5cd01f190fd0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.531946 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc7ebd5-cdcb-4163-b194-7a7125eb893c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.534218 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" (UID: "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.534822 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf" (OuterVolumeSpecName: "kube-api-access-9p5lf") pod "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" (UID: "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713"). InnerVolumeSpecName "kube-api-access-9p5lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.545802 5030 scope.go:117] "RemoveContainer" containerID="c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.555083 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" (UID: "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.567832 5030 scope.go:117] "RemoveContainer" containerID="52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" Mar 16 13:40:45 crc kubenswrapper[5030]: E0316 13:40:45.568223 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c\": container with ID starting with 52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c not found: ID does not exist" containerID="52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.568281 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c"} err="failed to get container status \"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c\": rpc error: code = NotFound desc = could not find container \"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c\": container with ID starting with 52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.568310 5030 scope.go:117] "RemoveContainer" containerID="c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" Mar 16 13:40:45 crc kubenswrapper[5030]: E0316 13:40:45.568898 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49\": container with ID starting with c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49 not found: ID does not exist" containerID="c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.568921 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49"} err="failed to get container status \"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49\": rpc error: code = NotFound desc = could not find container \"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49\": container with ID starting with c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49 not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.568933 5030 scope.go:117] "RemoveContainer" containerID="52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.569303 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c"} err="failed to get container status \"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c\": rpc error: code = NotFound desc = could not find container \"52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c\": container with ID starting with 52739d78921290a0cb304c18e8cacffeee96ea9bea8a707290c9e6b403011a1c not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.569322 5030 scope.go:117] "RemoveContainer" containerID="c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.569539 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49"} err="failed to get container status \"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49\": rpc error: code = NotFound desc = could not find container \"c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49\": container with ID starting with c6d85d8e408ce29cd650a246bb972dcb5a76e97ed47f92af3d93179539528c49 not found: ID does not exist" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.577496 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data" (OuterVolumeSpecName: "config-data") pod "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" (UID: "b5ddb8dd-8a92-40f6-9c3e-918cf38e0713"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.633990 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.634018 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p5lf\" (UniqueName: \"kubernetes.io/projected/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-kube-api-access-9p5lf\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.634029 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.634040 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.728076 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.754891 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.766130 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.773133 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.778543 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779574 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779594 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779621 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="probe" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779628 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="probe" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779636 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779641 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779664 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="cinder-scheduler" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779670 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="cinder-scheduler" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779704 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779709 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.779721 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780073 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780082 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780089 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780110 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780116 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780288 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780302 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780312 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780322 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" containerName="barbican-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780332 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1085d824-7231-4057-b19f-e8baece8d55f" containerName="barbican-keystone-listener-log" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780341 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" containerName="cinder-api" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780352 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="cinder-scheduler" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.780366 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" containerName="probe" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.784904 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.785019 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.787304 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.787582 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.787641 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-vz7xz\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.787713 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.790794 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.798627 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.798735 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.805016 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.805038 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.805031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836526 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836570 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hfp\" (UniqueName: \"kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836739 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836907 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.836991 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837026 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837236 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k66r\" (UniqueName: \"kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837333 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.837496 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940121 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940191 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940258 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940295 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940319 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55hfp\" (UniqueName: \"kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940358 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940380 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940426 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940502 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940596 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940624 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940654 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8k66r\" (UniqueName: \"kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940709 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.940803 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.942394 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.942535 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.946836 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.947036 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.947673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.947722 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.948982 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.948991 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.949242 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.952362 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.955937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.957604 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.957861 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hfp\" (UniqueName: \"kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp\") pod \"cinder-scheduler-0\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.958140 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k66r\" (UniqueName: \"kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r\") pod \"cinder-api-0\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.960191 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1085d824-7231-4057-b19f-e8baece8d55f" path="/var/lib/kubelet/pods/1085d824-7231-4057-b19f-e8baece8d55f/volumes" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.960894 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc7ebd5-cdcb-4163-b194-7a7125eb893c" path="/var/lib/kubelet/pods/7bc7ebd5-cdcb-4163-b194-7a7125eb893c/volumes" Mar 16 13:40:45 crc kubenswrapper[5030]: I0316 13:40:45.961489 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49b7c40-b933-4017-8ceb-5cd01f190fd0" path="/var/lib/kubelet/pods/c49b7c40-b933-4017-8ceb-5cd01f190fd0/volumes" Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.115957 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.135082 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.414115 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerStarted","Data":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.422074 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s" Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.445462 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.452108 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-55ddf7b54d-jmn7s"] Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.552616 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:40:46 crc kubenswrapper[5030]: W0316 13:40:46.553491 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56894fd4_591a_4c52_8304_f718c6fe9bcf.slice/crio-fa3ac4525d717c370f572c7a06631ef9920d200b4f9c1c252c9463e037010379 WatchSource:0}: Error finding container fa3ac4525d717c370f572c7a06631ef9920d200b4f9c1c252c9463e037010379: Status 404 returned error can't find the container with id fa3ac4525d717c370f572c7a06631ef9920d200b4f9c1c252c9463e037010379 Mar 16 13:40:46 crc kubenswrapper[5030]: I0316 13:40:46.611938 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:40:46 crc kubenswrapper[5030]: W0316 13:40:46.618174 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d20c426_1744_4c8f_a0e3_a81824dc2468.slice/crio-8288a66f8818984b788e36ab851934f0226955a17c3c3c4c9ed5c0f8df5d9652 WatchSource:0}: Error finding container 8288a66f8818984b788e36ab851934f0226955a17c3c3c4c9ed5c0f8df5d9652: Status 404 returned error can't find the container with id 8288a66f8818984b788e36ab851934f0226955a17c3c3c4c9ed5c0f8df5d9652 Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.031916 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.066334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data\") pod \"ada92e37-ee45-4c8c-80f2-38203cb91aad\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.066565 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom\") pod \"ada92e37-ee45-4c8c-80f2-38203cb91aad\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.066673 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsfkx\" (UniqueName: \"kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx\") pod \"ada92e37-ee45-4c8c-80f2-38203cb91aad\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.066799 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs\") pod \"ada92e37-ee45-4c8c-80f2-38203cb91aad\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.066858 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle\") pod \"ada92e37-ee45-4c8c-80f2-38203cb91aad\" (UID: \"ada92e37-ee45-4c8c-80f2-38203cb91aad\") " Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.068604 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs" (OuterVolumeSpecName: "logs") pod "ada92e37-ee45-4c8c-80f2-38203cb91aad" (UID: "ada92e37-ee45-4c8c-80f2-38203cb91aad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.081777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "ada92e37-ee45-4c8c-80f2-38203cb91aad" (UID: "ada92e37-ee45-4c8c-80f2-38203cb91aad"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.082947 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx" (OuterVolumeSpecName: "kube-api-access-rsfkx") pod "ada92e37-ee45-4c8c-80f2-38203cb91aad" (UID: "ada92e37-ee45-4c8c-80f2-38203cb91aad"). InnerVolumeSpecName "kube-api-access-rsfkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.107125 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ada92e37-ee45-4c8c-80f2-38203cb91aad" (UID: "ada92e37-ee45-4c8c-80f2-38203cb91aad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.133304 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data" (OuterVolumeSpecName: "config-data") pod "ada92e37-ee45-4c8c-80f2-38203cb91aad" (UID: "ada92e37-ee45-4c8c-80f2-38203cb91aad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.169126 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ada92e37-ee45-4c8c-80f2-38203cb91aad-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.169159 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.169174 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.169202 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/ada92e37-ee45-4c8c-80f2-38203cb91aad-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.169211 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsfkx\" (UniqueName: \"kubernetes.io/projected/ada92e37-ee45-4c8c-80f2-38203cb91aad-kube-api-access-rsfkx\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.464750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerStarted","Data":"84fb50a4dbfd389b98d639e4f42a109ec8e94878501b21e794ec9c4578e6ce59"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.464987 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerStarted","Data":"8288a66f8818984b788e36ab851934f0226955a17c3c3c4c9ed5c0f8df5d9652"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.468281 5030 generic.go:358] "Generic (PLEG): container finished" podID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerID="1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c" exitCode=0 Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.468377 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.468463 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerDied","Data":"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.468538 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj" event={"ID":"ada92e37-ee45-4c8c-80f2-38203cb91aad","Type":"ContainerDied","Data":"ef867e0165baa3421a3a70a873d6ebf4d284afc0f191279d919a9dba9445ea65"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.468660 5030 scope.go:117] "RemoveContainer" containerID="1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.472667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerStarted","Data":"c1a5ec8878da96d7b0a1aeec66817a418726c1704460e884ca52e4580abaa5f1"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.472697 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerStarted","Data":"fa3ac4525d717c370f572c7a06631ef9920d200b4f9c1c252c9463e037010379"} Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.506598 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.513245 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-679fffb6f5-2wcxj"] Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.531812 5030 scope.go:117] "RemoveContainer" containerID="74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.566493 5030 scope.go:117] "RemoveContainer" containerID="1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c" Mar 16 13:40:47 crc kubenswrapper[5030]: E0316 13:40:47.568963 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c\": container with ID starting with 1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c not found: ID does not exist" containerID="1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.569002 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c"} err="failed to get container status \"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c\": rpc error: code = NotFound desc = could not find container \"1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c\": container with ID starting with 1c53a2631702a425c5dfb7408244c8db58dd8d518d76c7856a278d1b8d5c394c not found: ID does not exist" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.569044 5030 scope.go:117] "RemoveContainer" containerID="74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d" Mar 16 13:40:47 crc kubenswrapper[5030]: E0316 13:40:47.570236 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d\": container with ID starting with 74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d not found: ID does not exist" containerID="74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.570286 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d"} err="failed to get container status \"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d\": rpc error: code = NotFound desc = could not find container \"74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d\": container with ID starting with 74eb5195e45c7b4ff85693fd17e276a9b7f2d164a0054fc6d0ba2b500744893d not found: ID does not exist" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.961504 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" path="/var/lib/kubelet/pods/ada92e37-ee45-4c8c-80f2-38203cb91aad/volumes" Mar 16 13:40:47 crc kubenswrapper[5030]: I0316 13:40:47.962291 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ddb8dd-8a92-40f6-9c3e-918cf38e0713" path="/var/lib/kubelet/pods/b5ddb8dd-8a92-40f6-9c3e-918cf38e0713/volumes" Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.488591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerStarted","Data":"933dd53e4ef77d9580c1bbca7464208f8635d8b7cf293cd5bc1139e90d3b095a"} Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.490802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerStarted","Data":"315b90ac9a0c0adaf33e2e4e60d82674059c236150e933fad0edde3061b7b567"} Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.491605 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.495483 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerStarted","Data":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.495930 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.508230 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.508217477 podStartE2EDuration="3.508217477s" podCreationTimestamp="2026-03-16 13:40:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:48.505007068 +0000 UTC m=+2092.904319614" watchObservedRunningTime="2026-03-16 13:40:48.508217477 +0000 UTC m=+2092.907530024" Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.566820 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.252243701 podStartE2EDuration="6.56679844s" podCreationTimestamp="2026-03-16 13:40:42 +0000 UTC" firstStartedPulling="2026-03-16 13:40:43.277969776 +0000 UTC m=+2087.677282323" lastFinishedPulling="2026-03-16 13:40:47.592524525 +0000 UTC m=+2091.991837062" observedRunningTime="2026-03-16 13:40:48.53045684 +0000 UTC m=+2092.929769397" watchObservedRunningTime="2026-03-16 13:40:48.56679844 +0000 UTC m=+2092.966110987" Mar 16 13:40:48 crc kubenswrapper[5030]: I0316 13:40:48.568536 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.568523726 podStartE2EDuration="3.568523726s" podCreationTimestamp="2026-03-16 13:40:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:40:48.551641309 +0000 UTC m=+2092.950953856" watchObservedRunningTime="2026-03-16 13:40:48.568523726 +0000 UTC m=+2092.967836273" Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.116062 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.623175 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.635416 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.699588 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.699876 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api-log" containerID="cri-o://57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca" gracePeriod=30 Mar 16 13:40:51 crc kubenswrapper[5030]: I0316 13:40:51.700614 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api" containerID="cri-o://b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d" gracePeriod=30 Mar 16 13:40:52 crc kubenswrapper[5030]: I0316 13:40:52.541336 5030 generic.go:358] "Generic (PLEG): container finished" podID="a2e400a7-912a-46e5-844c-3e1010052b31" containerID="57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca" exitCode=143 Mar 16 13:40:52 crc kubenswrapper[5030]: I0316 13:40:52.541434 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerDied","Data":"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca"} Mar 16 13:40:54 crc kubenswrapper[5030]: E0316 13:40:54.030521 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1604559 actualBytes=10240 Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.287156 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.287250 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.287336 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.288232 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.288319 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831" gracePeriod=600 Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.567305 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831" exitCode=0 Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.567330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831"} Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.567852 5030 scope.go:117] "RemoveContainer" containerID="65f98fd3de70db94a8d5b8cef904ce974d86323428c8ac4cea40f23c50d6d5d7" Mar 16 13:40:54 crc kubenswrapper[5030]: I0316 13:40:54.876778 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.1.253:9311/healthcheck\": read tcp 10.217.0.2:36904->10.217.1.253:9311: read: connection reset by peer" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.262360 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345101 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom\") pod \"a2e400a7-912a-46e5-844c-3e1010052b31\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345208 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fk69\" (UniqueName: \"kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69\") pod \"a2e400a7-912a-46e5-844c-3e1010052b31\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345258 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs\") pod \"a2e400a7-912a-46e5-844c-3e1010052b31\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle\") pod \"a2e400a7-912a-46e5-844c-3e1010052b31\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345610 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data\") pod \"a2e400a7-912a-46e5-844c-3e1010052b31\" (UID: \"a2e400a7-912a-46e5-844c-3e1010052b31\") " Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.345847 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs" (OuterVolumeSpecName: "logs") pod "a2e400a7-912a-46e5-844c-3e1010052b31" (UID: "a2e400a7-912a-46e5-844c-3e1010052b31"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.346514 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a2e400a7-912a-46e5-844c-3e1010052b31-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.351177 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "a2e400a7-912a-46e5-844c-3e1010052b31" (UID: "a2e400a7-912a-46e5-844c-3e1010052b31"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.351312 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69" (OuterVolumeSpecName: "kube-api-access-4fk69") pod "a2e400a7-912a-46e5-844c-3e1010052b31" (UID: "a2e400a7-912a-46e5-844c-3e1010052b31"). InnerVolumeSpecName "kube-api-access-4fk69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.372265 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a2e400a7-912a-46e5-844c-3e1010052b31" (UID: "a2e400a7-912a-46e5-844c-3e1010052b31"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.382535 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data" (OuterVolumeSpecName: "config-data") pod "a2e400a7-912a-46e5-844c-3e1010052b31" (UID: "a2e400a7-912a-46e5-844c-3e1010052b31"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.449495 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.449528 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fk69\" (UniqueName: \"kubernetes.io/projected/a2e400a7-912a-46e5-844c-3e1010052b31-kube-api-access-4fk69\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.449542 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.449575 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a2e400a7-912a-46e5-844c-3e1010052b31-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.583606 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785"} Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.585776 5030 generic.go:358] "Generic (PLEG): container finished" podID="a2e400a7-912a-46e5-844c-3e1010052b31" containerID="b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d" exitCode=0 Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.585950 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.586035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerDied","Data":"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d"} Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.586162 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" event={"ID":"a2e400a7-912a-46e5-844c-3e1010052b31","Type":"ContainerDied","Data":"4367736a0f7b667c89e77de0ad98e44d6c9032f16e3b095644d75bfcc2433c21"} Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.586191 5030 scope.go:117] "RemoveContainer" containerID="b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.623083 5030 scope.go:117] "RemoveContainer" containerID="57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.627996 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.634800 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4"] Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.642523 5030 scope.go:117] "RemoveContainer" containerID="b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d" Mar 16 13:40:55 crc kubenswrapper[5030]: E0316 13:40:55.642834 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d\": container with ID starting with b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d not found: ID does not exist" containerID="b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.642869 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d"} err="failed to get container status \"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d\": rpc error: code = NotFound desc = could not find container \"b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d\": container with ID starting with b155850cb259ca664d8b500e5285d424eb63ee2ab1c67c91960d30620ff99b9d not found: ID does not exist" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.642892 5030 scope.go:117] "RemoveContainer" containerID="57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca" Mar 16 13:40:55 crc kubenswrapper[5030]: E0316 13:40:55.643226 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca\": container with ID starting with 57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca not found: ID does not exist" containerID="57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.643247 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca"} err="failed to get container status \"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca\": rpc error: code = NotFound desc = could not find container \"57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca\": container with ID starting with 57bef22ac80e539bd0817ed97ea5f37b69fbab155fe8fd00cba4a0c4dea27cca not found: ID does not exist" Mar 16 13:40:55 crc kubenswrapper[5030]: I0316 13:40:55.967980 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" path="/var/lib/kubelet/pods/a2e400a7-912a-46e5-844c-3e1010052b31/volumes" Mar 16 13:40:56 crc kubenswrapper[5030]: I0316 13:40:56.346128 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:40:56 crc kubenswrapper[5030]: I0316 13:40:56.918767 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:40:56 crc kubenswrapper[5030]: I0316 13:40:56.927756 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:40:56 crc kubenswrapper[5030]: I0316 13:40:56.963616 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:40:56 crc kubenswrapper[5030]: I0316 13:40:56.970363 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:40:57 crc kubenswrapper[5030]: I0316 13:40:57.186171 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:41:00 crc kubenswrapper[5030]: I0316 13:41:00.231201 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7c6d7bd988-dhcd4" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.1.253:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:41:03 crc kubenswrapper[5030]: I0316 13:41:03.891050 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.717586 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.946258 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948268 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948307 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948327 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948335 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948346 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948351 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948372 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948377 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948574 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948590 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api-log" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948600 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ada92e37-ee45-4c8c-80f2-38203cb91aad" containerName="barbican-worker" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.948606 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2e400a7-912a-46e5-844c-3e1010052b31" containerName="barbican-api" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.953735 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:04 crc kubenswrapper[5030]: I0316 13:41:04.962177 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.049787 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.049943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.050420 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvfvm\" (UniqueName: \"kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.050545 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.050827 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.050987 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.051359 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154265 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvfvm\" (UniqueName: \"kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154360 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154500 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154583 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.154618 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.155239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.161992 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.162496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.162895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.164538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.165191 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.175195 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvfvm\" (UniqueName: \"kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm\") pod \"placement-579b7b9cfd-r4kx6\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.273213 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.559879 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.566900 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.567925 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.664725 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5dbq\" (UniqueName: \"kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.664801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.665031 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.683496 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:41:05 crc kubenswrapper[5030]: W0316 13:41:05.684875 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc568069c_06b6_42a4_a263_2e42abbbebd0.slice/crio-79e949624bc830afc2ae690f76b327943daa48416ed63be1edff2808fd750555 WatchSource:0}: Error finding container 79e949624bc830afc2ae690f76b327943daa48416ed63be1edff2808fd750555: Status 404 returned error can't find the container with id 79e949624bc830afc2ae690f76b327943daa48416ed63be1edff2808fd750555 Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.767926 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5dbq\" (UniqueName: \"kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.767992 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.768050 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.768708 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.768942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.787475 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5dbq\" (UniqueName: \"kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq\") pod \"redhat-marketplace-z6rw4\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:05 crc kubenswrapper[5030]: I0316 13:41:05.890100 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.365328 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.705770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerStarted","Data":"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462"} Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.705854 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerStarted","Data":"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656"} Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.705868 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerStarted","Data":"79e949624bc830afc2ae690f76b327943daa48416ed63be1edff2808fd750555"} Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.705992 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.707029 5030 generic.go:358] "Generic (PLEG): container finished" podID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerID="d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3" exitCode=0 Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.707250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerDied","Data":"d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3"} Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.707306 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerStarted","Data":"214410853d79119f6c157e0c9bb905e1f6e1691415caac30cda48e62cae8851f"} Mar 16 13:41:06 crc kubenswrapper[5030]: I0316 13:41:06.733595 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" podStartSLOduration=2.733584508 podStartE2EDuration="2.733584508s" podCreationTimestamp="2026-03-16 13:41:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:06.725310663 +0000 UTC m=+2111.124623211" watchObservedRunningTime="2026-03-16 13:41:06.733584508 +0000 UTC m=+2111.132897055" Mar 16 13:41:07 crc kubenswrapper[5030]: I0316 13:41:07.722770 5030 generic.go:358] "Generic (PLEG): container finished" podID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerID="e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d" exitCode=0 Mar 16 13:41:07 crc kubenswrapper[5030]: I0316 13:41:07.722896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerDied","Data":"e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d"} Mar 16 13:41:07 crc kubenswrapper[5030]: I0316 13:41:07.724433 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:08 crc kubenswrapper[5030]: I0316 13:41:08.739862 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerStarted","Data":"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9"} Mar 16 13:41:08 crc kubenswrapper[5030]: I0316 13:41:08.767872 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-z6rw4" podStartSLOduration=3.080371156 podStartE2EDuration="3.767853182s" podCreationTimestamp="2026-03-16 13:41:05 +0000 UTC" firstStartedPulling="2026-03-16 13:41:06.707848707 +0000 UTC m=+2111.107161254" lastFinishedPulling="2026-03-16 13:41:07.395330733 +0000 UTC m=+2111.794643280" observedRunningTime="2026-03-16 13:41:08.761053652 +0000 UTC m=+2113.160366200" watchObservedRunningTime="2026-03-16 13:41:08.767853182 +0000 UTC m=+2113.167165719" Mar 16 13:41:09 crc kubenswrapper[5030]: I0316 13:41:09.054988 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.396873 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.594148 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.599386 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.602427 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-cjmtb\"" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.604025 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.604227 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.608020 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.705834 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gz48\" (UniqueName: \"kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.706092 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.706488 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.706560 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.809172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.809268 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.809303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.809430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gz48\" (UniqueName: \"kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.810188 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.815825 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.815927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.824237 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gz48\" (UniqueName: \"kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48\") pod \"openstackclient\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:11 crc kubenswrapper[5030]: I0316 13:41:11.917202 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:41:12 crc kubenswrapper[5030]: I0316 13:41:12.379500 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:41:12 crc kubenswrapper[5030]: W0316 13:41:12.383775 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8322c5d_8b32_4542_bc97_97e0ea9053f2.slice/crio-be173e711e858ca8dea56f66c469a24da8426f59c27c03db168cc0f186e8bc56 WatchSource:0}: Error finding container be173e711e858ca8dea56f66c469a24da8426f59c27c03db168cc0f186e8bc56: Status 404 returned error can't find the container with id be173e711e858ca8dea56f66c469a24da8426f59c27c03db168cc0f186e8bc56 Mar 16 13:41:12 crc kubenswrapper[5030]: I0316 13:41:12.785368 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b8322c5d-8b32-4542-bc97-97e0ea9053f2","Type":"ContainerStarted","Data":"532844fff7ac3a729df0e9ab476589874e9e6ac20f747e51bca916efc13ce969"} Mar 16 13:41:12 crc kubenswrapper[5030]: I0316 13:41:12.785792 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"b8322c5d-8b32-4542-bc97-97e0ea9053f2","Type":"ContainerStarted","Data":"be173e711e858ca8dea56f66c469a24da8426f59c27c03db168cc0f186e8bc56"} Mar 16 13:41:12 crc kubenswrapper[5030]: I0316 13:41:12.804201 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=1.804182417 podStartE2EDuration="1.804182417s" podCreationTimestamp="2026-03-16 13:41:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:12.798880133 +0000 UTC m=+2117.198192680" watchObservedRunningTime="2026-03-16 13:41:12.804182417 +0000 UTC m=+2117.203494965" Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.349375 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.416586 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.416968 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-api" containerID="cri-o://a6dfb1cf00c1cfd9e6fac7224c2e65107e113903caaed803cf4174c19c215985" gracePeriod=30 Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.417114 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-httpd" containerID="cri-o://00360eccab6b27e1d4f2d26e9318d6d10eceb35383f2c8055da34e26e4108110" gracePeriod=30 Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.809910 5030 generic.go:358] "Generic (PLEG): container finished" podID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerID="00360eccab6b27e1d4f2d26e9318d6d10eceb35383f2c8055da34e26e4108110" exitCode=0 Mar 16 13:41:14 crc kubenswrapper[5030]: I0316 13:41:14.809960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerDied","Data":"00360eccab6b27e1d4f2d26e9318d6d10eceb35383f2c8055da34e26e4108110"} Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.622511 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.632033 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.633973 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.634060 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.634089 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.645961 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.716594 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.716648 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.716810 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.716889 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.717110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fgf8\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.717160 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.717202 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.717325 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819122 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fgf8\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819185 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819227 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819327 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819425 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819496 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819573 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.819762 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.820083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.826107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.827030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.827178 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.827491 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.828069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.834387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fgf8\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8\") pod \"swift-proxy-b56d98484-xh82b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.890527 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.890602 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.959864 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.977806 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.977836 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-4ln99"] Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.984507 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-4ln99"] Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.984533 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-smssw"] Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.984732 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.992056 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:15 crc kubenswrapper[5030]: I0316 13:41:15.995003 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.001422 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-smssw"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.072644 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2xnw5"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.078310 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.095509 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2xnw5"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.128665 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9xn\" (UniqueName: \"kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.128985 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.129569 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.129776 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpscf\" (UniqueName: \"kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.202739 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.212442 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.217800 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.241152 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.242726 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.242968 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.243072 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpscf\" (UniqueName: \"kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.243268 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvtd\" (UniqueName: \"kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.243323 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9xn\" (UniqueName: \"kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.244477 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.245201 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.247123 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.265466 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-ttd6l"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.269493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpscf\" (UniqueName: \"kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf\") pod \"nova-api-db-create-4ln99\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.270269 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9xn\" (UniqueName: \"kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn\") pod \"nova-api-b955-account-create-update-smssw\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.276839 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.319758 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-ttd6l"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.334363 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.343044 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.344860 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czvtd\" (UniqueName: \"kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.344916 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.345036 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.345115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9rvp\" (UniqueName: \"kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.345751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.346875 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.346980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.349285 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.360481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvtd\" (UniqueName: \"kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd\") pod \"nova-cell0-db-create-2xnw5\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.374982 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.394846 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rpxx\" (UniqueName: \"kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447570 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9jb\" (UniqueName: \"kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447610 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447710 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9rvp\" (UniqueName: \"kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.447734 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.448330 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.469877 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9rvp\" (UniqueName: \"kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp\") pod \"nova-cell0-13a5-account-create-update-bmkbp\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.507871 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.552126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.552193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rpxx\" (UniqueName: \"kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.552273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9jb\" (UniqueName: \"kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.552319 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.552884 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.553041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.560008 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.566304 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9jb\" (UniqueName: \"kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb\") pod \"nova-cell1-db-create-ttd6l\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.579992 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rpxx\" (UniqueName: \"kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx\") pod \"nova-cell1-9ddb-account-create-update-cvqbl\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.631249 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.667223 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.855524 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-4ln99"] Mar 16 13:41:16 crc kubenswrapper[5030]: W0316 13:41:16.855589 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24d65c01_d778_4c01_8e09_8c761063d50a.slice/crio-7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae WatchSource:0}: Error finding container 7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae: Status 404 returned error can't find the container with id 7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.873543 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerStarted","Data":"9b01349e0d5296ed55c2a323b03a5e33cbf350558a5e692a00c9254c54ca5f57"} Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.873827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerStarted","Data":"20304a9af43961e82a0bfc7a1a39f4ac9108e289dce7ee404eb1dda50ab38b6d"} Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.946761 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.959463 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2xnw5"] Mar 16 13:41:16 crc kubenswrapper[5030]: I0316 13:41:16.977332 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-smssw"] Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.011093 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.234865 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp"] Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.357771 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl"] Mar 16 13:41:17 crc kubenswrapper[5030]: W0316 13:41:17.387010 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod156f29ff_1c30_4bac_99a6_74a0727413f1.slice/crio-c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50 WatchSource:0}: Error finding container c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50: Status 404 returned error can't find the container with id c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.404332 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-ttd6l"] Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.847685 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.848221 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-central-agent" containerID="cri-o://15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" gracePeriod=30 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.848330 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="sg-core" containerID="cri-o://f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" gracePeriod=30 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.848365 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="proxy-httpd" containerID="cri-o://beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" gracePeriod=30 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.848377 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-notification-agent" containerID="cri-o://f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" gracePeriod=30 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.863202 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="proxy-httpd" probeResult="failure" output="Get \"http://10.217.0.61:3000/\": EOF" Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.890255 5030 generic.go:358] "Generic (PLEG): container finished" podID="c3a3876c-f28c-42cc-b84d-194026cfb552" containerID="8ca8c1f12b5943203f7105670ddfef0dc34422cdfc166891c4c1b0a2bd026067" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.890370 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" event={"ID":"c3a3876c-f28c-42cc-b84d-194026cfb552","Type":"ContainerDied","Data":"8ca8c1f12b5943203f7105670ddfef0dc34422cdfc166891c4c1b0a2bd026067"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.890405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" event={"ID":"c3a3876c-f28c-42cc-b84d-194026cfb552","Type":"ContainerStarted","Data":"86fa74722d04504d102dae17ca91f6a545dfbafecfd6a63df0caabca4d16a6c3"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.893427 5030 generic.go:358] "Generic (PLEG): container finished" podID="bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" containerID="6b0c780547169536bd68de9cb7ee694d4bc6a1f87039ab52cc2a5d098f4bd7c2" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.893516 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" event={"ID":"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b","Type":"ContainerDied","Data":"6b0c780547169536bd68de9cb7ee694d4bc6a1f87039ab52cc2a5d098f4bd7c2"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.893586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" event={"ID":"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b","Type":"ContainerStarted","Data":"52ae73c0a800cd4720ee496d059847ddfd382097ba3ee9bf4bade0baec57609e"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.904988 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerStarted","Data":"5595452be3e86c16401b0473831849bd2ab014dfde3e2188166c384f78d711a4"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.905278 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.905788 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.907288 5030 generic.go:358] "Generic (PLEG): container finished" podID="3278804c-e8b9-44e4-b149-f55bc2849325" containerID="620e54500b3f2913d4f7a4505bacc843ee3f4f635e3dc04182e7cd4cebc71395" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.907642 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" event={"ID":"3278804c-e8b9-44e4-b149-f55bc2849325","Type":"ContainerDied","Data":"620e54500b3f2913d4f7a4505bacc843ee3f4f635e3dc04182e7cd4cebc71395"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.907669 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" event={"ID":"3278804c-e8b9-44e4-b149-f55bc2849325","Type":"ContainerStarted","Data":"77955bdb65d584e5f4f3a961c56017f7ec0e59a0035e24c877fd18f03b1565fb"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.912367 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e65c553-fd32-4350-9186-32beb502436d" containerID="99f708a93ac65bd1f46af0997d3ffde748fa251265c8456c6e48049cdb6b446a" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.912480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" event={"ID":"7e65c553-fd32-4350-9186-32beb502436d","Type":"ContainerDied","Data":"99f708a93ac65bd1f46af0997d3ffde748fa251265c8456c6e48049cdb6b446a"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.912513 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" event={"ID":"7e65c553-fd32-4350-9186-32beb502436d","Type":"ContainerStarted","Data":"08b353e86f387b94d0ee53479daf37ab6693046d08090e0ed2f03e2fcab771ea"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.915076 5030 generic.go:358] "Generic (PLEG): container finished" podID="24d65c01-d778-4c01-8e09-8c761063d50a" containerID="3313d4e068be3e30966a1423d9a65a8af30edb28ac82b59805e1f7c82089b9d8" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.915342 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" event={"ID":"24d65c01-d778-4c01-8e09-8c761063d50a","Type":"ContainerDied","Data":"3313d4e068be3e30966a1423d9a65a8af30edb28ac82b59805e1f7c82089b9d8"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.916520 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" event={"ID":"24d65c01-d778-4c01-8e09-8c761063d50a","Type":"ContainerStarted","Data":"7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.919922 5030 generic.go:358] "Generic (PLEG): container finished" podID="156f29ff-1c30-4bac-99a6-74a0727413f1" containerID="150321c1d96b951976ada4aca4aa13e42d186d2b5fefbf388595bd62eaac35bc" exitCode=0 Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.920067 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" event={"ID":"156f29ff-1c30-4bac-99a6-74a0727413f1","Type":"ContainerDied","Data":"150321c1d96b951976ada4aca4aa13e42d186d2b5fefbf388595bd62eaac35bc"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.920102 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" event={"ID":"156f29ff-1c30-4bac-99a6-74a0727413f1","Type":"ContainerStarted","Data":"c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50"} Mar 16 13:41:17 crc kubenswrapper[5030]: I0316 13:41:17.985495 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" podStartSLOduration=2.985479861 podStartE2EDuration="2.985479861s" podCreationTimestamp="2026-03-16 13:41:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:17.964617187 +0000 UTC m=+2122.363929724" watchObservedRunningTime="2026-03-16 13:41:17.985479861 +0000 UTC m=+2122.384792408" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.793042 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914157 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914328 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914464 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtv9n\" (UniqueName: \"kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914633 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914788 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.914844 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml\") pod \"5408988e-43d3-4dee-bffd-77930aeef350\" (UID: \"5408988e-43d3-4dee-bffd-77930aeef350\") " Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.915644 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.915844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.925737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts" (OuterVolumeSpecName: "scripts") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.925772 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n" (OuterVolumeSpecName: "kube-api-access-dtv9n") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "kube-api-access-dtv9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.942670 5030 generic.go:358] "Generic (PLEG): container finished" podID="5408988e-43d3-4dee-bffd-77930aeef350" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" exitCode=0 Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.942701 5030 generic.go:358] "Generic (PLEG): container finished" podID="5408988e-43d3-4dee-bffd-77930aeef350" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" exitCode=2 Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.942755 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.943234 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerDied","Data":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.943274 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerDied","Data":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.943285 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerDied","Data":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.943309 5030 scope.go:117] "RemoveContainer" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.942730 5030 generic.go:358] "Generic (PLEG): container finished" podID="5408988e-43d3-4dee-bffd-77930aeef350" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" exitCode=0 Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.944509 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerDied","Data":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.948221 5030 generic.go:358] "Generic (PLEG): container finished" podID="5408988e-43d3-4dee-bffd-77930aeef350" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" exitCode=0 Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.948507 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5408988e-43d3-4dee-bffd-77930aeef350","Type":"ContainerDied","Data":"dbb39911df101a0e4129c43dd1987dbd9b76711ef5ebbcf299cea1e59ee764b5"} Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.948748 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-z6rw4" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="registry-server" containerID="cri-o://1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9" gracePeriod=2 Mar 16 13:41:18 crc kubenswrapper[5030]: I0316 13:41:18.959451 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.010973 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017377 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017406 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017417 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017427 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtv9n\" (UniqueName: \"kubernetes.io/projected/5408988e-43d3-4dee-bffd-77930aeef350-kube-api-access-dtv9n\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017435 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5408988e-43d3-4dee-bffd-77930aeef350-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.017442 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.021707 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data" (OuterVolumeSpecName: "config-data") pod "5408988e-43d3-4dee-bffd-77930aeef350" (UID: "5408988e-43d3-4dee-bffd-77930aeef350"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.118938 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5408988e-43d3-4dee-bffd-77930aeef350-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.122848 5030 scope.go:117] "RemoveContainer" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.158036 5030 scope.go:117] "RemoveContainer" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.205989 5030 scope.go:117] "RemoveContainer" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.239663 5030 scope.go:117] "RemoveContainer" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:19 crc kubenswrapper[5030]: E0316 13:41:19.243656 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": container with ID starting with beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558 not found: ID does not exist" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.243707 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} err="failed to get container status \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": rpc error: code = NotFound desc = could not find container \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": container with ID starting with beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.243732 5030 scope.go:117] "RemoveContainer" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: E0316 13:41:19.250707 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": container with ID starting with f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952 not found: ID does not exist" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.250739 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} err="failed to get container status \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": rpc error: code = NotFound desc = could not find container \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": container with ID starting with f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.250763 5030 scope.go:117] "RemoveContainer" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: E0316 13:41:19.252125 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": container with ID starting with f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3 not found: ID does not exist" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.252158 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} err="failed to get container status \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": rpc error: code = NotFound desc = could not find container \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": container with ID starting with f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.252181 5030 scope.go:117] "RemoveContainer" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: E0316 13:41:19.252599 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": container with ID starting with 15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c not found: ID does not exist" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.252619 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} err="failed to get container status \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": rpc error: code = NotFound desc = could not find container \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": container with ID starting with 15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.252632 5030 scope.go:117] "RemoveContainer" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253165 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} err="failed to get container status \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": rpc error: code = NotFound desc = could not find container \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": container with ID starting with beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253186 5030 scope.go:117] "RemoveContainer" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253469 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} err="failed to get container status \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": rpc error: code = NotFound desc = could not find container \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": container with ID starting with f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253488 5030 scope.go:117] "RemoveContainer" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253909 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} err="failed to get container status \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": rpc error: code = NotFound desc = could not find container \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": container with ID starting with f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.253983 5030 scope.go:117] "RemoveContainer" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254179 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} err="failed to get container status \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": rpc error: code = NotFound desc = could not find container \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": container with ID starting with 15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254198 5030 scope.go:117] "RemoveContainer" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254391 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} err="failed to get container status \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": rpc error: code = NotFound desc = could not find container \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": container with ID starting with beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254408 5030 scope.go:117] "RemoveContainer" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254624 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} err="failed to get container status \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": rpc error: code = NotFound desc = could not find container \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": container with ID starting with f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254644 5030 scope.go:117] "RemoveContainer" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254831 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} err="failed to get container status \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": rpc error: code = NotFound desc = could not find container \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": container with ID starting with f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.254849 5030 scope.go:117] "RemoveContainer" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255023 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} err="failed to get container status \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": rpc error: code = NotFound desc = could not find container \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": container with ID starting with 15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255041 5030 scope.go:117] "RemoveContainer" containerID="beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255212 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558"} err="failed to get container status \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": rpc error: code = NotFound desc = could not find container \"beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558\": container with ID starting with beb859169c86e95c64fa44215646b96a557c47036809aec26cfb2c83bbb5e558 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255231 5030 scope.go:117] "RemoveContainer" containerID="f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255410 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952"} err="failed to get container status \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": rpc error: code = NotFound desc = could not find container \"f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952\": container with ID starting with f52fc3e31f66cd7b0681566a05017c2d043140ffa8127d61d91b6f0c0ddd9952 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255428 5030 scope.go:117] "RemoveContainer" containerID="f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255652 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3"} err="failed to get container status \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": rpc error: code = NotFound desc = could not find container \"f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3\": container with ID starting with f140211611fc877f80c98c71c85a44ef515f3168a5a5bba37e34d244a4a5fad3 not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255672 5030 scope.go:117] "RemoveContainer" containerID="15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.255850 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c"} err="failed to get container status \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": rpc error: code = NotFound desc = could not find container \"15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c\": container with ID starting with 15bbe7b071dad7f54e02ffb69a059da8b3be3ce32776e474bdede204e121464c not found: ID does not exist" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.267253 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.312971 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.323758 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.332999 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339146 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-notification-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339183 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-notification-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="sg-core" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339205 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="sg-core" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339219 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="proxy-httpd" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="proxy-httpd" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339244 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e65c553-fd32-4350-9186-32beb502436d" containerName="mariadb-database-create" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339250 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e65c553-fd32-4350-9186-32beb502436d" containerName="mariadb-database-create" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339265 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-central-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339270 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-central-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339460 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="sg-core" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339475 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-central-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339488 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="proxy-httpd" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339499 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e65c553-fd32-4350-9186-32beb502436d" containerName="mariadb-database-create" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.339508 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5408988e-43d3-4dee-bffd-77930aeef350" containerName="ceilometer-notification-agent" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.345797 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.350441 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.350688 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.399104 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.425576 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts\") pod \"7e65c553-fd32-4350-9186-32beb502436d\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.425995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czvtd\" (UniqueName: \"kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd\") pod \"7e65c553-fd32-4350-9186-32beb502436d\" (UID: \"7e65c553-fd32-4350-9186-32beb502436d\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426337 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426399 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7cgd\" (UniqueName: \"kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426456 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426476 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426539 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.426677 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.427154 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "7e65c553-fd32-4350-9186-32beb502436d" (UID: "7e65c553-fd32-4350-9186-32beb502436d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.437985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd" (OuterVolumeSpecName: "kube-api-access-czvtd") pod "7e65c553-fd32-4350-9186-32beb502436d" (UID: "7e65c553-fd32-4350-9186-32beb502436d"). InnerVolumeSpecName "kube-api-access-czvtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.506062 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.511906 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.524995 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.532820 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533009 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533175 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533247 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7cgd\" (UniqueName: \"kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533334 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533426 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/7e65c553-fd32-4350-9186-32beb502436d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.533444 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czvtd\" (UniqueName: \"kubernetes.io/projected/7e65c553-fd32-4350-9186-32beb502436d-kube-api-access-czvtd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.537562 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.538736 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.539029 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.544449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.545109 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.549807 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.554004 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.556593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7cgd\" (UniqueName: \"kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd\") pod \"ceilometer-0\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.591343 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.592498 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.636848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities\") pod \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.636965 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts\") pod \"156f29ff-1c30-4bac-99a6-74a0727413f1\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p9jb\" (UniqueName: \"kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb\") pod \"156f29ff-1c30-4bac-99a6-74a0727413f1\" (UID: \"156f29ff-1c30-4bac-99a6-74a0727413f1\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637200 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities" (OuterVolumeSpecName: "utilities") pod "2e3841fb-4eb6-480f-9f6c-4b91a353355c" (UID: "2e3841fb-4eb6-480f-9f6c-4b91a353355c"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637251 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts\") pod \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637425 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpscf\" (UniqueName: \"kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf\") pod \"24d65c01-d778-4c01-8e09-8c761063d50a\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637576 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z9xn\" (UniqueName: \"kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn\") pod \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\" (UID: \"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637769 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5dbq\" (UniqueName: \"kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq\") pod \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637802 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content\") pod \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\" (UID: \"2e3841fb-4eb6-480f-9f6c-4b91a353355c\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts\") pod \"24d65c01-d778-4c01-8e09-8c761063d50a\" (UID: \"24d65c01-d778-4c01-8e09-8c761063d50a\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "156f29ff-1c30-4bac-99a6-74a0727413f1" (UID: "156f29ff-1c30-4bac-99a6-74a0727413f1"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.637791 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" (UID: "bbf8bc7c-6180-4394-a4a3-9ce68b957f8b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.638965 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.638990 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/156f29ff-1c30-4bac-99a6-74a0727413f1-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.639003 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.640060 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "24d65c01-d778-4c01-8e09-8c761063d50a" (UID: "24d65c01-d778-4c01-8e09-8c761063d50a"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.650612 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb" (OuterVolumeSpecName: "kube-api-access-5p9jb") pod "156f29ff-1c30-4bac-99a6-74a0727413f1" (UID: "156f29ff-1c30-4bac-99a6-74a0727413f1"). InnerVolumeSpecName "kube-api-access-5p9jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.651300 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "2e3841fb-4eb6-480f-9f6c-4b91a353355c" (UID: "2e3841fb-4eb6-480f-9f6c-4b91a353355c"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.651971 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf" (OuterVolumeSpecName: "kube-api-access-fpscf") pod "24d65c01-d778-4c01-8e09-8c761063d50a" (UID: "24d65c01-d778-4c01-8e09-8c761063d50a"). InnerVolumeSpecName "kube-api-access-fpscf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.652653 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn" (OuterVolumeSpecName: "kube-api-access-6z9xn") pod "bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" (UID: "bbf8bc7c-6180-4394-a4a3-9ce68b957f8b"). InnerVolumeSpecName "kube-api-access-6z9xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.654005 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq" (OuterVolumeSpecName: "kube-api-access-z5dbq") pod "2e3841fb-4eb6-480f-9f6c-4b91a353355c" (UID: "2e3841fb-4eb6-480f-9f6c-4b91a353355c"). InnerVolumeSpecName "kube-api-access-z5dbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.669843 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.741034 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rpxx\" (UniqueName: \"kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx\") pod \"c3a3876c-f28c-42cc-b84d-194026cfb552\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.741718 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts\") pod \"3278804c-e8b9-44e4-b149-f55bc2849325\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.741747 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts\") pod \"c3a3876c-f28c-42cc-b84d-194026cfb552\" (UID: \"c3a3876c-f28c-42cc-b84d-194026cfb552\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742128 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9rvp\" (UniqueName: \"kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp\") pod \"3278804c-e8b9-44e4-b149-f55bc2849325\" (UID: \"3278804c-e8b9-44e4-b149-f55bc2849325\") " Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742784 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p9jb\" (UniqueName: \"kubernetes.io/projected/156f29ff-1c30-4bac-99a6-74a0727413f1-kube-api-access-5p9jb\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742798 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpscf\" (UniqueName: \"kubernetes.io/projected/24d65c01-d778-4c01-8e09-8c761063d50a-kube-api-access-fpscf\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742808 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z9xn\" (UniqueName: \"kubernetes.io/projected/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b-kube-api-access-6z9xn\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742820 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5dbq\" (UniqueName: \"kubernetes.io/projected/2e3841fb-4eb6-480f-9f6c-4b91a353355c-kube-api-access-z5dbq\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742832 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/2e3841fb-4eb6-480f-9f6c-4b91a353355c-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.742844 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/24d65c01-d778-4c01-8e09-8c761063d50a-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.743510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c3a3876c-f28c-42cc-b84d-194026cfb552" (UID: "c3a3876c-f28c-42cc-b84d-194026cfb552"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.749541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx" (OuterVolumeSpecName: "kube-api-access-2rpxx") pod "c3a3876c-f28c-42cc-b84d-194026cfb552" (UID: "c3a3876c-f28c-42cc-b84d-194026cfb552"). InnerVolumeSpecName "kube-api-access-2rpxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.749900 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3278804c-e8b9-44e4-b149-f55bc2849325" (UID: "3278804c-e8b9-44e4-b149-f55bc2849325"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.758704 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp" (OuterVolumeSpecName: "kube-api-access-q9rvp") pod "3278804c-e8b9-44e4-b149-f55bc2849325" (UID: "3278804c-e8b9-44e4-b149-f55bc2849325"). InnerVolumeSpecName "kube-api-access-q9rvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.845264 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rpxx\" (UniqueName: \"kubernetes.io/projected/c3a3876c-f28c-42cc-b84d-194026cfb552-kube-api-access-2rpxx\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.845310 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3278804c-e8b9-44e4-b149-f55bc2849325-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.845321 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c3a3876c-f28c-42cc-b84d-194026cfb552-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.845331 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9rvp\" (UniqueName: \"kubernetes.io/projected/3278804c-e8b9-44e4-b149-f55bc2849325-kube-api-access-q9rvp\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.962313 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5408988e-43d3-4dee-bffd-77930aeef350" path="/var/lib/kubelet/pods/5408988e-43d3-4dee-bffd-77930aeef350/volumes" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.963078 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.970818 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.974424 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.980865 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp" event={"ID":"3278804c-e8b9-44e4-b149-f55bc2849325","Type":"ContainerDied","Data":"77955bdb65d584e5f4f3a961c56017f7ec0e59a0035e24c877fd18f03b1565fb"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.980914 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77955bdb65d584e5f4f3a961c56017f7ec0e59a0035e24c877fd18f03b1565fb" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.980953 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-2xnw5" event={"ID":"7e65c553-fd32-4350-9186-32beb502436d","Type":"ContainerDied","Data":"08b353e86f387b94d0ee53479daf37ab6693046d08090e0ed2f03e2fcab771ea"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981037 5030 generic.go:358] "Generic (PLEG): container finished" podID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerID="1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9" exitCode=0 Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981200 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-z6rw4" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981237 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08b353e86f387b94d0ee53479daf37ab6693046d08090e0ed2f03e2fcab771ea" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981262 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-4ln99" event={"ID":"24d65c01-d778-4c01-8e09-8c761063d50a","Type":"ContainerDied","Data":"7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981289 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f99dbee2b90d26f8044f6c01565dc24cc0da94c7c85507e4a517cba7bbc01ae" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981313 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerDied","Data":"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981329 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-z6rw4" event={"ID":"2e3841fb-4eb6-480f-9f6c-4b91a353355c","Type":"ContainerDied","Data":"214410853d79119f6c157e0c9bb905e1f6e1691415caac30cda48e62cae8851f"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.981355 5030 scope.go:117] "RemoveContainer" containerID="1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.984270 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" event={"ID":"156f29ff-1c30-4bac-99a6-74a0727413f1","Type":"ContainerDied","Data":"c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.984314 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c96a311c682dc11f6bed3ad7e1093284d05ed4b70dade6dc98fab050eb66ff50" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.984409 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-ttd6l" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.987076 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" event={"ID":"c3a3876c-f28c-42cc-b84d-194026cfb552","Type":"ContainerDied","Data":"86fa74722d04504d102dae17ca91f6a545dfbafecfd6a63df0caabca4d16a6c3"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.987355 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86fa74722d04504d102dae17ca91f6a545dfbafecfd6a63df0caabca4d16a6c3" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.987431 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.992972 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.994337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-smssw" event={"ID":"bbf8bc7c-6180-4394-a4a3-9ce68b957f8b","Type":"ContainerDied","Data":"52ae73c0a800cd4720ee496d059847ddfd382097ba3ee9bf4bade0baec57609e"} Mar 16 13:41:19 crc kubenswrapper[5030]: I0316 13:41:19.994373 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52ae73c0a800cd4720ee496d059847ddfd382097ba3ee9bf4bade0baec57609e" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.009064 5030 scope.go:117] "RemoveContainer" containerID="3333641da6802b58c83bf3747184a016a701765bf04144f4e97eb33b065daa64" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.038639 5030 scope.go:117] "RemoveContainer" containerID="e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.082074 5030 scope.go:117] "RemoveContainer" containerID="93967d80c7960c65591e9135e5799b21ffdc065d8c37f6283002184a0f414493" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.084230 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:20 crc kubenswrapper[5030]: W0316 13:41:20.087790 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf097a01b_f178_4727_a067_29075e67e739.slice/crio-35e337ea149ee6b7a0882010a2b17f6b42025d2f0e1d80e59453ed655d730938 WatchSource:0}: Error finding container 35e337ea149ee6b7a0882010a2b17f6b42025d2f0e1d80e59453ed655d730938: Status 404 returned error can't find the container with id 35e337ea149ee6b7a0882010a2b17f6b42025d2f0e1d80e59453ed655d730938 Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.156279 5030 scope.go:117] "RemoveContainer" containerID="d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.195590 5030 scope.go:117] "RemoveContainer" containerID="158d2dd6af6cb24e0bc5c70cbfd55d2599a204b9434109ef4c8391212d24067b" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.208827 5030 scope.go:117] "RemoveContainer" containerID="1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9" Mar 16 13:41:20 crc kubenswrapper[5030]: E0316 13:41:20.209229 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9\": container with ID starting with 1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9 not found: ID does not exist" containerID="1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.209272 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9"} err="failed to get container status \"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9\": rpc error: code = NotFound desc = could not find container \"1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9\": container with ID starting with 1c1f564fdc6218efc13a7a3642c776280b2c148c84337bf5ddc033a4fcc9b6e9 not found: ID does not exist" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.209308 5030 scope.go:117] "RemoveContainer" containerID="e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d" Mar 16 13:41:20 crc kubenswrapper[5030]: E0316 13:41:20.209854 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d\": container with ID starting with e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d not found: ID does not exist" containerID="e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.209901 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d"} err="failed to get container status \"e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d\": rpc error: code = NotFound desc = could not find container \"e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d\": container with ID starting with e77bdb7a49f6975915a957f264c2f5da725e448a4a46030bcd43ece68c9c271d not found: ID does not exist" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.211804 5030 scope.go:117] "RemoveContainer" containerID="d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3" Mar 16 13:41:20 crc kubenswrapper[5030]: E0316 13:41:20.212383 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3\": container with ID starting with d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3 not found: ID does not exist" containerID="d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.212435 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3"} err="failed to get container status \"d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3\": rpc error: code = NotFound desc = could not find container \"d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3\": container with ID starting with d33b5b6626574ae181e024379891b7cd13ab85befe8799818d98c46ba42b0fc3 not found: ID does not exist" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.227736 5030 scope.go:117] "RemoveContainer" containerID="f2951f0345102481a378938a76fc53caece79aef9756f23ad2e3b89641e1a111" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.242360 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.253340 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-z6rw4"] Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.254247 5030 scope.go:117] "RemoveContainer" containerID="3c167378963bc5d64c47a85b0ddce3f4da963ac996c490adb963b53169efcc9c" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.274522 5030 scope.go:117] "RemoveContainer" containerID="689ffd899b833c3e1a18d2bfa3c7f65e0a084e3316d81885ba75da2c57cc68fa" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.304071 5030 scope.go:117] "RemoveContainer" containerID="66ba65522f5cf621267b57572390623b11f761c696d38be53c87d8d37e2f2cfd" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.350962 5030 scope.go:117] "RemoveContainer" containerID="eda2cec29dad1a9a631748aa79aa2280974f7949e0ccd6e7e002ab4e21d9a299" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.408772 5030 scope.go:117] "RemoveContainer" containerID="d58ff4a8695cc38f391c0c2a69464858345aeff2447a9f3141702f54b01fff5b" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.599651 5030 scope.go:117] "RemoveContainer" containerID="197e8faf7f86168cc775f335574cef1b41469e1149f9f1ab8c7fb9d88670df25" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.641876 5030 scope.go:117] "RemoveContainer" containerID="1806450d29c48e0911874aee0f879139c7367e0bdf5b4c2a7f18f75cab3ca0d5" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.702600 5030 scope.go:117] "RemoveContainer" containerID="94e0f8580411d1f3d0d78190ef975b2cbea4caccf5391b4ca612264e09405711" Mar 16 13:41:20 crc kubenswrapper[5030]: I0316 13:41:20.726077 5030 scope.go:117] "RemoveContainer" containerID="f298e04471cffc32253883ebff460585bcff82a2e83c62dd409f0fa9199f3b5a" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.063014 5030 generic.go:358] "Generic (PLEG): container finished" podID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerID="a6dfb1cf00c1cfd9e6fac7224c2e65107e113903caaed803cf4174c19c215985" exitCode=0 Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.063182 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerDied","Data":"a6dfb1cf00c1cfd9e6fac7224c2e65107e113903caaed803cf4174c19c215985"} Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.098257 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerStarted","Data":"35e337ea149ee6b7a0882010a2b17f6b42025d2f0e1d80e59453ed655d730938"} Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.156268 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.190156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmbmn\" (UniqueName: \"kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn\") pod \"eaad9fe8-f71c-4675-9eba-1d061b629232\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.190336 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs\") pod \"eaad9fe8-f71c-4675-9eba-1d061b629232\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.190427 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config\") pod \"eaad9fe8-f71c-4675-9eba-1d061b629232\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.190476 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle\") pod \"eaad9fe8-f71c-4675-9eba-1d061b629232\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.190679 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config\") pod \"eaad9fe8-f71c-4675-9eba-1d061b629232\" (UID: \"eaad9fe8-f71c-4675-9eba-1d061b629232\") " Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.196857 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn" (OuterVolumeSpecName: "kube-api-access-qmbmn") pod "eaad9fe8-f71c-4675-9eba-1d061b629232" (UID: "eaad9fe8-f71c-4675-9eba-1d061b629232"). InnerVolumeSpecName "kube-api-access-qmbmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.205005 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "eaad9fe8-f71c-4675-9eba-1d061b629232" (UID: "eaad9fe8-f71c-4675-9eba-1d061b629232"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.274759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eaad9fe8-f71c-4675-9eba-1d061b629232" (UID: "eaad9fe8-f71c-4675-9eba-1d061b629232"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.297769 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.297808 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmbmn\" (UniqueName: \"kubernetes.io/projected/eaad9fe8-f71c-4675-9eba-1d061b629232-kube-api-access-qmbmn\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.297822 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.307809 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "eaad9fe8-f71c-4675-9eba-1d061b629232" (UID: "eaad9fe8-f71c-4675-9eba-1d061b629232"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.307838 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config" (OuterVolumeSpecName: "config") pod "eaad9fe8-f71c-4675-9eba-1d061b629232" (UID: "eaad9fe8-f71c-4675-9eba-1d061b629232"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.321365 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b"] Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322355 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3278804c-e8b9-44e4-b149-f55bc2849325" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322374 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3278804c-e8b9-44e4-b149-f55bc2849325" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322384 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="extract-utilities" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322391 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="extract-utilities" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322404 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24d65c01-d778-4c01-8e09-8c761063d50a" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322409 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="24d65c01-d778-4c01-8e09-8c761063d50a" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322426 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322431 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322445 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a3876c-f28c-42cc-b84d-194026cfb552" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322450 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a3876c-f28c-42cc-b84d-194026cfb552" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322460 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="extract-content" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322464 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="extract-content" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322479 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="156f29ff-1c30-4bac-99a6-74a0727413f1" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322485 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="156f29ff-1c30-4bac-99a6-74a0727413f1" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322492 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-httpd" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322498 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-httpd" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322504 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-api" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322517 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-api" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322532 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="registry-server" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322538 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="registry-server" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322695 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322712 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="156f29ff-1c30-4bac-99a6-74a0727413f1" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322721 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-httpd" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322733 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3278804c-e8b9-44e4-b149-f55bc2849325" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322741 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" containerName="neutron-api" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322748 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="24d65c01-d778-4c01-8e09-8c761063d50a" containerName="mariadb-database-create" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322755 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c3a3876c-f28c-42cc-b84d-194026cfb552" containerName="mariadb-account-create-update" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.322764 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" containerName="registry-server" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.327426 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.331177 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b"] Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.331798 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.332111 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.332255 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t9hlr\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.399750 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.399819 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.399934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf5b5\" (UniqueName: \"kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.399962 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.400066 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.400084 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/eaad9fe8-f71c-4675-9eba-1d061b629232-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.504118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jf5b5\" (UniqueName: \"kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.504192 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.504352 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.504973 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.509485 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.510436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.510735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.521152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf5b5\" (UniqueName: \"kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5\") pod \"nova-cell0-conductor-db-sync-nmg9b\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.660208 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:21 crc kubenswrapper[5030]: I0316 13:41:21.961675 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3841fb-4eb6-480f-9f6c-4b91a353355c" path="/var/lib/kubelet/pods/2e3841fb-4eb6-480f-9f6c-4b91a353355c/volumes" Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.131168 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b"] Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.149054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerStarted","Data":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.149208 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerStarted","Data":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.153130 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" event={"ID":"eaad9fe8-f71c-4675-9eba-1d061b629232","Type":"ContainerDied","Data":"af845c2dc86df40ef58999990ccff60e8fead81b0cbf622ba1bbef99a768b0b1"} Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.153197 5030 scope.go:117] "RemoveContainer" containerID="00360eccab6b27e1d4f2d26e9318d6d10eceb35383f2c8055da34e26e4108110" Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.153420 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-549cc5bf65-2np7b" Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.221814 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.223696 5030 scope.go:117] "RemoveContainer" containerID="a6dfb1cf00c1cfd9e6fac7224c2e65107e113903caaed803cf4174c19c215985" Mar 16 13:41:22 crc kubenswrapper[5030]: I0316 13:41:22.231989 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-549cc5bf65-2np7b"] Mar 16 13:41:23 crc kubenswrapper[5030]: I0316 13:41:23.169434 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerStarted","Data":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} Mar 16 13:41:23 crc kubenswrapper[5030]: I0316 13:41:23.171022 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" event={"ID":"5b04b430-865d-4967-9818-af2a5c9e0e2c","Type":"ContainerStarted","Data":"3d10b607799eb7e94ceff156c14d1ca73111e7ae90c788baf57abba38c84cfea"} Mar 16 13:41:23 crc kubenswrapper[5030]: I0316 13:41:23.171101 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" event={"ID":"5b04b430-865d-4967-9818-af2a5c9e0e2c","Type":"ContainerStarted","Data":"8752a721ff918ec5588c8d69161331c9069b21546384c0b176008c9bae30f5a1"} Mar 16 13:41:23 crc kubenswrapper[5030]: I0316 13:41:23.186255 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" podStartSLOduration=2.186239504 podStartE2EDuration="2.186239504s" podCreationTimestamp="2026-03-16 13:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:23.182956808 +0000 UTC m=+2127.582269356" watchObservedRunningTime="2026-03-16 13:41:23.186239504 +0000 UTC m=+2127.585552051" Mar 16 13:41:23 crc kubenswrapper[5030]: I0316 13:41:23.963149 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaad9fe8-f71c-4675-9eba-1d061b629232" path="/var/lib/kubelet/pods/eaad9fe8-f71c-4675-9eba-1d061b629232/volumes" Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:24.998429 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:24.999025 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:25.189896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerStarted","Data":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:25.190231 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:25.214529 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.067841698 podStartE2EDuration="6.214513843s" podCreationTimestamp="2026-03-16 13:41:19 +0000 UTC" firstStartedPulling="2026-03-16 13:41:20.089581804 +0000 UTC m=+2124.488894352" lastFinishedPulling="2026-03-16 13:41:24.23625395 +0000 UTC m=+2128.635566497" observedRunningTime="2026-03-16 13:41:25.208616429 +0000 UTC m=+2129.607928977" watchObservedRunningTime="2026-03-16 13:41:25.214513843 +0000 UTC m=+2129.613826390" Mar 16 13:41:25 crc kubenswrapper[5030]: I0316 13:41:25.234731 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.211207 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-central-agent" containerID="cri-o://caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" gracePeriod=30 Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.211716 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-notification-agent" containerID="cri-o://ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" gracePeriod=30 Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.211783 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="sg-core" containerID="cri-o://8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" gracePeriod=30 Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.212035 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="proxy-httpd" containerID="cri-o://b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" gracePeriod=30 Mar 16 13:41:27 crc kubenswrapper[5030]: E0316 13:41:27.434233 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf097a01b_f178_4727_a067_29075e67e739.slice/crio-conmon-8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf097a01b_f178_4727_a067_29075e67e739.slice/crio-8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf097a01b_f178_4727_a067_29075e67e739.slice/crio-conmon-b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.853086 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.956163 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7cgd\" (UniqueName: \"kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.956368 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.956560 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.956968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.957073 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.957229 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.957714 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd\") pod \"f097a01b-f178-4727-a067-29075e67e739\" (UID: \"f097a01b-f178-4727-a067-29075e67e739\") " Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.957741 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.957959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.958433 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.958517 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f097a01b-f178-4727-a067-29075e67e739-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.963128 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd" (OuterVolumeSpecName: "kube-api-access-m7cgd") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "kube-api-access-m7cgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.964637 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts" (OuterVolumeSpecName: "scripts") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:27 crc kubenswrapper[5030]: I0316 13:41:27.983895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.021255 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.043370 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data" (OuterVolumeSpecName: "config-data") pod "f097a01b-f178-4727-a067-29075e67e739" (UID: "f097a01b-f178-4727-a067-29075e67e739"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.060705 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.060739 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.060759 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7cgd\" (UniqueName: \"kubernetes.io/projected/f097a01b-f178-4727-a067-29075e67e739-kube-api-access-m7cgd\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.060770 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.060780 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f097a01b-f178-4727-a067-29075e67e739-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.221150 5030 generic.go:358] "Generic (PLEG): container finished" podID="5b04b430-865d-4967-9818-af2a5c9e0e2c" containerID="3d10b607799eb7e94ceff156c14d1ca73111e7ae90c788baf57abba38c84cfea" exitCode=0 Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.221708 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" event={"ID":"5b04b430-865d-4967-9818-af2a5c9e0e2c","Type":"ContainerDied","Data":"3d10b607799eb7e94ceff156c14d1ca73111e7ae90c788baf57abba38c84cfea"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224523 5030 generic.go:358] "Generic (PLEG): container finished" podID="f097a01b-f178-4727-a067-29075e67e739" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" exitCode=0 Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224569 5030 generic.go:358] "Generic (PLEG): container finished" podID="f097a01b-f178-4727-a067-29075e67e739" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" exitCode=2 Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224578 5030 generic.go:358] "Generic (PLEG): container finished" podID="f097a01b-f178-4727-a067-29075e67e739" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" exitCode=0 Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224584 5030 generic.go:358] "Generic (PLEG): container finished" podID="f097a01b-f178-4727-a067-29075e67e739" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" exitCode=0 Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224632 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerDied","Data":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224648 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerDied","Data":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224660 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerDied","Data":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224668 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerDied","Data":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"f097a01b-f178-4727-a067-29075e67e739","Type":"ContainerDied","Data":"35e337ea149ee6b7a0882010a2b17f6b42025d2f0e1d80e59453ed655d730938"} Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.224696 5030 scope.go:117] "RemoveContainer" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.225100 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.250429 5030 scope.go:117] "RemoveContainer" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.274672 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.277633 5030 scope.go:117] "RemoveContainer" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.286890 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.295602 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296884 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="sg-core" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296911 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="sg-core" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296953 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-central-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296960 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-central-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296974 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-notification-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.296981 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-notification-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297019 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="proxy-httpd" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297027 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="proxy-httpd" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297200 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-central-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297219 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="proxy-httpd" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297225 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="ceilometer-notification-agent" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.297240 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f097a01b-f178-4727-a067-29075e67e739" containerName="sg-core" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.302326 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.302450 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.305107 5030 scope.go:117] "RemoveContainer" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.305501 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.306962 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.330730 5030 scope.go:117] "RemoveContainer" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: E0316 13:41:28.332924 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": container with ID starting with b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16 not found: ID does not exist" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.332971 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} err="failed to get container status \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": rpc error: code = NotFound desc = could not find container \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": container with ID starting with b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.332996 5030 scope.go:117] "RemoveContainer" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: E0316 13:41:28.333361 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": container with ID starting with 8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f not found: ID does not exist" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.333491 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} err="failed to get container status \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": rpc error: code = NotFound desc = could not find container \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": container with ID starting with 8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.333591 5030 scope.go:117] "RemoveContainer" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: E0316 13:41:28.334328 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": container with ID starting with ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356 not found: ID does not exist" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.334363 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} err="failed to get container status \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": rpc error: code = NotFound desc = could not find container \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": container with ID starting with ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.334379 5030 scope.go:117] "RemoveContainer" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: E0316 13:41:28.334830 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": container with ID starting with caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61 not found: ID does not exist" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.334922 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} err="failed to get container status \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": rpc error: code = NotFound desc = could not find container \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": container with ID starting with caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.334995 5030 scope.go:117] "RemoveContainer" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.335372 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} err="failed to get container status \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": rpc error: code = NotFound desc = could not find container \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": container with ID starting with b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.335398 5030 scope.go:117] "RemoveContainer" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.335627 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} err="failed to get container status \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": rpc error: code = NotFound desc = could not find container \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": container with ID starting with 8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.335650 5030 scope.go:117] "RemoveContainer" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.336762 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} err="failed to get container status \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": rpc error: code = NotFound desc = could not find container \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": container with ID starting with ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.336867 5030 scope.go:117] "RemoveContainer" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.337569 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} err="failed to get container status \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": rpc error: code = NotFound desc = could not find container \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": container with ID starting with caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.337758 5030 scope.go:117] "RemoveContainer" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338053 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} err="failed to get container status \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": rpc error: code = NotFound desc = could not find container \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": container with ID starting with b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338136 5030 scope.go:117] "RemoveContainer" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338461 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} err="failed to get container status \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": rpc error: code = NotFound desc = could not find container \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": container with ID starting with 8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338563 5030 scope.go:117] "RemoveContainer" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338912 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} err="failed to get container status \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": rpc error: code = NotFound desc = could not find container \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": container with ID starting with ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.338996 5030 scope.go:117] "RemoveContainer" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.339359 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} err="failed to get container status \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": rpc error: code = NotFound desc = could not find container \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": container with ID starting with caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.339463 5030 scope.go:117] "RemoveContainer" containerID="b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.341725 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16"} err="failed to get container status \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": rpc error: code = NotFound desc = could not find container \"b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16\": container with ID starting with b44ed5b6ef82fd674ab92863eee9ae5d39e10c16535ccb2e5199d6e5ee2acc16 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.341837 5030 scope.go:117] "RemoveContainer" containerID="8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.342118 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f"} err="failed to get container status \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": rpc error: code = NotFound desc = could not find container \"8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f\": container with ID starting with 8e9247c99128131932f171fa7a3640e54f6853ec2c698a03fe6d52cf2238304f not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.342192 5030 scope.go:117] "RemoveContainer" containerID="ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.342456 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356"} err="failed to get container status \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": rpc error: code = NotFound desc = could not find container \"ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356\": container with ID starting with ee1fa775bc9e26ae88c7e57da704fef0169c413eab0a8623fa473a87ff6af356 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.342534 5030 scope.go:117] "RemoveContainer" containerID="caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.342868 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61"} err="failed to get container status \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": rpc error: code = NotFound desc = could not find container \"caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61\": container with ID starting with caf777d8756134396698afb8ce678268a24cd20f091f3453895c53ae55540e61 not found: ID does not exist" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwnq8\" (UniqueName: \"kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471331 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471510 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471676 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471715 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.471983 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574051 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574108 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574144 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574161 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574214 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwnq8\" (UniqueName: \"kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574375 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.574989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.575081 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.579264 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.590496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.590580 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.592347 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.598052 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwnq8\" (UniqueName: \"kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8\") pod \"ceilometer-0\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.616765 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:28 crc kubenswrapper[5030]: I0316 13:41:28.775818 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.023375 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.237151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerStarted","Data":"9750410292c5e47cc3aa9a107b52861616c01cba5e4e7a22ba82a60e0540591b"} Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.535240 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.701815 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts\") pod \"5b04b430-865d-4967-9818-af2a5c9e0e2c\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.702095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data\") pod \"5b04b430-865d-4967-9818-af2a5c9e0e2c\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.702290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle\") pod \"5b04b430-865d-4967-9818-af2a5c9e0e2c\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.702403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf5b5\" (UniqueName: \"kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5\") pod \"5b04b430-865d-4967-9818-af2a5c9e0e2c\" (UID: \"5b04b430-865d-4967-9818-af2a5c9e0e2c\") " Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.706635 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts" (OuterVolumeSpecName: "scripts") pod "5b04b430-865d-4967-9818-af2a5c9e0e2c" (UID: "5b04b430-865d-4967-9818-af2a5c9e0e2c"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.707451 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5" (OuterVolumeSpecName: "kube-api-access-jf5b5") pod "5b04b430-865d-4967-9818-af2a5c9e0e2c" (UID: "5b04b430-865d-4967-9818-af2a5c9e0e2c"). InnerVolumeSpecName "kube-api-access-jf5b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.732244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b04b430-865d-4967-9818-af2a5c9e0e2c" (UID: "5b04b430-865d-4967-9818-af2a5c9e0e2c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.732758 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.733002 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-log" containerID="cri-o://e5f66d5a17aa763e105571c7614a462722495dbe3df592e20e640df2f8ba30a4" gracePeriod=30 Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.733100 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-httpd" containerID="cri-o://8c38b9d67c7bd98247a893313b2b229d08c639e50cc0c7c7e533edc3094ee2ef" gracePeriod=30 Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.761761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data" (OuterVolumeSpecName: "config-data") pod "5b04b430-865d-4967-9818-af2a5c9e0e2c" (UID: "5b04b430-865d-4967-9818-af2a5c9e0e2c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.805422 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.805452 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.805463 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b04b430-865d-4967-9818-af2a5c9e0e2c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.805477 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf5b5\" (UniqueName: \"kubernetes.io/projected/5b04b430-865d-4967-9818-af2a5c9e0e2c-kube-api-access-jf5b5\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:29 crc kubenswrapper[5030]: I0316 13:41:29.966930 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f097a01b-f178-4727-a067-29075e67e739" path="/var/lib/kubelet/pods/f097a01b-f178-4727-a067-29075e67e739/volumes" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.248721 5030 generic.go:358] "Generic (PLEG): container finished" podID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerID="e5f66d5a17aa763e105571c7614a462722495dbe3df592e20e640df2f8ba30a4" exitCode=143 Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.248802 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerDied","Data":"e5f66d5a17aa763e105571c7614a462722495dbe3df592e20e640df2f8ba30a4"} Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.250502 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerStarted","Data":"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0"} Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.252384 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.252400 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b" event={"ID":"5b04b430-865d-4967-9818-af2a5c9e0e2c","Type":"ContainerDied","Data":"8752a721ff918ec5588c8d69161331c9069b21546384c0b176008c9bae30f5a1"} Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.252435 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8752a721ff918ec5588c8d69161331c9069b21546384c0b176008c9bae30f5a1" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.330124 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.331516 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b04b430-865d-4967-9818-af2a5c9e0e2c" containerName="nova-cell0-conductor-db-sync" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.331538 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b04b430-865d-4967-9818-af2a5c9e0e2c" containerName="nova-cell0-conductor-db-sync" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.331871 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b04b430-865d-4967-9818-af2a5c9e0e2c" containerName="nova-cell0-conductor-db-sync" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.336227 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.339953 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t9hlr\"" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.340045 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.341494 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.421067 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lz5k\" (UniqueName: \"kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.421134 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.421272 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.522430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lz5k\" (UniqueName: \"kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.522483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.522533 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.527028 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.527725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.537220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lz5k\" (UniqueName: \"kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k\") pod \"nova-cell0-conductor-0\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.648582 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.649755 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.671442 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.671759 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-log" containerID="cri-o://a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4" gracePeriod=30 Mar 16 13:41:30 crc kubenswrapper[5030]: I0316 13:41:30.671847 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-httpd" containerID="cri-o://0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8" gracePeriod=30 Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.083531 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.263961 5030 generic.go:358] "Generic (PLEG): container finished" podID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerID="a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4" exitCode=143 Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.264294 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerDied","Data":"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4"} Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.266599 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerStarted","Data":"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c"} Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.267668 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d3156383-62f8-4bf9-8b49-6fa7643dd350","Type":"ContainerStarted","Data":"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4"} Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.267692 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d3156383-62f8-4bf9-8b49-6fa7643dd350","Type":"ContainerStarted","Data":"23166576c39d07d187b0c8a3e53e0bf32a2863cf6adfff75e53a80bd2864242e"} Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.267828 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" containerID="cri-o://bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" gracePeriod=30 Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.268101 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:41:31 crc kubenswrapper[5030]: I0316 13:41:31.290331 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.290318787 podStartE2EDuration="1.290318787s" podCreationTimestamp="2026-03-16 13:41:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:31.278813175 +0000 UTC m=+2135.678125722" watchObservedRunningTime="2026-03-16 13:41:31.290318787 +0000 UTC m=+2135.689631324" Mar 16 13:41:32 crc kubenswrapper[5030]: I0316 13:41:32.281673 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerStarted","Data":"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41"} Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.298710 5030 generic.go:358] "Generic (PLEG): container finished" podID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerID="8c38b9d67c7bd98247a893313b2b229d08c639e50cc0c7c7e533edc3094ee2ef" exitCode=0 Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.298914 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerDied","Data":"8c38b9d67c7bd98247a893313b2b229d08c639e50cc0c7c7e533edc3094ee2ef"} Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerStarted","Data":"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e"} Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331587 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="proxy-httpd" containerID="cri-o://571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e" gracePeriod=30 Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331618 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="sg-core" containerID="cri-o://3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41" gracePeriod=30 Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331706 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-notification-agent" containerID="cri-o://ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c" gracePeriod=30 Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331775 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.331942 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-central-agent" containerID="cri-o://6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0" gracePeriod=30 Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.354922 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.306799125 podStartE2EDuration="5.354907364s" podCreationTimestamp="2026-03-16 13:41:28 +0000 UTC" firstStartedPulling="2026-03-16 13:41:29.027150702 +0000 UTC m=+2133.426463249" lastFinishedPulling="2026-03-16 13:41:33.075258941 +0000 UTC m=+2137.474571488" observedRunningTime="2026-03-16 13:41:33.35039135 +0000 UTC m=+2137.749703887" watchObservedRunningTime="2026-03-16 13:41:33.354907364 +0000 UTC m=+2137.754219911" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.384793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486181 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbdpx\" (UniqueName: \"kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486448 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486515 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486596 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486690 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.486803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle\") pod \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\" (UID: \"3f81a028-5f33-4c5c-8ff7-ede7801495a9\") " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.487137 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.487724 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs" (OuterVolumeSpecName: "logs") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.488673 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.488693 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3f81a028-5f33-4c5c-8ff7-ede7801495a9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.491297 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.492631 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts" (OuterVolumeSpecName: "scripts") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.493677 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx" (OuterVolumeSpecName: "kube-api-access-zbdpx") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "kube-api-access-zbdpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.510649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.528363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.537421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data" (OuterVolumeSpecName: "config-data") pod "3f81a028-5f33-4c5c-8ff7-ede7801495a9" (UID: "3f81a028-5f33-4c5c-8ff7-ede7801495a9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591098 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbdpx\" (UniqueName: \"kubernetes.io/projected/3f81a028-5f33-4c5c-8ff7-ede7801495a9-kube-api-access-zbdpx\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591133 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591143 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591152 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591163 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3f81a028-5f33-4c5c-8ff7-ede7801495a9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.591199 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.611162 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 13:41:33 crc kubenswrapper[5030]: I0316 13:41:33.692808 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.349841 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3f81a028-5f33-4c5c-8ff7-ede7801495a9","Type":"ContainerDied","Data":"518be3abec5ec71b1ef983b47ab7bb530abdab5f64a591f4457434736e073675"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.349964 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.349995 5030 scope.go:117] "RemoveContainer" containerID="8c38b9d67c7bd98247a893313b2b229d08c639e50cc0c7c7e533edc3094ee2ef" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.370948 5030 generic.go:358] "Generic (PLEG): container finished" podID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerID="3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41" exitCode=2 Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.371000 5030 generic.go:358] "Generic (PLEG): container finished" podID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerID="ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c" exitCode=0 Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.371011 5030 generic.go:358] "Generic (PLEG): container finished" podID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerID="6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0" exitCode=0 Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.371486 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerDied","Data":"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.371543 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerDied","Data":"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.371588 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerDied","Data":"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.375400 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.383000 5030 generic.go:358] "Generic (PLEG): container finished" podID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerID="0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8" exitCode=0 Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.383063 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerDied","Data":"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.383148 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"7441fa6c-2845-416e-b1c6-4bb20dcc0752","Type":"ContainerDied","Data":"5a3f710cb7bc1f8ff86a862504452b938e3a253e859ff3d5eab39d674b3984a4"} Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.398176 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.417016 5030 scope.go:117] "RemoveContainer" containerID="e5f66d5a17aa763e105571c7614a462722495dbe3df592e20e640df2f8ba30a4" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.417957 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.425637 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426818 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426844 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426880 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426887 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426915 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426920 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426935 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.426941 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.427128 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.427147 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.427167 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" containerName="glance-httpd" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.427175 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" containerName="glance-log" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.433396 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.437169 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.437325 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.455655 5030 scope.go:117] "RemoveContainer" containerID="0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.467750 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.475436 5030 scope.go:117] "RemoveContainer" containerID="a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.496913 5030 scope.go:117] "RemoveContainer" containerID="0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8" Mar 16 13:41:34 crc kubenswrapper[5030]: E0316 13:41:34.498280 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8\": container with ID starting with 0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8 not found: ID does not exist" containerID="0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.498315 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8"} err="failed to get container status \"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8\": rpc error: code = NotFound desc = could not find container \"0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8\": container with ID starting with 0e1f28c636eced191c9a57bedfcda9b6ffcf85741af21eb7a85dbd41c0c287f8 not found: ID does not exist" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.498337 5030 scope.go:117] "RemoveContainer" containerID="a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4" Mar 16 13:41:34 crc kubenswrapper[5030]: E0316 13:41:34.498537 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4\": container with ID starting with a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4 not found: ID does not exist" containerID="a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.498585 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4"} err="failed to get container status \"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4\": rpc error: code = NotFound desc = could not find container \"a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4\": container with ID starting with a65814151bae95e87cabaf9fafe03d1b1aee9c04f6bc21c521988df9f1f5e6b4 not found: ID does not exist" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.516720 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.516769 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.516871 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.517027 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.517134 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.517208 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.517326 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.518021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c48gh\" (UniqueName: \"kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh\") pod \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\" (UID: \"7441fa6c-2845-416e-b1c6-4bb20dcc0752\") " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.517329 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.518031 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs" (OuterVolumeSpecName: "logs") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.522678 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh" (OuterVolumeSpecName: "kube-api-access-c48gh") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "kube-api-access-c48gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.522923 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts" (OuterVolumeSpecName: "scripts") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.523780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.524025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.524560 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.524789 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.524973 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6rh\" (UniqueName: \"kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525198 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525324 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525436 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525688 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525756 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525822 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c48gh\" (UniqueName: \"kubernetes.io/projected/7441fa6c-2845-416e-b1c6-4bb20dcc0752-kube-api-access-c48gh\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.525885 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/7441fa6c-2845-416e-b1c6-4bb20dcc0752-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.528100 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.541086 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.574593 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.577059 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data" (OuterVolumeSpecName: "config-data") pod "7441fa6c-2845-416e-b1c6-4bb20dcc0752" (UID: "7441fa6c-2845-416e-b1c6-4bb20dcc0752"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.582927 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.598775 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.598941 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.627950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628034 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628098 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6rh\" (UniqueName: \"kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628190 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628225 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628477 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628622 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628717 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628865 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628940 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628953 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628967 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7441fa6c-2845-416e-b1c6-4bb20dcc0752-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.628986 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.629394 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.632423 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.634256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.638401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.639152 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.643977 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6rh\" (UniqueName: \"kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.654958 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.655162 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.730519 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.730631 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlb6\" (UniqueName: \"kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.730720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.731092 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.760280 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.833259 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.833329 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlb6\" (UniqueName: \"kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.833381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.833984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.834201 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.855271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlb6\" (UniqueName: \"kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6\") pod \"certified-operators-wjgz2\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:34 crc kubenswrapper[5030]: I0316 13:41:34.918495 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.228160 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:41:35 crc kubenswrapper[5030]: W0316 13:41:35.228995 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cae739c_dc40_47bc_8dee_a651ad03a719.slice/crio-7305bd3e44031d85bb99a0e915ddce269a3ef032198a5c0a35bd3d7c86e23dde WatchSource:0}: Error finding container 7305bd3e44031d85bb99a0e915ddce269a3ef032198a5c0a35bd3d7c86e23dde: Status 404 returned error can't find the container with id 7305bd3e44031d85bb99a0e915ddce269a3ef032198a5c0a35bd3d7c86e23dde Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.369986 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:35 crc kubenswrapper[5030]: W0316 13:41:35.380269 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d5c6de_5da7_461b_ab66_62071c4a616a.slice/crio-0c96d49926a2052f079da618a13a91ccd3d6d74420b72dda923f2b5aff9d553c WatchSource:0}: Error finding container 0c96d49926a2052f079da618a13a91ccd3d6d74420b72dda923f2b5aff9d553c: Status 404 returned error can't find the container with id 0c96d49926a2052f079da618a13a91ccd3d6d74420b72dda923f2b5aff9d553c Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.405900 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.414980 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerStarted","Data":"7305bd3e44031d85bb99a0e915ddce269a3ef032198a5c0a35bd3d7c86e23dde"} Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.418159 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerStarted","Data":"0c96d49926a2052f079da618a13a91ccd3d6d74420b72dda923f2b5aff9d553c"} Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.453451 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.462642 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.481389 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.487578 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.489167 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.493805 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.494015 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552593 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552659 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552681 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552741 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28mh\" (UniqueName: \"kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552823 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552847 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.552882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654265 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m28mh\" (UniqueName: \"kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654829 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.654878 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.655030 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.655061 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.655101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.655220 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.655526 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.662500 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.662781 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.662895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.663031 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.672180 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28mh\" (UniqueName: \"kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.693930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.825771 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.986728 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f81a028-5f33-4c5c-8ff7-ede7801495a9" path="/var/lib/kubelet/pods/3f81a028-5f33-4c5c-8ff7-ede7801495a9/volumes" Mar 16 13:41:35 crc kubenswrapper[5030]: I0316 13:41:35.987684 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7441fa6c-2845-416e-b1c6-4bb20dcc0752" path="/var/lib/kubelet/pods/7441fa6c-2845-416e-b1c6-4bb20dcc0752/volumes" Mar 16 13:41:36 crc kubenswrapper[5030]: I0316 13:41:36.274914 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:41:36 crc kubenswrapper[5030]: E0316 13:41:36.276536 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:36 crc kubenswrapper[5030]: W0316 13:41:36.279749 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7be6fd4_01c1_4f1d_b3ed_059eb51698c8.slice/crio-ee2feef3351b34283051bb1a548de2ca7f3f13820814a5dab6fadf6aad752499 WatchSource:0}: Error finding container ee2feef3351b34283051bb1a548de2ca7f3f13820814a5dab6fadf6aad752499: Status 404 returned error can't find the container with id ee2feef3351b34283051bb1a548de2ca7f3f13820814a5dab6fadf6aad752499 Mar 16 13:41:36 crc kubenswrapper[5030]: E0316 13:41:36.279762 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:36 crc kubenswrapper[5030]: E0316 13:41:36.281192 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:36 crc kubenswrapper[5030]: E0316 13:41:36.281243 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:41:36 crc kubenswrapper[5030]: I0316 13:41:36.441156 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerStarted","Data":"1540d31366b839c16da8fac3102afbc6dca3b0f5f0c194ca8dd3130e77195559"} Mar 16 13:41:36 crc kubenswrapper[5030]: I0316 13:41:36.445443 5030 generic.go:358] "Generic (PLEG): container finished" podID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerID="bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21" exitCode=0 Mar 16 13:41:36 crc kubenswrapper[5030]: I0316 13:41:36.445542 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerDied","Data":"bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21"} Mar 16 13:41:36 crc kubenswrapper[5030]: I0316 13:41:36.451016 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerStarted","Data":"ee2feef3351b34283051bb1a548de2ca7f3f13820814a5dab6fadf6aad752499"} Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.466770 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerStarted","Data":"c885a9cd710762e7604811f44a56d30bb7d165bab7c517418d4b13a69476e297"} Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.471349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerStarted","Data":"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf"} Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.473582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerStarted","Data":"7181b2b6a360fc23479fb6cd108a46adf1bcb271f2871bc0d67eac47a649f7c6"} Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.473657 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerStarted","Data":"68c4cb6b81b3e12a49f1f92aad05daab7e3145d24394fda695f25da0c130520e"} Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.489244 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.4892207490000002 podStartE2EDuration="3.489220749s" podCreationTimestamp="2026-03-16 13:41:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:37.488755714 +0000 UTC m=+2141.888068261" watchObservedRunningTime="2026-03-16 13:41:37.489220749 +0000 UTC m=+2141.888533296" Mar 16 13:41:37 crc kubenswrapper[5030]: I0316 13:41:37.517057 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=2.517040664 podStartE2EDuration="2.517040664s" podCreationTimestamp="2026-03-16 13:41:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:41:37.51017435 +0000 UTC m=+2141.909486896" watchObservedRunningTime="2026-03-16 13:41:37.517040664 +0000 UTC m=+2141.916353210" Mar 16 13:41:37 crc kubenswrapper[5030]: E0316 13:41:37.663626 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d5c6de_5da7_461b_ab66_62071c4a616a.slice/crio-f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:41:38 crc kubenswrapper[5030]: I0316 13:41:38.487609 5030 generic.go:358] "Generic (PLEG): container finished" podID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerID="f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf" exitCode=0 Mar 16 13:41:38 crc kubenswrapper[5030]: I0316 13:41:38.487676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerDied","Data":"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf"} Mar 16 13:41:38 crc kubenswrapper[5030]: I0316 13:41:38.749896 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.498151 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerStarted","Data":"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4"} Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.515164 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-wjgz2" podStartSLOduration=4.865248891 podStartE2EDuration="5.515147828s" podCreationTimestamp="2026-03-16 13:41:34 +0000 UTC" firstStartedPulling="2026-03-16 13:41:36.446821308 +0000 UTC m=+2140.846133855" lastFinishedPulling="2026-03-16 13:41:37.096720256 +0000 UTC m=+2141.496032792" observedRunningTime="2026-03-16 13:41:39.511658454 +0000 UTC m=+2143.910971002" watchObservedRunningTime="2026-03-16 13:41:39.515147828 +0000 UTC m=+2143.914460375" Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.618995 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.685471 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.687289 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-log" containerID="cri-o://64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80" gracePeriod=30 Mar 16 13:41:39 crc kubenswrapper[5030]: I0316 13:41:39.687855 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-api" containerID="cri-o://b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915" gracePeriod=30 Mar 16 13:41:40 crc kubenswrapper[5030]: I0316 13:41:40.533091 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerDied","Data":"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80"} Mar 16 13:41:40 crc kubenswrapper[5030]: I0316 13:41:40.532660 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerID="64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80" exitCode=143 Mar 16 13:41:41 crc kubenswrapper[5030]: E0316 13:41:41.271789 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:41 crc kubenswrapper[5030]: E0316 13:41:41.275067 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:41 crc kubenswrapper[5030]: E0316 13:41:41.276637 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:41 crc kubenswrapper[5030]: E0316 13:41:41.276786 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.267601 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.366856 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.366913 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.366941 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.367059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.367155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.367182 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.367263 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdmj9\" (UniqueName: \"kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9\") pod \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\" (UID: \"6f2a1e23-9375-4f0a-885d-3f5aafa08d76\") " Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.368378 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs" (OuterVolumeSpecName: "logs") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.374714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9" (OuterVolumeSpecName: "kube-api-access-rdmj9") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "kube-api-access-rdmj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.375737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts" (OuterVolumeSpecName: "scripts") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.412680 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data" (OuterVolumeSpecName: "config-data") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.414404 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.438004 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.442333 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6f2a1e23-9375-4f0a-885d-3f5aafa08d76" (UID: "6f2a1e23-9375-4f0a-885d-3f5aafa08d76"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469302 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469334 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469344 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdmj9\" (UniqueName: \"kubernetes.io/projected/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-kube-api-access-rdmj9\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469358 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469367 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469377 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.469386 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f2a1e23-9375-4f0a-885d-3f5aafa08d76-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.567774 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerID="b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915" exitCode=0 Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.567886 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.567912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerDied","Data":"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915"} Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.568402 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-59896dc98b-46bjr" event={"ID":"6f2a1e23-9375-4f0a-885d-3f5aafa08d76","Type":"ContainerDied","Data":"c153a572506383f7606874308b8f2ccb18eb98c14192f09b2a8d1fde3b1fe629"} Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.568437 5030 scope.go:117] "RemoveContainer" containerID="b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.600298 5030 scope.go:117] "RemoveContainer" containerID="64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.606579 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.611804 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-59896dc98b-46bjr"] Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.618267 5030 scope.go:117] "RemoveContainer" containerID="b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915" Mar 16 13:41:43 crc kubenswrapper[5030]: E0316 13:41:43.618647 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915\": container with ID starting with b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915 not found: ID does not exist" containerID="b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.618686 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915"} err="failed to get container status \"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915\": rpc error: code = NotFound desc = could not find container \"b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915\": container with ID starting with b868d6a4587f9aa8842d8e47c758f95f28b67126a50bcfb9253b0369aa844915 not found: ID does not exist" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.618715 5030 scope.go:117] "RemoveContainer" containerID="64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80" Mar 16 13:41:43 crc kubenswrapper[5030]: E0316 13:41:43.619036 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80\": container with ID starting with 64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80 not found: ID does not exist" containerID="64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.619075 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80"} err="failed to get container status \"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80\": rpc error: code = NotFound desc = could not find container \"64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80\": container with ID starting with 64807694a2bf801df6561086d21eb86c2d74f804137c8d6b8f027925fc536a80 not found: ID does not exist" Mar 16 13:41:43 crc kubenswrapper[5030]: I0316 13:41:43.968167 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" path="/var/lib/kubelet/pods/6f2a1e23-9375-4f0a-885d-3f5aafa08d76/volumes" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.760698 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.761637 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.786240 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.790402 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.918899 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.918959 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:44 crc kubenswrapper[5030]: I0316 13:41:44.959444 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.595339 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.595396 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.636776 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.689741 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.826529 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.826607 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.859716 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:45 crc kubenswrapper[5030]: I0316 13:41:45.862601 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:46 crc kubenswrapper[5030]: E0316 13:41:46.270568 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:46 crc kubenswrapper[5030]: E0316 13:41:46.272429 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:46 crc kubenswrapper[5030]: E0316 13:41:46.274440 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:46 crc kubenswrapper[5030]: E0316 13:41:46.274531 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:41:46 crc kubenswrapper[5030]: I0316 13:41:46.607757 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:46 crc kubenswrapper[5030]: I0316 13:41:46.608119 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:47 crc kubenswrapper[5030]: I0316 13:41:47.210526 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:47 crc kubenswrapper[5030]: I0316 13:41:47.352662 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:41:47 crc kubenswrapper[5030]: I0316 13:41:47.626100 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-wjgz2" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="registry-server" containerID="cri-o://b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4" gracePeriod=2 Mar 16 13:41:47 crc kubenswrapper[5030]: E0316 13:41:47.898186 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d5c6de_5da7_461b_ab66_62071c4a616a.slice/crio-conmon-b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.090840 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.171955 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdlb6\" (UniqueName: \"kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6\") pod \"06d5c6de-5da7-461b-ab66-62071c4a616a\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.172011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content\") pod \"06d5c6de-5da7-461b-ab66-62071c4a616a\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.172081 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities\") pod \"06d5c6de-5da7-461b-ab66-62071c4a616a\" (UID: \"06d5c6de-5da7-461b-ab66-62071c4a616a\") " Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.172865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities" (OuterVolumeSpecName: "utilities") pod "06d5c6de-5da7-461b-ab66-62071c4a616a" (UID: "06d5c6de-5da7-461b-ab66-62071c4a616a"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.186699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6" (OuterVolumeSpecName: "kube-api-access-zdlb6") pod "06d5c6de-5da7-461b-ab66-62071c4a616a" (UID: "06d5c6de-5da7-461b-ab66-62071c4a616a"). InnerVolumeSpecName "kube-api-access-zdlb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.207126 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "06d5c6de-5da7-461b-ab66-62071c4a616a" (UID: "06d5c6de-5da7-461b-ab66-62071c4a616a"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.275041 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdlb6\" (UniqueName: \"kubernetes.io/projected/06d5c6de-5da7-461b-ab66-62071c4a616a-kube-api-access-zdlb6\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.275068 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.275079 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/06d5c6de-5da7-461b-ab66-62071c4a616a-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.295936 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.297892 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.635108 5030 generic.go:358] "Generic (PLEG): container finished" podID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerID="b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4" exitCode=0 Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.635243 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerDied","Data":"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4"} Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.635260 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-wjgz2" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.635310 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-wjgz2" event={"ID":"06d5c6de-5da7-461b-ab66-62071c4a616a","Type":"ContainerDied","Data":"0c96d49926a2052f079da618a13a91ccd3d6d74420b72dda923f2b5aff9d553c"} Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.635338 5030 scope.go:117] "RemoveContainer" containerID="b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.669539 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.670474 5030 scope.go:117] "RemoveContainer" containerID="f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.676784 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-wjgz2"] Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.693421 5030 scope.go:117] "RemoveContainer" containerID="bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.721953 5030 scope.go:117] "RemoveContainer" containerID="b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4" Mar 16 13:41:48 crc kubenswrapper[5030]: E0316 13:41:48.724870 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4\": container with ID starting with b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4 not found: ID does not exist" containerID="b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.724929 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4"} err="failed to get container status \"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4\": rpc error: code = NotFound desc = could not find container \"b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4\": container with ID starting with b04e8e19938486ea5dd30fc1df0b19cba559076bac64c2a250ae38468f946ab4 not found: ID does not exist" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.724965 5030 scope.go:117] "RemoveContainer" containerID="f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf" Mar 16 13:41:48 crc kubenswrapper[5030]: E0316 13:41:48.726411 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf\": container with ID starting with f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf not found: ID does not exist" containerID="f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.726445 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf"} err="failed to get container status \"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf\": rpc error: code = NotFound desc = could not find container \"f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf\": container with ID starting with f4a9ff94d32589ab78e5993bf4c1f285df5d9fd8391ca6aa81674330a4d9adbf not found: ID does not exist" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.726461 5030 scope.go:117] "RemoveContainer" containerID="bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21" Mar 16 13:41:48 crc kubenswrapper[5030]: E0316 13:41:48.726732 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21\": container with ID starting with bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21 not found: ID does not exist" containerID="bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21" Mar 16 13:41:48 crc kubenswrapper[5030]: I0316 13:41:48.726756 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21"} err="failed to get container status \"bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21\": rpc error: code = NotFound desc = could not find container \"bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21\": container with ID starting with bbb735deb8d40ceae98ff182daa135da432308bdb378abfad96cb1269ff2dd21 not found: ID does not exist" Mar 16 13:41:49 crc kubenswrapper[5030]: I0316 13:41:49.958429 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" path="/var/lib/kubelet/pods/06d5c6de-5da7-461b-ab66-62071c4a616a/volumes" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.004901 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006222 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="extract-utilities" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006246 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="extract-utilities" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006284 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-log" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006291 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-log" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006304 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="extract-content" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006309 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="extract-content" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006337 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="registry-server" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006343 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="registry-server" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006365 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-api" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006371 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-api" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006576 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-api" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006587 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2a1e23-9375-4f0a-885d-3f5aafa08d76" containerName="placement-log" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.006600 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="06d5c6de-5da7-461b-ab66-62071c4a616a" containerName="registry-server" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.011692 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.018994 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.136570 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.136654 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.137109 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlc6\" (UniqueName: \"kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.239391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlc6\" (UniqueName: \"kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.239531 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.239609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.240011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.240065 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.262564 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlc6\" (UniqueName: \"kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6\") pod \"community-operators-4r2gt\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: E0316 13:41:51.274822 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:51 crc kubenswrapper[5030]: E0316 13:41:51.276744 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:51 crc kubenswrapper[5030]: E0316 13:41:51.278492 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:51 crc kubenswrapper[5030]: E0316 13:41:51.278614 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.332919 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:41:51 crc kubenswrapper[5030]: I0316 13:41:51.778306 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:41:51 crc kubenswrapper[5030]: W0316 13:41:51.778971 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e47614_f8af_4351_9fed_559e69d1caa4.slice/crio-0080af62c0ec8cb17f84780976400eefb125b78812940f76c5082f0af25bbf15 WatchSource:0}: Error finding container 0080af62c0ec8cb17f84780976400eefb125b78812940f76c5082f0af25bbf15: Status 404 returned error can't find the container with id 0080af62c0ec8cb17f84780976400eefb125b78812940f76c5082f0af25bbf15 Mar 16 13:41:52 crc kubenswrapper[5030]: I0316 13:41:52.692810 5030 generic.go:358] "Generic (PLEG): container finished" podID="63e47614-f8af-4351-9fed-559e69d1caa4" containerID="dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9" exitCode=0 Mar 16 13:41:52 crc kubenswrapper[5030]: I0316 13:41:52.692935 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerDied","Data":"dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9"} Mar 16 13:41:52 crc kubenswrapper[5030]: I0316 13:41:52.693300 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerStarted","Data":"0080af62c0ec8cb17f84780976400eefb125b78812940f76c5082f0af25bbf15"} Mar 16 13:41:53 crc kubenswrapper[5030]: E0316 13:41:53.911447 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1684248 actualBytes=10240 Mar 16 13:41:54 crc kubenswrapper[5030]: I0316 13:41:54.728821 5030 generic.go:358] "Generic (PLEG): container finished" podID="63e47614-f8af-4351-9fed-559e69d1caa4" containerID="3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd" exitCode=0 Mar 16 13:41:54 crc kubenswrapper[5030]: I0316 13:41:54.728920 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerDied","Data":"3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd"} Mar 16 13:41:55 crc kubenswrapper[5030]: I0316 13:41:55.743065 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerStarted","Data":"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a"} Mar 16 13:41:55 crc kubenswrapper[5030]: I0316 13:41:55.763340 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-4r2gt" podStartSLOduration=4.776351339 podStartE2EDuration="5.763317686s" podCreationTimestamp="2026-03-16 13:41:50 +0000 UTC" firstStartedPulling="2026-03-16 13:41:52.693731427 +0000 UTC m=+2157.093043975" lastFinishedPulling="2026-03-16 13:41:53.680697775 +0000 UTC m=+2158.080010322" observedRunningTime="2026-03-16 13:41:55.758241078 +0000 UTC m=+2160.157553625" watchObservedRunningTime="2026-03-16 13:41:55.763317686 +0000 UTC m=+2160.162630233" Mar 16 13:41:56 crc kubenswrapper[5030]: E0316 13:41:56.272440 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:56 crc kubenswrapper[5030]: E0316 13:41:56.274271 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:56 crc kubenswrapper[5030]: E0316 13:41:56.276464 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:41:56 crc kubenswrapper[5030]: E0316 13:41:56.276560 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.138148 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561142-qkxmz"] Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.143743 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.144643 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561142-qkxmz"] Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.146247 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.146776 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.146789 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.248434 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5dg\" (UniqueName: \"kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg\") pod \"auto-csr-approver-29561142-qkxmz\" (UID: \"cb374918-459d-4d20-b778-c1744386d86f\") " pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.351568 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5dg\" (UniqueName: \"kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg\") pod \"auto-csr-approver-29561142-qkxmz\" (UID: \"cb374918-459d-4d20-b778-c1744386d86f\") " pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.369200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5dg\" (UniqueName: \"kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg\") pod \"auto-csr-approver-29561142-qkxmz\" (UID: \"cb374918-459d-4d20-b778-c1744386d86f\") " pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.467090 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:00 crc kubenswrapper[5030]: I0316 13:42:00.868910 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561142-qkxmz"] Mar 16 13:42:00 crc kubenswrapper[5030]: W0316 13:42:00.869277 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb374918_459d_4d20_b778_c1744386d86f.slice/crio-cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67 WatchSource:0}: Error finding container cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67: Status 404 returned error can't find the container with id cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67 Mar 16 13:42:01 crc kubenswrapper[5030]: E0316 13:42:01.270395 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:42:01 crc kubenswrapper[5030]: E0316 13:42:01.272261 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:42:01 crc kubenswrapper[5030]: E0316 13:42:01.274437 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:42:01 crc kubenswrapper[5030]: E0316 13:42:01.274528 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.333451 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.333808 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.375597 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.575654 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.680496 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data\") pod \"d3156383-62f8-4bf9-8b49-6fa7643dd350\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.680704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lz5k\" (UniqueName: \"kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k\") pod \"d3156383-62f8-4bf9-8b49-6fa7643dd350\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.680826 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle\") pod \"d3156383-62f8-4bf9-8b49-6fa7643dd350\" (UID: \"d3156383-62f8-4bf9-8b49-6fa7643dd350\") " Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.687672 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k" (OuterVolumeSpecName: "kube-api-access-6lz5k") pod "d3156383-62f8-4bf9-8b49-6fa7643dd350" (UID: "d3156383-62f8-4bf9-8b49-6fa7643dd350"). InnerVolumeSpecName "kube-api-access-6lz5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.704382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data" (OuterVolumeSpecName: "config-data") pod "d3156383-62f8-4bf9-8b49-6fa7643dd350" (UID: "d3156383-62f8-4bf9-8b49-6fa7643dd350"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.705014 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d3156383-62f8-4bf9-8b49-6fa7643dd350" (UID: "d3156383-62f8-4bf9-8b49-6fa7643dd350"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.783840 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lz5k\" (UniqueName: \"kubernetes.io/projected/d3156383-62f8-4bf9-8b49-6fa7643dd350-kube-api-access-6lz5k\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.783874 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.783884 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d3156383-62f8-4bf9-8b49-6fa7643dd350-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.820440 5030 generic.go:358] "Generic (PLEG): container finished" podID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" exitCode=137 Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.820544 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.820823 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d3156383-62f8-4bf9-8b49-6fa7643dd350","Type":"ContainerDied","Data":"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4"} Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.820882 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"d3156383-62f8-4bf9-8b49-6fa7643dd350","Type":"ContainerDied","Data":"23166576c39d07d187b0c8a3e53e0bf32a2863cf6adfff75e53a80bd2864242e"} Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.820904 5030 scope.go:117] "RemoveContainer" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.827218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" event={"ID":"cb374918-459d-4d20-b778-c1744386d86f","Type":"ContainerStarted","Data":"cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67"} Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.857423 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.861608 5030 scope.go:117] "RemoveContainer" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" Mar 16 13:42:01 crc kubenswrapper[5030]: E0316 13:42:01.865589 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4\": container with ID starting with bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4 not found: ID does not exist" containerID="bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.865637 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4"} err="failed to get container status \"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4\": rpc error: code = NotFound desc = could not find container \"bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4\": container with ID starting with bf66bf76c8dd774a58624806d1ba566cfe7d701acf920d2bde6aab718697e5a4 not found: ID does not exist" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.877282 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.881721 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.885765 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.886864 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.886885 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.887086 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" containerName="nova-cell0-conductor-conductor" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.890151 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.890261 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.893411 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-t9hlr\"" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.893582 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.958712 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3156383-62f8-4bf9-8b49-6fa7643dd350" path="/var/lib/kubelet/pods/d3156383-62f8-4bf9-8b49-6fa7643dd350/volumes" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.990203 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.990355 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.990424 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbqbq\" (UniqueName: \"kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:01 crc kubenswrapper[5030]: I0316 13:42:01.997687 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.093252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.093348 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbqbq\" (UniqueName: \"kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.093595 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.098950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.099282 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.109151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbqbq\" (UniqueName: \"kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq\") pod \"nova-cell0-conductor-0\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.212436 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.631647 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:42:02 crc kubenswrapper[5030]: W0316 13:42:02.634210 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e34d42_3748_4503_a9cf_2c5cf9453067.slice/crio-14b94f94a9b6e219595f1fea1b4641d3c9d3aa38f9c83c07ae5b5dfdd90157c4 WatchSource:0}: Error finding container 14b94f94a9b6e219595f1fea1b4641d3c9d3aa38f9c83c07ae5b5dfdd90157c4: Status 404 returned error can't find the container with id 14b94f94a9b6e219595f1fea1b4641d3c9d3aa38f9c83c07ae5b5dfdd90157c4 Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.853848 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb374918-459d-4d20-b778-c1744386d86f" containerID="30c159d27976f159e43a676a397cb7153648cd97ce18ca623ff05a7d74bd2f49" exitCode=0 Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.853957 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" event={"ID":"cb374918-459d-4d20-b778-c1744386d86f","Type":"ContainerDied","Data":"30c159d27976f159e43a676a397cb7153648cd97ce18ca623ff05a7d74bd2f49"} Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.860661 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"36e34d42-3748-4503-a9cf-2c5cf9453067","Type":"ContainerStarted","Data":"1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd"} Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.860712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"36e34d42-3748-4503-a9cf-2c5cf9453067","Type":"ContainerStarted","Data":"14b94f94a9b6e219595f1fea1b4641d3c9d3aa38f9c83c07ae5b5dfdd90157c4"} Mar 16 13:42:02 crc kubenswrapper[5030]: I0316 13:42:02.887236 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=1.88721205 podStartE2EDuration="1.88721205s" podCreationTimestamp="2026-03-16 13:42:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:02.883322254 +0000 UTC m=+2167.282634821" watchObservedRunningTime="2026-03-16 13:42:02.88721205 +0000 UTC m=+2167.286524597" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.337898 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="proxy-httpd" probeResult="failure" output="HTTP probe failed with statuscode: 503" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.700344 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.838419 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.838610 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.838726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwnq8\" (UniqueName: \"kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.838755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.839026 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.839150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.839211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data\") pod \"068d17c1-6183-44bb-b4d5-a85d497b617e\" (UID: \"068d17c1-6183-44bb-b4d5-a85d497b617e\") " Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.839347 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.840276 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.840546 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.853735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts" (OuterVolumeSpecName: "scripts") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.853812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8" (OuterVolumeSpecName: "kube-api-access-zwnq8") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "kube-api-access-zwnq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.864686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.872790 5030 generic.go:358] "Generic (PLEG): container finished" podID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerID="571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e" exitCode=137 Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.872992 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerDied","Data":"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e"} Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.873188 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"068d17c1-6183-44bb-b4d5-a85d497b617e","Type":"ContainerDied","Data":"9750410292c5e47cc3aa9a107b52861616c01cba5e4e7a22ba82a60e0540591b"} Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.873221 5030 scope.go:117] "RemoveContainer" containerID="571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.873356 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.874978 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.876164 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-4r2gt" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="registry-server" containerID="cri-o://ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a" gracePeriod=2 Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.909745 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.930698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data" (OuterVolumeSpecName: "config-data") pod "068d17c1-6183-44bb-b4d5-a85d497b617e" (UID: "068d17c1-6183-44bb-b4d5-a85d497b617e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942239 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942278 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwnq8\" (UniqueName: \"kubernetes.io/projected/068d17c1-6183-44bb-b4d5-a85d497b617e-kube-api-access-zwnq8\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942291 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942301 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/068d17c1-6183-44bb-b4d5-a85d497b617e-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942310 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:03 crc kubenswrapper[5030]: I0316 13:42:03.942318 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/068d17c1-6183-44bb-b4d5-a85d497b617e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.022594 5030 scope.go:117] "RemoveContainer" containerID="3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.040503 5030 scope.go:117] "RemoveContainer" containerID="ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.061351 5030 scope.go:117] "RemoveContainer" containerID="6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.076668 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.084114 5030 scope.go:117] "RemoveContainer" containerID="571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.084538 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e\": container with ID starting with 571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e not found: ID does not exist" containerID="571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.084601 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e"} err="failed to get container status \"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e\": rpc error: code = NotFound desc = could not find container \"571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e\": container with ID starting with 571e91f0aa3b5f012e905647b131e5ce699a3aac6903ab68b295a5a00befa42e not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.084623 5030 scope.go:117] "RemoveContainer" containerID="3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.084850 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41\": container with ID starting with 3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41 not found: ID does not exist" containerID="3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.084875 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41"} err="failed to get container status \"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41\": rpc error: code = NotFound desc = could not find container \"3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41\": container with ID starting with 3fa925b602ced9d0283af9eba012e24d598578c5faf46e6cbc97ca2fa7b37d41 not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.084893 5030 scope.go:117] "RemoveContainer" containerID="ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.085152 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c\": container with ID starting with ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c not found: ID does not exist" containerID="ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.085174 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c"} err="failed to get container status \"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c\": rpc error: code = NotFound desc = could not find container \"ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c\": container with ID starting with ec41bd6fed450fd84b739eb114b54e5b8b888373f661f8aec902d8eed974d75c not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.085187 5030 scope.go:117] "RemoveContainer" containerID="6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.085392 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0\": container with ID starting with 6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0 not found: ID does not exist" containerID="6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.085419 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0"} err="failed to get container status \"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0\": rpc error: code = NotFound desc = could not find container \"6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0\": container with ID starting with 6e38370dd6015e093ab3348b367c1eca16b64a8fc129054c308a21a60bbe47c0 not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.219090 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.228735 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.245560 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.248507 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx5dg\" (UniqueName: \"kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg\") pod \"cb374918-459d-4d20-b778-c1744386d86f\" (UID: \"cb374918-459d-4d20-b778-c1744386d86f\") " Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.256044 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg" (OuterVolumeSpecName: "kube-api-access-lx5dg") pod "cb374918-459d-4d20-b778-c1744386d86f" (UID: "cb374918-459d-4d20-b778-c1744386d86f"). InnerVolumeSpecName "kube-api-access-lx5dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.262601 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263742 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="extract-utilities" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263766 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="extract-utilities" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263780 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb374918-459d-4d20-b778-c1744386d86f" containerName="oc" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263786 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb374918-459d-4d20-b778-c1744386d86f" containerName="oc" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263815 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-central-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263820 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-central-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263834 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="proxy-httpd" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="proxy-httpd" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263861 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="extract-content" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263868 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="extract-content" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263878 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="sg-core" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263882 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="sg-core" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263897 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-notification-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263903 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-notification-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263920 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="registry-server" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.263925 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="registry-server" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264105 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb374918-459d-4d20-b778-c1744386d86f" containerName="oc" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264123 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="sg-core" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264130 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" containerName="registry-server" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264147 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="proxy-httpd" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264155 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-central-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.264161 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" containerName="ceilometer-notification-agent" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.268803 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.268915 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.272915 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.280811 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.351204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjlc6\" (UniqueName: \"kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6\") pod \"63e47614-f8af-4351-9fed-559e69d1caa4\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.351263 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content\") pod \"63e47614-f8af-4351-9fed-559e69d1caa4\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.351656 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities\") pod \"63e47614-f8af-4351-9fed-559e69d1caa4\" (UID: \"63e47614-f8af-4351-9fed-559e69d1caa4\") " Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.352127 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx5dg\" (UniqueName: \"kubernetes.io/projected/cb374918-459d-4d20-b778-c1744386d86f-kube-api-access-lx5dg\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.352762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities" (OuterVolumeSpecName: "utilities") pod "63e47614-f8af-4351-9fed-559e69d1caa4" (UID: "63e47614-f8af-4351-9fed-559e69d1caa4"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.354518 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6" (OuterVolumeSpecName: "kube-api-access-zjlc6") pod "63e47614-f8af-4351-9fed-559e69d1caa4" (UID: "63e47614-f8af-4351-9fed-559e69d1caa4"). InnerVolumeSpecName "kube-api-access-zjlc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.395407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "63e47614-f8af-4351-9fed-559e69d1caa4" (UID: "63e47614-f8af-4351-9fed-559e69d1caa4"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.455114 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.455467 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.455601 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.455838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2rwq\" (UniqueName: \"kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.455908 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.456030 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.456195 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.456458 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.456481 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjlc6\" (UniqueName: \"kubernetes.io/projected/63e47614-f8af-4351-9fed-559e69d1caa4-kube-api-access-zjlc6\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.456495 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/63e47614-f8af-4351-9fed-559e69d1caa4-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558423 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558497 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558541 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558767 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2rwq\" (UniqueName: \"kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.558792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.559885 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.560206 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.563303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.564083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.564100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.564869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.577856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2rwq\" (UniqueName: \"kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq\") pod \"ceilometer-0\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.598841 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.887886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" event={"ID":"cb374918-459d-4d20-b778-c1744386d86f","Type":"ContainerDied","Data":"cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67"} Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.888407 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561142-qkxmz" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.888431 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cee9fdb872eb780a37515f9ce42c25d7745f3fc29b37bf9c3df5547db9eccb67" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.891413 5030 generic.go:358] "Generic (PLEG): container finished" podID="63e47614-f8af-4351-9fed-559e69d1caa4" containerID="ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a" exitCode=0 Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.892368 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-4r2gt" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.892638 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerDied","Data":"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a"} Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.892702 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-4r2gt" event={"ID":"63e47614-f8af-4351-9fed-559e69d1caa4","Type":"ContainerDied","Data":"0080af62c0ec8cb17f84780976400eefb125b78812940f76c5082f0af25bbf15"} Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.892724 5030 scope.go:117] "RemoveContainer" containerID="ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.929834 5030 scope.go:117] "RemoveContainer" containerID="3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.932142 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.938232 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-4r2gt"] Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.965619 5030 scope.go:117] "RemoveContainer" containerID="dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.987365 5030 scope.go:117] "RemoveContainer" containerID="ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.987982 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a\": container with ID starting with ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a not found: ID does not exist" containerID="ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.988018 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a"} err="failed to get container status \"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a\": rpc error: code = NotFound desc = could not find container \"ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a\": container with ID starting with ded500b4fb6a62b9ab374ece5771a18ff517728162e618beb512e55e35cc999a not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.988044 5030 scope.go:117] "RemoveContainer" containerID="3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.988372 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd\": container with ID starting with 3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd not found: ID does not exist" containerID="3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.988410 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd"} err="failed to get container status \"3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd\": rpc error: code = NotFound desc = could not find container \"3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd\": container with ID starting with 3c1bb18faeb8ce15714ac0e2c6de634017460320ec76a9744be1dc6f7952fbcd not found: ID does not exist" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.988440 5030 scope.go:117] "RemoveContainer" containerID="dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9" Mar 16 13:42:04 crc kubenswrapper[5030]: E0316 13:42:04.990445 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9\": container with ID starting with dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9 not found: ID does not exist" containerID="dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9" Mar 16 13:42:04 crc kubenswrapper[5030]: I0316 13:42:04.990476 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9"} err="failed to get container status \"dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9\": rpc error: code = NotFound desc = could not find container \"dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9\": container with ID starting with dff7bcf290775fccb366da2e9b78545ba41f6eb69078223a8aa6eef680252bf9 not found: ID does not exist" Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.003133 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:05 crc kubenswrapper[5030]: W0316 13:42:05.011683 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod034d169a_5b08_4fb2_bb21_e525f87ed6c6.slice/crio-45bd559e07755c8ef495ba7ef026379c92a274547623373a1cab154dc22605f6 WatchSource:0}: Error finding container 45bd559e07755c8ef495ba7ef026379c92a274547623373a1cab154dc22605f6: Status 404 returned error can't find the container with id 45bd559e07755c8ef495ba7ef026379c92a274547623373a1cab154dc22605f6 Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.148972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561136-27rpk"] Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.155952 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561136-27rpk"] Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.903794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerStarted","Data":"ff9b380ac8807411074c646ed6a380151531d59b05b4248766bb04191f7ae693"} Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.903855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerStarted","Data":"45bd559e07755c8ef495ba7ef026379c92a274547623373a1cab154dc22605f6"} Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.957545 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068d17c1-6183-44bb-b4d5-a85d497b617e" path="/var/lib/kubelet/pods/068d17c1-6183-44bb-b4d5-a85d497b617e/volumes" Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.958311 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c25d9b6-5683-44f9-8642-21c83b9d17bc" path="/var/lib/kubelet/pods/3c25d9b6-5683-44f9-8642-21c83b9d17bc/volumes" Mar 16 13:42:05 crc kubenswrapper[5030]: I0316 13:42:05.959048 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e47614-f8af-4351-9fed-559e69d1caa4" path="/var/lib/kubelet/pods/63e47614-f8af-4351-9fed-559e69d1caa4/volumes" Mar 16 13:42:06 crc kubenswrapper[5030]: I0316 13:42:06.918405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerStarted","Data":"9e02d15daf16d1a4be5fff107ed7fb5715062a5c4074cbd2113afbb759334cca"} Mar 16 13:42:07 crc kubenswrapper[5030]: I0316 13:42:07.932422 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerStarted","Data":"19357431b5eca271c4962637a71dacdc3db5b28ee32c6a5f148b2a5f203feec9"} Mar 16 13:42:09 crc kubenswrapper[5030]: I0316 13:42:09.915858 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.337985 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.343104 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.345366 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.346050 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.349156 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.486316 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.488107 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.488309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.488425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.488801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zbs4\" (UniqueName: \"kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.498110 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.501955 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.515925 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.521442 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.525970 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.534989 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.542275 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.562303 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.564647 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.569418 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkh62\" (UniqueName: \"kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591085 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zbs4\" (UniqueName: \"kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591197 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591342 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zzkn\" (UniqueName: \"kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591532 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591589 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591652 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.591680 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.605349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.612111 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.616518 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.626284 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.629863 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zbs4\" (UniqueName: \"kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4\") pod \"nova-cell0-cell-mapping-jvtw7\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.672888 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.675036 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.681607 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.683531 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.687609 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zzkn\" (UniqueName: \"kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694599 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694641 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8m29\" (UniqueName: \"kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694663 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694700 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694727 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.694748 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.695096 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkh62\" (UniqueName: \"kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.695139 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.695258 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.697943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.701142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.701210 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.702809 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.705130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.706979 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.715133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkh62\" (UniqueName: \"kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62\") pod \"nova-metadata-0\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.720357 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zzkn\" (UniqueName: \"kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn\") pod \"nova-api-0\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800094 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8m29\" (UniqueName: \"kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4d7\" (UniqueName: \"kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.800260 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.805583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.817129 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8m29\" (UniqueName: \"kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.818028 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.832968 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.840815 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.898065 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.907514 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.908344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4d7\" (UniqueName: \"kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.908394 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.916158 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.917007 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:10 crc kubenswrapper[5030]: I0316 13:42:10.943011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4d7\" (UniqueName: \"kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7\") pod \"nova-cell1-novncproxy-0\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.073274 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.198262 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.462388 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:11 crc kubenswrapper[5030]: W0316 13:42:11.480387 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6fe6540_57a9_4966_b8be_d28ef4a78ae1.slice/crio-80b2b19ce5fec29322a084412478d8dae51d851275f39edadb9560c5c9496981 WatchSource:0}: Error finding container 80b2b19ce5fec29322a084412478d8dae51d851275f39edadb9560c5c9496981: Status 404 returned error can't find the container with id 80b2b19ce5fec29322a084412478d8dae51d851275f39edadb9560c5c9496981 Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.528088 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.556853 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.564371 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.621298 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.633650 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.637720 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj"] Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.638723 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.638800 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.739479 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.739564 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.739684 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cpv\" (UniqueName: \"kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.739832 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.841596 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.841654 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.841723 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cpv\" (UniqueName: \"kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.841810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.845900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.846306 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.846975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:11 crc kubenswrapper[5030]: I0316 13:42:11.864047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cpv\" (UniqueName: \"kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv\") pod \"nova-cell1-conductor-db-sync-ddtkj\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.019694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerStarted","Data":"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.019983 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerStarted","Data":"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.019996 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerStarted","Data":"80b2b19ce5fec29322a084412478d8dae51d851275f39edadb9560c5c9496981"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.025240 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"da2ca844-11ae-46b7-83f9-09eda9472f35","Type":"ContainerStarted","Data":"2c599a622b1994d59910eb4d20ab3be7721c6595e5f8a20a5a96765694d10c8d"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.025275 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"da2ca844-11ae-46b7-83f9-09eda9472f35","Type":"ContainerStarted","Data":"ac768b00264d429f5fba85a68939472d8cd7fecea4f3871236ec0a95b86dd70f"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.027849 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" event={"ID":"27d88717-e9ce-4276-9521-089e93e1780d","Type":"ContainerStarted","Data":"d90dffc5d783fc6f673a5126c2657459ae109383f1ecf978eeafb1b9e410294d"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.027889 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" event={"ID":"27d88717-e9ce-4276-9521-089e93e1780d","Type":"ContainerStarted","Data":"26cd9908bf024368a88f5edfa463040a2026bb4e69e032f840cc33e03def760b"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.034124 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.0341053159999998 podStartE2EDuration="2.034105316s" podCreationTimestamp="2026-03-16 13:42:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:12.032872538 +0000 UTC m=+2176.432185085" watchObservedRunningTime="2026-03-16 13:42:12.034105316 +0000 UTC m=+2176.433417863" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.035817 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerStarted","Data":"96bd6f780ebbb710a979cc9cb99a17864bae32f2f9e5bed53437cc9175b1a4ba"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.035848 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.043678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerStarted","Data":"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.043812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerStarted","Data":"4b89da682fcf9d1d2639dd6c6c0d88b3020d47a1db0297628b3f6b3a30cfd2b1"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.045685 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c69918af-68d8-43db-8d90-e7fdf358c180","Type":"ContainerStarted","Data":"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.045795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c69918af-68d8-43db-8d90-e7fdf358c180","Type":"ContainerStarted","Data":"5e11c58b683a69db3279f560424969eeedbcf066289ac96018783b55e240a2e4"} Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.051905 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" podStartSLOduration=2.051878806 podStartE2EDuration="2.051878806s" podCreationTimestamp="2026-03-16 13:42:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:12.050185451 +0000 UTC m=+2176.449497998" watchObservedRunningTime="2026-03-16 13:42:12.051878806 +0000 UTC m=+2176.451191354" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.070832 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.070823038 podStartE2EDuration="2.070823038s" podCreationTimestamp="2026-03-16 13:42:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:12.063536162 +0000 UTC m=+2176.462848709" watchObservedRunningTime="2026-03-16 13:42:12.070823038 +0000 UTC m=+2176.470135586" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.088146 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.7726697759999999 podStartE2EDuration="8.088102307s" podCreationTimestamp="2026-03-16 13:42:04 +0000 UTC" firstStartedPulling="2026-03-16 13:42:05.013188401 +0000 UTC m=+2169.412500947" lastFinishedPulling="2026-03-16 13:42:11.328620931 +0000 UTC m=+2175.727933478" observedRunningTime="2026-03-16 13:42:12.08117071 +0000 UTC m=+2176.480483257" watchObservedRunningTime="2026-03-16 13:42:12.088102307 +0000 UTC m=+2176.487414855" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.102819 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.102808768 podStartE2EDuration="2.102808768s" podCreationTimestamp="2026-03-16 13:42:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:12.097270171 +0000 UTC m=+2176.496582718" watchObservedRunningTime="2026-03-16 13:42:12.102808768 +0000 UTC m=+2176.502121316" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.104268 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:12 crc kubenswrapper[5030]: I0316 13:42:12.534153 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj"] Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.060936 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerStarted","Data":"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599"} Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.062635 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" event={"ID":"bf9ba145-a23e-4233-89bd-a5bb7f0b18db","Type":"ContainerStarted","Data":"fb6e3b56880d136108da18abb6d3dfece6c608d840d09ae54190f7bc35bf7801"} Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.062695 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" event={"ID":"bf9ba145-a23e-4233-89bd-a5bb7f0b18db","Type":"ContainerStarted","Data":"593affd99e854a633df2cb0f966fc07b2cde33399ef05de30de9fd0e764e8edb"} Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.080789 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.089028 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:13 crc kubenswrapper[5030]: I0316 13:42:13.098964 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.098954532 podStartE2EDuration="3.098954532s" podCreationTimestamp="2026-03-16 13:42:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:13.095129687 +0000 UTC m=+2177.494442235" watchObservedRunningTime="2026-03-16 13:42:13.098954532 +0000 UTC m=+2177.498267078" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.070855 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="c69918af-68d8-43db-8d90-e7fdf358c180" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548" gracePeriod=30 Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.071572 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-log" containerID="cri-o://91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" gracePeriod=30 Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.071630 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-metadata" containerID="cri-o://cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" gracePeriod=30 Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.619018 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.651240 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" podStartSLOduration=3.651223401 podStartE2EDuration="3.651223401s" podCreationTimestamp="2026-03-16 13:42:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:13.124275598 +0000 UTC m=+2177.523588145" watchObservedRunningTime="2026-03-16 13:42:14.651223401 +0000 UTC m=+2179.050535948" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.663984 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.718923 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle\") pod \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.719202 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs\") pod \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.719272 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data\") pod \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.719520 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkh62\" (UniqueName: \"kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62\") pod \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\" (UID: \"a6fe6540-57a9-4966-b8be-d28ef4a78ae1\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.719748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs" (OuterVolumeSpecName: "logs") pod "a6fe6540-57a9-4966-b8be-d28ef4a78ae1" (UID: "a6fe6540-57a9-4966-b8be-d28ef4a78ae1"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.720062 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.724182 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62" (OuterVolumeSpecName: "kube-api-access-zkh62") pod "a6fe6540-57a9-4966-b8be-d28ef4a78ae1" (UID: "a6fe6540-57a9-4966-b8be-d28ef4a78ae1"). InnerVolumeSpecName "kube-api-access-zkh62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.738515 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a6fe6540-57a9-4966-b8be-d28ef4a78ae1" (UID: "a6fe6540-57a9-4966-b8be-d28ef4a78ae1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.743192 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data" (OuterVolumeSpecName: "config-data") pod "a6fe6540-57a9-4966-b8be-d28ef4a78ae1" (UID: "a6fe6540-57a9-4966-b8be-d28ef4a78ae1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.821471 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data\") pod \"c69918af-68d8-43db-8d90-e7fdf358c180\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.821703 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle\") pod \"c69918af-68d8-43db-8d90-e7fdf358c180\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.822019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4d7\" (UniqueName: \"kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7\") pod \"c69918af-68d8-43db-8d90-e7fdf358c180\" (UID: \"c69918af-68d8-43db-8d90-e7fdf358c180\") " Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.822782 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkh62\" (UniqueName: \"kubernetes.io/projected/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-kube-api-access-zkh62\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.822799 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.822808 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a6fe6540-57a9-4966-b8be-d28ef4a78ae1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.824845 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7" (OuterVolumeSpecName: "kube-api-access-7v4d7") pod "c69918af-68d8-43db-8d90-e7fdf358c180" (UID: "c69918af-68d8-43db-8d90-e7fdf358c180"). InnerVolumeSpecName "kube-api-access-7v4d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.843883 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c69918af-68d8-43db-8d90-e7fdf358c180" (UID: "c69918af-68d8-43db-8d90-e7fdf358c180"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.847417 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data" (OuterVolumeSpecName: "config-data") pod "c69918af-68d8-43db-8d90-e7fdf358c180" (UID: "c69918af-68d8-43db-8d90-e7fdf358c180"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.925896 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.925932 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4d7\" (UniqueName: \"kubernetes.io/projected/c69918af-68d8-43db-8d90-e7fdf358c180-kube-api-access-7v4d7\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:14 crc kubenswrapper[5030]: I0316 13:42:14.925946 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c69918af-68d8-43db-8d90-e7fdf358c180-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.083959 5030 generic.go:358] "Generic (PLEG): container finished" podID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerID="cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" exitCode=0 Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084005 5030 generic.go:358] "Generic (PLEG): container finished" podID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerID="91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" exitCode=143 Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084406 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerDied","Data":"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039"} Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084447 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerDied","Data":"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523"} Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084459 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"a6fe6540-57a9-4966-b8be-d28ef4a78ae1","Type":"ContainerDied","Data":"80b2b19ce5fec29322a084412478d8dae51d851275f39edadb9560c5c9496981"} Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084479 5030 scope.go:117] "RemoveContainer" containerID="cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.084708 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.092007 5030 generic.go:358] "Generic (PLEG): container finished" podID="c69918af-68d8-43db-8d90-e7fdf358c180" containerID="6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548" exitCode=0 Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.092190 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c69918af-68d8-43db-8d90-e7fdf358c180","Type":"ContainerDied","Data":"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548"} Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.092239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"c69918af-68d8-43db-8d90-e7fdf358c180","Type":"ContainerDied","Data":"5e11c58b683a69db3279f560424969eeedbcf066289ac96018783b55e240a2e4"} Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.092346 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.117210 5030 scope.go:117] "RemoveContainer" containerID="91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.129918 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.142999 5030 scope.go:117] "RemoveContainer" containerID="cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" Mar 16 13:42:15 crc kubenswrapper[5030]: E0316 13:42:15.143750 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039\": container with ID starting with cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039 not found: ID does not exist" containerID="cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.143782 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039"} err="failed to get container status \"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039\": rpc error: code = NotFound desc = could not find container \"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039\": container with ID starting with cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039 not found: ID does not exist" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.143803 5030 scope.go:117] "RemoveContainer" containerID="91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" Mar 16 13:42:15 crc kubenswrapper[5030]: E0316 13:42:15.145597 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523\": container with ID starting with 91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523 not found: ID does not exist" containerID="91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.145625 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523"} err="failed to get container status \"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523\": rpc error: code = NotFound desc = could not find container \"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523\": container with ID starting with 91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523 not found: ID does not exist" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.145641 5030 scope.go:117] "RemoveContainer" containerID="cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.146715 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039"} err="failed to get container status \"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039\": rpc error: code = NotFound desc = could not find container \"cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039\": container with ID starting with cedea694432d002e2817d4fa3cc216aa20f7a15cb6a2e77c500b02373e939039 not found: ID does not exist" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.146766 5030 scope.go:117] "RemoveContainer" containerID="91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.147188 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523"} err="failed to get container status \"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523\": rpc error: code = NotFound desc = could not find container \"91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523\": container with ID starting with 91eb59b329f579f45671242cc7c98360585ea33656853a0b9a99ba0abebc1523 not found: ID does not exist" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.147216 5030 scope.go:117] "RemoveContainer" containerID="6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.152457 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.174402 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.187165 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.192691 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193718 5030 scope.go:117] "RemoveContainer" containerID="6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193810 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-log" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193831 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-log" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193869 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69918af-68d8-43db-8d90-e7fdf358c180" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193876 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69918af-68d8-43db-8d90-e7fdf358c180" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193900 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-metadata" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.193906 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-metadata" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.194116 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-metadata" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.194138 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" containerName="nova-metadata-log" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.194149 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c69918af-68d8-43db-8d90-e7fdf358c180" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:42:15 crc kubenswrapper[5030]: E0316 13:42:15.194743 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548\": container with ID starting with 6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548 not found: ID does not exist" containerID="6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.194791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548"} err="failed to get container status \"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548\": rpc error: code = NotFound desc = could not find container \"6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548\": container with ID starting with 6f22e597a255e074db38377f6aee8dda7659b315285ed422ee3eb1d3ef74c548 not found: ID does not exist" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.197796 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.197951 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.200776 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.200999 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.206209 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.213363 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.213471 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.220043 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.220219 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.220369 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.233213 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.233698 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.233734 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.233800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ftr\" (UniqueName: \"kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.233946 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.234045 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.234062 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.234303 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.234540 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qp5z\" (UniqueName: \"kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.234717 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.337593 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.337688 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.337742 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.337772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.337794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ftr\" (UniqueName: \"kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.338138 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.338287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.338319 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.338483 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.338797 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qp5z\" (UniqueName: \"kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.339943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.343430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.343613 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.344519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.345330 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.350675 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.351525 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.351802 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.353006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ftr\" (UniqueName: \"kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr\") pod \"nova-metadata-0\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.355822 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qp5z\" (UniqueName: \"kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z\") pod \"nova-cell1-novncproxy-0\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.540973 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.549118 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.899789 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.960137 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6fe6540-57a9-4966-b8be-d28ef4a78ae1" path="/var/lib/kubelet/pods/a6fe6540-57a9-4966-b8be-d28ef4a78ae1/volumes" Mar 16 13:42:15 crc kubenswrapper[5030]: I0316 13:42:15.960843 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69918af-68d8-43db-8d90-e7fdf358c180" path="/var/lib/kubelet/pods/c69918af-68d8-43db-8d90-e7fdf358c180/volumes" Mar 16 13:42:16 crc kubenswrapper[5030]: I0316 13:42:16.027878 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:16 crc kubenswrapper[5030]: W0316 13:42:16.071508 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf6d0c60_6927_419d_a6da_2e37f9f713f6.slice/crio-3949e4036b61a190215b72b8fd5b7efede76a75e0e0094560d3d4b513317560c WatchSource:0}: Error finding container 3949e4036b61a190215b72b8fd5b7efede76a75e0e0094560d3d4b513317560c: Status 404 returned error can't find the container with id 3949e4036b61a190215b72b8fd5b7efede76a75e0e0094560d3d4b513317560c Mar 16 13:42:16 crc kubenswrapper[5030]: I0316 13:42:16.073807 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:42:16 crc kubenswrapper[5030]: I0316 13:42:16.105938 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerStarted","Data":"60cd04adfd68165fd843f6ba2d99d724f74b85f0fb10d4f8786f0f03d53b1d62"} Mar 16 13:42:16 crc kubenswrapper[5030]: I0316 13:42:16.107962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"bf6d0c60-6927-419d-a6da-2e37f9f713f6","Type":"ContainerStarted","Data":"3949e4036b61a190215b72b8fd5b7efede76a75e0e0094560d3d4b513317560c"} Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.132319 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerStarted","Data":"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732"} Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.132666 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerStarted","Data":"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152"} Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.135265 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"bf6d0c60-6927-419d-a6da-2e37f9f713f6","Type":"ContainerStarted","Data":"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2"} Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.138827 5030 generic.go:358] "Generic (PLEG): container finished" podID="bf9ba145-a23e-4233-89bd-a5bb7f0b18db" containerID="fb6e3b56880d136108da18abb6d3dfece6c608d840d09ae54190f7bc35bf7801" exitCode=0 Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.139197 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" event={"ID":"bf9ba145-a23e-4233-89bd-a5bb7f0b18db","Type":"ContainerDied","Data":"fb6e3b56880d136108da18abb6d3dfece6c608d840d09ae54190f7bc35bf7801"} Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.163704 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.163681022 podStartE2EDuration="2.163681022s" podCreationTimestamp="2026-03-16 13:42:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:17.152558983 +0000 UTC m=+2181.551871530" watchObservedRunningTime="2026-03-16 13:42:17.163681022 +0000 UTC m=+2181.562993570" Mar 16 13:42:17 crc kubenswrapper[5030]: I0316 13:42:17.194915 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.194898177 podStartE2EDuration="2.194898177s" podCreationTimestamp="2026-03-16 13:42:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:17.184799944 +0000 UTC m=+2181.584112511" watchObservedRunningTime="2026-03-16 13:42:17.194898177 +0000 UTC m=+2181.594210715" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.150633 5030 generic.go:358] "Generic (PLEG): container finished" podID="27d88717-e9ce-4276-9521-089e93e1780d" containerID="d90dffc5d783fc6f673a5126c2657459ae109383f1ecf978eeafb1b9e410294d" exitCode=0 Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.150763 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" event={"ID":"27d88717-e9ce-4276-9521-089e93e1780d","Type":"ContainerDied","Data":"d90dffc5d783fc6f673a5126c2657459ae109383f1ecf978eeafb1b9e410294d"} Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.463034 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.511419 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9cpv\" (UniqueName: \"kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv\") pod \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.511873 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts\") pod \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.512171 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data\") pod \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.512247 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle\") pod \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\" (UID: \"bf9ba145-a23e-4233-89bd-a5bb7f0b18db\") " Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.517795 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts" (OuterVolumeSpecName: "scripts") pod "bf9ba145-a23e-4233-89bd-a5bb7f0b18db" (UID: "bf9ba145-a23e-4233-89bd-a5bb7f0b18db"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.527803 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv" (OuterVolumeSpecName: "kube-api-access-x9cpv") pod "bf9ba145-a23e-4233-89bd-a5bb7f0b18db" (UID: "bf9ba145-a23e-4233-89bd-a5bb7f0b18db"). InnerVolumeSpecName "kube-api-access-x9cpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.537254 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data" (OuterVolumeSpecName: "config-data") pod "bf9ba145-a23e-4233-89bd-a5bb7f0b18db" (UID: "bf9ba145-a23e-4233-89bd-a5bb7f0b18db"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.537496 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf9ba145-a23e-4233-89bd-a5bb7f0b18db" (UID: "bf9ba145-a23e-4233-89bd-a5bb7f0b18db"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.615890 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.615930 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.615944 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9cpv\" (UniqueName: \"kubernetes.io/projected/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-kube-api-access-x9cpv\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:18 crc kubenswrapper[5030]: I0316 13:42:18.615955 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/bf9ba145-a23e-4233-89bd-a5bb7f0b18db-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.165212 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.165254 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj" event={"ID":"bf9ba145-a23e-4233-89bd-a5bb7f0b18db","Type":"ContainerDied","Data":"593affd99e854a633df2cb0f966fc07b2cde33399ef05de30de9fd0e764e8edb"} Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.166336 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="593affd99e854a633df2cb0f966fc07b2cde33399ef05de30de9fd0e764e8edb" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.227113 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.228115 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9ba145-a23e-4233-89bd-a5bb7f0b18db" containerName="nova-cell1-conductor-db-sync" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.228136 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9ba145-a23e-4233-89bd-a5bb7f0b18db" containerName="nova-cell1-conductor-db-sync" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.228291 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf9ba145-a23e-4233-89bd-a5bb7f0b18db" containerName="nova-cell1-conductor-db-sync" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.233041 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.235540 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.246056 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.330007 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.330348 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.330493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.432724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.433077 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.433482 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.440104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.440647 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.450321 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9\") pod \"nova-cell1-conductor-0\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.487408 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.534619 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data\") pod \"27d88717-e9ce-4276-9521-089e93e1780d\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.534798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle\") pod \"27d88717-e9ce-4276-9521-089e93e1780d\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.534848 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts\") pod \"27d88717-e9ce-4276-9521-089e93e1780d\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.535394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zbs4\" (UniqueName: \"kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4\") pod \"27d88717-e9ce-4276-9521-089e93e1780d\" (UID: \"27d88717-e9ce-4276-9521-089e93e1780d\") " Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.539978 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4" (OuterVolumeSpecName: "kube-api-access-8zbs4") pod "27d88717-e9ce-4276-9521-089e93e1780d" (UID: "27d88717-e9ce-4276-9521-089e93e1780d"). InnerVolumeSpecName "kube-api-access-8zbs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.540181 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts" (OuterVolumeSpecName: "scripts") pod "27d88717-e9ce-4276-9521-089e93e1780d" (UID: "27d88717-e9ce-4276-9521-089e93e1780d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.552378 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.558385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "27d88717-e9ce-4276-9521-089e93e1780d" (UID: "27d88717-e9ce-4276-9521-089e93e1780d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.558752 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data" (OuterVolumeSpecName: "config-data") pod "27d88717-e9ce-4276-9521-089e93e1780d" (UID: "27d88717-e9ce-4276-9521-089e93e1780d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.637964 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zbs4\" (UniqueName: \"kubernetes.io/projected/27d88717-e9ce-4276-9521-089e93e1780d-kube-api-access-8zbs4\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.637993 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.638005 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.638013 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/27d88717-e9ce-4276-9521-089e93e1780d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:19 crc kubenswrapper[5030]: W0316 13:42:19.947977 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71389c0e_fb3c_4255_8333_717584f0dae9.slice/crio-15e4c3dd9c3adea99489e69e322811feb0fef5d4330e53963397229312c4e4f5 WatchSource:0}: Error finding container 15e4c3dd9c3adea99489e69e322811feb0fef5d4330e53963397229312c4e4f5: Status 404 returned error can't find the container with id 15e4c3dd9c3adea99489e69e322811feb0fef5d4330e53963397229312c4e4f5 Mar 16 13:42:19 crc kubenswrapper[5030]: I0316 13:42:19.955892 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.175653 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71389c0e-fb3c-4255-8333-717584f0dae9","Type":"ContainerStarted","Data":"77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69"} Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.175702 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71389c0e-fb3c-4255-8333-717584f0dae9","Type":"ContainerStarted","Data":"15e4c3dd9c3adea99489e69e322811feb0fef5d4330e53963397229312c4e4f5"} Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.175737 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.179620 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.179703 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7" event={"ID":"27d88717-e9ce-4276-9521-089e93e1780d","Type":"ContainerDied","Data":"26cd9908bf024368a88f5edfa463040a2026bb4e69e032f840cc33e03def760b"} Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.179759 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26cd9908bf024368a88f5edfa463040a2026bb4e69e032f840cc33e03def760b" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.190099 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=1.190078698 podStartE2EDuration="1.190078698s" podCreationTimestamp="2026-03-16 13:42:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:20.189056325 +0000 UTC m=+2184.588368873" watchObservedRunningTime="2026-03-16 13:42:20.190078698 +0000 UTC m=+2184.589391245" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.356998 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.357305 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-log" containerID="cri-o://35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" gracePeriod=30 Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.357334 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-api" containerID="cri-o://d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" gracePeriod=30 Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.374850 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.375478 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="da2ca844-11ae-46b7-83f9-09eda9472f35" containerName="nova-scheduler-scheduler" containerID="cri-o://2c599a622b1994d59910eb4d20ab3be7721c6595e5f8a20a5a96765694d10c8d" gracePeriod=30 Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.407921 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.408227 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-log" containerID="cri-o://9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" gracePeriod=30 Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.408418 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-metadata" containerID="cri-o://da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" gracePeriod=30 Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.550043 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.882796 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.912688 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967219 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle\") pod \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967273 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data\") pod \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967296 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs\") pod \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967331 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2ftr\" (UniqueName: \"kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr\") pod \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967457 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle\") pod \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.967646 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zzkn\" (UniqueName: \"kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn\") pod \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.968821 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs\") pod \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.968876 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs\") pod \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\" (UID: \"9a58892d-3fe3-462a-8e65-44f0059f0d1c\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.969309 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data\") pod \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\" (UID: \"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f\") " Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.968382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs" (OuterVolumeSpecName: "logs") pod "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" (UID: "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.969778 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs" (OuterVolumeSpecName: "logs") pod "9a58892d-3fe3-462a-8e65-44f0059f0d1c" (UID: "9a58892d-3fe3-462a-8e65-44f0059f0d1c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.970361 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9a58892d-3fe3-462a-8e65-44f0059f0d1c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.970375 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.974818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn" (OuterVolumeSpecName: "kube-api-access-2zzkn") pod "9a58892d-3fe3-462a-8e65-44f0059f0d1c" (UID: "9a58892d-3fe3-462a-8e65-44f0059f0d1c"). InnerVolumeSpecName "kube-api-access-2zzkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.974961 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr" (OuterVolumeSpecName: "kube-api-access-f2ftr") pod "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" (UID: "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f"). InnerVolumeSpecName "kube-api-access-f2ftr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.991774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9a58892d-3fe3-462a-8e65-44f0059f0d1c" (UID: "9a58892d-3fe3-462a-8e65-44f0059f0d1c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.995752 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" (UID: "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:20 crc kubenswrapper[5030]: I0316 13:42:20.996677 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data" (OuterVolumeSpecName: "config-data") pod "9a58892d-3fe3-462a-8e65-44f0059f0d1c" (UID: "9a58892d-3fe3-462a-8e65-44f0059f0d1c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.001729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data" (OuterVolumeSpecName: "config-data") pod "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" (UID: "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.015365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" (UID: "e0e7f41e-ee7b-42ff-b40e-502f0c269a4f"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081091 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081125 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081141 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9a58892d-3fe3-462a-8e65-44f0059f0d1c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081151 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2ftr\" (UniqueName: \"kubernetes.io/projected/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-kube-api-access-f2ftr\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081163 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081173 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zzkn\" (UniqueName: \"kubernetes.io/projected/9a58892d-3fe3-462a-8e65-44f0059f0d1c-kube-api-access-2zzkn\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.081182 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203107 5030 generic.go:358] "Generic (PLEG): container finished" podID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerID="d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" exitCode=0 Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203137 5030 generic.go:358] "Generic (PLEG): container finished" podID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerID="35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" exitCode=143 Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203543 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerDied","Data":"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203596 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerDied","Data":"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203607 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"9a58892d-3fe3-462a-8e65-44f0059f0d1c","Type":"ContainerDied","Data":"4b89da682fcf9d1d2639dd6c6c0d88b3020d47a1db0297628b3f6b3a30cfd2b1"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203623 5030 scope.go:117] "RemoveContainer" containerID="d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.203759 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207875 5030 generic.go:358] "Generic (PLEG): container finished" podID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerID="da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" exitCode=0 Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207902 5030 generic.go:358] "Generic (PLEG): container finished" podID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerID="9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" exitCode=143 Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerDied","Data":"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207955 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerDied","Data":"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.207986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"e0e7f41e-ee7b-42ff-b40e-502f0c269a4f","Type":"ContainerDied","Data":"60cd04adfd68165fd843f6ba2d99d724f74b85f0fb10d4f8786f0f03d53b1d62"} Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.233968 5030 scope.go:117] "RemoveContainer" containerID="35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.253216 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.269648 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.273749 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.276226 5030 scope.go:117] "RemoveContainer" containerID="d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.281797 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: E0316 13:42:21.282603 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599\": container with ID starting with d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599 not found: ID does not exist" containerID="d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282638 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599"} err="failed to get container status \"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599\": rpc error: code = NotFound desc = could not find container \"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599\": container with ID starting with d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282664 5030 scope.go:117] "RemoveContainer" containerID="35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282881 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-log" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282902 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-log" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282917 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d88717-e9ce-4276-9521-089e93e1780d" containerName="nova-manage" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282924 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d88717-e9ce-4276-9521-089e93e1780d" containerName="nova-manage" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282938 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-metadata" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282944 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-metadata" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282985 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-api" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.282993 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-api" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283007 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-log" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283013 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-log" Mar 16 13:42:21 crc kubenswrapper[5030]: E0316 13:42:21.283025 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8\": container with ID starting with 35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8 not found: ID does not exist" containerID="35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283043 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8"} err="failed to get container status \"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8\": rpc error: code = NotFound desc = could not find container \"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8\": container with ID starting with 35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283056 5030 scope.go:117] "RemoveContainer" containerID="d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283168 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-metadata" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283180 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-api" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283188 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" containerName="nova-api-log" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283193 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" containerName="nova-metadata-log" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283201 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="27d88717-e9ce-4276-9521-089e93e1780d" containerName="nova-manage" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599"} err="failed to get container status \"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599\": rpc error: code = NotFound desc = could not find container \"d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599\": container with ID starting with d337c0388629dd1e0827971425ca49fa345e48a05b03e630c4f6bebccc2b5599 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.283814 5030 scope.go:117] "RemoveContainer" containerID="35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.284694 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8"} err="failed to get container status \"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8\": rpc error: code = NotFound desc = could not find container \"35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8\": container with ID starting with 35860971ad3d00d0172d86f29d08d31b0c91416de947b3139cf9949c0a21d8e8 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.284715 5030 scope.go:117] "RemoveContainer" containerID="da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.287374 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.290293 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.297443 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.302369 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.309526 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.317675 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.317803 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.319827 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.320720 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.328502 5030 scope.go:117] "RemoveContainer" containerID="9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.348367 5030 scope.go:117] "RemoveContainer" containerID="da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" Mar 16 13:42:21 crc kubenswrapper[5030]: E0316 13:42:21.348818 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732\": container with ID starting with da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732 not found: ID does not exist" containerID="da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.348847 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732"} err="failed to get container status \"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732\": rpc error: code = NotFound desc = could not find container \"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732\": container with ID starting with da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.348867 5030 scope.go:117] "RemoveContainer" containerID="9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" Mar 16 13:42:21 crc kubenswrapper[5030]: E0316 13:42:21.349243 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152\": container with ID starting with 9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152 not found: ID does not exist" containerID="9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.349340 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152"} err="failed to get container status \"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152\": rpc error: code = NotFound desc = could not find container \"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152\": container with ID starting with 9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.349450 5030 scope.go:117] "RemoveContainer" containerID="da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.349835 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732"} err="failed to get container status \"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732\": rpc error: code = NotFound desc = could not find container \"da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732\": container with ID starting with da9451462dcc9a25566050f4cd223b78cd638ca914c70fe565c0c778c19b6732 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.349873 5030 scope.go:117] "RemoveContainer" containerID="9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.350100 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152"} err="failed to get container status \"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152\": rpc error: code = NotFound desc = could not find container \"9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152\": container with ID starting with 9fb085c566f0f61acfa849fc5206f65ae19faf23051e59bb0bfe660010e52152 not found: ID does not exist" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395715 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8pr\" (UniqueName: \"kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395816 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395840 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.395863 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.396223 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.396656 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.396784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2jn4\" (UniqueName: \"kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.422330 5030 scope.go:117] "RemoveContainer" containerID="c5ad0a40ecf2f3795ace418338b0033f5e62f93495aad56ca7d364639a66358b" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.481382 5030 scope.go:117] "RemoveContainer" containerID="7b25dab5240b95806825988fa0fd9a1ddecc967ec3ed3dada714d55b6c397036" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.499595 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.499694 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2jn4\" (UniqueName: \"kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.499772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.499800 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8pr\" (UniqueName: \"kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.499819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500027 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500122 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500412 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500443 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.500976 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.506420 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.506966 5030 scope.go:117] "RemoveContainer" containerID="7d17f24d949dd1bc68b4d3666daa243dd4da7b8e0ea98877dd427d30f0a09db4" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.507049 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.513432 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.514145 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.514415 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.516726 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8pr\" (UniqueName: \"kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr\") pod \"nova-api-0\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.517473 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2jn4\" (UniqueName: \"kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4\") pod \"nova-metadata-0\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.582675 5030 scope.go:117] "RemoveContainer" containerID="c4af88105e395719e57752a2f391be7f4698fb9cbfa0fbe832f4df3e9e341c4d" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.607724 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.631478 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.688677 5030 scope.go:117] "RemoveContainer" containerID="05be438c16f7cc07d73c9be8416a3e11f04cd9ea225c0144382e579b01b4c86e" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.759874 5030 scope.go:117] "RemoveContainer" containerID="6698db1ac1ffaf2b90b75b486edce322016be4998065142387f0f7df8f1dafc2" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.788085 5030 scope.go:117] "RemoveContainer" containerID="b83caba6a6863ca924241e3545d0c5847ba3a0bd980d807936d043745b7ae405" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.808663 5030 scope.go:117] "RemoveContainer" containerID="f9d562705a940bffc1836315cdc77a47960b337a18d9ee1f0ad1f5b38b626d2c" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.852471 5030 scope.go:117] "RemoveContainer" containerID="7e26dcce3440baf9597675468ed929ce100b008d1eaa17bb63c61610d7027a4d" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.871864 5030 scope.go:117] "RemoveContainer" containerID="6ce3cc876201e249e535661657085f98810d891a457e25b4fee73d15d538879d" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.894781 5030 scope.go:117] "RemoveContainer" containerID="13110cdb63d56fbb62e52fd6f4186e652404c75a8b4553668cc03dcbe9902002" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.931102 5030 scope.go:117] "RemoveContainer" containerID="a8336322caa38223b2d6e94a98fe9b4f9aae4283000f9ce1794ad4a68e41d1bb" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.958653 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a58892d-3fe3-462a-8e65-44f0059f0d1c" path="/var/lib/kubelet/pods/9a58892d-3fe3-462a-8e65-44f0059f0d1c/volumes" Mar 16 13:42:21 crc kubenswrapper[5030]: I0316 13:42:21.959425 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0e7f41e-ee7b-42ff-b40e-502f0c269a4f" path="/var/lib/kubelet/pods/e0e7f41e-ee7b-42ff-b40e-502f0c269a4f/volumes" Mar 16 13:42:22 crc kubenswrapper[5030]: I0316 13:42:22.160524 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:22 crc kubenswrapper[5030]: W0316 13:42:22.167128 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod115ed59d_059b_4190_b298_41fe54ea4cf2.slice/crio-3484e989eb38227528e7369d886bc80f5618d3d75e4ac52ce9f715f0849c6fa9 WatchSource:0}: Error finding container 3484e989eb38227528e7369d886bc80f5618d3d75e4ac52ce9f715f0849c6fa9: Status 404 returned error can't find the container with id 3484e989eb38227528e7369d886bc80f5618d3d75e4ac52ce9f715f0849c6fa9 Mar 16 13:42:22 crc kubenswrapper[5030]: I0316 13:42:22.203486 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:22 crc kubenswrapper[5030]: W0316 13:42:22.204762 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0c526c3_9976_477d_ba96_d0bb3af76307.slice/crio-9b47fe3794584956594bdecc080e083389a5a0088ea640fc3bb04dbfb3e43f21 WatchSource:0}: Error finding container 9b47fe3794584956594bdecc080e083389a5a0088ea640fc3bb04dbfb3e43f21: Status 404 returned error can't find the container with id 9b47fe3794584956594bdecc080e083389a5a0088ea640fc3bb04dbfb3e43f21 Mar 16 13:42:22 crc kubenswrapper[5030]: I0316 13:42:22.223602 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerStarted","Data":"3484e989eb38227528e7369d886bc80f5618d3d75e4ac52ce9f715f0849c6fa9"} Mar 16 13:42:22 crc kubenswrapper[5030]: I0316 13:42:22.225172 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerStarted","Data":"9b47fe3794584956594bdecc080e083389a5a0088ea640fc3bb04dbfb3e43f21"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.248944 5030 generic.go:358] "Generic (PLEG): container finished" podID="da2ca844-11ae-46b7-83f9-09eda9472f35" containerID="2c599a622b1994d59910eb4d20ab3be7721c6595e5f8a20a5a96765694d10c8d" exitCode=0 Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.249018 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"da2ca844-11ae-46b7-83f9-09eda9472f35","Type":"ContainerDied","Data":"2c599a622b1994d59910eb4d20ab3be7721c6595e5f8a20a5a96765694d10c8d"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.252563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerStarted","Data":"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.252632 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerStarted","Data":"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.256982 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerStarted","Data":"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.257012 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerStarted","Data":"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e"} Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.272291 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.272267662 podStartE2EDuration="2.272267662s" podCreationTimestamp="2026-03-16 13:42:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:23.270722326 +0000 UTC m=+2187.670034872" watchObservedRunningTime="2026-03-16 13:42:23.272267662 +0000 UTC m=+2187.671580209" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.292463 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.292450513 podStartE2EDuration="2.292450513s" podCreationTimestamp="2026-03-16 13:42:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:23.284745872 +0000 UTC m=+2187.684058419" watchObservedRunningTime="2026-03-16 13:42:23.292450513 +0000 UTC m=+2187.691763060" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.308695 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.452181 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8m29\" (UniqueName: \"kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29\") pod \"da2ca844-11ae-46b7-83f9-09eda9472f35\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.452803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle\") pod \"da2ca844-11ae-46b7-83f9-09eda9472f35\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.452945 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data\") pod \"da2ca844-11ae-46b7-83f9-09eda9472f35\" (UID: \"da2ca844-11ae-46b7-83f9-09eda9472f35\") " Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.460957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29" (OuterVolumeSpecName: "kube-api-access-k8m29") pod "da2ca844-11ae-46b7-83f9-09eda9472f35" (UID: "da2ca844-11ae-46b7-83f9-09eda9472f35"). InnerVolumeSpecName "kube-api-access-k8m29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.477450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "da2ca844-11ae-46b7-83f9-09eda9472f35" (UID: "da2ca844-11ae-46b7-83f9-09eda9472f35"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.479081 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data" (OuterVolumeSpecName: "config-data") pod "da2ca844-11ae-46b7-83f9-09eda9472f35" (UID: "da2ca844-11ae-46b7-83f9-09eda9472f35"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.555063 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8m29\" (UniqueName: \"kubernetes.io/projected/da2ca844-11ae-46b7-83f9-09eda9472f35-kube-api-access-k8m29\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.555110 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:23 crc kubenswrapper[5030]: I0316 13:42:23.555122 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/da2ca844-11ae-46b7-83f9-09eda9472f35-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.272264 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.272270 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"da2ca844-11ae-46b7-83f9-09eda9472f35","Type":"ContainerDied","Data":"ac768b00264d429f5fba85a68939472d8cd7fecea4f3871236ec0a95b86dd70f"} Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.272390 5030 scope.go:117] "RemoveContainer" containerID="2c599a622b1994d59910eb4d20ab3be7721c6595e5f8a20a5a96765694d10c8d" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.296993 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.302679 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.308080 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.309329 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2ca844-11ae-46b7-83f9-09eda9472f35" containerName="nova-scheduler-scheduler" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.309359 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2ca844-11ae-46b7-83f9-09eda9472f35" containerName="nova-scheduler-scheduler" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.309568 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="da2ca844-11ae-46b7-83f9-09eda9472f35" containerName="nova-scheduler-scheduler" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.313245 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.316054 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.319853 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.476687 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghsz\" (UniqueName: \"kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.476780 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.477284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.578848 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.578979 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.579117 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rghsz\" (UniqueName: \"kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.585086 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.585779 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.594569 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghsz\" (UniqueName: \"kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz\") pod \"nova-scheduler-0\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:24 crc kubenswrapper[5030]: I0316 13:42:24.636667 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.053258 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:25 crc kubenswrapper[5030]: W0316 13:42:25.053759 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaf2c9f2_6544_4e59_9954_ec50a26e2b12.slice/crio-707af33977a206c320963175fca24c5195dcd49375f6b36b55a8e666441c8914 WatchSource:0}: Error finding container 707af33977a206c320963175fca24c5195dcd49375f6b36b55a8e666441c8914: Status 404 returned error can't find the container with id 707af33977a206c320963175fca24c5195dcd49375f6b36b55a8e666441c8914 Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.286748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaf2c9f2-6544-4e59-9954-ec50a26e2b12","Type":"ContainerStarted","Data":"1ca892203cf9e8fd5632e65927f5469d8c6fc407bae5c0b3c7132169fb101fc1"} Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.286815 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaf2c9f2-6544-4e59-9954-ec50a26e2b12","Type":"ContainerStarted","Data":"707af33977a206c320963175fca24c5195dcd49375f6b36b55a8e666441c8914"} Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.302770 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.30275016 podStartE2EDuration="1.30275016s" podCreationTimestamp="2026-03-16 13:42:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:25.301737705 +0000 UTC m=+2189.701050243" watchObservedRunningTime="2026-03-16 13:42:25.30275016 +0000 UTC m=+2189.702062707" Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.550128 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.569190 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:25 crc kubenswrapper[5030]: I0316 13:42:25.960281 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2ca844-11ae-46b7-83f9-09eda9472f35" path="/var/lib/kubelet/pods/da2ca844-11ae-46b7-83f9-09eda9472f35/volumes" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.234413 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.310439 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.671742 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws"] Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.676403 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.677364 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws"] Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.678153 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.679099 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.823574 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.823901 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.823943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.824054 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzl74\" (UniqueName: \"kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.925476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.925528 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.925780 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.926211 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzl74\" (UniqueName: \"kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.932587 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.936738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.938137 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.943917 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzl74\" (UniqueName: \"kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74\") pod \"nova-cell1-cell-mapping-h8fws\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:26 crc kubenswrapper[5030]: I0316 13:42:26.998524 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:27 crc kubenswrapper[5030]: I0316 13:42:27.407755 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws"] Mar 16 13:42:28 crc kubenswrapper[5030]: I0316 13:42:28.329225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" event={"ID":"8315e216-17a2-41dd-a1ab-e0837916253e","Type":"ContainerStarted","Data":"25d4d552e6dcf52423705906ef532e5a2cc367ee50e9b3b20b7e987d00d8a649"} Mar 16 13:42:28 crc kubenswrapper[5030]: I0316 13:42:28.329539 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" event={"ID":"8315e216-17a2-41dd-a1ab-e0837916253e","Type":"ContainerStarted","Data":"edcd209d3495455629dccd24d0709240011714ff41f73fc80b31eb665c15ca17"} Mar 16 13:42:28 crc kubenswrapper[5030]: I0316 13:42:28.345306 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" podStartSLOduration=2.345290639 podStartE2EDuration="2.345290639s" podCreationTimestamp="2026-03-16 13:42:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:28.338800833 +0000 UTC m=+2192.738113380" watchObservedRunningTime="2026-03-16 13:42:28.345290639 +0000 UTC m=+2192.744603186" Mar 16 13:42:29 crc kubenswrapper[5030]: I0316 13:42:29.637790 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:31 crc kubenswrapper[5030]: I0316 13:42:31.608620 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:31 crc kubenswrapper[5030]: I0316 13:42:31.609048 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:31 crc kubenswrapper[5030]: I0316 13:42:31.631927 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:31 crc kubenswrapper[5030]: I0316 13:42:31.632072 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.372063 5030 generic.go:358] "Generic (PLEG): container finished" podID="8315e216-17a2-41dd-a1ab-e0837916253e" containerID="25d4d552e6dcf52423705906ef532e5a2cc367ee50e9b3b20b7e987d00d8a649" exitCode=0 Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.372257 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" event={"ID":"8315e216-17a2-41dd-a1ab-e0837916253e","Type":"ContainerDied","Data":"25d4d552e6dcf52423705906ef532e5a2cc367ee50e9b3b20b7e987d00d8a649"} Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.637727 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.130:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.638826 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.130:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.650715 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.129:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:32 crc kubenswrapper[5030]: I0316 13:42:32.651099 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.129:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.708025 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.766633 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle\") pod \"8315e216-17a2-41dd-a1ab-e0837916253e\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.766734 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data\") pod \"8315e216-17a2-41dd-a1ab-e0837916253e\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.766798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzl74\" (UniqueName: \"kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74\") pod \"8315e216-17a2-41dd-a1ab-e0837916253e\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.766896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts\") pod \"8315e216-17a2-41dd-a1ab-e0837916253e\" (UID: \"8315e216-17a2-41dd-a1ab-e0837916253e\") " Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.772085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts" (OuterVolumeSpecName: "scripts") pod "8315e216-17a2-41dd-a1ab-e0837916253e" (UID: "8315e216-17a2-41dd-a1ab-e0837916253e"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.785521 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74" (OuterVolumeSpecName: "kube-api-access-hzl74") pod "8315e216-17a2-41dd-a1ab-e0837916253e" (UID: "8315e216-17a2-41dd-a1ab-e0837916253e"). InnerVolumeSpecName "kube-api-access-hzl74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.790541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data" (OuterVolumeSpecName: "config-data") pod "8315e216-17a2-41dd-a1ab-e0837916253e" (UID: "8315e216-17a2-41dd-a1ab-e0837916253e"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.792462 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8315e216-17a2-41dd-a1ab-e0837916253e" (UID: "8315e216-17a2-41dd-a1ab-e0837916253e"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.869281 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.869314 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.869324 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzl74\" (UniqueName: \"kubernetes.io/projected/8315e216-17a2-41dd-a1ab-e0837916253e-kube-api-access-hzl74\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:33 crc kubenswrapper[5030]: I0316 13:42:33.869335 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8315e216-17a2-41dd-a1ab-e0837916253e-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.393208 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" event={"ID":"8315e216-17a2-41dd-a1ab-e0837916253e","Type":"ContainerDied","Data":"edcd209d3495455629dccd24d0709240011714ff41f73fc80b31eb665c15ca17"} Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.393255 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edcd209d3495455629dccd24d0709240011714ff41f73fc80b31eb665c15ca17" Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.393220 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws" Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.561665 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.562127 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-log" containerID="cri-o://36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e" gracePeriod=30 Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.562252 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-api" containerID="cri-o://634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1" gracePeriod=30 Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.571834 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.572079 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" containerName="nova-scheduler-scheduler" containerID="cri-o://1ca892203cf9e8fd5632e65927f5469d8c6fc407bae5c0b3c7132169fb101fc1" gracePeriod=30 Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.661073 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.661329 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-log" containerID="cri-o://8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72" gracePeriod=30 Mar 16 13:42:34 crc kubenswrapper[5030]: I0316 13:42:34.661403 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-metadata" containerID="cri-o://176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d" gracePeriod=30 Mar 16 13:42:35 crc kubenswrapper[5030]: I0316 13:42:35.405968 5030 generic.go:358] "Generic (PLEG): container finished" podID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerID="8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72" exitCode=143 Mar 16 13:42:35 crc kubenswrapper[5030]: I0316 13:42:35.406054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerDied","Data":"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72"} Mar 16 13:42:35 crc kubenswrapper[5030]: I0316 13:42:35.408216 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerID="36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e" exitCode=143 Mar 16 13:42:35 crc kubenswrapper[5030]: I0316 13:42:35.408300 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerDied","Data":"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e"} Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.421767 5030 generic.go:358] "Generic (PLEG): container finished" podID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" containerID="1ca892203cf9e8fd5632e65927f5469d8c6fc407bae5c0b3c7132169fb101fc1" exitCode=0 Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.421846 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaf2c9f2-6544-4e59-9954-ec50a26e2b12","Type":"ContainerDied","Data":"1ca892203cf9e8fd5632e65927f5469d8c6fc407bae5c0b3c7132169fb101fc1"} Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.512191 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.631456 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rghsz\" (UniqueName: \"kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz\") pod \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.631540 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data\") pod \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.632063 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle\") pod \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\" (UID: \"eaf2c9f2-6544-4e59-9954-ec50a26e2b12\") " Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.639191 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz" (OuterVolumeSpecName: "kube-api-access-rghsz") pod "eaf2c9f2-6544-4e59-9954-ec50a26e2b12" (UID: "eaf2c9f2-6544-4e59-9954-ec50a26e2b12"). InnerVolumeSpecName "kube-api-access-rghsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.658729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eaf2c9f2-6544-4e59-9954-ec50a26e2b12" (UID: "eaf2c9f2-6544-4e59-9954-ec50a26e2b12"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.661380 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data" (OuterVolumeSpecName: "config-data") pod "eaf2c9f2-6544-4e59-9954-ec50a26e2b12" (UID: "eaf2c9f2-6544-4e59-9954-ec50a26e2b12"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.736306 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.736605 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rghsz\" (UniqueName: \"kubernetes.io/projected/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-kube-api-access-rghsz\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:36 crc kubenswrapper[5030]: I0316 13:42:36.736617 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eaf2c9f2-6544-4e59-9954-ec50a26e2b12-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.433595 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.433596 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"eaf2c9f2-6544-4e59-9954-ec50a26e2b12","Type":"ContainerDied","Data":"707af33977a206c320963175fca24c5195dcd49375f6b36b55a8e666441c8914"} Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.433758 5030 scope.go:117] "RemoveContainer" containerID="1ca892203cf9e8fd5632e65927f5469d8c6fc407bae5c0b3c7132169fb101fc1" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.481263 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.507580 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.515742 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517054 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" containerName="nova-scheduler-scheduler" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517072 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" containerName="nova-scheduler-scheduler" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517102 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8315e216-17a2-41dd-a1ab-e0837916253e" containerName="nova-manage" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517108 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8315e216-17a2-41dd-a1ab-e0837916253e" containerName="nova-manage" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517275 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" containerName="nova-scheduler-scheduler" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.517301 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8315e216-17a2-41dd-a1ab-e0837916253e" containerName="nova-manage" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.521534 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.523593 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.524567 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.658696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.658807 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.658874 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr44l\" (UniqueName: \"kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.762262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.762467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.762641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr44l\" (UniqueName: \"kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.769011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.769131 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.779172 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr44l\" (UniqueName: \"kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l\") pod \"nova-scheduler-0\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.839280 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:37 crc kubenswrapper[5030]: I0316 13:42:37.969920 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf2c9f2-6544-4e59-9954-ec50a26e2b12" path="/var/lib/kubelet/pods/eaf2c9f2-6544-4e59-9954-ec50a26e2b12/volumes" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.145856 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.184485 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.275968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2jn4\" (UniqueName: \"kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4\") pod \"115ed59d-059b-4190-b298-41fe54ea4cf2\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276078 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle\") pod \"c0c526c3-9976-477d-ba96-d0bb3af76307\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276133 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data\") pod \"115ed59d-059b-4190-b298-41fe54ea4cf2\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276431 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs\") pod \"115ed59d-059b-4190-b298-41fe54ea4cf2\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs\") pod \"c0c526c3-9976-477d-ba96-d0bb3af76307\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276526 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk8pr\" (UniqueName: \"kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr\") pod \"c0c526c3-9976-477d-ba96-d0bb3af76307\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276652 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs\") pod \"115ed59d-059b-4190-b298-41fe54ea4cf2\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle\") pod \"115ed59d-059b-4190-b298-41fe54ea4cf2\" (UID: \"115ed59d-059b-4190-b298-41fe54ea4cf2\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.276854 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data\") pod \"c0c526c3-9976-477d-ba96-d0bb3af76307\" (UID: \"c0c526c3-9976-477d-ba96-d0bb3af76307\") " Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.277569 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs" (OuterVolumeSpecName: "logs") pod "115ed59d-059b-4190-b298-41fe54ea4cf2" (UID: "115ed59d-059b-4190-b298-41fe54ea4cf2"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.277541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs" (OuterVolumeSpecName: "logs") pod "c0c526c3-9976-477d-ba96-d0bb3af76307" (UID: "c0c526c3-9976-477d-ba96-d0bb3af76307"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.278350 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c0c526c3-9976-477d-ba96-d0bb3af76307-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.278386 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/115ed59d-059b-4190-b298-41fe54ea4cf2-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.283334 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4" (OuterVolumeSpecName: "kube-api-access-l2jn4") pod "115ed59d-059b-4190-b298-41fe54ea4cf2" (UID: "115ed59d-059b-4190-b298-41fe54ea4cf2"). InnerVolumeSpecName "kube-api-access-l2jn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.283486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr" (OuterVolumeSpecName: "kube-api-access-lk8pr") pod "c0c526c3-9976-477d-ba96-d0bb3af76307" (UID: "c0c526c3-9976-477d-ba96-d0bb3af76307"). InnerVolumeSpecName "kube-api-access-lk8pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.311220 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data" (OuterVolumeSpecName: "config-data") pod "c0c526c3-9976-477d-ba96-d0bb3af76307" (UID: "c0c526c3-9976-477d-ba96-d0bb3af76307"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.311663 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c0c526c3-9976-477d-ba96-d0bb3af76307" (UID: "c0c526c3-9976-477d-ba96-d0bb3af76307"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.313208 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "115ed59d-059b-4190-b298-41fe54ea4cf2" (UID: "115ed59d-059b-4190-b298-41fe54ea4cf2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.313910 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data" (OuterVolumeSpecName: "config-data") pod "115ed59d-059b-4190-b298-41fe54ea4cf2" (UID: "115ed59d-059b-4190-b298-41fe54ea4cf2"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.328976 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "115ed59d-059b-4190-b298-41fe54ea4cf2" (UID: "115ed59d-059b-4190-b298-41fe54ea4cf2"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.342280 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381095 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381135 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk8pr\" (UniqueName: \"kubernetes.io/projected/c0c526c3-9976-477d-ba96-d0bb3af76307-kube-api-access-lk8pr\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381148 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381161 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381174 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2jn4\" (UniqueName: \"kubernetes.io/projected/115ed59d-059b-4190-b298-41fe54ea4cf2-kube-api-access-l2jn4\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381184 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c0c526c3-9976-477d-ba96-d0bb3af76307-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.381194 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/115ed59d-059b-4190-b298-41fe54ea4cf2-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.448191 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7207a47f-803a-426c-9c9a-40979efab6e6","Type":"ContainerStarted","Data":"3e8bd04965bbdc1e61f5dc51e9669a722bb949657d35b3e20c368bfe5caa13aa"} Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.451439 5030 generic.go:358] "Generic (PLEG): container finished" podID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerID="176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d" exitCode=0 Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.451534 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerDied","Data":"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d"} Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.451583 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"115ed59d-059b-4190-b298-41fe54ea4cf2","Type":"ContainerDied","Data":"3484e989eb38227528e7369d886bc80f5618d3d75e4ac52ce9f715f0849c6fa9"} Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.451596 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.451610 5030 scope.go:117] "RemoveContainer" containerID="176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.454775 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerID="634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1" exitCode=0 Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.454841 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerDied","Data":"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1"} Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.454913 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"c0c526c3-9976-477d-ba96-d0bb3af76307","Type":"ContainerDied","Data":"9b47fe3794584956594bdecc080e083389a5a0088ea640fc3bb04dbfb3e43f21"} Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.454945 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.481524 5030 scope.go:117] "RemoveContainer" containerID="8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.502808 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.510926 5030 scope.go:117] "RemoveContainer" containerID="176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d" Mar 16 13:42:38 crc kubenswrapper[5030]: E0316 13:42:38.511768 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d\": container with ID starting with 176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d not found: ID does not exist" containerID="176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.511839 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d"} err="failed to get container status \"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d\": rpc error: code = NotFound desc = could not find container \"176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d\": container with ID starting with 176fffde1d32aced468db63b74fbd1bdcd3e61716c7cd20ed1ada919a0dfb41d not found: ID does not exist" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.511873 5030 scope.go:117] "RemoveContainer" containerID="8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72" Mar 16 13:42:38 crc kubenswrapper[5030]: E0316 13:42:38.513321 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72\": container with ID starting with 8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72 not found: ID does not exist" containerID="8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.513379 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72"} err="failed to get container status \"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72\": rpc error: code = NotFound desc = could not find container \"8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72\": container with ID starting with 8e9e417a6874d802f0820ee35c63ebfa9e2ba1aa2c4a2d00d318a77119ac2c72 not found: ID does not exist" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.513410 5030 scope.go:117] "RemoveContainer" containerID="634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.522536 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.538609 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.540694 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.545922 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547145 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547160 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547202 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-metadata" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547208 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-metadata" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547237 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547244 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547256 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-api" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547262 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-api" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547457 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547467 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" containerName="nova-api-api" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547487 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-metadata" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.547494 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" containerName="nova-metadata-log" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.549979 5030 scope.go:117] "RemoveContainer" containerID="36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.553414 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.555399 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.555593 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.555795 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.563034 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.567490 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.571304 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.573744 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.592167 5030 scope.go:117] "RemoveContainer" containerID="634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1" Mar 16 13:42:38 crc kubenswrapper[5030]: E0316 13:42:38.592596 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1\": container with ID starting with 634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1 not found: ID does not exist" containerID="634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.592638 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1"} err="failed to get container status \"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1\": rpc error: code = NotFound desc = could not find container \"634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1\": container with ID starting with 634e886850c3a950940bafd95395e846b712fbd126149bfc8abdaca2c9f226d1 not found: ID does not exist" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.592667 5030 scope.go:117] "RemoveContainer" containerID="36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e" Mar 16 13:42:38 crc kubenswrapper[5030]: E0316 13:42:38.592965 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e\": container with ID starting with 36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e not found: ID does not exist" containerID="36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.593068 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e"} err="failed to get container status \"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e\": rpc error: code = NotFound desc = could not find container \"36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e\": container with ID starting with 36376d6ecb6bec06e66068b18b84b1ce73188d1d4c7fe7f65dbf528e0e31115e not found: ID does not exist" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.697274 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.697589 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8kgx\" (UniqueName: \"kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.697768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.697921 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.697990 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.698122 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94kd\" (UniqueName: \"kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.698182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.698281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.698478 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800616 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800692 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800753 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8kgx\" (UniqueName: \"kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800862 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800901 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.800981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j94kd\" (UniqueName: \"kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.801014 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.802284 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.802402 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.806859 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.807093 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.807937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.808310 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.816502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.818834 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8kgx\" (UniqueName: \"kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx\") pod \"nova-api-0\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.819798 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94kd\" (UniqueName: \"kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd\") pod \"nova-metadata-0\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.886464 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:38 crc kubenswrapper[5030]: I0316 13:42:38.894009 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:39 crc kubenswrapper[5030]: W0316 13:42:39.298434 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a23a64e_636b_4ff4_9a65_a0eaf49ed976.slice/crio-2b52db127b85af9bd3445ebf980f8670ef256b981d2d1e0d9ff550cdf1a8a9ac WatchSource:0}: Error finding container 2b52db127b85af9bd3445ebf980f8670ef256b981d2d1e0d9ff550cdf1a8a9ac: Status 404 returned error can't find the container with id 2b52db127b85af9bd3445ebf980f8670ef256b981d2d1e0d9ff550cdf1a8a9ac Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.299889 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:42:39 crc kubenswrapper[5030]: W0316 13:42:39.350255 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7c5f65_64a2_4594_84a6_0d6011daeaaa.slice/crio-e32623527dbb8a59dce180e7728d5c99c739062d633a849b3ec97df3182ee289 WatchSource:0}: Error finding container e32623527dbb8a59dce180e7728d5c99c739062d633a849b3ec97df3182ee289: Status 404 returned error can't find the container with id e32623527dbb8a59dce180e7728d5c99c739062d633a849b3ec97df3182ee289 Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.356159 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.472202 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7207a47f-803a-426c-9c9a-40979efab6e6","Type":"ContainerStarted","Data":"cdce8f133c15f415a7f8b63a9de8e7f1e7a1706eb5a7d5d7432f130398131741"} Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.492244 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerStarted","Data":"e32623527dbb8a59dce180e7728d5c99c739062d633a849b3ec97df3182ee289"} Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.498035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerStarted","Data":"552ce2e9d39a274116813b9f78eb0fe85fff38f8219572ab02922cfc2f225038"} Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.498088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerStarted","Data":"2b52db127b85af9bd3445ebf980f8670ef256b981d2d1e0d9ff550cdf1a8a9ac"} Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.507725 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.50770879 podStartE2EDuration="2.50770879s" podCreationTimestamp="2026-03-16 13:42:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:39.505679723 +0000 UTC m=+2203.904992270" watchObservedRunningTime="2026-03-16 13:42:39.50770879 +0000 UTC m=+2203.907021337" Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.957569 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="115ed59d-059b-4190-b298-41fe54ea4cf2" path="/var/lib/kubelet/pods/115ed59d-059b-4190-b298-41fe54ea4cf2/volumes" Mar 16 13:42:39 crc kubenswrapper[5030]: I0316 13:42:39.958738 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c526c3-9976-477d-ba96-d0bb3af76307" path="/var/lib/kubelet/pods/c0c526c3-9976-477d-ba96-d0bb3af76307/volumes" Mar 16 13:42:40 crc kubenswrapper[5030]: I0316 13:42:40.510828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerStarted","Data":"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59"} Mar 16 13:42:40 crc kubenswrapper[5030]: I0316 13:42:40.510894 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerStarted","Data":"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7"} Mar 16 13:42:40 crc kubenswrapper[5030]: I0316 13:42:40.512980 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerStarted","Data":"300624a2cf3872a049a923a4caa0c93d984c664f0bb2df045a9da29e1aa23a61"} Mar 16 13:42:40 crc kubenswrapper[5030]: I0316 13:42:40.536698 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.536683498 podStartE2EDuration="2.536683498s" podCreationTimestamp="2026-03-16 13:42:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:40.52583789 +0000 UTC m=+2204.925150437" watchObservedRunningTime="2026-03-16 13:42:40.536683498 +0000 UTC m=+2204.935996046" Mar 16 13:42:40 crc kubenswrapper[5030]: I0316 13:42:40.552411 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.552387716 podStartE2EDuration="2.552387716s" podCreationTimestamp="2026-03-16 13:42:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:42:40.543184687 +0000 UTC m=+2204.942497234" watchObservedRunningTime="2026-03-16 13:42:40.552387716 +0000 UTC m=+2204.951700264" Mar 16 13:42:42 crc kubenswrapper[5030]: I0316 13:42:42.839830 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:43 crc kubenswrapper[5030]: I0316 13:42:43.069267 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:46 crc kubenswrapper[5030]: I0316 13:42:46.435690 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:46 crc kubenswrapper[5030]: I0316 13:42:46.436254 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="4ac07f5b-281f-4341-8497-a54bfea788eb" containerName="kube-state-metrics" containerID="cri-o://7f644b8a4de32bc55bc03169b2c043b99ee0b3db8afc08645e8d4e1c6cc776ea" gracePeriod=30 Mar 16 13:42:46 crc kubenswrapper[5030]: I0316 13:42:46.585261 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ac07f5b-281f-4341-8497-a54bfea788eb" containerID="7f644b8a4de32bc55bc03169b2c043b99ee0b3db8afc08645e8d4e1c6cc776ea" exitCode=2 Mar 16 13:42:46 crc kubenswrapper[5030]: I0316 13:42:46.586111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"4ac07f5b-281f-4341-8497-a54bfea788eb","Type":"ContainerDied","Data":"7f644b8a4de32bc55bc03169b2c043b99ee0b3db8afc08645e8d4e1c6cc776ea"} Mar 16 13:42:46 crc kubenswrapper[5030]: I0316 13:42:46.879961 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.001600 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8sfz\" (UniqueName: \"kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz\") pod \"4ac07f5b-281f-4341-8497-a54bfea788eb\" (UID: \"4ac07f5b-281f-4341-8497-a54bfea788eb\") " Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.016742 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz" (OuterVolumeSpecName: "kube-api-access-z8sfz") pod "4ac07f5b-281f-4341-8497-a54bfea788eb" (UID: "4ac07f5b-281f-4341-8497-a54bfea788eb"). InnerVolumeSpecName "kube-api-access-z8sfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.105017 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8sfz\" (UniqueName: \"kubernetes.io/projected/4ac07f5b-281f-4341-8497-a54bfea788eb-kube-api-access-z8sfz\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.603631 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.603636 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"4ac07f5b-281f-4341-8497-a54bfea788eb","Type":"ContainerDied","Data":"948842b165c2054414eb7784818404f6cd1d68c6d13c9a08db78945108a51834"} Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.603733 5030 scope.go:117] "RemoveContainer" containerID="7f644b8a4de32bc55bc03169b2c043b99ee0b3db8afc08645e8d4e1c6cc776ea" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.651654 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.662596 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.673542 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.674665 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac07f5b-281f-4341-8497-a54bfea788eb" containerName="kube-state-metrics" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.674685 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac07f5b-281f-4341-8497-a54bfea788eb" containerName="kube-state-metrics" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.674929 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ac07f5b-281f-4341-8497-a54bfea788eb" containerName="kube-state-metrics" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.678065 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.680042 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.680393 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.683336 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.822129 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.822234 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kxlr\" (UniqueName: \"kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.822344 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.822584 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.840154 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.866040 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.925086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.925270 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.925307 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kxlr\" (UniqueName: \"kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.925326 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.931026 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.931422 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.932594 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.941387 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kxlr\" (UniqueName: \"kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr\") pod \"kube-state-metrics-0\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.961838 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac07f5b-281f-4341-8497-a54bfea788eb" path="/var/lib/kubelet/pods/4ac07f5b-281f-4341-8497-a54bfea788eb/volumes" Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.991991 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.992486 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="sg-core" containerID="cri-o://19357431b5eca271c4962637a71dacdc3db5b28ee32c6a5f148b2a5f203feec9" gracePeriod=30 Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.992504 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="proxy-httpd" containerID="cri-o://96bd6f780ebbb710a979cc9cb99a17864bae32f2f9e5bed53437cc9175b1a4ba" gracePeriod=30 Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.992710 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-notification-agent" containerID="cri-o://9e02d15daf16d1a4be5fff107ed7fb5715062a5c4074cbd2113afbb759334cca" gracePeriod=30 Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.992949 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-central-agent" containerID="cri-o://ff9b380ac8807411074c646ed6a380151531d59b05b4248766bb04191f7ae693" gracePeriod=30 Mar 16 13:42:47 crc kubenswrapper[5030]: I0316 13:42:47.998270 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.402431 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619766 5030 generic.go:358] "Generic (PLEG): container finished" podID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerID="96bd6f780ebbb710a979cc9cb99a17864bae32f2f9e5bed53437cc9175b1a4ba" exitCode=0 Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619801 5030 generic.go:358] "Generic (PLEG): container finished" podID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerID="19357431b5eca271c4962637a71dacdc3db5b28ee32c6a5f148b2a5f203feec9" exitCode=2 Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619808 5030 generic.go:358] "Generic (PLEG): container finished" podID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerID="9e02d15daf16d1a4be5fff107ed7fb5715062a5c4074cbd2113afbb759334cca" exitCode=0 Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619814 5030 generic.go:358] "Generic (PLEG): container finished" podID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerID="ff9b380ac8807411074c646ed6a380151531d59b05b4248766bb04191f7ae693" exitCode=0 Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerDied","Data":"96bd6f780ebbb710a979cc9cb99a17864bae32f2f9e5bed53437cc9175b1a4ba"} Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.619997 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerDied","Data":"19357431b5eca271c4962637a71dacdc3db5b28ee32c6a5f148b2a5f203feec9"} Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.620008 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerDied","Data":"9e02d15daf16d1a4be5fff107ed7fb5715062a5c4074cbd2113afbb759334cca"} Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.620018 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerDied","Data":"ff9b380ac8807411074c646ed6a380151531d59b05b4248766bb04191f7ae693"} Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.621707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d56ee776-82e2-47a2-bd48-74a5e7e64cef","Type":"ContainerStarted","Data":"1fed04a0f1674fb5ec80849a0d5cc80c906b4ac8c978b3eabda4990a7df7fb08"} Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.656340 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.662734 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.851454 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2rwq\" (UniqueName: \"kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852149 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852221 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852424 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852605 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.852690 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd\") pod \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\" (UID: \"034d169a-5b08-4fb2-bb21-e525f87ed6c6\") " Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.853825 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.854939 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.861442 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq" (OuterVolumeSpecName: "kube-api-access-f2rwq") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "kube-api-access-f2rwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.861631 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts" (OuterVolumeSpecName: "scripts") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.884359 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.886609 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.888500 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.894433 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.894480 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.932621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955463 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2rwq\" (UniqueName: \"kubernetes.io/projected/034d169a-5b08-4fb2-bb21-e525f87ed6c6-kube-api-access-f2rwq\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955489 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955499 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955508 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955520 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.955531 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/034d169a-5b08-4fb2-bb21-e525f87ed6c6-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:48 crc kubenswrapper[5030]: I0316 13:42:48.972372 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data" (OuterVolumeSpecName: "config-data") pod "034d169a-5b08-4fb2-bb21-e525f87ed6c6" (UID: "034d169a-5b08-4fb2-bb21-e525f87ed6c6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.059045 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/034d169a-5b08-4fb2-bb21-e525f87ed6c6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.642802 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.642871 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"034d169a-5b08-4fb2-bb21-e525f87ed6c6","Type":"ContainerDied","Data":"45bd559e07755c8ef495ba7ef026379c92a274547623373a1cab154dc22605f6"} Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.643352 5030 scope.go:117] "RemoveContainer" containerID="96bd6f780ebbb710a979cc9cb99a17864bae32f2f9e5bed53437cc9175b1a4ba" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.649544 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d56ee776-82e2-47a2-bd48-74a5e7e64cef","Type":"ContainerStarted","Data":"f03be0fe0f119f339025ec27b7b4a51796f7a20c267b664eeab52715521fcbc0"} Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.649652 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.677541 5030 scope.go:117] "RemoveContainer" containerID="19357431b5eca271c4962637a71dacdc3db5b28ee32c6a5f148b2a5f203feec9" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.680913 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.255465412 podStartE2EDuration="2.680903116s" podCreationTimestamp="2026-03-16 13:42:47 +0000 UTC" firstStartedPulling="2026-03-16 13:42:48.442818127 +0000 UTC m=+2212.842130674" lastFinishedPulling="2026-03-16 13:42:48.868255831 +0000 UTC m=+2213.267568378" observedRunningTime="2026-03-16 13:42:49.668400261 +0000 UTC m=+2214.067712807" watchObservedRunningTime="2026-03-16 13:42:49.680903116 +0000 UTC m=+2214.080215664" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.700376 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.712991 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.720641 5030 scope.go:117] "RemoveContainer" containerID="9e02d15daf16d1a4be5fff107ed7fb5715062a5c4074cbd2113afbb759334cca" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.728741 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729782 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="proxy-httpd" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729801 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="proxy-httpd" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729832 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-central-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-central-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729854 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="sg-core" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729860 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="sg-core" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729882 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-notification-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.729889 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-notification-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.730055 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="proxy-httpd" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.730070 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-central-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.730079 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="ceilometer-notification-agent" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.730096 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" containerName="sg-core" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.735737 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.735842 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.740027 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.740318 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.740471 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.748441 5030 scope.go:117] "RemoveContainer" containerID="ff9b380ac8807411074c646ed6a380151531d59b05b4248766bb04191f7ae693" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.790836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.790921 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.790952 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.791002 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.791025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.791074 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6fvz\" (UniqueName: \"kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.791331 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.791388 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.894118 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.894707 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.0.134:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.895347 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.895852 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.895950 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896006 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896075 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6fvz\" (UniqueName: \"kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896237 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896298 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.896983 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.0.134:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.897183 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.903131 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.905117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.906252 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.908315 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.909880 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.916466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6fvz\" (UniqueName: \"kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz\") pod \"ceilometer-0\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.934713 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.0.135:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.935706 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.0.135:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:42:49 crc kubenswrapper[5030]: I0316 13:42:49.956638 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034d169a-5b08-4fb2-bb21-e525f87ed6c6" path="/var/lib/kubelet/pods/034d169a-5b08-4fb2-bb21-e525f87ed6c6/volumes" Mar 16 13:42:50 crc kubenswrapper[5030]: I0316 13:42:50.065414 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:50 crc kubenswrapper[5030]: I0316 13:42:50.470157 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:42:50 crc kubenswrapper[5030]: I0316 13:42:50.664654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerStarted","Data":"7e201a1f9a46d1964ec67a7d6cb62bbcc111a1719373d5b46fec90e36215fb3b"} Mar 16 13:42:51 crc kubenswrapper[5030]: I0316 13:42:51.677595 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerStarted","Data":"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f"} Mar 16 13:42:52 crc kubenswrapper[5030]: I0316 13:42:52.692375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerStarted","Data":"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787"} Mar 16 13:42:53 crc kubenswrapper[5030]: I0316 13:42:53.714598 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerStarted","Data":"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf"} Mar 16 13:42:54 crc kubenswrapper[5030]: E0316 13:42:54.093075 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763178 actualBytes=10240 Mar 16 13:42:54 crc kubenswrapper[5030]: I0316 13:42:54.287767 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:42:54 crc kubenswrapper[5030]: I0316 13:42:54.288245 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:42:55 crc kubenswrapper[5030]: I0316 13:42:55.742801 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerStarted","Data":"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32"} Mar 16 13:42:55 crc kubenswrapper[5030]: I0316 13:42:55.743356 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:42:55 crc kubenswrapper[5030]: I0316 13:42:55.771164 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.548271107 podStartE2EDuration="6.771146185s" podCreationTimestamp="2026-03-16 13:42:49 +0000 UTC" firstStartedPulling="2026-03-16 13:42:50.471021348 +0000 UTC m=+2214.870333895" lastFinishedPulling="2026-03-16 13:42:54.693896426 +0000 UTC m=+2219.093208973" observedRunningTime="2026-03-16 13:42:55.760513066 +0000 UTC m=+2220.159825612" watchObservedRunningTime="2026-03-16 13:42:55.771146185 +0000 UTC m=+2220.170458742" Mar 16 13:42:56 crc kubenswrapper[5030]: I0316 13:42:56.886638 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:56 crc kubenswrapper[5030]: I0316 13:42:56.887027 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:56 crc kubenswrapper[5030]: I0316 13:42:56.894648 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:56 crc kubenswrapper[5030]: I0316 13:42:56.894685 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.894067 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.897634 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.898337 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.898800 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.899570 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:42:58 crc kubenswrapper[5030]: I0316 13:42:58.900966 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:59 crc kubenswrapper[5030]: I0316 13:42:59.790270 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:42:59 crc kubenswrapper[5030]: I0316 13:42:59.790688 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:43:00 crc kubenswrapper[5030]: I0316 13:43:00.672027 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.462665 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.462980 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-central-agent" containerID="cri-o://ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f" gracePeriod=30 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.463041 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-notification-agent" containerID="cri-o://c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787" gracePeriod=30 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.463078 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="proxy-httpd" containerID="cri-o://df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32" gracePeriod=30 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.463009 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="sg-core" containerID="cri-o://2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf" gracePeriod=30 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.847475 5030 generic.go:358] "Generic (PLEG): container finished" podID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerID="df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32" exitCode=0 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.848268 5030 generic.go:358] "Generic (PLEG): container finished" podID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerID="2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf" exitCode=2 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.848285 5030 generic.go:358] "Generic (PLEG): container finished" podID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerID="ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f" exitCode=0 Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.850939 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerDied","Data":"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32"} Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.850989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerDied","Data":"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf"} Mar 16 13:43:01 crc kubenswrapper[5030]: I0316 13:43:01.851001 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerDied","Data":"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f"} Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.062708 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.404742 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.485997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6fvz\" (UniqueName: \"kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486124 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486197 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486395 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486464 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486542 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.486702 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd\") pod \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\" (UID: \"5aae7fff-aa80-4a6d-97b7-7897d5d07c50\") " Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.487961 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.490385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.495844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts" (OuterVolumeSpecName: "scripts") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.501358 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz" (OuterVolumeSpecName: "kube-api-access-f6fvz") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "kube-api-access-f6fvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.517352 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.540121 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.549779 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.571936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data" (OuterVolumeSpecName: "config-data") pod "5aae7fff-aa80-4a6d-97b7-7897d5d07c50" (UID: "5aae7fff-aa80-4a6d-97b7-7897d5d07c50"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589210 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6fvz\" (UniqueName: \"kubernetes.io/projected/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-kube-api-access-f6fvz\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589330 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589410 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589495 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589617 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589687 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589749 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.589816 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/5aae7fff-aa80-4a6d-97b7-7897d5d07c50-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.862368 5030 generic.go:358] "Generic (PLEG): container finished" podID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerID="c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787" exitCode=0 Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.862740 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-log" containerID="cri-o://36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59" gracePeriod=30 Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.863143 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.865604 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-api" containerID="cri-o://9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7" gracePeriod=30 Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.865680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerDied","Data":"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787"} Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.865716 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"5aae7fff-aa80-4a6d-97b7-7897d5d07c50","Type":"ContainerDied","Data":"7e201a1f9a46d1964ec67a7d6cb62bbcc111a1719373d5b46fec90e36215fb3b"} Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.865741 5030 scope.go:117] "RemoveContainer" containerID="df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.895099 5030 scope.go:117] "RemoveContainer" containerID="2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.915400 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.917307 5030 scope.go:117] "RemoveContainer" containerID="c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.921631 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.934472 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936600 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="sg-core" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936618 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="sg-core" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936676 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="proxy-httpd" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936684 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="proxy-httpd" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936718 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-central-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936724 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-central-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936780 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-notification-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.936787 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-notification-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.937176 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-central-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.937192 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="proxy-httpd" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.937204 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="ceilometer-notification-agent" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.937216 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" containerName="sg-core" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.951370 5030 scope.go:117] "RemoveContainer" containerID="ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.960209 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.963773 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.964083 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.964267 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.966983 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.972733 5030 scope.go:117] "RemoveContainer" containerID="df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32" Mar 16 13:43:02 crc kubenswrapper[5030]: E0316 13:43:02.974223 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32\": container with ID starting with df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32 not found: ID does not exist" containerID="df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974270 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32"} err="failed to get container status \"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32\": rpc error: code = NotFound desc = could not find container \"df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32\": container with ID starting with df440008479d880553712d189212ed37b8c7af82aafcca1df20a9a013b6e2f32 not found: ID does not exist" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974296 5030 scope.go:117] "RemoveContainer" containerID="2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf" Mar 16 13:43:02 crc kubenswrapper[5030]: E0316 13:43:02.974602 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf\": container with ID starting with 2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf not found: ID does not exist" containerID="2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974631 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf"} err="failed to get container status \"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf\": rpc error: code = NotFound desc = could not find container \"2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf\": container with ID starting with 2108786887a2ecf6b9d8a9bd8c734a7a80b9eb0d75dd64aab6db64bca1baa8bf not found: ID does not exist" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974645 5030 scope.go:117] "RemoveContainer" containerID="c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787" Mar 16 13:43:02 crc kubenswrapper[5030]: E0316 13:43:02.974919 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787\": container with ID starting with c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787 not found: ID does not exist" containerID="c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974955 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787"} err="failed to get container status \"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787\": rpc error: code = NotFound desc = could not find container \"c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787\": container with ID starting with c337f11bb5445b8576fcdb2f04c93718961d3fc73fa71935f3fa987969915787 not found: ID does not exist" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.974979 5030 scope.go:117] "RemoveContainer" containerID="ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f" Mar 16 13:43:02 crc kubenswrapper[5030]: E0316 13:43:02.975211 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f\": container with ID starting with ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f not found: ID does not exist" containerID="ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f" Mar 16 13:43:02 crc kubenswrapper[5030]: I0316 13:43:02.975241 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f"} err="failed to get container status \"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f\": rpc error: code = NotFound desc = could not find container \"ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f\": container with ID starting with ba8467894802060a3e96e99d9cc99863af6880034e28b4f4c16653ee1ecfc75f not found: ID does not exist" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.003798 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.003855 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d6p7\" (UniqueName: \"kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.004065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.004311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.004426 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.004475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.004516 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.005123 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.107955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108043 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108094 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108130 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108159 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108188 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6p7\" (UniqueName: \"kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.108899 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.109212 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.114105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.114401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.114613 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.116799 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.118095 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.124032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6p7\" (UniqueName: \"kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7\") pod \"ceilometer-0\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.281142 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.309683 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.729177 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.731104 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.877507 5030 generic.go:358] "Generic (PLEG): container finished" podID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerID="36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59" exitCode=143 Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.878500 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerDied","Data":"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59"} Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.880256 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerStarted","Data":"2a06eb7ffa5c9268fccadb4d400498866a54e6342853ccf69896ba2ac275d20a"} Mar 16 13:43:03 crc kubenswrapper[5030]: I0316 13:43:03.959127 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aae7fff-aa80-4a6d-97b7-7897d5d07c50" path="/var/lib/kubelet/pods/5aae7fff-aa80-4a6d-97b7-7897d5d07c50/volumes" Mar 16 13:43:04 crc kubenswrapper[5030]: I0316 13:43:04.891757 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerStarted","Data":"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3"} Mar 16 13:43:05 crc kubenswrapper[5030]: I0316 13:43:05.903651 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerStarted","Data":"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f"} Mar 16 13:43:05 crc kubenswrapper[5030]: I0316 13:43:05.904054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerStarted","Data":"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2"} Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.411086 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.504370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs\") pod \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.504470 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data\") pod \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.504606 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8kgx\" (UniqueName: \"kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx\") pod \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.505127 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle\") pod \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\" (UID: \"dc7c5f65-64a2-4594-84a6-0d6011daeaaa\") " Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.506450 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs" (OuterVolumeSpecName: "logs") pod "dc7c5f65-64a2-4594-84a6-0d6011daeaaa" (UID: "dc7c5f65-64a2-4594-84a6-0d6011daeaaa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.511441 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx" (OuterVolumeSpecName: "kube-api-access-b8kgx") pod "dc7c5f65-64a2-4594-84a6-0d6011daeaaa" (UID: "dc7c5f65-64a2-4594-84a6-0d6011daeaaa"). InnerVolumeSpecName "kube-api-access-b8kgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.528681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "dc7c5f65-64a2-4594-84a6-0d6011daeaaa" (UID: "dc7c5f65-64a2-4594-84a6-0d6011daeaaa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.537747 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data" (OuterVolumeSpecName: "config-data") pod "dc7c5f65-64a2-4594-84a6-0d6011daeaaa" (UID: "dc7c5f65-64a2-4594-84a6-0d6011daeaaa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.612839 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.612864 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.612874 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8kgx\" (UniqueName: \"kubernetes.io/projected/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-kube-api-access-b8kgx\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.612883 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc7c5f65-64a2-4594-84a6-0d6011daeaaa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.917059 5030 generic.go:358] "Generic (PLEG): container finished" podID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerID="9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7" exitCode=0 Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.917942 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerDied","Data":"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7"} Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.917984 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"dc7c5f65-64a2-4594-84a6-0d6011daeaaa","Type":"ContainerDied","Data":"e32623527dbb8a59dce180e7728d5c99c739062d633a849b3ec97df3182ee289"} Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.918013 5030 scope.go:117] "RemoveContainer" containerID="9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.918186 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.964606 5030 scope.go:117] "RemoveContainer" containerID="36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.965648 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.977826 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.987424 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.988839 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-api" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.988864 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-api" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.988889 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-log" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.988897 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-log" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.989108 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-log" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.989138 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" containerName="nova-api-api" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.993767 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.997172 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:43:06 crc kubenswrapper[5030]: I0316 13:43:06.997436 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:06.997877 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.021959 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.024203 5030 scope.go:117] "RemoveContainer" containerID="9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7" Mar 16 13:43:07 crc kubenswrapper[5030]: E0316 13:43:07.025229 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7\": container with ID starting with 9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7 not found: ID does not exist" containerID="9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.025288 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7"} err="failed to get container status \"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7\": rpc error: code = NotFound desc = could not find container \"9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7\": container with ID starting with 9beb5e208337c5ee06ed660e33e37ace7ecc2ccc9470f484bb5e9049041171a7 not found: ID does not exist" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.025375 5030 scope.go:117] "RemoveContainer" containerID="36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59" Mar 16 13:43:07 crc kubenswrapper[5030]: E0316 13:43:07.026890 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59\": container with ID starting with 36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59 not found: ID does not exist" containerID="36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.026920 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59"} err="failed to get container status \"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59\": rpc error: code = NotFound desc = could not find container \"36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59\": container with ID starting with 36498c988b068165c71f87b330e67ec71150ef70106cc93b142de41136529f59 not found: ID does not exist" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.126625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.129647 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.129797 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.130199 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.130992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llrrb\" (UniqueName: \"kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.131183 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.236284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.237320 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llrrb\" (UniqueName: \"kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.237668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.239801 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.240546 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.240656 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.240732 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.242597 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.244703 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.244839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.245078 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.252141 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llrrb\" (UniqueName: \"kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb\") pod \"nova-api-0\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.326823 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.742269 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:07 crc kubenswrapper[5030]: W0316 13:43:07.744307 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b7e7304_ba88_4264_a982_26ead7f093aa.slice/crio-861c4babab173955c2477a1d2f52f143e9d1346a192f9c35fad04885d0dfc9db WatchSource:0}: Error finding container 861c4babab173955c2477a1d2f52f143e9d1346a192f9c35fad04885d0dfc9db: Status 404 returned error can't find the container with id 861c4babab173955c2477a1d2f52f143e9d1346a192f9c35fad04885d0dfc9db Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.931315 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerStarted","Data":"268d410e123e14d58c7e0979b35e815769b19c15c0191395ddd2dbde5968fdd8"} Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.931369 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerStarted","Data":"861c4babab173955c2477a1d2f52f143e9d1346a192f9c35fad04885d0dfc9db"} Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937272 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerStarted","Data":"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671"} Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937396 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-central-agent" containerID="cri-o://c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3" gracePeriod=30 Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937425 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="sg-core" containerID="cri-o://ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f" gracePeriod=30 Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937503 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-notification-agent" containerID="cri-o://2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2" gracePeriod=30 Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.937451 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="proxy-httpd" containerID="cri-o://162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671" gracePeriod=30 Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.968717 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.196002792 podStartE2EDuration="5.968699291s" podCreationTimestamp="2026-03-16 13:43:02 +0000 UTC" firstStartedPulling="2026-03-16 13:43:03.731269959 +0000 UTC m=+2228.130582506" lastFinishedPulling="2026-03-16 13:43:07.503966468 +0000 UTC m=+2231.903279005" observedRunningTime="2026-03-16 13:43:07.963401678 +0000 UTC m=+2232.362714225" watchObservedRunningTime="2026-03-16 13:43:07.968699291 +0000 UTC m=+2232.368011838" Mar 16 13:43:07 crc kubenswrapper[5030]: I0316 13:43:07.975203 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7c5f65-64a2-4594-84a6-0d6011daeaaa" path="/var/lib/kubelet/pods/dc7c5f65-64a2-4594-84a6-0d6011daeaaa/volumes" Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954076 5030 generic.go:358] "Generic (PLEG): container finished" podID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerID="162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671" exitCode=0 Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954427 5030 generic.go:358] "Generic (PLEG): container finished" podID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerID="ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f" exitCode=2 Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954460 5030 generic.go:358] "Generic (PLEG): container finished" podID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerID="2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2" exitCode=0 Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954150 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerDied","Data":"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671"} Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954537 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerDied","Data":"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f"} Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.954566 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerDied","Data":"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2"} Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.958586 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerStarted","Data":"4cf1dfd8dfb4253e1511ccbdffc0c082d52d97bb71c34f2baae009a01c4a0b42"} Mar 16 13:43:08 crc kubenswrapper[5030]: I0316 13:43:08.981582 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.981544264 podStartE2EDuration="2.981544264s" podCreationTimestamp="2026-03-16 13:43:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:43:08.975595955 +0000 UTC m=+2233.374908512" watchObservedRunningTime="2026-03-16 13:43:08.981544264 +0000 UTC m=+2233.380856811" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.804630 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.966628 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d6p7\" (UniqueName: \"kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.966796 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.966831 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967040 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967119 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967246 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967307 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs\") pod \"61b9c95a-c606-4899-9016-5a728c3cd9f1\" (UID: \"61b9c95a-c606-4899-9016-5a728c3cd9f1\") " Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.967395 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.968458 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.968595 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.973829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts" (OuterVolumeSpecName: "scripts") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.974196 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7" (OuterVolumeSpecName: "kube-api-access-9d6p7") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "kube-api-access-9d6p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.995214 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.995812 5030 generic.go:358] "Generic (PLEG): container finished" podID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerID="c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3" exitCode=0 Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.996329 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerDied","Data":"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3"} Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.996449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"61b9c95a-c606-4899-9016-5a728c3cd9f1","Type":"ContainerDied","Data":"2a06eb7ffa5c9268fccadb4d400498866a54e6342853ccf69896ba2ac275d20a"} Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.996510 5030 scope.go:117] "RemoveContainer" containerID="162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671" Mar 16 13:43:11 crc kubenswrapper[5030]: I0316 13:43:11.996618 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.017036 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.032703 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.039729 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data" (OuterVolumeSpecName: "config-data") pod "61b9c95a-c606-4899-9016-5a728c3cd9f1" (UID: "61b9c95a-c606-4899-9016-5a728c3cd9f1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.058795 5030 scope.go:117] "RemoveContainer" containerID="ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.071965 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072000 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d6p7\" (UniqueName: \"kubernetes.io/projected/61b9c95a-c606-4899-9016-5a728c3cd9f1-kube-api-access-9d6p7\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072017 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072048 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072060 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/61b9c95a-c606-4899-9016-5a728c3cd9f1-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072069 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.072080 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/61b9c95a-c606-4899-9016-5a728c3cd9f1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.078837 5030 scope.go:117] "RemoveContainer" containerID="2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.099512 5030 scope.go:117] "RemoveContainer" containerID="c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.121612 5030 scope.go:117] "RemoveContainer" containerID="162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671" Mar 16 13:43:12 crc kubenswrapper[5030]: E0316 13:43:12.122067 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671\": container with ID starting with 162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671 not found: ID does not exist" containerID="162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.122110 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671"} err="failed to get container status \"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671\": rpc error: code = NotFound desc = could not find container \"162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671\": container with ID starting with 162f233b12113ce6a86b1c9e336ca5ab2e45b15cf14420af128199d6f3edc671 not found: ID does not exist" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.122136 5030 scope.go:117] "RemoveContainer" containerID="ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f" Mar 16 13:43:12 crc kubenswrapper[5030]: E0316 13:43:12.122641 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f\": container with ID starting with ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f not found: ID does not exist" containerID="ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.122683 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f"} err="failed to get container status \"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f\": rpc error: code = NotFound desc = could not find container \"ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f\": container with ID starting with ce211516ad1109e6bbf916f6590282fcbd83aa2340f30408a8559656e9dcf06f not found: ID does not exist" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.122712 5030 scope.go:117] "RemoveContainer" containerID="2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2" Mar 16 13:43:12 crc kubenswrapper[5030]: E0316 13:43:12.123034 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2\": container with ID starting with 2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2 not found: ID does not exist" containerID="2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.123065 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2"} err="failed to get container status \"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2\": rpc error: code = NotFound desc = could not find container \"2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2\": container with ID starting with 2ff863aa45a4ad4a8ceae5185a3c90fcf9fa23378ab9b6b17d07782b6c6ca8e2 not found: ID does not exist" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.123082 5030 scope.go:117] "RemoveContainer" containerID="c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3" Mar 16 13:43:12 crc kubenswrapper[5030]: E0316 13:43:12.123436 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3\": container with ID starting with c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3 not found: ID does not exist" containerID="c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.123489 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3"} err="failed to get container status \"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3\": rpc error: code = NotFound desc = could not find container \"c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3\": container with ID starting with c0154e8cb66e86359aed9f4831849f01378702c3fb8e3ca9512461d72bc4c6f3 not found: ID does not exist" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.332437 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.339236 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.353043 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355543 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-central-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355583 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-central-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355617 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-notification-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355624 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-notification-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355642 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="proxy-httpd" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355647 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="proxy-httpd" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355663 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="sg-core" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.355668 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="sg-core" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.356809 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="proxy-httpd" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.356843 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-notification-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.356857 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="ceilometer-central-agent" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.356873 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" containerName="sg-core" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.360862 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.363246 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.363267 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.363495 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.363663 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478138 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478450 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpz8f\" (UniqueName: \"kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478512 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478604 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478828 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478915 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.478966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580087 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580140 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580197 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580220 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpz8f\" (UniqueName: \"kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580304 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.580895 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.581574 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.581623 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.586039 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.586357 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.586369 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.586502 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.588047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.597051 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpz8f\" (UniqueName: \"kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f\") pod \"ceilometer-0\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:12 crc kubenswrapper[5030]: I0316 13:43:12.678681 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:13 crc kubenswrapper[5030]: I0316 13:43:13.105637 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:43:13 crc kubenswrapper[5030]: I0316 13:43:13.960658 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b9c95a-c606-4899-9016-5a728c3cd9f1" path="/var/lib/kubelet/pods/61b9c95a-c606-4899-9016-5a728c3cd9f1/volumes" Mar 16 13:43:14 crc kubenswrapper[5030]: I0316 13:43:14.022074 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerStarted","Data":"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c"} Mar 16 13:43:14 crc kubenswrapper[5030]: I0316 13:43:14.022156 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerStarted","Data":"94b86e9d13720bdd5f1426349d5cd56a1637e7e61dfd1372ac2d8eb89f2d3278"} Mar 16 13:43:15 crc kubenswrapper[5030]: I0316 13:43:15.036849 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerStarted","Data":"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1"} Mar 16 13:43:16 crc kubenswrapper[5030]: I0316 13:43:16.052056 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerStarted","Data":"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763"} Mar 16 13:43:17 crc kubenswrapper[5030]: I0316 13:43:17.327167 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:17 crc kubenswrapper[5030]: I0316 13:43:17.327577 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:18 crc kubenswrapper[5030]: I0316 13:43:18.075837 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerStarted","Data":"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d"} Mar 16 13:43:18 crc kubenswrapper[5030]: I0316 13:43:18.076283 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:18 crc kubenswrapper[5030]: I0316 13:43:18.107726 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.318673169 podStartE2EDuration="6.107685867s" podCreationTimestamp="2026-03-16 13:43:12 +0000 UTC" firstStartedPulling="2026-03-16 13:43:13.107691478 +0000 UTC m=+2237.507004025" lastFinishedPulling="2026-03-16 13:43:16.896704176 +0000 UTC m=+2241.296016723" observedRunningTime="2026-03-16 13:43:18.095186458 +0000 UTC m=+2242.494498995" watchObservedRunningTime="2026-03-16 13:43:18.107685867 +0000 UTC m=+2242.506998415" Mar 16 13:43:18 crc kubenswrapper[5030]: I0316 13:43:18.333757 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:43:18 crc kubenswrapper[5030]: I0316 13:43:18.333782 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:43:22 crc kubenswrapper[5030]: I0316 13:43:22.343016 5030 scope.go:117] "RemoveContainer" containerID="36582482e2ed0d0790387242cb447593d43541c3e59a25c289aab819b6e1e999" Mar 16 13:43:22 crc kubenswrapper[5030]: I0316 13:43:22.367396 5030 scope.go:117] "RemoveContainer" containerID="cf14a7006e145cca50442d47a7c874a3069534fd61ae615859776ae28104b0aa" Mar 16 13:43:22 crc kubenswrapper[5030]: I0316 13:43:22.404939 5030 scope.go:117] "RemoveContainer" containerID="4ecebf9d1e932efc3788ecab96dea7dc8121a27ef50ade84cf82f4c464504816" Mar 16 13:43:22 crc kubenswrapper[5030]: I0316 13:43:22.450103 5030 scope.go:117] "RemoveContainer" containerID="c682fa91f1a777a42f4f7d4d6f156a4ff592b9b949d9be274627796dd060613b" Mar 16 13:43:24 crc kubenswrapper[5030]: I0316 13:43:24.287296 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:43:24 crc kubenswrapper[5030]: I0316 13:43:24.288199 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:43:25 crc kubenswrapper[5030]: I0316 13:43:25.327407 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:25 crc kubenswrapper[5030]: I0316 13:43:25.328622 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:27 crc kubenswrapper[5030]: I0316 13:43:27.336919 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:27 crc kubenswrapper[5030]: I0316 13:43:27.338287 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:27 crc kubenswrapper[5030]: I0316 13:43:27.343317 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:28 crc kubenswrapper[5030]: I0316 13:43:28.188107 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:43:49 crc kubenswrapper[5030]: I0316 13:43:49.092476 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:43:54 crc kubenswrapper[5030]: E0316 13:43:54.001131 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763181 actualBytes=10240 Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.132066 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.138403 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.153766 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.181113 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.181358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.181708 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q686\" (UniqueName: \"kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.181907 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.182065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.182117 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.182156 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284438 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5q686\" (UniqueName: \"kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284593 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284680 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284718 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284746 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.284910 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.285022 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.285226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.290791 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.290905 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.290985 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.292126 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.292214 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" gracePeriod=600 Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.293306 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.295884 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.296142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.296311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.304033 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.304957 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q686\" (UniqueName: \"kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686\") pod \"placement-64f687559b-qm7qj\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: E0316 13:43:54.420272 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.459857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.460351 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" exitCode=0 Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.460449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785"} Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.460516 5030 scope.go:117] "RemoveContainer" containerID="9c13a161447a9151ddd5631fb65d224b5ea4795e9142de8e12657109f3988831" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.461179 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:43:54 crc kubenswrapper[5030]: E0316 13:43:54.461632 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.940674 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.961755 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.962119 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-log" containerID="cri-o://1540d31366b839c16da8fac3102afbc6dca3b0f5f0c194ca8dd3130e77195559" gracePeriod=30 Mar 16 13:43:54 crc kubenswrapper[5030]: I0316 13:43:54.963162 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-httpd" containerID="cri-o://c885a9cd710762e7604811f44a56d30bb7d165bab7c517418d4b13a69476e297" gracePeriod=30 Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.016041 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.016573 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-log" containerID="cri-o://68c4cb6b81b3e12a49f1f92aad05daab7e3145d24394fda695f25da0c130520e" gracePeriod=30 Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.016746 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-httpd" containerID="cri-o://7181b2b6a360fc23479fb6cd108a46adf1bcb271f2871bc0d67eac47a649f7c6" gracePeriod=30 Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.472114 5030 generic.go:358] "Generic (PLEG): container finished" podID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerID="1540d31366b839c16da8fac3102afbc6dca3b0f5f0c194ca8dd3130e77195559" exitCode=143 Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.472210 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerDied","Data":"1540d31366b839c16da8fac3102afbc6dca3b0f5f0c194ca8dd3130e77195559"} Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.475736 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerID="68c4cb6b81b3e12a49f1f92aad05daab7e3145d24394fda695f25da0c130520e" exitCode=143 Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.475870 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerDied","Data":"68c4cb6b81b3e12a49f1f92aad05daab7e3145d24394fda695f25da0c130520e"} Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.477979 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerStarted","Data":"74e865a20823a9f25ad5767b2bf345cc75d0e6f07940b858280faca697cd8dad"} Mar 16 13:43:55 crc kubenswrapper[5030]: I0316 13:43:55.478048 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerStarted","Data":"7ab3220c368f136199d0b69d09453224c1db2d3245acadb0af3f35802546178a"} Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.371854 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.372735 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="cinder-scheduler" containerID="cri-o://c1a5ec8878da96d7b0a1aeec66817a418726c1704460e884ca52e4580abaa5f1" gracePeriod=30 Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.372879 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="probe" containerID="cri-o://933dd53e4ef77d9580c1bbca7464208f8635d8b7cf293cd5bc1139e90d3b095a" gracePeriod=30 Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.394119 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.394321 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api-log" containerID="cri-o://84fb50a4dbfd389b98d639e4f42a109ec8e94878501b21e794ec9c4578e6ce59" gracePeriod=30 Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.394370 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api" containerID="cri-o://315b90ac9a0c0adaf33e2e4e60d82674059c236150e933fad0edde3061b7b567" gracePeriod=30 Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.490433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerStarted","Data":"5fea847316980c600bf225624d67d88be3fb53fd4a7ec593a4314d60d2f06471"} Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.490599 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.490641 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:43:56 crc kubenswrapper[5030]: I0316 13:43:56.513560 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" podStartSLOduration=2.513531384 podStartE2EDuration="2.513531384s" podCreationTimestamp="2026-03-16 13:43:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:43:56.504794473 +0000 UTC m=+2280.904107019" watchObservedRunningTime="2026-03-16 13:43:56.513531384 +0000 UTC m=+2280.912843931" Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.501364 5030 generic.go:358] "Generic (PLEG): container finished" podID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerID="84fb50a4dbfd389b98d639e4f42a109ec8e94878501b21e794ec9c4578e6ce59" exitCode=143 Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.502795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerDied","Data":"84fb50a4dbfd389b98d639e4f42a109ec8e94878501b21e794ec9c4578e6ce59"} Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.504919 5030 generic.go:358] "Generic (PLEG): container finished" podID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerID="933dd53e4ef77d9580c1bbca7464208f8635d8b7cf293cd5bc1139e90d3b095a" exitCode=0 Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.504956 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerDied","Data":"933dd53e4ef77d9580c1bbca7464208f8635d8b7cf293cd5bc1139e90d3b095a"} Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.933870 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.940342 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:57 crc kubenswrapper[5030]: I0316 13:43:57.971010 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.086955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087094 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087151 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087447 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087690 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsf2s\" (UniqueName: \"kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.087856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.189277 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.189480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.189796 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsf2s\" (UniqueName: \"kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.189959 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.190243 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.190503 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.190542 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.197139 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.197201 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.197354 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.198350 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.198541 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.201092 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.207496 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsf2s\" (UniqueName: \"kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s\") pod \"neutron-67dbf445bd-b5v4n\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.258512 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.618177 5030 generic.go:358] "Generic (PLEG): container finished" podID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerID="c885a9cd710762e7604811f44a56d30bb7d165bab7c517418d4b13a69476e297" exitCode=0 Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.618767 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerDied","Data":"c885a9cd710762e7604811f44a56d30bb7d165bab7c517418d4b13a69476e297"} Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.623233 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerID="7181b2b6a360fc23479fb6cd108a46adf1bcb271f2871bc0d67eac47a649f7c6" exitCode=0 Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.623558 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerDied","Data":"7181b2b6a360fc23479fb6cd108a46adf1bcb271f2871bc0d67eac47a649f7c6"} Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.643573 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.706056 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808229 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808651 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808776 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808821 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808842 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.808911 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809760 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm6rh\" (UniqueName: \"kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809917 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.809991 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m28mh\" (UniqueName: \"kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810047 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810070 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data\") pod \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\" (UID: \"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810154 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810204 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810355 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts\") pod \"0cae739c-dc40-47bc-8dee-a651ad03a719\" (UID: \"0cae739c-dc40-47bc-8dee-a651ad03a719\") " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs" (OuterVolumeSpecName: "logs") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.810864 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs" (OuterVolumeSpecName: "logs") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.812165 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.812189 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.812203 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.812626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.819153 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts" (OuterVolumeSpecName: "scripts") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.819263 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.820621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.822865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh" (OuterVolumeSpecName: "kube-api-access-m28mh") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "kube-api-access-m28mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.822972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts" (OuterVolumeSpecName: "scripts") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.823115 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh" (OuterVolumeSpecName: "kube-api-access-sm6rh") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "kube-api-access-sm6rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.843307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.847727 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.864213 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data" (OuterVolumeSpecName: "config-data") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.870256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" (UID: "f7be6fd4-01c1-4f1d-b3ed-059eb51698c8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.878074 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data" (OuterVolumeSpecName: "config-data") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.879904 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0cae739c-dc40-47bc-8dee-a651ad03a719" (UID: "0cae739c-dc40-47bc-8dee-a651ad03a719"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915283 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m28mh\" (UniqueName: \"kubernetes.io/projected/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-kube-api-access-m28mh\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915313 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915324 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915335 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915344 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915352 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915385 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915400 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915410 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915428 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0cae739c-dc40-47bc-8dee-a651ad03a719-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915438 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915447 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0cae739c-dc40-47bc-8dee-a651ad03a719-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.915455 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm6rh\" (UniqueName: \"kubernetes.io/projected/0cae739c-dc40-47bc-8dee-a651ad03a719-kube-api-access-sm6rh\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.934723 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.936294 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:43:58 crc kubenswrapper[5030]: I0316 13:43:58.982318 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.018420 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.018447 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.334045 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.334530 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerName="nova-cell0-conductor-conductor" containerID="cri-o://1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.385168 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.385471 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="7207a47f-803a-426c-9c9a-40979efab6e6" containerName="nova-scheduler-scheduler" containerID="cri-o://cdce8f133c15f415a7f8b63a9de8e7f1e7a1706eb5a7d5d7432f130398131741" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.398244 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.398504 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.412221 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.412529 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-log" containerID="cri-o://268d410e123e14d58c7e0979b35e815769b19c15c0191395ddd2dbde5968fdd8" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.412600 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" containerID="cri-o://4cf1dfd8dfb4253e1511ccbdffc0c082d52d97bb71c34f2baae009a01c4a0b42" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.467938 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.468206 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-log" containerID="cri-o://552ce2e9d39a274116813b9f78eb0fe85fff38f8219572ab02922cfc2f225038" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.468282 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-metadata" containerID="cri-o://300624a2cf3872a049a923a4caa0c93d984c664f0bb2df045a9da29e1aa23a61" gracePeriod=30 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.650832 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0cae739c-dc40-47bc-8dee-a651ad03a719","Type":"ContainerDied","Data":"7305bd3e44031d85bb99a0e915ddce269a3ef032198a5c0a35bd3d7c86e23dde"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.652499 5030 scope.go:117] "RemoveContainer" containerID="c885a9cd710762e7604811f44a56d30bb7d165bab7c517418d4b13a69476e297" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.651782 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.658896 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerID="552ce2e9d39a274116813b9f78eb0fe85fff38f8219572ab02922cfc2f225038" exitCode=143 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.658981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerDied","Data":"552ce2e9d39a274116813b9f78eb0fe85fff38f8219572ab02922cfc2f225038"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.666280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f7be6fd4-01c1-4f1d-b3ed-059eb51698c8","Type":"ContainerDied","Data":"ee2feef3351b34283051bb1a548de2ca7f3f13820814a5dab6fadf6aad752499"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.666586 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.676895 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerStarted","Data":"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.676933 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerStarted","Data":"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.676946 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerStarted","Data":"b809ed6a687bb1e185d76a21140c2bdc90e0927e2e24c265511c3ea5a410878a"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.678202 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.687959 5030 generic.go:358] "Generic (PLEG): container finished" podID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerID="c1a5ec8878da96d7b0a1aeec66817a418726c1704460e884ca52e4580abaa5f1" exitCode=0 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.688058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerDied","Data":"c1a5ec8878da96d7b0a1aeec66817a418726c1704460e884ca52e4580abaa5f1"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.694733 5030 generic.go:358] "Generic (PLEG): container finished" podID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerID="315b90ac9a0c0adaf33e2e4e60d82674059c236150e933fad0edde3061b7b567" exitCode=0 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.694851 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerDied","Data":"315b90ac9a0c0adaf33e2e4e60d82674059c236150e933fad0edde3061b7b567"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.700808 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerID="268d410e123e14d58c7e0979b35e815769b19c15c0191395ddd2dbde5968fdd8" exitCode=143 Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.700858 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerDied","Data":"268d410e123e14d58c7e0979b35e815769b19c15c0191395ddd2dbde5968fdd8"} Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.714528 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" podStartSLOduration=2.714515253 podStartE2EDuration="2.714515253s" podCreationTimestamp="2026-03-16 13:43:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:43:59.703930536 +0000 UTC m=+2284.103243083" watchObservedRunningTime="2026-03-16 13:43:59.714515253 +0000 UTC m=+2284.113827800" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.745579 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.776753 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.815507 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816649 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816669 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816684 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816690 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816699 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816706 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816727 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816732 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816925 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816941 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816951 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-httpd" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.816961 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" containerName="glance-log" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.828947 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.829247 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.836164 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-9gklp\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.836741 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.838568 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.839680 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.853136 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.853285 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.873011 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.884046 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.884139 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.893316 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.893605 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:43:59 crc kubenswrapper[5030]: E0316 13:43:59.902048 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:43:59 crc kubenswrapper[5030]: E0316 13:43:59.932640 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941060 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941217 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbswh\" (UniqueName: \"kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941439 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941715 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941798 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.941892 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:43:59 crc kubenswrapper[5030]: E0316 13:43:59.951909 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:43:59 crc kubenswrapper[5030]: E0316 13:43:59.951956 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.976376 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cae739c-dc40-47bc-8dee-a651ad03a719" path="/var/lib/kubelet/pods/0cae739c-dc40-47bc-8dee-a651ad03a719/volumes" Mar 16 13:43:59 crc kubenswrapper[5030]: I0316 13:43:59.983316 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7be6fd4-01c1-4f1d-b3ed-059eb51698c8" path="/var/lib/kubelet/pods/f7be6fd4-01c1-4f1d-b3ed-059eb51698c8/volumes" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052149 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052210 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052238 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlpm\" (UniqueName: \"kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052350 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbswh\" (UniqueName: \"kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052371 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052743 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052767 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052798 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052820 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052869 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052884 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052900 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052918 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.052966 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.053070 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.055189 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.055734 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.069115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.069780 5030 scope.go:117] "RemoveContainer" containerID="1540d31366b839c16da8fac3102afbc6dca3b0f5f0c194ca8dd3130e77195559" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.087866 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.090818 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbswh\" (UniqueName: \"kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.091470 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.091819 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.099903 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.103798 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.151587 5030 scope.go:117] "RemoveContainer" containerID="7181b2b6a360fc23479fb6cd108a46adf1bcb271f2871bc0d67eac47a649f7c6" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.154765 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlpm\" (UniqueName: \"kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.154914 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.154981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.155061 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.155088 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.155218 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.155247 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.155284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.157584 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") device mount path \"/mnt/openstack/pv15\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.161207 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.161488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.162351 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.167404 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561144-kcbl5"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170114 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170149 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170505 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="probe" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170522 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="probe" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170606 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="cinder-scheduler" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170615 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="cinder-scheduler" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170836 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="probe" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.170867 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" containerName="cinder-scheduler" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.191506 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561144-kcbl5"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.191842 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.196259 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.197300 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.201834 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.215650 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.216777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlpm\" (UniqueName: \"kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.243956 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"glance-default-external-api-0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.257408 5030 scope.go:117] "RemoveContainer" containerID="68c4cb6b81b3e12a49f1f92aad05daab7e3145d24394fda695f25da0c130520e" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.258476 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.259000 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.259123 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55hfp\" (UniqueName: \"kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.259631 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.261744 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.261957 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle\") pod \"56894fd4-591a-4c52-8304-f718c6fe9bcf\" (UID: \"56894fd4-591a-4c52-8304-f718c6fe9bcf\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.258578 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.263173 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/56894fd4-591a-4c52-8304-f718c6fe9bcf-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.269902 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp" (OuterVolumeSpecName: "kube-api-access-55hfp") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "kube-api-access-55hfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.282511 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.347673 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts" (OuterVolumeSpecName: "scripts") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.366207 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx86s\" (UniqueName: \"kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s\") pod \"auto-csr-approver-29561144-kcbl5\" (UID: \"bbe427e5-4271-420b-8211-71b57749c5ef\") " pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.366472 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.366487 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55hfp\" (UniqueName: \"kubernetes.io/projected/56894fd4-591a-4c52-8304-f718c6fe9bcf-kube-api-access-55hfp\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.366498 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.428736 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.468100 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx86s\" (UniqueName: \"kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s\") pod \"auto-csr-approver-29561144-kcbl5\" (UID: \"bbe427e5-4271-420b-8211-71b57749c5ef\") " pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.468232 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.484150 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data" (OuterVolumeSpecName: "config-data") pod "56894fd4-591a-4c52-8304-f718c6fe9bcf" (UID: "56894fd4-591a-4c52-8304-f718c6fe9bcf"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.491310 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.496108 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx86s\" (UniqueName: \"kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s\") pod \"auto-csr-approver-29561144-kcbl5\" (UID: \"bbe427e5-4271-420b-8211-71b57749c5ef\") " pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.511521 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.533016 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.571017 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/56894fd4-591a-4c52-8304-f718c6fe9bcf-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.672267 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.674073 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs\") pod \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.674673 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data\") pod \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.674821 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qp5z\" (UniqueName: \"kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z\") pod \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675141 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675301 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle\") pod \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675507 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675688 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs\") pod \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\" (UID: \"bf6d0c60-6927-419d-a6da-2e37f9f713f6\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.675964 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.676162 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.676313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.676441 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k66r\" (UniqueName: \"kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.676532 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data\") pod \"7d20c426-1744-4c8f-a0e3-a81824dc2468\" (UID: \"7d20c426-1744-4c8f-a0e3-a81824dc2468\") " Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.677363 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs" (OuterVolumeSpecName: "logs") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.677714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.691960 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.693758 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r" (OuterVolumeSpecName: "kube-api-access-8k66r") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "kube-api-access-8k66r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.694475 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts" (OuterVolumeSpecName: "scripts") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.696762 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z" (OuterVolumeSpecName: "kube-api-access-6qp5z") pod "bf6d0c60-6927-419d-a6da-2e37f9f713f6" (UID: "bf6d0c60-6927-419d-a6da-2e37f9f713f6"). InnerVolumeSpecName "kube-api-access-6qp5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.716576 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data" (OuterVolumeSpecName: "config-data") pod "bf6d0c60-6927-419d-a6da-2e37f9f713f6" (UID: "bf6d0c60-6927-419d-a6da-2e37f9f713f6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.725528 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf6d0c60-6927-419d-a6da-2e37f9f713f6" (UID: "bf6d0c60-6927-419d-a6da-2e37f9f713f6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.735114 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.737894 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.737937 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"7d20c426-1744-4c8f-a0e3-a81824dc2468","Type":"ContainerDied","Data":"8288a66f8818984b788e36ab851934f0226955a17c3c3c4c9ed5c0f8df5d9652"} Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.738128 5030 scope.go:117] "RemoveContainer" containerID="315b90ac9a0c0adaf33e2e4e60d82674059c236150e933fad0edde3061b7b567" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.748339 5030 generic.go:358] "Generic (PLEG): container finished" podID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" containerID="8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2" exitCode=0 Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.748523 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"bf6d0c60-6927-419d-a6da-2e37f9f713f6","Type":"ContainerDied","Data":"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2"} Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.748617 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"bf6d0c60-6927-419d-a6da-2e37f9f713f6","Type":"ContainerDied","Data":"3949e4036b61a190215b72b8fd5b7efede76a75e0e0094560d3d4b513317560c"} Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.748660 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "bf6d0c60-6927-419d-a6da-2e37f9f713f6" (UID: "bf6d0c60-6927-419d-a6da-2e37f9f713f6"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.748736 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.752516 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.754542 5030 generic.go:358] "Generic (PLEG): container finished" podID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerID="1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" exitCode=0 Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.754616 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"36e34d42-3748-4503-a9cf-2c5cf9453067","Type":"ContainerDied","Data":"1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd"} Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.769843 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"56894fd4-591a-4c52-8304-f718c6fe9bcf","Type":"ContainerDied","Data":"fa3ac4525d717c370f572c7a06631ef9920d200b4f9c1c252c9463e037010379"} Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.769910 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.776677 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data" (OuterVolumeSpecName: "config-data") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.779398 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.779499 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.779584 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.779657 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7d20c426-1744-4c8f-a0e3-a81824dc2468-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.779718 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.781488 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/7d20c426-1744-4c8f-a0e3-a81824dc2468-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.781608 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k66r\" (UniqueName: \"kubernetes.io/projected/7d20c426-1744-4c8f-a0e3-a81824dc2468-kube-api-access-8k66r\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.781683 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.781783 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.782883 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.783372 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qp5z\" (UniqueName: \"kubernetes.io/projected/bf6d0c60-6927-419d-a6da-2e37f9f713f6-kube-api-access-6qp5z\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.783711 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "bf6d0c60-6927-419d-a6da-2e37f9f713f6" (UID: "bf6d0c60-6927-419d-a6da-2e37f9f713f6"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.785096 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.787339 5030 scope.go:117] "RemoveContainer" containerID="84fb50a4dbfd389b98d639e4f42a109ec8e94878501b21e794ec9c4578e6ce59" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.792652 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7d20c426-1744-4c8f-a0e3-a81824dc2468" (UID: "7d20c426-1744-4c8f-a0e3-a81824dc2468"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.812413 5030 scope.go:117] "RemoveContainer" containerID="8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2" Mar 16 13:44:00 crc kubenswrapper[5030]: E0316 13:44:00.832341 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e34d42_3748_4503_a9cf_2c5cf9453067.slice/crio-conmon-1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.834755 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.847996 5030 scope.go:117] "RemoveContainer" containerID="8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2" Mar 16 13:44:00 crc kubenswrapper[5030]: E0316 13:44:00.848728 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2\": container with ID starting with 8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2 not found: ID does not exist" containerID="8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.848909 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2"} err="failed to get container status \"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2\": rpc error: code = NotFound desc = could not find container \"8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2\": container with ID starting with 8a6c5378547c3b8b8346b6302a56f954834681170aaa92a171a1e88f25212bc2 not found: ID does not exist" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.848934 5030 scope.go:117] "RemoveContainer" containerID="933dd53e4ef77d9580c1bbca7464208f8635d8b7cf293cd5bc1139e90d3b095a" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.883592 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.885506 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.885632 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf6d0c60-6927-419d-a6da-2e37f9f713f6-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.885706 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7d20c426-1744-4c8f-a0e3-a81824dc2468-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.900889 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.913538 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914728 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914749 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914763 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914770 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914811 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api-log" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914817 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api-log" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.914990 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.915010 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" containerName="cinder-api-log" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.915022 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.917215 5030 scope.go:117] "RemoveContainer" containerID="c1a5ec8878da96d7b0a1aeec66817a418726c1704460e884ca52e4580abaa5f1" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.924485 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.924933 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:00 crc kubenswrapper[5030]: I0316 13:44:00.926658 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.040819 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.090954 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.090992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.091060 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.091103 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.091175 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5wj\" (UniqueName: \"kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.091275 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.144929 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.187246 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.192953 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193092 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5wj\" (UniqueName: \"kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193294 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193314 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193373 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.193667 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.207134 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.207768 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.217014 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.224841 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.238372 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5wj\" (UniqueName: \"kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj\") pod \"cinder-scheduler-0\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.245021 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.248395 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.296244 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.296316 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data\") pod \"36e34d42-3748-4503-a9cf-2c5cf9453067\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.296595 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle\") pod \"36e34d42-3748-4503-a9cf-2c5cf9453067\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.296893 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbqbq\" (UniqueName: \"kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq\") pod \"36e34d42-3748-4503-a9cf-2c5cf9453067\" (UID: \"36e34d42-3748-4503-a9cf-2c5cf9453067\") " Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.314344 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.315572 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.315599 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.315837 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.330798 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq" (OuterVolumeSpecName: "kube-api-access-tbqbq") pod "36e34d42-3748-4503-a9cf-2c5cf9453067" (UID: "36e34d42-3748-4503-a9cf-2c5cf9453067"). InnerVolumeSpecName "kube-api-access-tbqbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.346079 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.355594 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.355875 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.356002 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.384849 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.387681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "36e34d42-3748-4503-a9cf-2c5cf9453067" (UID: "36e34d42-3748-4503-a9cf-2c5cf9453067"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.395626 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.411575 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbqbq\" (UniqueName: \"kubernetes.io/projected/36e34d42-3748-4503-a9cf-2c5cf9453067-kube-api-access-tbqbq\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.411605 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.424674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data" (OuterVolumeSpecName: "config-data") pod "36e34d42-3748-4503-a9cf-2c5cf9453067" (UID: "36e34d42-3748-4503-a9cf-2c5cf9453067"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:01 crc kubenswrapper[5030]: W0316 13:44:01.430263 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbe427e5_4271_420b_8211_71b57749c5ef.slice/crio-d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518 WatchSource:0}: Error finding container d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518: Status 404 returned error can't find the container with id d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518 Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.454251 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.480609 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.488932 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.489156 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.489245 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514095 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514188 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94lll\" (UniqueName: \"kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514614 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.514765 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/36e34d42-3748-4503-a9cf-2c5cf9453067-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.517222 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.546148 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561144-kcbl5"] Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.629747 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.629992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.630023 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xbr\" (UniqueName: \"kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.630040 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.630062 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.630101 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631460 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631538 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631648 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631762 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631788 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94lll\" (UniqueName: \"kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631877 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.631933 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.645869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.646834 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.653472 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.655783 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.684272 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94lll\" (UniqueName: \"kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll\") pod \"nova-cell1-novncproxy-0\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737341 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737434 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737475 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737521 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737606 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737652 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737770 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737820 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42xbr\" (UniqueName: \"kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.737844 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.738810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.744094 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.745126 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.745220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.745999 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.754766 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.756050 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.761003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.775744 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xbr\" (UniqueName: \"kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr\") pod \"cinder-api-0\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.778094 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.888135 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerStarted","Data":"8bed82471d418671aa7809d7e050e593fa3888d8707cf564d39dd8c0ee11f825"} Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.888999 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:01 crc kubenswrapper[5030]: I0316 13:44:01.954951 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerStarted","Data":"951554d736319dc7e885014d472c15493983a97ed10dd38e9e3b484a60c2f410"} Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.026864 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.045786 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56894fd4-591a-4c52-8304-f718c6fe9bcf" path="/var/lib/kubelet/pods/56894fd4-591a-4c52-8304-f718c6fe9bcf/volumes" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.046580 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d20c426-1744-4c8f-a0e3-a81824dc2468" path="/var/lib/kubelet/pods/7d20c426-1744-4c8f-a0e3-a81824dc2468/volumes" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.047150 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6d0c60-6927-419d-a6da-2e37f9f713f6" path="/var/lib/kubelet/pods/bf6d0c60-6927-419d-a6da-2e37f9f713f6/volumes" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.048586 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.048614 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"36e34d42-3748-4503-a9cf-2c5cf9453067","Type":"ContainerDied","Data":"14b94f94a9b6e219595f1fea1b4641d3c9d3aa38f9c83c07ae5b5dfdd90157c4"} Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.048644 5030 scope.go:117] "RemoveContainer" containerID="1359551751fc174be8af151d6311e2fe05687f7a678e5faa207c44de68589efd" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.065970 5030 generic.go:358] "Generic (PLEG): container finished" podID="7207a47f-803a-426c-9c9a-40979efab6e6" containerID="cdce8f133c15f415a7f8b63a9de8e7f1e7a1706eb5a7d5d7432f130398131741" exitCode=0 Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.066047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7207a47f-803a-426c-9c9a-40979efab6e6","Type":"ContainerDied","Data":"cdce8f133c15f415a7f8b63a9de8e7f1e7a1706eb5a7d5d7432f130398131741"} Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.125838 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.132120 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" event={"ID":"bbe427e5-4271-420b-8211-71b57749c5ef","Type":"ContainerStarted","Data":"d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518"} Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.136617 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.151491 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.183439 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.192109 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr44l\" (UniqueName: \"kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l\") pod \"7207a47f-803a-426c-9c9a-40979efab6e6\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.192309 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data\") pod \"7207a47f-803a-426c-9c9a-40979efab6e6\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.192511 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle\") pod \"7207a47f-803a-426c-9c9a-40979efab6e6\" (UID: \"7207a47f-803a-426c-9c9a-40979efab6e6\") " Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.194060 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7207a47f-803a-426c-9c9a-40979efab6e6" containerName="nova-scheduler-scheduler" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.194090 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7207a47f-803a-426c-9c9a-40979efab6e6" containerName="nova-scheduler-scheduler" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.194403 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7207a47f-803a-426c-9c9a-40979efab6e6" containerName="nova-scheduler-scheduler" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.212785 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l" (OuterVolumeSpecName: "kube-api-access-kr44l") pod "7207a47f-803a-426c-9c9a-40979efab6e6" (UID: "7207a47f-803a-426c-9c9a-40979efab6e6"). InnerVolumeSpecName "kube-api-access-kr44l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.222184 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.230454 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.231248 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7207a47f-803a-426c-9c9a-40979efab6e6" (UID: "7207a47f-803a-426c-9c9a-40979efab6e6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.240937 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data" (OuterVolumeSpecName: "config-data") pod "7207a47f-803a-426c-9c9a-40979efab6e6" (UID: "7207a47f-803a-426c-9c9a-40979efab6e6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.252948 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300216 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300279 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkdf\" (UniqueName: \"kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300512 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300525 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr44l\" (UniqueName: \"kubernetes.io/projected/7207a47f-803a-426c-9c9a-40979efab6e6-kube-api-access-kr44l\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.300535 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7207a47f-803a-426c-9c9a-40979efab6e6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.402472 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.402763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkdf\" (UniqueName: \"kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.402879 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.413380 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.421514 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.424104 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttkdf\" (UniqueName: \"kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf\") pod \"nova-cell0-conductor-0\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.441793 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.680402 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.735361 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.836204 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:02 crc kubenswrapper[5030]: I0316 13:44:02.836525 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" containerName="nova-cell1-conductor-conductor" containerID="cri-o://77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" gracePeriod=30 Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.234800 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerStarted","Data":"ddfbb426b84372e6e57d997ca3a9cbb6999dfc01b6d506731f0bb2a8d24ce832"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.240524 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"7207a47f-803a-426c-9c9a-40979efab6e6","Type":"ContainerDied","Data":"3e8bd04965bbdc1e61f5dc51e9669a722bb949657d35b3e20c368bfe5caa13aa"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.240627 5030 scope.go:117] "RemoveContainer" containerID="cdce8f133c15f415a7f8b63a9de8e7f1e7a1706eb5a7d5d7432f130398131741" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.240835 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.280581 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerID="4cf1dfd8dfb4253e1511ccbdffc0c082d52d97bb71c34f2baae009a01c4a0b42" exitCode=0 Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.280718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerDied","Data":"4cf1dfd8dfb4253e1511ccbdffc0c082d52d97bb71c34f2baae009a01c4a0b42"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.307011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerStarted","Data":"6501af12ade6721c99ecf9efefc870c95c731c78ce8e913aabab7eb5396cee9b"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.326010 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerStarted","Data":"dc368a1c38ce85c20526fa89e305dc8a3392dc49b04f3595a80c1c0efa371ed0"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.338326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerStarted","Data":"6aa264c00fe74a92e2a3d3960ea920630b83182fd71c1c5f2fec1fdba1993356"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.343485 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"98d53f79-da23-4943-81fa-20a1e84bc2d5","Type":"ContainerStarted","Data":"24e4ee8f7e3badbc851d3c547ad3993a101e3d880413483b95d054e1bd3eab58"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.343535 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"98d53f79-da23-4943-81fa-20a1e84bc2d5","Type":"ContainerStarted","Data":"01fb94cecaa30e37f26192c61e73210a25ac022458a38c024cd2c961afebcb2f"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.381471 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.38138212 podStartE2EDuration="2.38138212s" podCreationTimestamp="2026-03-16 13:44:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:03.366931012 +0000 UTC m=+2287.766243559" watchObservedRunningTime="2026-03-16 13:44:03.38138212 +0000 UTC m=+2287.780694668" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.384413 5030 generic.go:358] "Generic (PLEG): container finished" podID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerID="300624a2cf3872a049a923a4caa0c93d984c664f0bb2df045a9da29e1aa23a61" exitCode=0 Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.384600 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerDied","Data":"300624a2cf3872a049a923a4caa0c93d984c664f0bb2df045a9da29e1aa23a61"} Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.429211 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.436596 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.459616 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.498537 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.506470 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-metadata" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.506497 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-metadata" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.506519 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-log" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.506526 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-log" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.508167 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-log" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.508204 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" containerName="nova-metadata-metadata" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.516300 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.516542 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.520982 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.546321 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs\") pod \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.546385 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle\") pod \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.546660 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs\") pod \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.546792 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data\") pod \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.547080 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j94kd\" (UniqueName: \"kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd\") pod \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\" (UID: \"2a23a64e-636b-4ff4-9a65-a0eaf49ed976\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.553930 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs" (OuterVolumeSpecName: "logs") pod "2a23a64e-636b-4ff4-9a65-a0eaf49ed976" (UID: "2a23a64e-636b-4ff4-9a65-a0eaf49ed976"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.590041 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd" (OuterVolumeSpecName: "kube-api-access-j94kd") pod "2a23a64e-636b-4ff4-9a65-a0eaf49ed976" (UID: "2a23a64e-636b-4ff4-9a65-a0eaf49ed976"). InnerVolumeSpecName "kube-api-access-j94kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.611537 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "2a23a64e-636b-4ff4-9a65-a0eaf49ed976" (UID: "2a23a64e-636b-4ff4-9a65-a0eaf49ed976"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.636117 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.652021 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "2a23a64e-636b-4ff4-9a65-a0eaf49ed976" (UID: "2a23a64e-636b-4ff4-9a65-a0eaf49ed976"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.656934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxk44\" (UniqueName: \"kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.656990 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.657017 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.657116 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j94kd\" (UniqueName: \"kubernetes.io/projected/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-kube-api-access-j94kd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.657127 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.657136 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.657145 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.684638 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data" (OuterVolumeSpecName: "config-data") pod "2a23a64e-636b-4ff4-9a65-a0eaf49ed976" (UID: "2a23a64e-636b-4ff4-9a65-a0eaf49ed976"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.734895 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.767408 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxk44\" (UniqueName: \"kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.767476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.767501 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.767628 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2a23a64e-636b-4ff4-9a65-a0eaf49ed976-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.771182 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.780099 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.800574 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxk44\" (UniqueName: \"kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44\") pod \"nova-scheduler-0\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.846838 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.869163 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.869253 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.880925 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.881047 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llrrb\" (UniqueName: \"kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.881210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.881312 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle\") pod \"4b7e7304-ba88-4264-a982-26ead7f093aa\" (UID: \"4b7e7304-ba88-4264-a982-26ead7f093aa\") " Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.882381 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs" (OuterVolumeSpecName: "logs") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.895826 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb" (OuterVolumeSpecName: "kube-api-access-llrrb") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "kube-api-access-llrrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.909705 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data" (OuterVolumeSpecName: "config-data") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.918830 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.936691 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.954510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4b7e7304-ba88-4264-a982-26ead7f093aa" (UID: "4b7e7304-ba88-4264-a982-26ead7f093aa"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.960225 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36e34d42-3748-4503-a9cf-2c5cf9453067" path="/var/lib/kubelet/pods/36e34d42-3748-4503-a9cf-2c5cf9453067/volumes" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.960989 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7207a47f-803a-426c-9c9a-40979efab6e6" path="/var/lib/kubelet/pods/7207a47f-803a-426c-9c9a-40979efab6e6/volumes" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987349 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987377 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987388 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987396 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b7e7304-ba88-4264-a982-26ead7f093aa-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987404 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4b7e7304-ba88-4264-a982-26ead7f093aa-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:03 crc kubenswrapper[5030]: I0316 13:44:03.987412 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llrrb\" (UniqueName: \"kubernetes.io/projected/4b7e7304-ba88-4264-a982-26ead7f093aa-kube-api-access-llrrb\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.433858 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438030 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438057 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438088 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-log" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438094 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-log" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438346 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-log" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.438355 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.447148 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.447823 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.468105 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.488105 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.515400 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.524504 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.535348 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.536326 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.543506 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"4b7e7304-ba88-4264-a982-26ead7f093aa","Type":"ContainerDied","Data":"861c4babab173955c2477a1d2f52f143e9d1346a192f9c35fad04885d0dfc9db"} Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.543561 5030 scope.go:117] "RemoveContainer" containerID="4cf1dfd8dfb4253e1511ccbdffc0c082d52d97bb71c34f2baae009a01c4a0b42" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.543711 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.569843 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" event={"ID":"bbe427e5-4271-420b-8211-71b57749c5ef","Type":"ContainerStarted","Data":"180709938a3b005fe056cb3c32832c1225574c99a170f1a9926109ff84f8f8c9"} Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.583870 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"37fb15cb-5d16-45f2-a665-bafba7ed8e69","Type":"ContainerStarted","Data":"ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3"} Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.583898 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"37fb15cb-5d16-45f2-a665-bafba7ed8e69","Type":"ContainerStarted","Data":"7ee850ecf96b7f402ee6447889550ecf11953c58c24c183a96a5530f285acee0"} Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.584335 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.608136 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.620525 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627743 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627800 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627826 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627865 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627907 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627944 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgth\" (UniqueName: \"kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.627985 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fvst\" (UniqueName: \"kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628019 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvdsz\" (UniqueName: \"kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628166 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628205 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628306 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628457 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628633 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628747 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.628848 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.630743 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.631288 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"2a23a64e-636b-4ff4-9a65-a0eaf49ed976","Type":"ContainerDied","Data":"2b52db127b85af9bd3445ebf980f8670ef256b981d2d1e0d9ff550cdf1a8a9ac"} Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.642286 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" podStartSLOduration=3.014526264 podStartE2EDuration="4.642268226s" podCreationTimestamp="2026-03-16 13:44:00 +0000 UTC" firstStartedPulling="2026-03-16 13:44:01.480514277 +0000 UTC m=+2285.879826825" lastFinishedPulling="2026-03-16 13:44:03.108256241 +0000 UTC m=+2287.507568787" observedRunningTime="2026-03-16 13:44:04.620185174 +0000 UTC m=+2289.019497721" watchObservedRunningTime="2026-03-16 13:44:04.642268226 +0000 UTC m=+2289.041580773" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.655782 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.656239 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.656226718 podStartE2EDuration="2.656226718s" podCreationTimestamp="2026-03-16 13:44:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:04.641825925 +0000 UTC m=+2289.041138472" watchObservedRunningTime="2026-03-16 13:44:04.656226718 +0000 UTC m=+2289.055539264" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.667354 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.675107 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.675525 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.675766 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.683618 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.740484 5030 scope.go:117] "RemoveContainer" containerID="268d410e123e14d58c7e0979b35e815769b19c15c0191395ddd2dbde5968fdd8" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.744675 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgth\" (UniqueName: \"kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.744807 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvst\" (UniqueName: \"kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.744923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvdsz\" (UniqueName: \"kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745043 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745086 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745368 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745737 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745862 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.745951 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746041 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746283 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746343 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746446 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746573 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.746621 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.752194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.755682 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.757869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.762643 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.768010 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.773033 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvdsz\" (UniqueName: \"kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.778240 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.778712 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.778919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.779190 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.779711 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.780701 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvst\" (UniqueName: \"kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.787404 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom\") pod \"barbican-keystone-listener-d5db7ddf4-fg6mp\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.789908 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.796397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.799683 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data\") pod \"barbican-api-95df9c4d4-9gfjq\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.799810 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgth\" (UniqueName: \"kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.804561 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom\") pod \"barbican-worker-5bb4989c79-rlz4z\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.809498 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.822130 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.823513 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.826191 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.826410 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.838101 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.845771 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.848944 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz262\" (UniqueName: \"kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.849211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.849330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.849437 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.849677 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.849960 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.869900 5030 scope.go:117] "RemoveContainer" containerID="300624a2cf3872a049a923a4caa0c93d984c664f0bb2df045a9da29e1aa23a61" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.883169 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952737 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952795 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952910 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprz7\" (UniqueName: \"kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.952984 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.953005 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.953035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.953080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.953110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nz262\" (UniqueName: \"kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.953211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.962990 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.964287 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.965824 5030 scope.go:117] "RemoveContainer" containerID="552ce2e9d39a274116813b9f78eb0fe85fff38f8219572ab02922cfc2f225038" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.976981 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.983110 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.984022 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:04 crc kubenswrapper[5030]: I0316 13:44:04.992759 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz262\" (UniqueName: \"kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262\") pod \"nova-api-0\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.064469 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vprz7\" (UniqueName: \"kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.064582 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.064639 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.064821 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.065024 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.065427 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.074744 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.077328 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.077473 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.110037 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.112436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprz7\" (UniqueName: \"kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7\") pod \"nova-metadata-0\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.153781 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.650728 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.687942 5030 generic.go:358] "Generic (PLEG): container finished" podID="bbe427e5-4271-420b-8211-71b57749c5ef" containerID="180709938a3b005fe056cb3c32832c1225574c99a170f1a9926109ff84f8f8c9" exitCode=0 Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.688047 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" event={"ID":"bbe427e5-4271-420b-8211-71b57749c5ef","Type":"ContainerDied","Data":"180709938a3b005fe056cb3c32832c1225574c99a170f1a9926109ff84f8f8c9"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.693921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerStarted","Data":"cf428a1b9f28401055b4d46f0ef2097ebf5b885395f5e937c44aae9f06a8f4f7"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.725522 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerStarted","Data":"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.731675 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerStarted","Data":"7a9e36b7e519090c25100a0f288d2abfa121e3fd0dde5207c05eb2265331b79b"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.750085 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=6.750074674 podStartE2EDuration="6.750074674s" podCreationTimestamp="2026-03-16 13:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:05.737875831 +0000 UTC m=+2290.137188379" watchObservedRunningTime="2026-03-16 13:44:05.750074674 +0000 UTC m=+2290.149387221" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.817029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"54b6dffe-7356-4d45-bec3-8416d27c7e81","Type":"ContainerStarted","Data":"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.817066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"54b6dffe-7356-4d45-bec3-8416d27c7e81","Type":"ContainerStarted","Data":"42ce52e7b38f5157fde02dc3ddbbc22fedba90e29945a327cd184ccfcc45c6d2"} Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.871913 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=6.8718944109999995 podStartE2EDuration="6.871894411s" podCreationTimestamp="2026-03-16 13:43:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:05.7860379 +0000 UTC m=+2290.185350448" watchObservedRunningTime="2026-03-16 13:44:05.871894411 +0000 UTC m=+2290.271206958" Mar 16 13:44:05 crc kubenswrapper[5030]: I0316 13:44:05.890230 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.890218994 podStartE2EDuration="2.890218994s" podCreationTimestamp="2026-03-16 13:44:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:05.870462468 +0000 UTC m=+2290.269775016" watchObservedRunningTime="2026-03-16 13:44:05.890218994 +0000 UTC m=+2290.289531532" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.011016 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a23a64e-636b-4ff4-9a65-a0eaf49ed976" path="/var/lib/kubelet/pods/2a23a64e-636b-4ff4-9a65-a0eaf49ed976/volumes" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.012660 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" path="/var/lib/kubelet/pods/4b7e7304-ba88-4264-a982-26ead7f093aa/volumes" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.013862 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.013991 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.015702 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:44:06 crc kubenswrapper[5030]: E0316 13:44:06.016186 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.119029 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:06 crc kubenswrapper[5030]: E0316 13:44:06.227361 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:06 crc kubenswrapper[5030]: E0316 13:44:06.233024 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:06 crc kubenswrapper[5030]: E0316 13:44:06.268762 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:06 crc kubenswrapper[5030]: E0316 13:44:06.268811 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.294025 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.779680 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.841797 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerStarted","Data":"0b1e42be70589f3e99bf54158f09bcccdcfc11eef50fea6cb0e9ad7c75e86b93"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.841840 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerStarted","Data":"d1bd1a3bfe1b0a8769e3335dda412222cc815260aa5962541f367346ba78f5b6"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.909707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerStarted","Data":"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.909759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerStarted","Data":"8b8677b1fc087ef99a79565534c4e62e12485d986b093481ca2991bf96e815bc"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.972960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerStarted","Data":"f4b8bab8b748083d9e385230e986284b1a71e91cca58d21ee85f8b91510b3dd8"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.973023 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerStarted","Data":"ab3515d985327396060d5c803e5bd04bb89a796bf4e514752d14b2e51bd1662f"} Mar 16 13:44:06 crc kubenswrapper[5030]: I0316 13:44:06.973038 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerStarted","Data":"f19f8e91e34090ea52472c9431f7c60cf0b1bb40164ce5a919573a4bd67f4f1d"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.009589 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" podStartSLOduration=3.009571627 podStartE2EDuration="3.009571627s" podCreationTimestamp="2026-03-16 13:44:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:06.997819405 +0000 UTC m=+2291.397131951" watchObservedRunningTime="2026-03-16 13:44:07.009571627 +0000 UTC m=+2291.408884164" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.023517 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerStarted","Data":"2e484f8a9260112500afbb25ead1854af02a3aa3ce489f90ace6133e62b50f4c"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.042078 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.042334 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker-log" containerID="cri-o://670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.042480 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker" containerID="cri-o://0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.074970 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerStarted","Data":"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.075033 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerStarted","Data":"1f9f852ac7d647ae567a743c99b72d56b766e05627f5ff0bd7a829e074666dab"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.102189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerStarted","Data":"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.110060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerStarted","Data":"010a464c7510dc0d0f468c5fde1bface35c3e423f0e68104f94908ac19fbe8eb"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.110093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerStarted","Data":"7b94deeb0290286e23956570e3b2cc885e7d824111881a35ee53a2c1023ce0f0"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.110104 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerStarted","Data":"32041e86653e4d9e5afbed8001c67ecd1a5f13ac01ee64ff964e5c767fb42cda"} Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.126060 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=7.126047123 podStartE2EDuration="7.126047123s" podCreationTimestamp="2026-03-16 13:44:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:07.116886305 +0000 UTC m=+2291.516198852" watchObservedRunningTime="2026-03-16 13:44:07.126047123 +0000 UTC m=+2291.525359670" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.154504 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" podStartSLOduration=3.154486309 podStartE2EDuration="3.154486309s" podCreationTimestamp="2026-03-16 13:44:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:07.13763692 +0000 UTC m=+2291.536949467" watchObservedRunningTime="2026-03-16 13:44:07.154486309 +0000 UTC m=+2291.553798856" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.172428 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.172693 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener-log" containerID="cri-o://befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.173246 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener" containerID="cri-o://9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.325982 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.330790 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-central-agent" containerID="cri-o://8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.331215 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="proxy-httpd" containerID="cri-o://ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.331293 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="sg-core" containerID="cri-o://d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.331411 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-notification-agent" containerID="cri-o://22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1" gracePeriod=30 Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.559293 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.598306 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx86s\" (UniqueName: \"kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s\") pod \"bbe427e5-4271-420b-8211-71b57749c5ef\" (UID: \"bbe427e5-4271-420b-8211-71b57749c5ef\") " Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.616735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s" (OuterVolumeSpecName: "kube-api-access-lx86s") pod "bbe427e5-4271-420b-8211-71b57749c5ef" (UID: "bbe427e5-4271-420b-8211-71b57749c5ef"). InnerVolumeSpecName "kube-api-access-lx86s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.702036 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx86s\" (UniqueName: \"kubernetes.io/projected/bbe427e5-4271-420b-8211-71b57749c5ef-kube-api-access-lx86s\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.716943 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561138-2gshr"] Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.720665 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561138-2gshr"] Mar 16 13:44:07 crc kubenswrapper[5030]: I0316 13:44:07.956629 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cacd40d5-9a69-4128-bdd5-8adfd13db2b7" path="/var/lib/kubelet/pods/cacd40d5-9a69-4128-bdd5-8adfd13db2b7/volumes" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.161428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerStarted","Data":"a4ee5d8402e5faad087dd9f6d5c41e49bbe5357d0fd48bfd39d624279db5fc36"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.166342 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.179966 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerStarted","Data":"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.184319 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" event={"ID":"bbe427e5-4271-420b-8211-71b57749c5ef","Type":"ContainerDied","Data":"d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.184368 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5e39c1da51e0d7714c7464e19874c543960b4e7ab652be8b9b0c3c435882518" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.184526 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561144-kcbl5" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.224603 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=7.224576473 podStartE2EDuration="7.224576473s" podCreationTimestamp="2026-03-16 13:44:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:08.205669915 +0000 UTC m=+2292.604982463" watchObservedRunningTime="2026-03-16 13:44:08.224576473 +0000 UTC m=+2292.623889020" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.248089 5030 generic.go:358] "Generic (PLEG): container finished" podID="294c61ef-1239-444f-adb6-7786bc89bb94" containerID="670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a" exitCode=143 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.248245 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerDied","Data":"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.277505 5030 generic.go:358] "Generic (PLEG): container finished" podID="0fdd17b2-757d-481f-a166-e552973c1bba" containerID="befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229" exitCode=143 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.278504 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerDied","Data":"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.296703 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=4.296677865 podStartE2EDuration="4.296677865s" podCreationTimestamp="2026-03-16 13:44:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:08.264105656 +0000 UTC m=+2292.663418203" watchObservedRunningTime="2026-03-16 13:44:08.296677865 +0000 UTC m=+2292.695990412" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326471 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerID="ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d" exitCode=0 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326753 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerID="d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763" exitCode=2 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326761 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerID="8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c" exitCode=0 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326877 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerDied","Data":"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326900 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerDied","Data":"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.326910 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerDied","Data":"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.328954 5030 generic.go:358] "Generic (PLEG): container finished" podID="71389c0e-fb3c-4255-8333-717584f0dae9" containerID="77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" exitCode=0 Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.329053 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71389c0e-fb3c-4255-8333-717584f0dae9","Type":"ContainerDied","Data":"77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.330302 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerStarted","Data":"0562aa7e24c003d1a504f7a47f2a7c9268fd557bf551de5e0643c2a593a728d5"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.331638 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.331665 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.334750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerStarted","Data":"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa"} Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.367339 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podStartSLOduration=4.367326184 podStartE2EDuration="4.367326184s" podCreationTimestamp="2026-03-16 13:44:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:08.349171971 +0000 UTC m=+2292.748484518" watchObservedRunningTime="2026-03-16 13:44:08.367326184 +0000 UTC m=+2292.766638731" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.370185 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=4.370141288 podStartE2EDuration="4.370141288s" podCreationTimestamp="2026-03-16 13:44:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:08.364059931 +0000 UTC m=+2292.763372478" watchObservedRunningTime="2026-03-16 13:44:08.370141288 +0000 UTC m=+2292.769453835" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.546731 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.632322 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle\") pod \"71389c0e-fb3c-4255-8333-717584f0dae9\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.632472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9\") pod \"71389c0e-fb3c-4255-8333-717584f0dae9\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.632767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data\") pod \"71389c0e-fb3c-4255-8333-717584f0dae9\" (UID: \"71389c0e-fb3c-4255-8333-717584f0dae9\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.639706 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9" (OuterVolumeSpecName: "kube-api-access-dcvn9") pod "71389c0e-fb3c-4255-8333-717584f0dae9" (UID: "71389c0e-fb3c-4255-8333-717584f0dae9"). InnerVolumeSpecName "kube-api-access-dcvn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.667713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "71389c0e-fb3c-4255-8333-717584f0dae9" (UID: "71389c0e-fb3c-4255-8333-717584f0dae9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.673626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data" (OuterVolumeSpecName: "config-data") pod "71389c0e-fb3c-4255-8333-717584f0dae9" (UID: "71389c0e-fb3c-4255-8333-717584f0dae9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.697959 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.736697 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle\") pod \"0fdd17b2-757d-481f-a166-e552973c1bba\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.737302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data\") pod \"0fdd17b2-757d-481f-a166-e552973c1bba\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.737851 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom\") pod \"0fdd17b2-757d-481f-a166-e552973c1bba\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.738000 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs\") pod \"0fdd17b2-757d-481f-a166-e552973c1bba\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.738095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmbf\" (UniqueName: \"kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf\") pod \"0fdd17b2-757d-481f-a166-e552973c1bba\" (UID: \"0fdd17b2-757d-481f-a166-e552973c1bba\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.738616 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.738634 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/71389c0e-fb3c-4255-8333-717584f0dae9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.738644 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcvn9\" (UniqueName: \"kubernetes.io/projected/71389c0e-fb3c-4255-8333-717584f0dae9-kube-api-access-dcvn9\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.742345 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf" (OuterVolumeSpecName: "kube-api-access-2gmbf") pod "0fdd17b2-757d-481f-a166-e552973c1bba" (UID: "0fdd17b2-757d-481f-a166-e552973c1bba"). InnerVolumeSpecName "kube-api-access-2gmbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.742947 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs" (OuterVolumeSpecName: "logs") pod "0fdd17b2-757d-481f-a166-e552973c1bba" (UID: "0fdd17b2-757d-481f-a166-e552973c1bba"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.747626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0fdd17b2-757d-481f-a166-e552973c1bba" (UID: "0fdd17b2-757d-481f-a166-e552973c1bba"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.752230 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.762675 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0fdd17b2-757d-481f-a166-e552973c1bba" (UID: "0fdd17b2-757d-481f-a166-e552973c1bba"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.791820 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data" (OuterVolumeSpecName: "config-data") pod "0fdd17b2-757d-481f-a166-e552973c1bba" (UID: "0fdd17b2-757d-481f-a166-e552973c1bba"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841331 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841407 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841577 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841912 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.841962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.842018 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.842178 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpz8f\" (UniqueName: \"kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f\") pod \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\" (UID: \"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58\") " Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.842987 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843006 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0fdd17b2-757d-481f-a166-e552973c1bba-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843017 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmbf\" (UniqueName: \"kubernetes.io/projected/0fdd17b2-757d-481f-a166-e552973c1bba-kube-api-access-2gmbf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843027 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843036 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0fdd17b2-757d-481f-a166-e552973c1bba-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843288 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.843492 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.845909 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts" (OuterVolumeSpecName: "scripts") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.846368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f" (OuterVolumeSpecName: "kube-api-access-vpz8f") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "kube-api-access-vpz8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.847536 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.862847 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.884278 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.901126 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.922796 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data" (OuterVolumeSpecName: "config-data") pod "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" (UID: "6f8ad3a4-6f44-4eda-bae4-6bc893f34e58"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952102 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952147 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952160 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952169 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952178 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952187 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952196 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:08 crc kubenswrapper[5030]: I0316 13:44:08.952204 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpz8f\" (UniqueName: \"kubernetes.io/projected/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58-kube-api-access-vpz8f\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.260600 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.347813 5030 generic.go:358] "Generic (PLEG): container finished" podID="294c61ef-1239-444f-adb6-7786bc89bb94" containerID="0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8" exitCode=0 Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.347890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.347876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerDied","Data":"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.348453 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8" event={"ID":"294c61ef-1239-444f-adb6-7786bc89bb94","Type":"ContainerDied","Data":"74c2b77f3844e74146d8679e5eb52727cd02585a08b19b4df022e91504844ef1"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.348507 5030 scope.go:117] "RemoveContainer" containerID="0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.354652 5030 generic.go:358] "Generic (PLEG): container finished" podID="0fdd17b2-757d-481f-a166-e552973c1bba" containerID="9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15" exitCode=0 Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.354829 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerDied","Data":"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.354857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" event={"ID":"0fdd17b2-757d-481f-a166-e552973c1bba","Type":"ContainerDied","Data":"40b7432e746b4c6a48a9185169a3312c0b1d7fcee60586b22290ac192173557b"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.354948 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.363583 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data\") pod \"294c61ef-1239-444f-adb6-7786bc89bb94\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.364739 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom\") pod \"294c61ef-1239-444f-adb6-7786bc89bb94\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.364980 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle\") pod \"294c61ef-1239-444f-adb6-7786bc89bb94\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.365162 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs\") pod \"294c61ef-1239-444f-adb6-7786bc89bb94\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.365295 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89v95\" (UniqueName: \"kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95\") pod \"294c61ef-1239-444f-adb6-7786bc89bb94\" (UID: \"294c61ef-1239-444f-adb6-7786bc89bb94\") " Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.368219 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs" (OuterVolumeSpecName: "logs") pod "294c61ef-1239-444f-adb6-7786bc89bb94" (UID: "294c61ef-1239-444f-adb6-7786bc89bb94"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376331 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "294c61ef-1239-444f-adb6-7786bc89bb94" (UID: "294c61ef-1239-444f-adb6-7786bc89bb94"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376431 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerID="22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1" exitCode=0 Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376521 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerDied","Data":"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376525 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95" (OuterVolumeSpecName: "kube-api-access-89v95") pod "294c61ef-1239-444f-adb6-7786bc89bb94" (UID: "294c61ef-1239-444f-adb6-7786bc89bb94"). InnerVolumeSpecName "kube-api-access-89v95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6f8ad3a4-6f44-4eda-bae4-6bc893f34e58","Type":"ContainerDied","Data":"94b86e9d13720bdd5f1426349d5cd56a1637e7e61dfd1372ac2d8eb89f2d3278"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.376651 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.380876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"71389c0e-fb3c-4255-8333-717584f0dae9","Type":"ContainerDied","Data":"15e4c3dd9c3adea99489e69e322811feb0fef5d4330e53963397229312c4e4f5"} Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.381125 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.394496 5030 scope.go:117] "RemoveContainer" containerID="670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.403779 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "294c61ef-1239-444f-adb6-7786bc89bb94" (UID: "294c61ef-1239-444f-adb6-7786bc89bb94"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.431624 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data" (OuterVolumeSpecName: "config-data") pod "294c61ef-1239-444f-adb6-7786bc89bb94" (UID: "294c61ef-1239-444f-adb6-7786bc89bb94"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.470865 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.471012 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.471097 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294c61ef-1239-444f-adb6-7786bc89bb94-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.471187 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/294c61ef-1239-444f-adb6-7786bc89bb94-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.471249 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89v95\" (UniqueName: \"kubernetes.io/projected/294c61ef-1239-444f-adb6-7786bc89bb94-kube-api-access-89v95\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.497171 5030 scope.go:117] "RemoveContainer" containerID="0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.498135 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8\": container with ID starting with 0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8 not found: ID does not exist" containerID="0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.498245 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8"} err="failed to get container status \"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8\": rpc error: code = NotFound desc = could not find container \"0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8\": container with ID starting with 0632e8d664e3c7a8d4bb49d17eb598144f1478e43c3263d1c2127df803e005f8 not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.498354 5030 scope.go:117] "RemoveContainer" containerID="670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.498917 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a\": container with ID starting with 670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a not found: ID does not exist" containerID="670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.498957 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a"} err="failed to get container status \"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a\": rpc error: code = NotFound desc = could not find container \"670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a\": container with ID starting with 670fcfb435c336dcf82aa66fbc8197ca08b17d87948381da6bf357258415e20a not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.498984 5030 scope.go:117] "RemoveContainer" containerID="9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.510381 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.535265 5030 scope.go:117] "RemoveContainer" containerID="befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.535419 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-vdpnw"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.544813 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.554926 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.568480 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.574335 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.581531 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582719 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582739 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582755 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582762 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582774 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582781 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582791 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-central-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582796 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-central-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582812 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="proxy-httpd" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582820 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="proxy-httpd" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582832 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe427e5-4271-420b-8211-71b57749c5ef" containerName="oc" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe427e5-4271-420b-8211-71b57749c5ef" containerName="oc" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582860 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582865 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582880 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="sg-core" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582885 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="sg-core" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582893 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-notification-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582900 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-notification-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582906 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.582911 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583109 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbe427e5-4271-420b-8211-71b57749c5ef" containerName="oc" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583122 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583131 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener-log" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583140 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-notification-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583149 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583159 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="proxy-httpd" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583173 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" containerName="barbican-keystone-listener" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583180 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="ceilometer-central-agent" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583189 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" containerName="sg-core" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.583197 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" containerName="barbican-worker" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.585581 5030 scope.go:117] "RemoveContainer" containerID="9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.588494 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15\": container with ID starting with 9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15 not found: ID does not exist" containerID="9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.588532 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15"} err="failed to get container status \"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15\": rpc error: code = NotFound desc = could not find container \"9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15\": container with ID starting with 9a1176f3c29609dbead73c8a5890500f1121a43db9a4411934c62d8090113f15 not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.588579 5030 scope.go:117] "RemoveContainer" containerID="befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.590285 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229\": container with ID starting with befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229 not found: ID does not exist" containerID="befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.590315 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229"} err="failed to get container status \"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229\": rpc error: code = NotFound desc = could not find container \"befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229\": container with ID starting with befeda2f53c603efe7e2df27e503f0a6457a9173068075a71ff2faa0f92aa229 not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.590331 5030 scope.go:117] "RemoveContainer" containerID="ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.596426 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.596624 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.598406 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.600102 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.600187 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.607275 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.607313 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.607448 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.609195 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.609230 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.616806 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.616952 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.632252 5030 scope.go:117] "RemoveContainer" containerID="d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677239 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v48ch\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677623 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpnxs\" (UniqueName: \"kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677689 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677776 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.677872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678022 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678131 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678242 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678429 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678492 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678584 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.678963 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s29j\" (UniqueName: \"kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.679038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.700350 5030 scope.go:117] "RemoveContainer" containerID="22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.726256 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.736803 5030 scope.go:117] "RemoveContainer" containerID="8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.740857 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-pzfr8"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.758449 5030 scope.go:117] "RemoveContainer" containerID="ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.759008 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d\": container with ID starting with ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d not found: ID does not exist" containerID="ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.759057 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d"} err="failed to get container status \"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d\": rpc error: code = NotFound desc = could not find container \"ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d\": container with ID starting with ab0d16a76d5d2be4ae51d266e2ffad87fc65053a5b546da43770b9756e5d756d not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.759093 5030 scope.go:117] "RemoveContainer" containerID="d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.759811 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763\": container with ID starting with d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763 not found: ID does not exist" containerID="d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.759858 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763"} err="failed to get container status \"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763\": rpc error: code = NotFound desc = could not find container \"d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763\": container with ID starting with d6325a37b03064e74699b5f60e70668fd18e133b8524090d12d54d91b64d2763 not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.759889 5030 scope.go:117] "RemoveContainer" containerID="22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.760202 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1\": container with ID starting with 22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1 not found: ID does not exist" containerID="22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.760257 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1"} err="failed to get container status \"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1\": rpc error: code = NotFound desc = could not find container \"22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1\": container with ID starting with 22627aaa9299228668274879190a65c38103f06d17ae64994f096fbe393766d1 not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.760283 5030 scope.go:117] "RemoveContainer" containerID="8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c" Mar 16 13:44:09 crc kubenswrapper[5030]: E0316 13:44:09.760599 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c\": container with ID starting with 8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c not found: ID does not exist" containerID="8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.760662 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c"} err="failed to get container status \"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c\": rpc error: code = NotFound desc = could not find container \"8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c\": container with ID starting with 8c542479f321842832756389c00dd0af8507ac0bc6b4ca6a8932ed7266b3217c not found: ID does not exist" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.760678 5030 scope.go:117] "RemoveContainer" containerID="77ae5083fc9cdc2142e78d8cf1b88998c9f86e650b09810ac3158961444a0e69" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.781981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782056 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v48ch\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782087 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpnxs\" (UniqueName: \"kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782111 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782199 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782238 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782285 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782313 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782354 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782464 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782527 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782562 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6s29j\" (UniqueName: \"kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782590 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.782593 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.783167 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.783384 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.784812 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.793389 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.794063 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.794221 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.796041 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.796156 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.796186 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.796256 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.797664 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.798271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.799383 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpnxs\" (UniqueName: \"kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.799488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.800208 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts\") pod \"ceilometer-0\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.800431 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.801357 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s29j\" (UniqueName: \"kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j\") pod \"nova-cell1-conductor-0\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.804257 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v48ch\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch\") pod \"swift-proxy-775558c784-nmdlz\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.856234 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.857581 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.926016 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.942722 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.958499 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdd17b2-757d-481f-a166-e552973c1bba" path="/var/lib/kubelet/pods/0fdd17b2-757d-481f-a166-e552973c1bba/volumes" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.959264 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294c61ef-1239-444f-adb6-7786bc89bb94" path="/var/lib/kubelet/pods/294c61ef-1239-444f-adb6-7786bc89bb94/volumes" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.965916 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8ad3a4-6f44-4eda-bae4-6bc893f34e58" path="/var/lib/kubelet/pods/6f8ad3a4-6f44-4eda-bae4-6bc893f34e58/volumes" Mar 16 13:44:09 crc kubenswrapper[5030]: I0316 13:44:09.966596 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71389c0e-fb3c-4255-8333-717584f0dae9" path="/var/lib/kubelet/pods/71389c0e-fb3c-4255-8333-717584f0dae9/volumes" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.217195 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.217476 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.268766 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.274201 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.338899 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.389745 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerStarted","Data":"c6a7339fb0eefcc8307c45167c098dd71ba5aa43cc1e3fae424f211e7c9f7c32"} Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.396763 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.396802 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.422805 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.430371 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:10 crc kubenswrapper[5030]: W0316 13:44:10.451464 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e932185_2e0e_4845_a258_a48580b8af5d.slice/crio-b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11 WatchSource:0}: Error finding container b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11: Status 404 returned error can't find the container with id b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11 Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.534433 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.534710 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.581203 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.581256 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.923640 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:44:10 crc kubenswrapper[5030]: I0316 13:44:10.970851 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.246064 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.410197 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerStarted","Data":"fe0d145d0aa2a2e66ce1a58a2a706bf85ecc3cf1794644272856192c8a3cfb5b"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.413628 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bedb1082-b93a-49aa-89e5-17faf391b81a","Type":"ContainerStarted","Data":"4a07accc387220399ab6dca08be48452c5423895167772740deddcaa9d92a5df"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.413681 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bedb1082-b93a-49aa-89e5-17faf391b81a","Type":"ContainerStarted","Data":"2d05e0d75ff0d06554f3f64bbb953e01d1d1eda9b257ae1c986bbfc519715eff"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.413731 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418003 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerStarted","Data":"4c455a4b8b95ca1eba09d8e139eac3253f2ce455e476fe5effc103e57a8c8dcc"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418035 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerStarted","Data":"e13ff8885b326ba542092f5269716a5cc9aed50be25f0ffa805c8c4d13543766"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418052 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418061 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerStarted","Data":"b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11"} Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418071 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418081 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.418089 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.431359 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.431347887 podStartE2EDuration="2.431347887s" podCreationTimestamp="2026-03-16 13:44:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:11.428985825 +0000 UTC m=+2295.828298372" watchObservedRunningTime="2026-03-16 13:44:11.431347887 +0000 UTC m=+2295.830660434" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.449464 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" podStartSLOduration=2.449453207 podStartE2EDuration="2.449453207s" podCreationTimestamp="2026-03-16 13:44:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:11.447257088 +0000 UTC m=+2295.846569634" watchObservedRunningTime="2026-03-16 13:44:11.449453207 +0000 UTC m=+2295.848765754" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.572025 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.790799 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:11 crc kubenswrapper[5030]: I0316 13:44:11.846913 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.154188 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.371630 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.372454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-log" containerID="cri-o://74e865a20823a9f25ad5767b2bf345cc75d0e6f07940b858280faca697cd8dad" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.372926 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-api" containerID="cri-o://5fea847316980c600bf225624d67d88be3fb53fd4a7ec593a4314d60d2f06471" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.401650 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-log" probeResult="failure" output="Get \"https://10.217.0.141:8778/\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.419278 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.141:8778/\": read tcp 10.217.0.2:50740->10.217.0.141:8778: read: connection reset by peer" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.432984 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerStarted","Data":"d009664d043b9f838006bbc4280c2570fe92ffefee9671d7712b47035660b287"} Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.433731 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.433752 5030 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.434043 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" containerID="cri-o://6aa264c00fe74a92e2a3d3960ea920630b83182fd71c1c5f2fec1fdba1993356" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.434225 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" containerID="cri-o://7a9e36b7e519090c25100a0f288d2abfa121e3fd0dde5207c05eb2265331b79b" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.434718 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" containerID="cri-o://cf428a1b9f28401055b4d46f0ef2097ebf5b885395f5e937c44aae9f06a8f4f7" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.434833 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" containerID="cri-o://6501af12ade6721c99ecf9efefc870c95c731c78ce8e913aabab7eb5396cee9b" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.445694 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.458665 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.463098 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.485510 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.485990 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="cinder-scheduler" containerID="cri-o://30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.486359 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="probe" containerID="cri-o://e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.486705 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.143:9292/healthcheck\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.486982 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.143:9292/healthcheck\": EOF" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.503599 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.609140 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.609665 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api-log" containerID="cri-o://2e484f8a9260112500afbb25ead1854af02a3aa3ce489f90ace6133e62b50f4c" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.609950 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api" containerID="cri-o://a4ee5d8402e5faad087dd9f6d5c41e49bbe5357d0fd48bfd39d624279db5fc36" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.624248 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.148:8776/healthcheck\": read tcp 10.217.0.2:37380->10.217.0.148:8776: read: connection reset by peer" Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.837920 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.838215 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-api" containerID="cri-o://4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.838361 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-httpd" containerID="cri-o://cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068" gracePeriod=30 Mar 16 13:44:12 crc kubenswrapper[5030]: I0316 13:44:12.865956 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.142:9696/\": EOF" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.240868 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.241302 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerName="nova-cell0-conductor-conductor" containerID="cri-o://ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.374284 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.385232 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.404962 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.431037 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.471039 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.518829 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.518940 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.519249 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.519355 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ddm4\" (UniqueName: \"kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.519664 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.592767 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.595388 5030 generic.go:358] "Generic (PLEG): container finished" podID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerID="cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068" exitCode=0 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.595638 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerDied","Data":"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.620305 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.620822 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" containerID="cri-o://0b1e42be70589f3e99bf54158f09bcccdcfc11eef50fea6cb0e9ad7c75e86b93" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.624742 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5d4d\" (UniqueName: \"kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.624881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.624960 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.624989 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ddm4\" (UniqueName: \"kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625138 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625190 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625265 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625386 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.625407 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.631638 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.640540 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" containerID="cri-o://0562aa7e24c003d1a504f7a47f2a7c9268fd557bf551de5e0643c2a593a728d5" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.643313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.646249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.655582 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.670896 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": EOF" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.671194 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": EOF" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.674336 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.674582 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="54b6dffe-7356-4d45-bec3-8416d27c7e81" containerName="nova-scheduler-scheduler" containerID="cri-o://d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.674926 5030 generic.go:358] "Generic (PLEG): container finished" podID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerID="a4ee5d8402e5faad087dd9f6d5c41e49bbe5357d0fd48bfd39d624279db5fc36" exitCode=0 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.674944 5030 generic.go:358] "Generic (PLEG): container finished" podID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerID="2e484f8a9260112500afbb25ead1854af02a3aa3ce489f90ace6133e62b50f4c" exitCode=143 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.675054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerDied","Data":"a4ee5d8402e5faad087dd9f6d5c41e49bbe5357d0fd48bfd39d624279db5fc36"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.675080 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerDied","Data":"2e484f8a9260112500afbb25ead1854af02a3aa3ce489f90ace6133e62b50f4c"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.678239 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ddm4\" (UniqueName: \"kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4\") pod \"barbican-keystone-listener-6b4d547578-6hb2k\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.683833 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.687302 5030 generic.go:358] "Generic (PLEG): container finished" podID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerID="6501af12ade6721c99ecf9efefc870c95c731c78ce8e913aabab7eb5396cee9b" exitCode=143 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.687385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerDied","Data":"6501af12ade6721c99ecf9efefc870c95c731c78ce8e913aabab7eb5396cee9b"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.697361 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.697565 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-log" containerID="cri-o://ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.697845 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-metadata" containerID="cri-o://983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.704998 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.705288 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-log" containerID="cri-o://d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.705357 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-api" containerID="cri-o://2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" gracePeriod=30 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.719872 5030 generic.go:358] "Generic (PLEG): container finished" podID="e49acc44-7ca6-465e-a365-63887c202b70" containerID="30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166" exitCode=0 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.720360 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerDied","Data":"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.731178 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.731881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.731929 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.731960 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.732053 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5d4d\" (UniqueName: \"kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.732126 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.732508 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.741675 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.750600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.757970 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.766888 5030 generic.go:358] "Generic (PLEG): container finished" podID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerID="6aa264c00fe74a92e2a3d3960ea920630b83182fd71c1c5f2fec1fdba1993356" exitCode=143 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.767067 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerDied","Data":"6aa264c00fe74a92e2a3d3960ea920630b83182fd71c1c5f2fec1fdba1993356"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.774707 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerStarted","Data":"6b2d58f63659c3022c9a4c0aae0b7ef3bbf2ae14d0fefb254e270ff76923f1c5"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.774971 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5d4d\" (UniqueName: \"kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d\") pod \"barbican-worker-68b6d4cb87-86zn5\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.778186 5030 generic.go:358] "Generic (PLEG): container finished" podID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerID="5fea847316980c600bf225624d67d88be3fb53fd4a7ec593a4314d60d2f06471" exitCode=0 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.778206 5030 generic.go:358] "Generic (PLEG): container finished" podID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerID="74e865a20823a9f25ad5767b2bf345cc75d0e6f07940b858280faca697cd8dad" exitCode=143 Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.778993 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerDied","Data":"5fea847316980c600bf225624d67d88be3fb53fd4a7ec593a4314d60d2f06471"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.779017 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerDied","Data":"74e865a20823a9f25ad5767b2bf345cc75d0e6f07940b858280faca697cd8dad"} Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.858696 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.897692 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.936986 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937048 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937257 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937613 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q686\" (UniqueName: \"kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937640 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.937691 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs\") pod \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\" (UID: \"196ff66d-0bd1-4dc1-b113-8a4a010f9209\") " Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.943234 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs" (OuterVolumeSpecName: "logs") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:13 crc kubenswrapper[5030]: I0316 13:44:13.970733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts" (OuterVolumeSpecName: "scripts") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.015703 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686" (OuterVolumeSpecName: "kube-api-access-5q686") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "kube-api-access-5q686". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.046382 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q686\" (UniqueName: \"kubernetes.io/projected/196ff66d-0bd1-4dc1-b113-8a4a010f9209-kube-api-access-5q686\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.046411 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/196ff66d-0bd1-4dc1-b113-8a4a010f9209-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.046430 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.098541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.126094 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data" (OuterVolumeSpecName: "config-data") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.149846 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.149966 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.150191 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.240726 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.252616 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.252743 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.252929 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253021 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253308 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253465 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xbr\" (UniqueName: \"kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253674 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.253770 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts\") pod \"af9b036a-a766-4320-b4b7-3f08bf23ad29\" (UID: \"af9b036a-a766-4320-b4b7-3f08bf23ad29\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.254474 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.256034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs" (OuterVolumeSpecName: "logs") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.256066 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.284697 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts" (OuterVolumeSpecName: "scripts") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.292590 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.307830 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr" (OuterVolumeSpecName: "kube-api-access-42xbr") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "kube-api-access-42xbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.362342 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.362398 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xbr\" (UniqueName: \"kubernetes.io/projected/af9b036a-a766-4320-b4b7-3f08bf23ad29-kube-api-access-42xbr\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.362409 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.362418 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/af9b036a-a766-4320-b4b7-3f08bf23ad29-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.362436 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/af9b036a-a766-4320-b4b7-3f08bf23ad29-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.368805 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.385775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "196ff66d-0bd1-4dc1-b113-8a4a010f9209" (UID: "196ff66d-0bd1-4dc1-b113-8a4a010f9209"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.464325 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.469224 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l5wj\" (UniqueName: \"kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.469400 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.469637 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.469874 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.470107 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id\") pod \"e49acc44-7ca6-465e-a365-63887c202b70\" (UID: \"e49acc44-7ca6-465e-a365-63887c202b70\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.470760 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/196ff66d-0bd1-4dc1-b113-8a4a010f9209-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.475624 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.468767 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.498807 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.503156 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts" (OuterVolumeSpecName: "scripts") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.503286 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.504806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj" (OuterVolumeSpecName: "kube-api-access-9l5wj") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "kube-api-access-9l5wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.527678 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.542568 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data" (OuterVolumeSpecName: "config-data") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.543335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "af9b036a-a766-4320-b4b7-3f08bf23ad29" (UID: "af9b036a-a766-4320-b4b7-3f08bf23ad29"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.577035 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs\") pod \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.577376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vprz7\" (UniqueName: \"kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7\") pod \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.577439 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle\") pod \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.577671 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data\") pod \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.577881 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs\") pod \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\" (UID: \"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.578332 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs" (OuterVolumeSpecName: "logs") pod "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" (UID: "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.578750 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.578839 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.578902 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.578964 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/e49acc44-7ca6-465e-a365-63887c202b70-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.579022 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.579079 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l5wj\" (UniqueName: \"kubernetes.io/projected/e49acc44-7ca6-465e-a365-63887c202b70-kube-api-access-9l5wj\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.579135 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.579320 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.579381 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/af9b036a-a766-4320-b4b7-3f08bf23ad29-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.589747 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7" (OuterVolumeSpecName: "kube-api-access-vprz7") pod "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" (UID: "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6"). InnerVolumeSpecName "kube-api-access-vprz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.635160 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data" (OuterVolumeSpecName: "config-data") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.671791 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" (UID: "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.679214 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" (UID: "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.682923 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vprz7\" (UniqueName: \"kubernetes.io/projected/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-kube-api-access-vprz7\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.682964 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.682974 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.682984 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.700639 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.700864 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="bedb1082-b93a-49aa-89e5-17faf391b81a" containerName="nova-cell1-conductor-conductor" containerID="cri-o://4a07accc387220399ab6dca08be48452c5423895167772740deddcaa9d92a5df" gracePeriod=30 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.710839 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data" (OuterVolumeSpecName: "config-data") pod "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" (UID: "ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.710980 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e49acc44-7ca6-465e-a365-63887c202b70" (UID: "e49acc44-7ca6-465e-a365-63887c202b70"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.738588 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.751103 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.793743 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.794060 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e49acc44-7ca6-465e-a365-63887c202b70-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.805211 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" event={"ID":"196ff66d-0bd1-4dc1-b113-8a4a010f9209","Type":"ContainerDied","Data":"7ab3220c368f136199d0b69d09453224c1db2d3245acadb0af3f35802546178a"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.805279 5030 scope.go:117] "RemoveContainer" containerID="5fea847316980c600bf225624d67d88be3fb53fd4a7ec593a4314d60d2f06471" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.805473 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-64f687559b-qm7qj" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.825720 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.826701 5030 generic.go:358] "Generic (PLEG): container finished" podID="bf225c37-5611-47f6-995b-615f1f648742" containerID="0b1e42be70589f3e99bf54158f09bcccdcfc11eef50fea6cb0e9ad7c75e86b93" exitCode=143 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.826852 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerDied","Data":"0b1e42be70589f3e99bf54158f09bcccdcfc11eef50fea6cb0e9ad7c75e86b93"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829646 5030 generic.go:358] "Generic (PLEG): container finished" podID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerID="983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" exitCode=0 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829669 5030 generic.go:358] "Generic (PLEG): container finished" podID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerID="ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" exitCode=143 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829809 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerDied","Data":"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829835 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerDied","Data":"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6","Type":"ContainerDied","Data":"8b8677b1fc087ef99a79565534c4e62e12485d986b093481ca2991bf96e815bc"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.829904 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.850525 5030 scope.go:117] "RemoveContainer" containerID="74e865a20823a9f25ad5767b2bf345cc75d0e6f07940b858280faca697cd8dad" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.851283 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"af9b036a-a766-4320-b4b7-3f08bf23ad29","Type":"ContainerDied","Data":"ddfbb426b84372e6e57d997ca3a9cbb6999dfc01b6d506731f0bb2a8d24ce832"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.851380 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.866822 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.866940 5030 generic.go:358] "Generic (PLEG): container finished" podID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerID="2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" exitCode=0 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.867059 5030 generic.go:358] "Generic (PLEG): container finished" podID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerID="d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" exitCode=143 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.867128 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerDied","Data":"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.867147 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerDied","Data":"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.867158 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"29c3410b-9a0c-462f-9743-8ebe9403c9dd","Type":"ContainerDied","Data":"1f9f852ac7d647ae567a743c99b72d56b766e05627f5ff0bd7a829e074666dab"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.867216 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.871604 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerStarted","Data":"a40974de403a13837ddedc19ae2e92846c0c411f7ec13c8ac4153563a31f2b97"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.877720 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-64f687559b-qm7qj"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.881776 5030 generic.go:358] "Generic (PLEG): container finished" podID="e49acc44-7ca6-465e-a365-63887c202b70" containerID="e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6" exitCode=0 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.882201 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="98d53f79-da23-4943-81fa-20a1e84bc2d5" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://24e4ee8f7e3badbc851d3c547ad3993a101e3d880413483b95d054e1bd3eab58" gracePeriod=30 Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.882321 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.886068 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerDied","Data":"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.886125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"e49acc44-7ca6-465e-a365-63887c202b70","Type":"ContainerDied","Data":"dc368a1c38ce85c20526fa89e305dc8a3392dc49b04f3595a80c1c0efa371ed0"} Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.895711 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.895951 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.896096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.896132 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz262\" (UniqueName: \"kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.896369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.896418 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs\") pod \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\" (UID: \"29c3410b-9a0c-462f-9743-8ebe9403c9dd\") " Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.899743 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs" (OuterVolumeSpecName: "logs") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.910609 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.929690 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.944708 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945691 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945707 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945720 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945726 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945749 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="cinder-scheduler" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945755 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="cinder-scheduler" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945767 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945772 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945793 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="probe" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945798 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="probe" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945804 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945809 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945819 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945825 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945833 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-metadata" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-metadata" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945851 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945857 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945862 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.945868 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946026 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946037 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="cinder-scheduler" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946048 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946056 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946063 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" containerName="nova-api-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946071 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-metadata" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946079 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e49acc44-7ca6-465e-a365-63887c202b70" containerName="probe" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946087 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" containerName="cinder-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946096 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" containerName="nova-metadata-log" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946106 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" containerName="placement-api" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.946810 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262" (OuterVolumeSpecName: "kube-api-access-nz262") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "kube-api-access-nz262". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.950079 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.954238 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.954461 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.961107 5030 scope.go:117] "RemoveContainer" containerID="983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.963648 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.976403 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.992524 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:14 crc kubenswrapper[5030]: I0316 13:44:14.995995 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.072910 5030 scope.go:117] "RemoveContainer" containerID="ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077395 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077495 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077616 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlkgn\" (UniqueName: \"kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077862 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29c3410b-9a0c-462f-9743-8ebe9403c9dd-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.077880 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz262\" (UniqueName: \"kubernetes.io/projected/29c3410b-9a0c-462f-9743-8ebe9403c9dd-kube-api-access-nz262\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.086927 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.091463 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.092799 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.093298 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.095977 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-vz7xz\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.105816 5030 scope.go:117] "RemoveContainer" containerID="983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.106194 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa\": container with ID starting with 983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa not found: ID does not exist" containerID="983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.106247 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa"} err="failed to get container status \"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa\": rpc error: code = NotFound desc = could not find container \"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa\": container with ID starting with 983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.106274 5030 scope.go:117] "RemoveContainer" containerID="ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.109007 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8\": container with ID starting with ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8 not found: ID does not exist" containerID="ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.109052 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8"} err="failed to get container status \"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8\": rpc error: code = NotFound desc = could not find container \"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8\": container with ID starting with ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.109076 5030 scope.go:117] "RemoveContainer" containerID="983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.119150 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa"} err="failed to get container status \"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa\": rpc error: code = NotFound desc = could not find container \"983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa\": container with ID starting with 983546680e8ba7d3b2c7eb1b0496234115b26d35ad12505e0427211e9a48d3aa not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.119201 5030 scope.go:117] "RemoveContainer" containerID="ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.132440 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8"} err="failed to get container status \"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8\": rpc error: code = NotFound desc = could not find container \"ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8\": container with ID starting with ec387c2e636f1be5294970438bdca9c5a25abfcb97230fa2e339a69f7a765bf8 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.132467 5030 scope.go:117] "RemoveContainer" containerID="a4ee5d8402e5faad087dd9f6d5c41e49bbe5357d0fd48bfd39d624279db5fc36" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.151603 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.189292 5030 scope.go:117] "RemoveContainer" containerID="2e484f8a9260112500afbb25ead1854af02a3aa3ce489f90ace6133e62b50f4c" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.190701 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.192018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlkgn\" (UniqueName: \"kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.192391 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.192917 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.193132 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.193570 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.191807 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.207328 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.208850 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.211416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlkgn\" (UniqueName: \"kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.217841 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.234859 5030 scope.go:117] "RemoveContainer" containerID="2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.235018 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.246272 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.248180 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.252053 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.252588 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.252957 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.253627 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.281201 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295643 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295712 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjjch\" (UniqueName: \"kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295737 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295822 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kt2t\" (UniqueName: \"kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295884 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295921 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295940 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.295979 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.296018 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.296080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.296096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.296110 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.330203 5030 scope.go:117] "RemoveContainer" containerID="d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.363734 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.367114 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.380991 5030 scope.go:117] "RemoveContainer" containerID="2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.382477 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639\": container with ID starting with 2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639 not found: ID does not exist" containerID="2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.382530 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639"} err="failed to get container status \"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639\": rpc error: code = NotFound desc = could not find container \"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639\": container with ID starting with 2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.382573 5030 scope.go:117] "RemoveContainer" containerID="d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.387930 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683\": container with ID starting with d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683 not found: ID does not exist" containerID="d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.387971 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683"} err="failed to get container status \"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683\": rpc error: code = NotFound desc = could not find container \"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683\": container with ID starting with d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.387992 5030 scope.go:117] "RemoveContainer" containerID="2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.392059 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639"} err="failed to get container status \"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639\": rpc error: code = NotFound desc = could not find container \"2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639\": container with ID starting with 2f4b85375d0774132de3d5cb3ad9b365f128fd00c3e2c849c17374b4496be639 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.392086 5030 scope.go:117] "RemoveContainer" containerID="d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.392642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data" (OuterVolumeSpecName: "config-data") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.395761 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.396204 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683"} err="failed to get container status \"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683\": rpc error: code = NotFound desc = could not find container \"d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683\": container with ID starting with d3c42d924b4a0f334fd182ac93898f4479daa227ce04609d983f943fb7b9c683 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.396226 5030 scope.go:117] "RemoveContainer" containerID="e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397721 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397790 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397810 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjjch\" (UniqueName: \"kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397846 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397902 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.397981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kt2t\" (UniqueName: \"kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398024 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398074 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398107 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398129 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398184 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398248 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398342 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398379 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398469 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398486 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.398497 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.399034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.400937 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.405666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "29c3410b-9a0c-462f-9743-8ebe9403c9dd" (UID: "29c3410b-9a0c-462f-9743-8ebe9403c9dd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.405825 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.415845 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.421098 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.423755 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.431136 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.431309 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.431938 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.436151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.440467 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.440704 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.449141 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjjch\" (UniqueName: \"kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch\") pod \"cinder-api-0\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.449225 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.451349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kt2t\" (UniqueName: \"kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t\") pod \"cinder-scheduler-0\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.499290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.500019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.500115 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.500279 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.500397 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.503973 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.504120 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsf2s\" (UniqueName: \"kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s\") pod \"d176b094-0552-4e4c-95c9-3ba756709a5c\" (UID: \"d176b094-0552-4e4c-95c9-3ba756709a5c\") " Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.504574 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29c3410b-9a0c-462f-9743-8ebe9403c9dd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.509418 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.512939 5030 scope.go:117] "RemoveContainer" containerID="30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.521838 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s" (OuterVolumeSpecName: "kube-api-access-tsf2s") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "kube-api-access-tsf2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.578976 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.606660 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsf2s\" (UniqueName: \"kubernetes.io/projected/d176b094-0552-4e4c-95c9-3ba756709a5c-kube-api-access-tsf2s\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.606694 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.612381 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.639643 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.695186 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.708593 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.711487 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.711511 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.711520 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.715649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.728829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config" (OuterVolumeSpecName: "config") pod "d176b094-0552-4e4c-95c9-3ba756709a5c" (UID: "d176b094-0552-4e4c-95c9-3ba756709a5c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.804602 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.804761 5030 scope.go:117] "RemoveContainer" containerID="e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.808802 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6\": container with ID starting with e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6 not found: ID does not exist" containerID="e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.808846 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6"} err="failed to get container status \"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6\": rpc error: code = NotFound desc = could not find container \"e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6\": container with ID starting with e676ab711f500c72202bcdb148a352f9c15a573ff044585f1393490c0d8eaaf6 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.808872 5030 scope.go:117] "RemoveContainer" containerID="30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166" Mar 16 13:44:15 crc kubenswrapper[5030]: E0316 13:44:15.812633 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166\": container with ID starting with 30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166 not found: ID does not exist" containerID="30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.812665 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166"} err="failed to get container status \"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166\": rpc error: code = NotFound desc = could not find container \"30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166\": container with ID starting with 30404d60830cc4f61bf72f385d362defe2229476572baa38c2dcdf395502c166 not found: ID does not exist" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.814691 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.814715 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d176b094-0552-4e4c-95c9-3ba756709a5c-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.839469 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.847509 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848636 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-httpd" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848651 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-httpd" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848698 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-api" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848704 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-api" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848905 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-api" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.848917 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerName="neutron-httpd" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.856388 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.856508 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.859633 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.859989 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.860131 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.878385 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:15 crc kubenswrapper[5030]: W0316 13:44:15.879989 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6980b22d_cacf_43fa_9a2d_7b9f5a24a5ef.slice/crio-216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc WatchSource:0}: Error finding container 216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc: Status 404 returned error can't find the container with id 216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.915439 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerStarted","Data":"34f5f180611ebf8981f7a57e7b2a5fc3422c18edea666dbb0dd27e2fea57c23b"} Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.916048 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-central-agent" containerID="cri-o://fe0d145d0aa2a2e66ce1a58a2a706bf85ecc3cf1794644272856192c8a3cfb5b" gracePeriod=30 Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.916371 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.917011 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="proxy-httpd" containerID="cri-o://34f5f180611ebf8981f7a57e7b2a5fc3422c18edea666dbb0dd27e2fea57c23b" gracePeriod=30 Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.917120 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-notification-agent" containerID="cri-o://d009664d043b9f838006bbc4280c2570fe92ffefee9671d7712b47035660b287" gracePeriod=30 Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.917195 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="sg-core" containerID="cri-o://6b2d58f63659c3022c9a4c0aae0b7ef3bbf2ae14d0fefb254e270ff76923f1c5" gracePeriod=30 Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.932995 5030 generic.go:358] "Generic (PLEG): container finished" podID="98d53f79-da23-4943-81fa-20a1e84bc2d5" containerID="24e4ee8f7e3badbc851d3c547ad3993a101e3d880413483b95d054e1bd3eab58" exitCode=0 Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.933312 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"98d53f79-da23-4943-81fa-20a1e84bc2d5","Type":"ContainerDied","Data":"24e4ee8f7e3badbc851d3c547ad3993a101e3d880413483b95d054e1bd3eab58"} Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.966799 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.486994683 podStartE2EDuration="6.966780061s" podCreationTimestamp="2026-03-16 13:44:09 +0000 UTC" firstStartedPulling="2026-03-16 13:44:10.336407516 +0000 UTC m=+2294.735720063" lastFinishedPulling="2026-03-16 13:44:14.816192894 +0000 UTC m=+2299.215505441" observedRunningTime="2026-03-16 13:44:15.953917899 +0000 UTC m=+2300.353230447" watchObservedRunningTime="2026-03-16 13:44:15.966780061 +0000 UTC m=+2300.366092607" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.977909 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:15 crc kubenswrapper[5030]: I0316 13:44:15.986892 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.004795 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="196ff66d-0bd1-4dc1-b113-8a4a010f9209" path="/var/lib/kubelet/pods/196ff66d-0bd1-4dc1-b113-8a4a010f9209/volumes" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.005488 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c3410b-9a0c-462f-9743-8ebe9403c9dd" path="/var/lib/kubelet/pods/29c3410b-9a0c-462f-9743-8ebe9403c9dd/volumes" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.006095 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af9b036a-a766-4320-b4b7-3f08bf23ad29" path="/var/lib/kubelet/pods/af9b036a-a766-4320-b4b7-3f08bf23ad29/volumes" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.007269 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49acc44-7ca6-465e-a365-63887c202b70" path="/var/lib/kubelet/pods/e49acc44-7ca6-465e-a365-63887c202b70/volumes" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.007886 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6" path="/var/lib/kubelet/pods/ea870d72-fdcb-4b7d-b2d7-e0f06ef62cd6/volumes" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.013833 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerStarted","Data":"33ab4ba5ddc6e00f0235995ac7a380aa7fc85703f8c6e1bed39d09f4eab5f383"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.013875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerStarted","Data":"f56d97d38f18d1a7842662df81d79464c5460a66b9fa5bfbb2511e0a0d821289"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.018940 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs\") pod \"98d53f79-da23-4943-81fa-20a1e84bc2d5\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.019015 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94lll\" (UniqueName: \"kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll\") pod \"98d53f79-da23-4943-81fa-20a1e84bc2d5\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.019081 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s29j\" (UniqueName: \"kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j\") pod \"bedb1082-b93a-49aa-89e5-17faf391b81a\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.019287 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data\") pod \"bedb1082-b93a-49aa-89e5-17faf391b81a\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.026615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle\") pod \"bedb1082-b93a-49aa-89e5-17faf391b81a\" (UID: \"bedb1082-b93a-49aa-89e5-17faf391b81a\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.026745 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle\") pod \"98d53f79-da23-4943-81fa-20a1e84bc2d5\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.026882 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data\") pod \"98d53f79-da23-4943-81fa-20a1e84bc2d5\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.026976 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs\") pod \"98d53f79-da23-4943-81fa-20a1e84bc2d5\" (UID: \"98d53f79-da23-4943-81fa-20a1e84bc2d5\") " Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.027630 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrmp\" (UniqueName: \"kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.027854 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.027943 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.027963 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.028083 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.028259 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.043291 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j" (OuterVolumeSpecName: "kube-api-access-6s29j") pod "bedb1082-b93a-49aa-89e5-17faf391b81a" (UID: "bedb1082-b93a-49aa-89e5-17faf391b81a"). InnerVolumeSpecName "kube-api-access-6s29j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.044098 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll" (OuterVolumeSpecName: "kube-api-access-94lll") pod "98d53f79-da23-4943-81fa-20a1e84bc2d5" (UID: "98d53f79-da23-4943-81fa-20a1e84bc2d5"). InnerVolumeSpecName "kube-api-access-94lll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.057530 5030 generic.go:358] "Generic (PLEG): container finished" podID="bedb1082-b93a-49aa-89e5-17faf391b81a" containerID="4a07accc387220399ab6dca08be48452c5423895167772740deddcaa9d92a5df" exitCode=0 Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.057803 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"bedb1082-b93a-49aa-89e5-17faf391b81a","Type":"ContainerDied","Data":"4a07accc387220399ab6dca08be48452c5423895167772740deddcaa9d92a5df"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.061745 5030 scope.go:117] "RemoveContainer" containerID="4a07accc387220399ab6dca08be48452c5423895167772740deddcaa9d92a5df" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.067512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerStarted","Data":"216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.074260 5030 generic.go:358] "Generic (PLEG): container finished" podID="d176b094-0552-4e4c-95c9-3ba756709a5c" containerID="4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0" exitCode=0 Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.074375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerDied","Data":"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.074416 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" event={"ID":"d176b094-0552-4e4c-95c9-3ba756709a5c","Type":"ContainerDied","Data":"b809ed6a687bb1e185d76a21140c2bdc90e0927e2e24c265511c3ea5a410878a"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.074507 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-67dbf445bd-b5v4n" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.087632 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.108348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerStarted","Data":"261f920f417aed1085ab33305627f98da93c33458bfa5394c1b0376b0f50472e"} Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.123010 5030 scope.go:117] "RemoveContainer" containerID="cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134597 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrmp\" (UniqueName: \"kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134830 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.134932 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.135072 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94lll\" (UniqueName: \"kubernetes.io/projected/98d53f79-da23-4943-81fa-20a1e84bc2d5-kube-api-access-94lll\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.135085 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s29j\" (UniqueName: \"kubernetes.io/projected/bedb1082-b93a-49aa-89e5-17faf391b81a-kube-api-access-6s29j\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.163461 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.164074 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.170939 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.173955 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.182406 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrmp\" (UniqueName: \"kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.187891 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data" (OuterVolumeSpecName: "config-data") pod "bedb1082-b93a-49aa-89e5-17faf391b81a" (UID: "bedb1082-b93a-49aa-89e5-17faf391b81a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.188365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.212793 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.213785 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.228821 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bedb1082-b93a-49aa-89e5-17faf391b81a" (UID: "bedb1082-b93a-49aa-89e5-17faf391b81a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.237782 5030 scope.go:117] "RemoveContainer" containerID="4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.241792 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.242785 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bedb1082-b93a-49aa-89e5-17faf391b81a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.262221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data" (OuterVolumeSpecName: "config-data") pod "98d53f79-da23-4943-81fa-20a1e84bc2d5" (UID: "98d53f79-da23-4943-81fa-20a1e84bc2d5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.262390 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-67dbf445bd-b5v4n"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.265657 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "98d53f79-da23-4943-81fa-20a1e84bc2d5" (UID: "98d53f79-da23-4943-81fa-20a1e84bc2d5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.270130 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" podStartSLOduration=3.270108121 podStartE2EDuration="3.270108121s" podCreationTimestamp="2026-03-16 13:44:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:16.132937623 +0000 UTC m=+2300.532250160" watchObservedRunningTime="2026-03-16 13:44:16.270108121 +0000 UTC m=+2300.669420668" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.274990 5030 scope.go:117] "RemoveContainer" containerID="cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.280601 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "98d53f79-da23-4943-81fa-20a1e84bc2d5" (UID: "98d53f79-da23-4943-81fa-20a1e84bc2d5"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: E0316 13:44:16.280766 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068\": container with ID starting with cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068 not found: ID does not exist" containerID="cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.280877 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068"} err="failed to get container status \"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068\": rpc error: code = NotFound desc = could not find container \"cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068\": container with ID starting with cae45c685cc21c85873d0541223c1c01ec817955685155db0b3fa2a31299c068 not found: ID does not exist" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.281013 5030 scope.go:117] "RemoveContainer" containerID="4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.281261 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "98d53f79-da23-4943-81fa-20a1e84bc2d5" (UID: "98d53f79-da23-4943-81fa-20a1e84bc2d5"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:16 crc kubenswrapper[5030]: E0316 13:44:16.281487 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0\": container with ID starting with 4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0 not found: ID does not exist" containerID="4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.281627 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0"} err="failed to get container status \"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0\": rpc error: code = NotFound desc = could not find container \"4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0\": container with ID starting with 4f3f2ac0912711e2c7fb6f5562b61af44899939e5f93262dcdf33869799802a0 not found: ID does not exist" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.285250 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.301865 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener" containerID="cri-o://010a464c7510dc0d0f468c5fde1bface35c3e423f0e68104f94908ac19fbe8eb" gracePeriod=30 Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.302260 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener-log" containerID="cri-o://7b94deeb0290286e23956570e3b2cc885e7d824111881a35ee53a2c1023ce0f0" gracePeriod=30 Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.323633 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.346901 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.346932 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.346943 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.346954 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/98d53f79-da23-4943-81fa-20a1e84bc2d5-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.441517 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.478780 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.490607 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.498483 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.499667 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bedb1082-b93a-49aa-89e5-17faf391b81a" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.499681 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bedb1082-b93a-49aa-89e5-17faf391b81a" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.499755 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d53f79-da23-4943-81fa-20a1e84bc2d5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.499761 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d53f79-da23-4943-81fa-20a1e84bc2d5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.499986 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bedb1082-b93a-49aa-89e5-17faf391b81a" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.500001 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="98d53f79-da23-4943-81fa-20a1e84bc2d5" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.503368 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.503484 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.505464 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.554227 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.554322 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5vh\" (UniqueName: \"kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.554438 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.657000 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.657137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5vh\" (UniqueName: \"kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.657676 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.664511 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.674989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5vh\" (UniqueName: \"kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.679686 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.684313 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.927080 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" probeResult="failure" output="Get \"https://10.217.0.143:9292/healthcheck\": read tcp 10.217.0.2:52236->10.217.0.143:9292: read: connection reset by peer" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.927520 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.143:9292/healthcheck\": read tcp 10.217.0.2:52228->10.217.0.143:9292: read: connection reset by peer" Mar 16 13:44:16 crc kubenswrapper[5030]: I0316 13:44:16.944530 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:17 crc kubenswrapper[5030]: E0316 13:44:17.151673 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3 is running failed: container process not found" containerID="ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:17 crc kubenswrapper[5030]: E0316 13:44:17.153634 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3 is running failed: container process not found" containerID="ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:17 crc kubenswrapper[5030]: E0316 13:44:17.156301 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3 is running failed: container process not found" containerID="ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:17 crc kubenswrapper[5030]: E0316 13:44:17.156369 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.193238 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"98d53f79-da23-4943-81fa-20a1e84bc2d5","Type":"ContainerDied","Data":"01fb94cecaa30e37f26192c61e73210a25ac022458a38c024cd2c961afebcb2f"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.193305 5030 scope.go:117] "RemoveContainer" containerID="24e4ee8f7e3badbc851d3c547ad3993a101e3d880413483b95d054e1bd3eab58" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.193466 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.231385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerStarted","Data":"7e4806648bb39e33b3636a695eee1a2e84af95146d08df6d677984c64adbc0d0"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.252454 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.260138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerStarted","Data":"9b332c5d196f21e70fe76729f96c6c33e6693a4a4c15083fa9e8a78144584f64"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.285627 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.287989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerStarted","Data":"87e8266f67ef2c6024d087e44ca1c95bb72f2277648dca6a41a904a5c54ba99b"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.310497 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.343641 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerStarted","Data":"16f06f903eb64352f056169bfb9e86a75510e6a5bfc5cc296520028a191e918c"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.343689 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerStarted","Data":"6ed0c635656f5dd66d6e4d2db4cb2fb94c5ed8f85831fad8a58570e3f56a7850"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.343823 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.346604 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" podStartSLOduration=4.346585748 podStartE2EDuration="4.346585748s" podCreationTimestamp="2026-03-16 13:44:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:17.263726605 +0000 UTC m=+2301.663039152" watchObservedRunningTime="2026-03-16 13:44:17.346585748 +0000 UTC m=+2301.745898295" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.346688 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.346773 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerStarted","Data":"5b6d5fc0f2963adaa49270952377845bd23c073d4a537d29ce820e51e6203379"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.346861 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.347390 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.366694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerStarted","Data":"53d0f9b197386d170f93652b6003ebccaf3f55a90671832cbd6f621cea3b038d"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.378974 5030 generic.go:358] "Generic (PLEG): container finished" podID="08f24da9-a345-4eb5-b643-811fddc089c7" containerID="7b94deeb0290286e23956570e3b2cc885e7d824111881a35ee53a2c1023ce0f0" exitCode=143 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.379133 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerDied","Data":"7b94deeb0290286e23956570e3b2cc885e7d824111881a35ee53a2c1023ce0f0"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.384204 5030 generic.go:358] "Generic (PLEG): container finished" podID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerID="ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" exitCode=0 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.384443 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"37fb15cb-5d16-45f2-a665-bafba7ed8e69","Type":"ContainerDied","Data":"ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.389942 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.396254 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.396361 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.402701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r8jb\" (UniqueName: \"kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.402766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.402793 5030 generic.go:358] "Generic (PLEG): container finished" podID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerID="7a9e36b7e519090c25100a0f288d2abfa121e3fd0dde5207c05eb2265331b79b" exitCode=0 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.402903 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerDied","Data":"7a9e36b7e519090c25100a0f288d2abfa121e3fd0dde5207c05eb2265331b79b"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.402921 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.407865 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.408095 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker-log" containerID="cri-o://ab3515d985327396060d5c803e5bd04bb89a796bf4e514752d14b2e51bd1662f" gracePeriod=30 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.408676 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker" containerID="cri-o://f4b8bab8b748083d9e385230e986284b1a71e91cca58d21ee85f8b91510b3dd8" gracePeriod=30 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.416965 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430300 5030 generic.go:358] "Generic (PLEG): container finished" podID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerID="34f5f180611ebf8981f7a57e7b2a5fc3422c18edea666dbb0dd27e2fea57c23b" exitCode=0 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430762 5030 generic.go:358] "Generic (PLEG): container finished" podID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerID="6b2d58f63659c3022c9a4c0aae0b7ef3bbf2ae14d0fefb254e270ff76923f1c5" exitCode=2 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430771 5030 generic.go:358] "Generic (PLEG): container finished" podID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerID="d009664d043b9f838006bbc4280c2570fe92ffefee9671d7712b47035660b287" exitCode=0 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430833 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerDied","Data":"34f5f180611ebf8981f7a57e7b2a5fc3422c18edea666dbb0dd27e2fea57c23b"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerDied","Data":"6b2d58f63659c3022c9a4c0aae0b7ef3bbf2ae14d0fefb254e270ff76923f1c5"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.430866 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerDied","Data":"d009664d043b9f838006bbc4280c2570fe92ffefee9671d7712b47035660b287"} Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.446144 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.455283 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.467972 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.467952183 podStartE2EDuration="3.467952183s" podCreationTimestamp="2026-03-16 13:44:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:17.333358091 +0000 UTC m=+2301.732670638" watchObservedRunningTime="2026-03-16 13:44:17.467952183 +0000 UTC m=+2301.867264730" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.545746 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.545869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.545923 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.546078 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.546137 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbswh\" (UniqueName: \"kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.546166 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.546418 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.546645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs\") pod \"cc8394f6-a896-4525-80c1-f2d45b1f897b\" (UID: \"cc8394f6-a896-4525-80c1-f2d45b1f897b\") " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.547448 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.547750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7r8jb\" (UniqueName: \"kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.547799 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.547888 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.548027 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.552819 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.567362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs" (OuterVolumeSpecName: "logs") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.583869 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.586811 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.613639 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.614779 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.621895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.630403 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r8jb\" (UniqueName: \"kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb\") pod \"nova-cell1-novncproxy-0\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.631159 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh" (OuterVolumeSpecName: "kube-api-access-gbswh") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "kube-api-access-gbswh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.633969 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts" (OuterVolumeSpecName: "scripts") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.667899 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.667950 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbswh\" (UniqueName: \"kubernetes.io/projected/cc8394f6-a896-4525-80c1-f2d45b1f897b-kube-api-access-gbswh\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.667966 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.667976 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/cc8394f6-a896-4525-80c1-f2d45b1f897b-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.668013 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.687995 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.701687 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.702233 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-httpd" containerID="cri-o://9b01349e0d5296ed55c2a323b03a5e33cbf350558a5e692a00c9254c54ca5f57" gracePeriod=30 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.702803 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-server" containerID="cri-o://5595452be3e86c16401b0473831849bd2ab014dfde3e2188166c384f78d711a4" gracePeriod=30 Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.713625 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.718919 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.735619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.740747 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.745393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data" (OuterVolumeSpecName: "config-data") pod "cc8394f6-a896-4525-80c1-f2d45b1f897b" (UID: "cc8394f6-a896-4525-80c1-f2d45b1f897b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.770677 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.770708 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.770718 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.770729 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cc8394f6-a896-4525-80c1-f2d45b1f897b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.963210 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d53f79-da23-4943-81fa-20a1e84bc2d5" path="/var/lib/kubelet/pods/98d53f79-da23-4943-81fa-20a1e84bc2d5/volumes" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.964084 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bedb1082-b93a-49aa-89e5-17faf391b81a" path="/var/lib/kubelet/pods/bedb1082-b93a-49aa-89e5-17faf391b81a/volumes" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.964573 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d176b094-0552-4e4c-95c9-3ba756709a5c" path="/var/lib/kubelet/pods/d176b094-0552-4e4c-95c9-3ba756709a5c/volumes" Mar 16 13:44:17 crc kubenswrapper[5030]: I0316 13:44:17.977624 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.076684 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data\") pod \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.076735 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttkdf\" (UniqueName: \"kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf\") pod \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.076949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle\") pod \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\" (UID: \"37fb15cb-5d16-45f2-a665-bafba7ed8e69\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.103821 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf" (OuterVolumeSpecName: "kube-api-access-ttkdf") pod "37fb15cb-5d16-45f2-a665-bafba7ed8e69" (UID: "37fb15cb-5d16-45f2-a665-bafba7ed8e69"). InnerVolumeSpecName "kube-api-access-ttkdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.144983 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "37fb15cb-5d16-45f2-a665-bafba7ed8e69" (UID: "37fb15cb-5d16-45f2-a665-bafba7ed8e69"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.145271 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data" (OuterVolumeSpecName: "config-data") pod "37fb15cb-5d16-45f2-a665-bafba7ed8e69" (UID: "37fb15cb-5d16-45f2-a665-bafba7ed8e69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.184603 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.184635 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/37fb15cb-5d16-45f2-a665-bafba7ed8e69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.184646 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttkdf\" (UniqueName: \"kubernetes.io/projected/37fb15cb-5d16-45f2-a665-bafba7ed8e69-kube-api-access-ttkdf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.210217 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:18 crc kubenswrapper[5030]: W0316 13:44:18.303842 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e26e066_ea63_42d9_8853_63bf42e1714d.slice/crio-284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263 WatchSource:0}: Error finding container 284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263: Status 404 returned error can't find the container with id 284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.318542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.432276 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433595 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433616 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433639 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433644 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433655 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b6dffe-7356-4d45-bec3-8416d27c7e81" containerName="nova-scheduler-scheduler" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433660 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b6dffe-7356-4d45-bec3-8416d27c7e81" containerName="nova-scheduler-scheduler" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433687 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433692 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433890 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="54b6dffe-7356-4d45-bec3-8416d27c7e81" containerName="nova-scheduler-scheduler" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433902 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" containerName="nova-cell0-conductor-conductor" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433919 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.433930 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" containerName="glance-log" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.438444 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.453684 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.488391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerStarted","Data":"4302dd707348f58ec092cd96e6f42e6ac3362572c16e9cf685cf10c5f70d2ddd"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.488723 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerStarted","Data":"04697bbdcb5d13a8a23f6690c70f4c5f47395db34abeead25501ed08f764dcb1"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.514143 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8e26e066-ea63-42d9-8853-63bf42e1714d","Type":"ContainerStarted","Data":"284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.514925 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data\") pod \"54b6dffe-7356-4d45-bec3-8416d27c7e81\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.515099 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxk44\" (UniqueName: \"kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44\") pod \"54b6dffe-7356-4d45-bec3-8416d27c7e81\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.515156 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle\") pod \"54b6dffe-7356-4d45-bec3-8416d27c7e81\" (UID: \"54b6dffe-7356-4d45-bec3-8416d27c7e81\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.517711 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.517756 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhvk\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.517945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.517989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.518069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.518165 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.518221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.518257 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.528905 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=3.5288767500000002 podStartE2EDuration="3.52887675s" podCreationTimestamp="2026-03-16 13:44:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:18.506817833 +0000 UTC m=+2302.906130380" watchObservedRunningTime="2026-03-16 13:44:18.52887675 +0000 UTC m=+2302.928189297" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.533466 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44" (OuterVolumeSpecName: "kube-api-access-wxk44") pod "54b6dffe-7356-4d45-bec3-8416d27c7e81" (UID: "54b6dffe-7356-4d45-bec3-8416d27c7e81"). InnerVolumeSpecName "kube-api-access-wxk44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.583841 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.583941 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"37fb15cb-5d16-45f2-a665-bafba7ed8e69","Type":"ContainerDied","Data":"7ee850ecf96b7f402ee6447889550ecf11953c58c24c183a96a5530f285acee0"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.583997 5030 scope.go:117] "RemoveContainer" containerID="ab84907215bded39abb7296667b63f0039c2ee8dc211698857fd193ebd24c6c3" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.596894 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data" (OuterVolumeSpecName: "config-data") pod "54b6dffe-7356-4d45-bec3-8416d27c7e81" (UID: "54b6dffe-7356-4d45-bec3-8416d27c7e81"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.598784 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "54b6dffe-7356-4d45-bec3-8416d27c7e81" (UID: "54b6dffe-7356-4d45-bec3-8416d27c7e81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.605843 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.606676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"cc8394f6-a896-4525-80c1-f2d45b1f897b","Type":"ContainerDied","Data":"951554d736319dc7e885014d472c15493983a97ed10dd38e9e3b484a60c2f410"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629248 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629317 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629399 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629469 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.629504 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.630684 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.630758 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhvk\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.630785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.631050 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.631199 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxk44\" (UniqueName: \"kubernetes.io/projected/54b6dffe-7356-4d45-bec3-8416d27c7e81-kube-api-access-wxk44\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.631224 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/54b6dffe-7356-4d45-bec3-8416d27c7e81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.631319 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.633207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"085f3cd4-d430-49b3-b3a5-8c4196dfed7b","Type":"ContainerStarted","Data":"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.633312 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"085f3cd4-d430-49b3-b3a5-8c4196dfed7b","Type":"ContainerStarted","Data":"7a4afc982b3ca38513836a97a5de7e0b686fe6a38b0ae0cbe26da402f745a2ab"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.634603 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.662503 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.662934 5030 generic.go:358] "Generic (PLEG): container finished" podID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerID="fe0d145d0aa2a2e66ce1a58a2a706bf85ecc3cf1794644272856192c8a3cfb5b" exitCode=0 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.663120 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerDied","Data":"fe0d145d0aa2a2e66ce1a58a2a706bf85ecc3cf1794644272856192c8a3cfb5b"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.669275 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=2.669259829 podStartE2EDuration="2.669259829s" podCreationTimestamp="2026-03-16 13:44:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:18.661368598 +0000 UTC m=+2303.060681135" watchObservedRunningTime="2026-03-16 13:44:18.669259829 +0000 UTC m=+2303.068572376" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.676283 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.690650 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerStarted","Data":"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.693578 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.693586 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.694164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.698849 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhvk\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk\") pod \"swift-proxy-b56d98484-vtfdj\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.706536 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerStarted","Data":"b1aba8f8b4e2addb25d9ce6ff3cbdad9e6e656092729f8a6106cee5288d47711"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.716292 5030 generic.go:358] "Generic (PLEG): container finished" podID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerID="ab3515d985327396060d5c803e5bd04bb89a796bf4e514752d14b2e51bd1662f" exitCode=143 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.716491 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerDied","Data":"ab3515d985327396060d5c803e5bd04bb89a796bf4e514752d14b2e51bd1662f"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.739519 5030 generic.go:358] "Generic (PLEG): container finished" podID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerID="5595452be3e86c16401b0473831849bd2ab014dfde3e2188166c384f78d711a4" exitCode=0 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.739541 5030 generic.go:358] "Generic (PLEG): container finished" podID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerID="9b01349e0d5296ed55c2a323b03a5e33cbf350558a5e692a00c9254c54ca5f57" exitCode=0 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.739615 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerDied","Data":"5595452be3e86c16401b0473831849bd2ab014dfde3e2188166c384f78d711a4"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.739637 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerDied","Data":"9b01349e0d5296ed55c2a323b03a5e33cbf350558a5e692a00c9254c54ca5f57"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.778178 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.796387 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.803072 5030 scope.go:117] "RemoveContainer" containerID="7a9e36b7e519090c25100a0f288d2abfa121e3fd0dde5207c05eb2265331b79b" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.804248 5030 generic.go:358] "Generic (PLEG): container finished" podID="54b6dffe-7356-4d45-bec3-8416d27c7e81" containerID="d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279" exitCode=0 Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.805295 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.807734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"54b6dffe-7356-4d45-bec3-8416d27c7e81","Type":"ContainerDied","Data":"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.807786 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"54b6dffe-7356-4d45-bec3-8416d27c7e81","Type":"ContainerDied","Data":"42ce52e7b38f5157fde02dc3ddbbc22fedba90e29945a327cd184ccfcc45c6d2"} Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.814647 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.819776 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.839997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840293 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840447 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840516 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840586 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpnxs\" (UniqueName: \"kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.840787 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data\") pod \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\" (UID: \"7808fdc9-2990-4da1-8adb-bac98fa2ce8b\") " Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.861926 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.862087 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864887 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-central-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864911 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-central-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864922 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="proxy-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864927 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="proxy-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864955 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="sg-core" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864961 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="sg-core" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864968 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-notification-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.864974 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-notification-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.865522 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-notification-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.865563 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="ceilometer-central-agent" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.865576 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="proxy-httpd" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.865593 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" containerName="sg-core" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.868719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.933197 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.933354 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.939992 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs" (OuterVolumeSpecName: "kube-api-access-qpnxs") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "kube-api-access-qpnxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.955769 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb77b\" (UniqueName: \"kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.955990 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.956105 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.956882 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.958331 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.991652 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:18 crc kubenswrapper[5030]: I0316 13:44:18.993383 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpnxs\" (UniqueName: \"kubernetes.io/projected/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-kube-api-access-qpnxs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.024216 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.108824 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.109395 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb77b\" (UniqueName: \"kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.109738 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.113860 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.113945 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle podName:a7df4d50-0430-4610-b3ec-9c2156f78c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:19.613919584 +0000 UTC m=+2304.013232130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04") : secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.116313 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.128519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.165315 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" probeResult="failure" output="Get \"https://10.217.0.144:9292/healthcheck\": read tcp 10.217.0.2:51422->10.217.0.144:9292: read: connection reset by peer" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.200616 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.222997 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.224811 5030 scope.go:117] "RemoveContainer" containerID="6aa264c00fe74a92e2a3d3960ea920630b83182fd71c1c5f2fec1fdba1993356" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.246185 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.255852 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.277440 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.312491 5030 scope.go:117] "RemoveContainer" containerID="d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.336481 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.395046 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts" (OuterVolumeSpecName: "scripts") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.411522 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.419867 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.419934 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.419971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420056 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420109 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420299 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74bx\" (UniqueName: \"kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.420396 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.439720 5030 scope.go:117] "RemoveContainer" containerID="d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.447479 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.447687 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279\": container with ID starting with d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279 not found: ID does not exist" containerID="d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.447725 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279"} err="failed to get container status \"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279\": rpc error: code = NotFound desc = could not find container \"d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279\": container with ID starting with d7c4e142a45ad99797d2259cdba0e97d01e1f73c57003c8aa10520a0ca0fa279 not found: ID does not exist" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.455353 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.456347 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb77b\" (UniqueName: \"kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.467451 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.475806 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.501702 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522238 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522280 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522306 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522406 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdlrr\" (UniqueName: \"kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522453 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522500 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g74bx\" (UniqueName: \"kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522674 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522715 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.522781 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.525055 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.525146 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle podName:345a1b2b-5460-4c84-98b6-3ce8ab810d98 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.025122816 +0000 UTC m=+2304.424435363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle") pod "glance-default-internal-api-0" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98") : secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.525177 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.525459 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.525826 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.578488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.612620 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.615905 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.625603 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.626151 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74bx\" (UniqueName: \"kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.627617 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdlrr\" (UniqueName: \"kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.627701 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.627764 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.628106 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.630495 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.630513 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.630604 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle podName:a7df4d50-0430-4610-b3ec-9c2156f78c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.630588516 +0000 UTC m=+2305.029901063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04") : secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: E0316 13:44:19.630693 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.130675699 +0000 UTC m=+2304.529988247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "combined-ca-bundle" not found Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.641942 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.662925 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.667276 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.679681 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.755676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdlrr\" (UniqueName: \"kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.820062 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.820934 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" containerName="openstackclient" containerID="cri-o://532844fff7ac3a729df0e9ab476589874e9e6ac20f747e51bca916efc13ce969" gracePeriod=2 Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.835896 5030 status_manager.go:895] "Failed to get status for pod" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.838893 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.839143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkv7l\" (UniqueName: \"kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.863124 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.892116 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" event={"ID":"fba7aa49-e100-4b16-9e75-3483cd17f86b","Type":"ContainerDied","Data":"20304a9af43961e82a0bfc7a1a39f4ac9108e289dce7ee404eb1dda50ab38b6d"} Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.892180 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20304a9af43961e82a0bfc7a1a39f4ac9108e289dce7ee404eb1dda50ab38b6d" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.915640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.924001 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-j7467"] Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.941814 5030 generic.go:358] "Generic (PLEG): container finished" podID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerID="cf428a1b9f28401055b4d46f0ef2097ebf5b885395f5e937c44aae9f06a8f4f7" exitCode=0 Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.941980 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerDied","Data":"cf428a1b9f28401055b4d46f0ef2097ebf5b885395f5e937c44aae9f06a8f4f7"} Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.944069 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkv7l\" (UniqueName: \"kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.944525 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.944622 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:19 crc kubenswrapper[5030]: I0316 13:44:19.947027 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.030503 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkv7l\" (UniqueName: \"kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l\") pod \"placement-3ec7-account-create-update-gx4mw\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.048418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.048789 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.048848 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle podName:345a1b2b-5460-4c84-98b6-3ce8ab810d98 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.048833371 +0000 UTC m=+2305.448145918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle") pod "glance-default-internal-api-0" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.088837 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fb15cb-5d16-45f2-a665-bafba7ed8e69" path="/var/lib/kubelet/pods/37fb15cb-5d16-45f2-a665-bafba7ed8e69/volumes" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.089506 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54b6dffe-7356-4d45-bec3-8416d27c7e81" path="/var/lib/kubelet/pods/54b6dffe-7356-4d45-bec3-8416d27c7e81/volumes" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.093544 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8394f6-a896-4525-80c1-f2d45b1f897b" path="/var/lib/kubelet/pods/cc8394f6-a896-4525-80c1-f2d45b1f897b/volumes" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.147640 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.150255 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.150605 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.150659 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.150643425 +0000 UTC m=+2305.549955972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.267346 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.267672 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.767652605 +0000 UTC m=+2305.166965152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-public-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268008 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268038 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.768030356 +0000 UTC m=+2305.167342903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-internal-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268082 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268107 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.7681014 +0000 UTC m=+2305.167413947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268146 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.268167 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:20.768161041 +0000 UTC m=+2305.167473588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.327239 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": read tcp 10.217.0.2:34338->10.217.0.153:9311: read: connection reset by peer" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.327454 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": read tcp 10.217.0.2:34328->10.217.0.153:9311: read: connection reset by peer" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.417658 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.418855 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data" (OuterVolumeSpecName: "config-data") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.490580 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:20 crc kubenswrapper[5030]: W0316 13:44:20.537205 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f50eef9_fd16_4e77_9a48_c6989850d346.slice/crio-9035d2480fc5908900d399b7196abcbc55f2e12d9c522ac94b38b5bfba971cd6 WatchSource:0}: Error finding container 9035d2480fc5908900d399b7196abcbc55f2e12d9c522ac94b38b5bfba971cd6: Status 404 returned error can't find the container with id 9035d2480fc5908900d399b7196abcbc55f2e12d9c522ac94b38b5bfba971cd6 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.614737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7808fdc9-2990-4da1-8adb-bac98fa2ce8b" (UID: "7808fdc9-2990-4da1-8adb-bac98fa2ce8b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.695263 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.695763 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7808fdc9-2990-4da1-8adb-bac98fa2ce8b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.695455 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.695839 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle podName:a7df4d50-0430-4610-b3ec-9c2156f78c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.695819661 +0000 UTC m=+2307.095132208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802349 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802440 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.802402333 +0000 UTC m=+2306.201714880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802508 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802534 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.802527307 +0000 UTC m=+2306.201839854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802562 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802660 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.802628949 +0000 UTC m=+2306.201941495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-internal-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802717 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.802753 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.80274609 +0000 UTC m=+2306.202058626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-public-svc" not found Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.896017 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-j7467"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.896147 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.897372 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" containerName="openstackclient" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.897394 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" containerName="openstackclient" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.897720 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" containerName="openstackclient" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.898619 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:44:20 crc kubenswrapper[5030]: E0316 13:44:20.898871 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902489 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902516 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-mg2tg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902536 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"7808fdc9-2990-4da1-8adb-bac98fa2ce8b","Type":"ContainerDied","Data":"c6a7339fb0eefcc8307c45167c098dd71ba5aa43cc1e3fae424f211e7c9f7c32"} Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902586 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902606 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qq7bb"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902839 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.902878 5030 scope.go:117] "RemoveContainer" containerID="34f5f180611ebf8981f7a57e7b2a5fc3422c18edea666dbb0dd27e2fea57c23b" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.904909 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.913964 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.914057 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qq7bb"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.914207 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.916678 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.924666 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927077 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-smssw"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927175 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4xhx8"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927247 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-smssw"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927317 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-4xhx8"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927402 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927483 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5mdzd"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927541 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-5mdzd"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927639 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927701 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-027c-account-create-update-gh8jg"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927773 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927847 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927917 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.927983 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-13a5-account-create-update-bmkbp"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928042 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-86mwm"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928102 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-l8ncv"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928160 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928223 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-jgqkp"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928287 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-l8ncv"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928344 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-86mwm"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928409 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-jgqkp"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928488 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928562 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928622 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-9ddb-account-create-update-cvqbl"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928694 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-ctqw8"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928757 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-ctqw8"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928826 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928882 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.928942 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-jvtw7"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929005 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929066 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-h8fws"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929126 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="openstack-network-exporter" containerID="cri-o://531bfb3e1a951bc9f5c1f8d6920f737f51dd45ef67dbac259b97bfae251a0515" gracePeriod=300 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929145 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929227 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-dkv6n"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929244 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-dkv6n"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929262 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929275 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929421 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-log" containerID="cri-o://3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929083 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.929892 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-api" containerID="cri-o://d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.930014 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="openstack-network-exporter" containerID="cri-o://58540f742909b9c7d67366440fbde7d05d0e263af58a6725c443ddce79442b49" gracePeriod=300 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.930198 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="ovn-northd" containerID="cri-o://f528204e7ce812978b1b4c5c0816bfc669ec75a9157881de1e574df2705fe754" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.930414 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="openstack-network-exporter" containerID="cri-o://95fbb4006226b7a376cba582e792561c2c545e4b5048ee1d55c1da49b7564735" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.938172 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.938904 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-7f17-account-create-update-wjwmh"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.946010 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.948978 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-api" containerID="cri-o://7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.949165 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-httpd" containerID="cri-o://2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.965406 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zqmcz"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.981738 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.982369 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-server" containerID="cri-o://921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.982717 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="swift-recon-cron" containerID="cri-o://1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.982845 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="rsync" containerID="cri-o://ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.982955 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-expirer" containerID="cri-o://fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.983060 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-updater" containerID="cri-o://85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.983166 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-auditor" containerID="cri-o://45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.983332 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-replicator" containerID="cri-o://3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.983454 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-server" containerID="cri-o://cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.984372 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-updater" containerID="cri-o://138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.984496 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-auditor" containerID="cri-o://fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.984905 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-replicator" containerID="cri-o://9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.985033 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-server" containerID="cri-o://fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.985130 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-reaper" containerID="cri-o://cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.985242 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-auditor" containerID="cri-o://e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178" gracePeriod=30 Mar 16 13:44:20 crc kubenswrapper[5030]: I0316 13:44:20.985370 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-replicator" containerID="cri-o://b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.006052 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-zqmcz"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008245 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008338 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbksd\" (UniqueName: \"kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008746 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxwzf\" (UniqueName: \"kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.008838 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.009735 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.009784 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.509771012 +0000 UTC m=+2305.909083559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.011118 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.011147 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.511137672 +0000 UTC m=+2305.910450210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.014653 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.014682 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data podName:7bffb37f-433d-4562-bf3d-edf49b7cc030 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.514673893 +0000 UTC m=+2305.913986440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data") pod "rabbitmq-server-0" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030") : configmap "rabbitmq-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.080841 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.098708 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="ovsdbserver-nb" containerID="cri-o://1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" gracePeriod=300 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.109197 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.109387 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.116274 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.128722 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.148351 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.171342 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="345a1b2b-5460-4c84-98b6-3ce8ab810d98" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.188766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.188913 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9csc\" (UniqueName: \"kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.188942 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxwzf\" (UniqueName: \"kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.188967 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189053 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189099 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189325 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189418 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbksd\" (UniqueName: \"kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189651 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.189825 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196024 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196217 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.196161777 +0000 UTC m=+2307.595474325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196281 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196321 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.696313733 +0000 UTC m=+2306.095626281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : configmap "openstack-cell1-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196402 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196446 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle podName:345a1b2b-5460-4c84-98b6-3ce8ab810d98 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.196424352 +0000 UTC m=+2307.595736899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle") pod "glance-default-internal-api-0" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196497 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-scheduler-config-data: secret "nova-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.196543 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.696528559 +0000 UTC m=+2306.095841105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "nova-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.197163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.198166 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.217067 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.222326 5030 scope.go:117] "RemoveContainer" containerID="6b2d58f63659c3022c9a4c0aae0b7ef3bbf2ae14d0fefb254e270ff76923f1c5" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.262231 5030 projected.go:194] Error preparing data for projected volume kube-api-access-rs2p2 for pod openstack-kuttl-tests/root-account-create-update-qq7bb: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.262893 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2 podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:21.762859857 +0000 UTC m=+2306.162172405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rs2p2" (UniqueName: "kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.290909 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerStarted","Data":"9035d2480fc5908900d399b7196abcbc55f2e12d9c522ac94b38b5bfba971cd6"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296748 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296819 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296962 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.296997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwlpm\" (UniqueName: \"kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297080 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297176 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297200 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297235 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fgf8\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297404 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297438 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data\") pod \"fba7aa49-e100-4b16-9e75-3483cd17f86b\" (UID: \"fba7aa49-e100-4b16-9e75-3483cd17f86b\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297480 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297579 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data\") pod \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\" (UID: \"0241f5a5-aa18-4cdd-9b37-453180b09fe0\") " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.297941 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9csc\" (UniqueName: \"kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.298313 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.298364 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.299381 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.310642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.313797 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxwzf\" (UniqueName: \"kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf\") pod \"glance-3f90-account-create-update-qdqjg\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.313970 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbksd\" (UniqueName: \"kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd\") pod \"nova-api-b955-account-create-update-654rz\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.315078 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.322889 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs" (OuterVolumeSpecName: "logs") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.338748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.338855 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="4b7e7304-ba88-4264-a982-26ead7f093aa" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.0.139:8774/\": context deadline exceeded" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.339782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.377485 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9csc\" (UniqueName: \"kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc\") pod \"dnsmasq-dnsmasq-79dcd846c5-rkkxz\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.378070 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8" (OuterVolumeSpecName: "kube-api-access-9fgf8") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "kube-api-access-9fgf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.378150 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts" (OuterVolumeSpecName: "scripts") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.384327 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.386407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm" (OuterVolumeSpecName: "kube-api-access-xwlpm") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "kube-api-access-xwlpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.389022 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage15-crc" (OuterVolumeSpecName: "glance") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "local-storage15-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.394242 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.401019 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406091 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406114 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406128 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fgf8\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-kube-api-access-9fgf8\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406137 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406145 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/0241f5a5-aa18-4cdd-9b37-453180b09fe0-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406154 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/fba7aa49-e100-4b16-9e75-3483cd17f86b-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406162 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/fba7aa49-e100-4b16-9e75-3483cd17f86b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406186 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" " Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.406195 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwlpm\" (UniqueName: \"kubernetes.io/projected/0241f5a5-aa18-4cdd-9b37-453180b09fe0-kube-api-access-xwlpm\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.414964 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8e26e066-ea63-42d9-8853-63bf42e1714d","Type":"ContainerStarted","Data":"f9da55917cbf0ab4733a021bc717fcf40db775cd7b8dcab7611a4d41900b5aef"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.417673 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429237 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429261 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429281 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429287 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429301 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-server" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429306 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-server" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429338 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429342 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429539 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429576 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-httpd" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429586 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" containerName="glance-log" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.429599 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-server" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.470857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.472028 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.472086 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h2hws"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.472324 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-log" containerID="cri-o://6ed0c635656f5dd66d6e4d2db4cb2fb94c5ed8f85831fad8a58570e3f56a7850" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.472496 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-metadata" containerID="cri-o://16f06f903eb64352f056169bfb9e86a75510e6a5bfc5cc296520028a191e918c" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.472780 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" secret="" err="secret \"nova-nova-dockercfg-t9hlr\" not found" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.473840 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.474190 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.481699 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.482466 5030 generic.go:358] "Generic (PLEG): container finished" podID="08f24da9-a345-4eb5-b643-811fddc089c7" containerID="010a464c7510dc0d0f468c5fde1bface35c3e423f0e68104f94908ac19fbe8eb" exitCode=0 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.482684 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerDied","Data":"010a464c7510dc0d0f468c5fde1bface35c3e423f0e68104f94908ac19fbe8eb"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.490418 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-h2hws"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.508532 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.517996 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.539778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.539856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.540046 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.540071 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.540221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.540361 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.540418 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540627 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540688 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.040670558 +0000 UTC m=+2306.439983105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540728 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540754 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.040745218 +0000 UTC m=+2306.440057765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540800 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540819 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.540814278 +0000 UTC m=+2306.940126826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540850 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-novncproxy-config-data: secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540868 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.04086295 +0000 UTC m=+2306.440175497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540897 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540915 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.540910469 +0000 UTC m=+2306.940223016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540951 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.540969 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.04096449 +0000 UTC m=+2306.440277037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.545641 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1e507f45-9b3e-4be2-ae26-341712344d66/ovn-northd/0.log" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.545689 5030 generic.go:358] "Generic (PLEG): container finished" podID="1e507f45-9b3e-4be2-ae26-341712344d66" containerID="95fbb4006226b7a376cba582e792561c2c545e4b5048ee1d55c1da49b7564735" exitCode=2 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.545705 5030 generic.go:358] "Generic (PLEG): container finished" podID="1e507f45-9b3e-4be2-ae26-341712344d66" containerID="f528204e7ce812978b1b4c5c0816bfc669ec75a9157881de1e574df2705fe754" exitCode=143 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.545930 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerDied","Data":"95fbb4006226b7a376cba582e792561c2c545e4b5048ee1d55c1da49b7564735"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.545963 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerDied","Data":"f528204e7ce812978b1b4c5c0816bfc669ec75a9157881de1e574df2705fe754"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.560966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.561387 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4b6c97ea-4885-4b61-880f-bd53acc1928b/ovsdbserver-nb/0.log" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.561423 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerID="58540f742909b9c7d67366440fbde7d05d0e263af58a6725c443ddce79442b49" exitCode=2 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.561528 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerDied","Data":"58540f742909b9c7d67366440fbde7d05d0e263af58a6725c443ddce79442b49"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.562827 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-vwcgx"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.568268 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="ovsdbserver-sb" containerID="cri-o://84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" gracePeriod=300 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.570088 5030 generic.go:358] "Generic (PLEG): container finished" podID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerID="3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656" exitCode=143 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.570436 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerDied","Data":"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.574365 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.574656 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener-log" containerID="cri-o://261f920f417aed1085ab33305627f98da93c33458bfa5394c1b0376b0f50472e" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.575070 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener" containerID="cri-o://53d0f9b197386d170f93652b6003ebccaf3f55a90671832cbd6f621cea3b038d" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.592330 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage15-crc" (UniqueName: "kubernetes.io/local-volume/local-storage15-crc") on node "crc" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.598260 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5" exitCode=0 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.598281 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4" exitCode=0 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.598351 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.598399 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.600420 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.608265 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.624097 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerStarted","Data":"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.627494 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/cinder-scheduler-0" secret="" err="secret \"cinder-cinder-dockercfg-vz7xz\" not found" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.630840 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-vwcgx"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.633104 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.636698 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.642684 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.642724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.642843 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.642973 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643023 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643409 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643575 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643588 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643597 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage15-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage15-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.643609 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.643711 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.643749 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.644045 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.644374 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.644446 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.644505 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646179 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.643766 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.14375059 +0000 UTC m=+2306.543063138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646244 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.146227639 +0000 UTC m=+2306.545540187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646257 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.146251154 +0000 UTC m=+2306.545563700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646359 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data podName:7bffb37f-433d-4562-bf3d-edf49b7cc030 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.646334921 +0000 UTC m=+2307.045647469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data") pod "rabbitmq-server-0" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030") : configmap "rabbitmq-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646373 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.146368644 +0000 UTC m=+2306.545681192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.646952 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.146938115 +0000 UTC m=+2306.546250662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.653203 5030 projected.go:194] Error preparing data for projected volume kube-api-access-j5lds for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.653241 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.153232534 +0000 UTC m=+2306.552545081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j5lds" (UniqueName: "kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.654024 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.658019 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.658418 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker-log" containerID="cri-o://33ab4ba5ddc6e00f0235995ac7a380aa7fc85703f8c6e1bed39d09f4eab5f383" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.659092 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker" containerID="cri-o://7e4806648bb39e33b3636a695eee1a2e84af95146d08df6d677984c64adbc0d0" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.660238 5030 generic.go:358] "Generic (PLEG): container finished" podID="bf225c37-5611-47f6-995b-615f1f648742" containerID="0562aa7e24c003d1a504f7a47f2a7c9268fd557bf551de5e0643c2a593a728d5" exitCode=0 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.662845 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerDied","Data":"0562aa7e24c003d1a504f7a47f2a7c9268fd557bf551de5e0643c2a593a728d5"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.671866 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.682874 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.683075 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"0241f5a5-aa18-4cdd-9b37-453180b09fe0","Type":"ContainerDied","Data":"8bed82471d418671aa7809d7e050e593fa3888d8707cf564d39dd8c0ee11f825"} Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.684483 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-conductor-0" secret="" err="secret \"nova-nova-dockercfg-t9hlr\" not found" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.685514 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.685515 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-log" containerID="cri-o://04697bbdcb5d13a8a23f6690c70f4c5f47395db34abeead25501ed08f764dcb1" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.685670 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-api" containerID="cri-o://4302dd707348f58ec092cd96e6f42e6ac3362572c16e9cf685cf10c5f70d2ddd" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.700407 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.709709 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.709848 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400 is running failed: container process not found" containerID="84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.709897 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api-log" containerID="cri-o://2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.709977 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api" containerID="cri-o://04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6" gracePeriod=30 Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.715456 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400 is running failed: container process not found" containerID="84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.717265 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400 is running failed: container process not found" containerID="84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.717304 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.737719 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-j96tf"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.748988 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749323 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749385 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.249368597 +0000 UTC m=+2306.648681144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749436 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749458 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.249452405 +0000 UTC m=+2306.648764942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749490 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749506 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.249501307 +0000 UTC m=+2306.648813854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749534 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749565 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.249559696 +0000 UTC m=+2306.648872244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749602 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-scheduler-config-data: secret "nova-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749610 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749646 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749619 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.749613538 +0000 UTC m=+2307.148926085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "nova-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749687 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.249671076 +0000 UTC m=+2306.648983623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.749702 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.749694821 +0000 UTC m=+2307.149007367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : configmap "openstack-cell1-scripts" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.769366 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2xnw5"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.783640 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.790887 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.791668 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="65b03029-a404-44a7-b76d-fc4dd9b61b12" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.801764 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.811023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data" (OuterVolumeSpecName: "config-data") pod "0241f5a5-aa18-4cdd-9b37-453180b09fe0" (UID: "0241f5a5-aa18-4cdd-9b37-453180b09fe0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.822673 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-2xnw5"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.831086 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-j96tf"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.834269 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.841007 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-ttd6l"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.849414 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-ttd6l"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851758 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851804 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851832 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.851813176 +0000 UTC m=+2308.251125723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-internal-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851861 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.851842521 +0000 UTC m=+2308.251155068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851771 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.851894 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.851887616 +0000 UTC m=+2308.251200162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "combined-ca-bundle" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.852212 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.852258 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.852248855 +0000 UTC m=+2308.251561402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-public-svc" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.852468 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.854929 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0241f5a5-aa18-4cdd-9b37-453180b09fe0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.854949 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.862288 5030 projected.go:194] Error preparing data for projected volume kube-api-access-rs2p2 for pod openstack-kuttl-tests/root-account-create-update-qq7bb: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.862329 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2 podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:22.862318083 +0000 UTC m=+2307.261630630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rs2p2" (UniqueName: "kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.866624 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-4ln99"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.869730 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-4ln99"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.874349 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.874649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data" (OuterVolumeSpecName: "config-data") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.875594 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="a7df4d50-0430-4610-b3ec-9c2156f78c04" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.882615 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.892499 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.896186 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5 is running failed: container process not found" containerID="1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.902336 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5 is running failed: container process not found" containerID="1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.920024 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5 is running failed: container process not found" containerID="1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:44:21 crc kubenswrapper[5030]: E0316 13:44:21.920091 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.928677 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-nmg9b"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.943463 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.984672 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="156f29ff-1c30-4bac-99a6-74a0727413f1" path="/var/lib/kubelet/pods/156f29ff-1c30-4bac-99a6-74a0727413f1/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.985133 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="185e70b6-3cae-460c-8e00-a3eb4f0993c0" path="/var/lib/kubelet/pods/185e70b6-3cae-460c-8e00-a3eb4f0993c0/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.985617 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24d65c01-d778-4c01-8e09-8c761063d50a" path="/var/lib/kubelet/pods/24d65c01-d778-4c01-8e09-8c761063d50a/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.986053 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d88717-e9ce-4276-9521-089e93e1780d" path="/var/lib/kubelet/pods/27d88717-e9ce-4276-9521-089e93e1780d/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.989041 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a4ea528-ba89-46f5-a41f-c2e75ed380fe" path="/var/lib/kubelet/pods/2a4ea528-ba89-46f5-a41f-c2e75ed380fe/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.989661 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3278804c-e8b9-44e4-b149-f55bc2849325" path="/var/lib/kubelet/pods/3278804c-e8b9-44e4-b149-f55bc2849325/volumes" Mar 16 13:44:21 crc kubenswrapper[5030]: I0316 13:44:21.990117 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad13737-f305-4cc7-bf80-dd80c873c5d9" path="/var/lib/kubelet/pods/4ad13737-f305-4cc7-bf80-dd80c873c5d9/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:21.991151 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c372d53-949c-4ea3-9638-2eb752b13ad3" path="/var/lib/kubelet/pods/4c372d53-949c-4ea3-9638-2eb752b13ad3/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:21.991647 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f65948-2704-42ed-a4b7-4dcfd7e87780" path="/var/lib/kubelet/pods/54f65948-2704-42ed-a4b7-4dcfd7e87780/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:21.992162 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ae3158-67d7-486b-8274-d163c8a7031a" path="/var/lib/kubelet/pods/58ae3158-67d7-486b-8274-d163c8a7031a/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.000792 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.009820 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b04b430-865d-4967-9818-af2a5c9e0e2c" path="/var/lib/kubelet/pods/5b04b430-865d-4967-9818-af2a5c9e0e2c/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.010375 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7808fdc9-2990-4da1-8adb-bac98fa2ce8b" path="/var/lib/kubelet/pods/7808fdc9-2990-4da1-8adb-bac98fa2ce8b/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.011063 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e65c553-fd32-4350-9186-32beb502436d" path="/var/lib/kubelet/pods/7e65c553-fd32-4350-9186-32beb502436d/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.022656 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8315e216-17a2-41dd-a1ab-e0837916253e" path="/var/lib/kubelet/pods/8315e216-17a2-41dd-a1ab-e0837916253e/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.023101 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2dc120-8674-46a7-91ba-6952fc676165" path="/var/lib/kubelet/pods/8e2dc120-8674-46a7-91ba-6952fc676165/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.023540 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf8bc7c-6180-4394-a4a3-9ce68b957f8b" path="/var/lib/kubelet/pods/bbf8bc7c-6180-4394-a4a3-9ce68b957f8b/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.027742 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fba7aa49-e100-4b16-9e75-3483cd17f86b" (UID: "fba7aa49-e100-4b16-9e75-3483cd17f86b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.028534 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe" path="/var/lib/kubelet/pods/bd67e71e-b64e-4d9a-b7c4-8c0c187c1bbe/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.032210 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0a394c9-abf0-49f5-a294-9af598189768" path="/var/lib/kubelet/pods/c0a394c9-abf0-49f5-a294-9af598189768/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.041116 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c29141c8-6f47-4ef8-a908-ca7681c673c1" path="/var/lib/kubelet/pods/c29141c8-6f47-4ef8-a908-ca7681c673c1/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.041590 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a3876c-f28c-42cc-b84d-194026cfb552" path="/var/lib/kubelet/pods/c3a3876c-f28c-42cc-b84d-194026cfb552/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.042027 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c730090b-37b1-40db-90d3-263b055709f3" path="/var/lib/kubelet/pods/c730090b-37b1-40db-90d3-263b055709f3/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.043653 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e03348e0-1bbc-4738-984c-774c619ec0cf" path="/var/lib/kubelet/pods/e03348e0-1bbc-4738-984c-774c619ec0cf/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.044487 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e220c63b-56ff-405d-b04c-30b005b3bdd1" path="/var/lib/kubelet/pods/e220c63b-56ff-405d-b04c-30b005b3bdd1/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.044987 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e593cea5-6037-4818-8c8d-37046d90f034" path="/var/lib/kubelet/pods/e593cea5-6037-4818-8c8d-37046d90f034/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.045471 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd873fb-2f7f-4fb8-a683-e4e642ad89b8" path="/var/lib/kubelet/pods/ebd873fb-2f7f-4fb8-a683-e4e642ad89b8/volumes" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.057342 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.057375 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-m4hnk"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.063076 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-ddtkj"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.081760 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-m4hnk"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.112696 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.114982 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fba7aa49-e100-4b16-9e75-3483cd17f86b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115084 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-novncproxy-config-data: secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115198 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.115168429 +0000 UTC m=+2307.514480976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115746 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115847 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.115824513 +0000 UTC m=+2307.515137060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115897 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115922 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.115914802 +0000 UTC m=+2307.515227349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.115988 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.116007 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.116001897 +0000 UTC m=+2307.515314444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.220401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.220875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.223034 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.224744 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.225265 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228130 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.228097275 +0000 UTC m=+2307.627409822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228167 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.22815838 +0000 UTC m=+2307.627470927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.228218 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.228395 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.228416 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228669 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228715 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.228694359 +0000 UTC m=+2307.628006905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228754 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.228777 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.228770542 +0000 UTC m=+2307.628083088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.230592 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.230659 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.230643484 +0000 UTC m=+2307.629956031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.237187 5030 projected.go:194] Error preparing data for projected volume kube-api-access-j5lds for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.237298 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.23726138 +0000 UTC m=+2307.636573927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5lds" (UniqueName: "kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.239083 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.269678 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-0b53-account-create-update-mtmqt"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.288799 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qq7bb"] Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.289965 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rs2p2 operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/root-account-create-update-qq7bb" podUID="9a081412-dba3-400c-876e-c0e9720ec513" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.299378 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.299735 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" containerName="kube-state-metrics" containerID="cri-o://f03be0fe0f119f339025ec27b7b4a51796f7a20c267b664eeab52715521fcbc0" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.308956 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=5.308939786 podStartE2EDuration="5.308939786s" podCreationTimestamp="2026-03-16 13:44:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:21.444500911 +0000 UTC m=+2305.843813458" watchObservedRunningTime="2026-03-16 13:44:22.308939786 +0000 UTC m=+2306.708252333" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.341930 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342013 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.341995254 +0000 UTC m=+2307.741307801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342515 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342572 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.34254101 +0000 UTC m=+2307.741853558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342610 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342648 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.342624256 +0000 UTC m=+2307.741936803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.342670 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.343248 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.343227542 +0000 UTC m=+2307.742540089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.343473 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.343542 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.343532424 +0000 UTC m=+2307.742844972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.356465 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=8.356447845 podStartE2EDuration="8.356447845s" podCreationTimestamp="2026-03-16 13:44:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:21.648566217 +0000 UTC m=+2306.047878754" watchObservedRunningTime="2026-03-16 13:44:22.356447845 +0000 UTC m=+2306.755760382" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.363119 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.371124 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.398646 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.403214 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.403610 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-httpd" containerID="cri-o://e13ff8885b326ba542092f5269716a5cc9aed50be25f0ffa805c8c4d13543766" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.403680 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-server" containerID="cri-o://4c455a4b8b95ca1eba09d8e139eac3253f2ce455e476fe5effc103e57a8c8dcc" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.407515 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.407832 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="27c6f290-ff76-4884-8db6-075c353aa2df" containerName="memcached" containerID="cri-o://a52be5d468e9737e26bae8c052a17fcdc642093e60bed5709f31f1edc1e620d1" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.415638 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.416301 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-trnw6"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.421588 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lft2n"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.429096 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.434384 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.441343 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-lft2n"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.442762 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.448387 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h7nwp"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.458454 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-h7nwp"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.463038 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.463217 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" podUID="c95e47e9-8db9-48d4-903e-5f61151a5dff" containerName="keystone-api" containerID="cri-o://75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.468506 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.474784 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.497022 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.497695 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="galera" containerID="cri-o://d3297ede49c51ccf1261e055fd5c28cd006d991bb9a6dfe1a54440eee3b2d257" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.499596 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-8rk44"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.504646 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-8rk44"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.531007 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.158:8080/healthcheck\": read tcp 10.217.0.2:33120->10.217.0.158:8080: read: connection reset by peer" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.531316 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.158:8080/healthcheck\": read tcp 10.217.0.2:33112->10.217.0.158:8080: read: connection reset by peer" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.553034 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.553085 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.553456 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-kube-state-metrics-svc: secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.553526 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.553507946 +0000 UTC m=+2308.952820484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls-certs" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "cert-kube-state-metrics-svc" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.570007 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.570068 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle podName:d56ee776-82e2-47a2-bd48-74a5e7e64cef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.570052683 +0000 UTC m=+2308.969365230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle") pod "kube-state-metrics-0" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef") : secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.570111 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.570133 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data podName:2b6c1e85-68d7-448e-81c8-2efabf9e73ef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.070126893 +0000 UTC m=+2307.469439439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data") pod "rabbitmq-cell1-server-0" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.656683 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.656725 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.657452 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.657515 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data podName:7bffb37f-433d-4562-bf3d-edf49b7cc030 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.657497991 +0000 UTC m=+2309.056810539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data") pod "rabbitmq-server-0" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030") : configmap "rabbitmq-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.657848 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.657928 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.157903434 +0000 UTC m=+2307.557215981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : configmap "openstack-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.667068 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2ch7q for pod openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.667165 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:23.167144884 +0000 UTC m=+2307.566457432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ch7q" (UniqueName: "kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.675453 5030 scope.go:117] "RemoveContainer" containerID="b4acc12a66d0145dbecf40627c01df8c7bd337cd03205c0a2b729fd864219f98" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.702523 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.760419 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.760825 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.761695 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-scheduler-config-data: secret "nova-scheduler-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.761788 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.761772402 +0000 UTC m=+2309.161084948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "nova-scheduler-config-data" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.762349 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.762411 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle podName:a7df4d50-0430-4610-b3ec-9c2156f78c04 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:26.762396565 +0000 UTC m=+2311.161709112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle") pod "nova-cell0-conductor-0" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04") : secret "combined-ca-bundle" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.762703 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.762766 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.762756632 +0000 UTC m=+2309.162069179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : configmap "openstack-cell1-scripts" not found Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763291 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763308 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763315 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763347 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763362 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763369 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763375 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763380 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763386 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763394 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763422 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.763436 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764305 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764361 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764397 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764408 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764417 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764438 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764447 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764457 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.764479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.767424 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" event={"ID":"bf225c37-5611-47f6-995b-615f1f648742","Type":"ContainerDied","Data":"d1bd1a3bfe1b0a8769e3335dda412222cc815260aa5962541f367346ba78f5b6"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.767462 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1bd1a3bfe1b0a8769e3335dda412222cc815260aa5962541f367346ba78f5b6" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.794385 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerStarted","Data":"df9b619df61a13f1488cb1e18a265966883cac3d23539d81e7e7098e2f469c5d"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.794660 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api-log" containerID="cri-o://b1aba8f8b4e2addb25d9ce6ff3cbdad9e6e656092729f8a6106cee5288d47711" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.794973 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.795318 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api" containerID="cri-o://df9b619df61a13f1488cb1e18a265966883cac3d23539d81e7e7098e2f469c5d" gracePeriod=30 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.819233 5030 generic.go:358] "Generic (PLEG): container finished" podID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerID="16f06f903eb64352f056169bfb9e86a75510e6a5bfc5cc296520028a191e918c" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.819265 5030 generic.go:358] "Generic (PLEG): container finished" podID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerID="6ed0c635656f5dd66d6e4d2db4cb2fb94c5ed8f85831fad8a58570e3f56a7850" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.819349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerDied","Data":"16f06f903eb64352f056169bfb9e86a75510e6a5bfc5cc296520028a191e918c"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.819379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerDied","Data":"6ed0c635656f5dd66d6e4d2db4cb2fb94c5ed8f85831fad8a58570e3f56a7850"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.839791 5030 generic.go:358] "Generic (PLEG): container finished" podID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerID="f4b8bab8b748083d9e385230e986284b1a71e91cca58d21ee85f8b91510b3dd8" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.839901 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerDied","Data":"f4b8bab8b748083d9e385230e986284b1a71e91cca58d21ee85f8b91510b3dd8"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.847342 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="rabbitmq" containerID="cri-o://f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7" gracePeriod=604800 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.868847 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.885046 5030 projected.go:194] Error preparing data for projected volume kube-api-access-rs2p2 for pod openstack-kuttl-tests/root-account-create-update-qq7bb: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.885134 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2 podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.885112297 +0000 UTC m=+2309.284424844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rs2p2" (UniqueName: "kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:22 crc kubenswrapper[5030]: E0316 13:44:22.893943 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6c97ea_4885_4b61_880f_bd53acc1928b.slice/crio-1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6c97ea_4885_4b61_880f_bd53acc1928b.slice/crio-conmon-1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46aa0fb6_44eb_478c_829a_7b9c13448128.slice/crio-conmon-cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8322c5d_8b32_4542_bc97_97e0ea9053f2.slice/crio-532844fff7ac3a729df0e9ab476589874e9e6ac20f747e51bca916efc13ce969.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.904423 5030 generic.go:358] "Generic (PLEG): container finished" podID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerID="2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.904815 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerDied","Data":"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.919704 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=7.919686872 podStartE2EDuration="7.919686872s" podCreationTimestamp="2026-03-16 13:44:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:22.837802311 +0000 UTC m=+2307.237114857" watchObservedRunningTime="2026-03-16 13:44:22.919686872 +0000 UTC m=+2307.318999429" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.930705 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerID="4302dd707348f58ec092cd96e6f42e6ac3362572c16e9cf685cf10c5f70d2ddd" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.930742 5030 generic.go:358] "Generic (PLEG): container finished" podID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerID="04697bbdcb5d13a8a23f6690c70f4c5f47395db34abeead25501ed08f764dcb1" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.930844 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerDied","Data":"4302dd707348f58ec092cd96e6f42e6ac3362572c16e9cf685cf10c5f70d2ddd"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.930886 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerDied","Data":"04697bbdcb5d13a8a23f6690c70f4c5f47395db34abeead25501ed08f764dcb1"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.937972 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.953836 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerID="53d0f9b197386d170f93652b6003ebccaf3f55a90671832cbd6f621cea3b038d" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.953866 5030 generic.go:358] "Generic (PLEG): container finished" podID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerID="261f920f417aed1085ab33305627f98da93c33458bfa5394c1b0376b0f50472e" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.953956 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerDied","Data":"53d0f9b197386d170f93652b6003ebccaf3f55a90671832cbd6f621cea3b038d"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.954038 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerDied","Data":"261f920f417aed1085ab33305627f98da93c33458bfa5394c1b0376b0f50472e"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.971273 5030 generic.go:358] "Generic (PLEG): container finished" podID="6e932185-2e0e-4845-a258-a48580b8af5d" containerID="e13ff8885b326ba542092f5269716a5cc9aed50be25f0ffa805c8c4d13543766" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.971380 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerDied","Data":"e13ff8885b326ba542092f5269716a5cc9aed50be25f0ffa805c8c4d13543766"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.972964 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerStarted","Data":"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.974192 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" event={"ID":"08f24da9-a345-4eb5-b643-811fddc089c7","Type":"ContainerDied","Data":"32041e86653e4d9e5afbed8001c67ecd1a5f13ac01ee64ff964e5c767fb42cda"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.974210 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32041e86653e4d9e5afbed8001c67ecd1a5f13ac01ee64ff964e5c767fb42cda" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.978903 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1e507f45-9b3e-4be2-ae26-341712344d66/ovn-northd/0.log" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.978964 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"1e507f45-9b3e-4be2-ae26-341712344d66","Type":"ContainerDied","Data":"a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.978978 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8763b42bc5f25b8884e200527efae48934686029940d4e371f6425cfbd5db83" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.980537 5030 generic.go:358] "Generic (PLEG): container finished" podID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerID="2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f" exitCode=0 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.980627 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerDied","Data":"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.983113 5030 generic.go:358] "Generic (PLEG): container finished" podID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" containerID="532844fff7ac3a729df0e9ab476589874e9e6ac20f747e51bca916efc13ce969" exitCode=137 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985220 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_22ab016c-c89d-4fc7-9daa-10dcbb93d493/ovsdbserver-sb/0.log" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985244 5030 generic.go:358] "Generic (PLEG): container finished" podID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerID="531bfb3e1a951bc9f5c1f8d6920f737f51dd45ef67dbac259b97bfae251a0515" exitCode=2 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985253 5030 generic.go:358] "Generic (PLEG): container finished" podID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerID="84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerDied","Data":"531bfb3e1a951bc9f5c1f8d6920f737f51dd45ef67dbac259b97bfae251a0515"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985339 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerDied","Data":"84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"22ab016c-c89d-4fc7-9daa-10dcbb93d493","Type":"ContainerDied","Data":"240d416eb8dd3d5e134cc85f2af757803406849d0135410bf9d224ff3fa2a41c"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.985355 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="240d416eb8dd3d5e134cc85f2af757803406849d0135410bf9d224ff3fa2a41c" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.991931 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4b6c97ea-4885-4b61-880f-bd53acc1928b/ovsdbserver-nb/0.log" Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.991952 5030 generic.go:358] "Generic (PLEG): container finished" podID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerID="1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" exitCode=143 Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.992029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerDied","Data":"1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.992043 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"4b6c97ea-4885-4b61-880f-bd53acc1928b","Type":"ContainerDied","Data":"166f0e095cadcc0be612298a6d25ad8d7015b20db6a7e30e1695fed4d7d6482c"} Mar 16 13:44:22 crc kubenswrapper[5030]: I0316 13:44:22.992051 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="166f0e095cadcc0be612298a6d25ad8d7015b20db6a7e30e1695fed4d7d6482c" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.000634 5030 generic.go:358] "Generic (PLEG): container finished" podID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerID="7e4806648bb39e33b3636a695eee1a2e84af95146d08df6d677984c64adbc0d0" exitCode=0 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.000658 5030 generic.go:358] "Generic (PLEG): container finished" podID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerID="33ab4ba5ddc6e00f0235995ac7a380aa7fc85703f8c6e1bed39d09f4eab5f383" exitCode=143 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.000809 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerDied","Data":"7e4806648bb39e33b3636a695eee1a2e84af95146d08df6d677984c64adbc0d0"} Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.000840 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerDied","Data":"33ab4ba5ddc6e00f0235995ac7a380aa7fc85703f8c6e1bed39d09f4eab5f383"} Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.007921 5030 generic.go:358] "Generic (PLEG): container finished" podID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" containerID="f03be0fe0f119f339025ec27b7b4a51796f7a20c267b664eeab52715521fcbc0" exitCode=2 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008104 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d56ee776-82e2-47a2-bd48-74a5e7e64cef","Type":"ContainerDied","Data":"f03be0fe0f119f339025ec27b7b4a51796f7a20c267b664eeab52715521fcbc0"} Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008197 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008322 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008319 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" containerID="cri-o://7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" gracePeriod=30 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.008895 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.009527 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" secret="" err="secret \"nova-nova-dockercfg-t9hlr\" not found" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.010185 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="cinder-scheduler" containerID="cri-o://4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" gracePeriod=30 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.010416 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="probe" containerID="cri-o://668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" gracePeriod=30 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.050698 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="rabbitmq" containerID="cri-o://f8f9a228c39d74f6171e07f48041b560bd59771df3190e00fdcc1f3f427d342b" gracePeriod=604800 Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.072562 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.080277 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.080346 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data podName:2b6c1e85-68d7-448e-81c8-2efabf9e73ef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.080330665 +0000 UTC m=+2308.479643212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data") pod "rabbitmq-cell1-server-0" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.148933 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="galera" containerID="cri-o://1052f1d94b64dacb4245d627d76e0498e3eeacbc2f3ac8a2fe43735cbc098b4e" gracePeriod=30 Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.183865 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184071 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.184024362 +0000 UTC m=+2309.583336909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184110 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-novncproxy-config-data: secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184180 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.184162072 +0000 UTC m=+2309.583474618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184218 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184256 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.18424636 +0000 UTC m=+2309.583558896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184676 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.184756 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.184736993 +0000 UTC m=+2309.584049539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.184980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.185012 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.185267 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.185344 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.18532514 +0000 UTC m=+2308.584637686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : configmap "openstack-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.191074 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2ch7q for pod openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.191159 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.191140425 +0000 UTC m=+2308.590452973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ch7q" (UniqueName: "kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.205953 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.276540 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.287518 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.287719 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.287767 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.287920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.287945 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.288242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.288337 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288405 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288490 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle podName:345a1b2b-5460-4c84-98b6-3ce8ab810d98 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.288470505 +0000 UTC m=+2311.687783053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle") pod "glance-default-internal-api-0" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288506 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288529 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288598 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288584 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle podName:65b03029-a404-44a7-b76d-fc4dd9b61b12 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.288565573 +0000 UTC m=+2311.687878121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle") pod "nova-scheduler-0" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288661 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.288651195 +0000 UTC m=+2309.687963743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "cert-ceilometer-internal-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288694 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: secret "ceilometer-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.288700 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288725 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.28871782 +0000 UTC m=+2309.688030367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288745 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.288736515 +0000 UTC m=+2309.688049063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288757 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: secret "ceilometer-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.288872 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.290931 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.28877657 +0000 UTC m=+2309.688089117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "ceilometer-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.290966 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.290957052 +0000 UTC m=+2309.690269599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.293320 5030 projected.go:194] Error preparing data for projected volume kube-api-access-j5lds for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.293379 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.29335962 +0000 UTC m=+2309.692672167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5lds" (UniqueName: "kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.394684 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.394762 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.394741249 +0000 UTC m=+2309.794053796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.394851 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.394916 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.394897082 +0000 UTC m=+2309.794209619 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.395491 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.395568 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.395530364 +0000 UTC m=+2309.794842911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.396062 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.396244 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.396294 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.39626735 +0000 UTC m=+2309.795580137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.396338 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.396325869 +0000 UTC m=+2309.795638416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.446809 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:44:23 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: if [ -n "placement" ]; then Mar 16 13:44:23 crc kubenswrapper[5030]: GRANT_DATABASE="placement" Mar 16 13:44:23 crc kubenswrapper[5030]: else Mar 16 13:44:23 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:44:23 crc kubenswrapper[5030]: fi Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:44:23 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:44:23 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:44:23 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:44:23 crc kubenswrapper[5030]: # support updates Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.448182 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"placement-db-secret\\\" not found\"" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" podUID="febb1dae-5fff-46f6-82ed-0ea41974dbf0" Mar 16 13:44:23 crc kubenswrapper[5030]: W0316 13:44:23.631501 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc38064ac_98ac_4ec4_8c01_0b537d555047.slice/crio-9094d0cf5683df4022688fdfb568cbdcce5d39f19fe0481aee0ef22632f8a695 WatchSource:0}: Error finding container 9094d0cf5683df4022688fdfb568cbdcce5d39f19fe0481aee0ef22632f8a695: Status 404 returned error can't find the container with id 9094d0cf5683df4022688fdfb568cbdcce5d39f19fe0481aee0ef22632f8a695 Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.637164 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:44:23 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: if [ -n "glance" ]; then Mar 16 13:44:23 crc kubenswrapper[5030]: GRANT_DATABASE="glance" Mar 16 13:44:23 crc kubenswrapper[5030]: else Mar 16 13:44:23 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:44:23 crc kubenswrapper[5030]: fi Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:44:23 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:44:23 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:44:23 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:44:23 crc kubenswrapper[5030]: # support updates Mar 16 13:44:23 crc kubenswrapper[5030]: Mar 16 13:44:23 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.638436 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" podUID="c38064ac-98ac-4ec4-8c01-0b537d555047" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.682105 5030 scope.go:117] "RemoveContainer" containerID="d009664d043b9f838006bbc4280c2570fe92ffefee9671d7712b47035660b287" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.726492 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.727788 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" secret="" err="secret \"galera-openstack-dockercfg-46dh4\" not found" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.727848 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.736470 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[ceilometer-tls-certs combined-ca-bundle config-data kube-api-access-j5lds scripts sg-core-conf-yaml], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/ceilometer-0" podUID="2d9f383c-c0db-4808-a7ea-95de949c8d9b" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.766418 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.769651 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.784817 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.786852 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-xh82b"] Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.800658 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_1e507f45-9b3e-4be2-ae26-341712344d66/ovn-northd/0.log" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.800722 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.810870 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.811084 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data\") pod \"08f24da9-a345-4eb5-b643-811fddc089c7\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.814470 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fvst\" (UniqueName: \"kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.814607 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle\") pod \"08f24da9-a345-4eb5-b643-811fddc089c7\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.814821 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.814979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvdsz\" (UniqueName: \"kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz\") pod \"08f24da9-a345-4eb5-b643-811fddc089c7\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815118 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815258 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom\") pod \"08f24da9-a345-4eb5-b643-811fddc089c7\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815310 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs\") pod \"08f24da9-a345-4eb5-b643-811fddc089c7\" (UID: \"08f24da9-a345-4eb5-b643-811fddc089c7\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815650 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815719 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.815755 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs\") pod \"bf225c37-5611-47f6-995b-615f1f648742\" (UID: \"bf225c37-5611-47f6-995b-615f1f648742\") " Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.820774 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.820847 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts podName:41d5224a-9426-4e7d-8e47-4d4f9aab1ef2 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:24.320827913 +0000 UTC m=+2308.720140460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts") pod "nova-api-b955-account-create-update-654rz" (UID: "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2") : configmap "openstack-scripts" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.824085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs" (OuterVolumeSpecName: "logs") pod "08f24da9-a345-4eb5-b643-811fddc089c7" (UID: "08f24da9-a345-4eb5-b643-811fddc089c7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.825354 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/08f24da9-a345-4eb5-b643-811fddc089c7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.826691 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs" (OuterVolumeSpecName: "logs") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.840161 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst" (OuterVolumeSpecName: "kube-api-access-8fvst") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "kube-api-access-8fvst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.849917 5030 scope.go:117] "RemoveContainer" containerID="fe0d145d0aa2a2e66ce1a58a2a706bf85ecc3cf1794644272856192c8a3cfb5b" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.862777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz" (OuterVolumeSpecName: "kube-api-access-jvdsz") pod "08f24da9-a345-4eb5-b643-811fddc089c7" (UID: "08f24da9-a345-4eb5-b643-811fddc089c7"). InnerVolumeSpecName "kube-api-access-jvdsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.872199 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "08f24da9-a345-4eb5-b643-811fddc089c7" (UID: "08f24da9-a345-4eb5-b643-811fddc089c7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.874163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.874500 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.903981 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "08f24da9-a345-4eb5-b643-811fddc089c7" (UID: "08f24da9-a345-4eb5-b643-811fddc089c7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.909688 5030 scope.go:117] "RemoveContainer" containerID="418c2ae8a3e29aaebfe75d39aa3e156dea569cf6f9a33c380b5741e55ed1f16e" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.920959 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.927211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6t67\" (UniqueName: \"kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.927568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.927905 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.927989 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.928126 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.928231 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.929531 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config" (OuterVolumeSpecName: "config") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.929597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts" (OuterVolumeSpecName: "scripts") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.929830 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir\") pod \"1e507f45-9b3e-4be2-ae26-341712344d66\" (UID: \"1e507f45-9b3e-4be2-ae26-341712344d66\") " Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931832 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931850 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvdsz\" (UniqueName: \"kubernetes.io/projected/08f24da9-a345-4eb5-b643-811fddc089c7-kube-api-access-jvdsz\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931864 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931878 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931888 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931899 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/bf225c37-5611-47f6-995b-615f1f648742-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931911 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931922 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e507f45-9b3e-4be2-ae26-341712344d66-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931932 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fvst\" (UniqueName: \"kubernetes.io/projected/bf225c37-5611-47f6-995b-615f1f648742-kube-api-access-8fvst\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.931941 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.932022 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.932086 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.932064195 +0000 UTC m=+2312.331376743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934087 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-internal-svc: secret "cert-nova-internal-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934172 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.934147384 +0000 UTC m=+2312.333459920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "internal-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-internal-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934293 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934338 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.934325969 +0000 UTC m=+2312.333638517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934396 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-public-svc: secret "cert-nova-public-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: E0316 13:44:23.934420 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs podName:ac6d227c-baa9-4de4-a59e-0a8a42e53c67 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.934411951 +0000 UTC m=+2312.333724497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "public-tls-certs" (UniqueName: "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs") pod "nova-api-0" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67") : secret "cert-nova-public-svc" not found Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.934443 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.938911 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67" (OuterVolumeSpecName: "kube-api-access-f6t67") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "kube-api-access-f6t67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.939658 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.941353 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data" (OuterVolumeSpecName: "config-data") pod "bf225c37-5611-47f6-995b-615f1f648742" (UID: "bf225c37-5611-47f6-995b-615f1f648742"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.965012 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbeaa27-2788-4e32-bc50-ffd14095486a" path="/var/lib/kubelet/pods/1cbeaa27-2788-4e32-bc50-ffd14095486a/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.965641 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2745c69e-440c-405d-b62b-5cbf56739ef5" path="/var/lib/kubelet/pods/2745c69e-440c-405d-b62b-5cbf56739ef5/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.966337 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa624ca3-86a7-4768-95f0-f47ed77c6f7b" path="/var/lib/kubelet/pods/aa624ca3-86a7-4768-95f0-f47ed77c6f7b/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.966717 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.967081 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97dd349-8786-43a7-b5d6-938548d988cf" path="/var/lib/kubelet/pods/b97dd349-8786-43a7-b5d6-938548d988cf/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.968415 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b98c7910-5683-418f-81c8-e0174aa4ed85" path="/var/lib/kubelet/pods/b98c7910-5683-418f-81c8-e0174aa4ed85/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.968984 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9ba145-a23e-4233-89bd-a5bb7f0b18db" path="/var/lib/kubelet/pods/bf9ba145-a23e-4233-89bd-a5bb7f0b18db/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.969577 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3e18b9-f416-49a3-be5d-8cf5c427b3a6" path="/var/lib/kubelet/pods/ed3e18b9-f416-49a3-be5d-8cf5c427b3a6/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.970577 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" path="/var/lib/kubelet/pods/fba7aa49-e100-4b16-9e75-3483cd17f86b/volumes" Mar 16 13:44:23 crc kubenswrapper[5030]: I0316 13:44:23.973776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data" (OuterVolumeSpecName: "config-data") pod "08f24da9-a345-4eb5-b643-811fddc089c7" (UID: "08f24da9-a345-4eb5-b643-811fddc089c7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.001118 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.023874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "1e507f45-9b3e-4be2-ae26-341712344d66" (UID: "1e507f45-9b3e-4be2-ae26-341712344d66"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.030031 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" containerID="cri-o://7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021" gracePeriod=30 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.030871 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" containerID="cri-o://fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8" gracePeriod=30 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035567 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035597 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bf225c37-5611-47f6-995b-615f1f648742-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035610 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035620 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/08f24da9-a345-4eb5-b643-811fddc089c7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035631 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035642 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e507f45-9b3e-4be2-ae26-341712344d66-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035654 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/1e507f45-9b3e-4be2-ae26-341712344d66-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.035664 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6t67\" (UniqueName: \"kubernetes.io/projected/1e507f45-9b3e-4be2-ae26-341712344d66-kube-api-access-f6t67\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.039588 5030 generic.go:358] "Generic (PLEG): container finished" podID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerID="d3297ede49c51ccf1261e055fd5c28cd006d991bb9a6dfe1a54440eee3b2d257" exitCode=0 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.080321 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podStartSLOduration=6.080281799 podStartE2EDuration="6.080281799s" podCreationTimestamp="2026-03-16 13:44:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:24.075135831 +0000 UTC m=+2308.474448378" watchObservedRunningTime="2026-03-16 13:44:24.080281799 +0000 UTC m=+2308.479594346" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.093777 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerStarted","Data":"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107481 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107515 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerDied","Data":"d3297ede49c51ccf1261e055fd5c28cd006d991bb9a6dfe1a54440eee3b2d257"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107559 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107614 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"eea15d11-b237-4437-a87c-bfcfd6ba2cd2","Type":"ContainerDied","Data":"9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107627 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d329e82fdedec86d5caccebad5fca7d797e095c8af4555ed14b62288fa9430b" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107637 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be173e711e858ca8dea56f66c469a24da8426f59c27c03db168cc0f186e8bc56" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107643 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" event={"ID":"c38064ac-98ac-4ec4-8c01-0b537d555047","Type":"ContainerStarted","Data":"9094d0cf5683df4022688fdfb568cbdcce5d39f19fe0481aee0ef22632f8a695"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" event={"ID":"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a","Type":"ContainerDied","Data":"f56d97d38f18d1a7842662df81d79464c5460a66b9fa5bfbb2511e0a0d821289"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107664 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f56d97d38f18d1a7842662df81d79464c5460a66b9fa5bfbb2511e0a0d821289" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107672 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"d56ee776-82e2-47a2-bd48-74a5e7e64cef","Type":"ContainerDied","Data":"1fed04a0f1674fb5ec80849a0d5cc80c906b4ac8c978b3eabda4990a7df7fb08"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107682 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fed04a0f1674fb5ec80849a0d5cc80c906b4ac8c978b3eabda4990a7df7fb08" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.107691 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" event={"ID":"febb1dae-5fff-46f6-82ed-0ea41974dbf0","Type":"ContainerStarted","Data":"6bbe3d1606f1d9ef319ae2680c3ed5046ef83d652556ab8cedd5817d9db944a7"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.113108 5030 generic.go:358] "Generic (PLEG): container finished" podID="27c6f290-ff76-4884-8db6-075c353aa2df" containerID="a52be5d468e9737e26bae8c052a17fcdc642093e60bed5709f31f1edc1e620d1" exitCode=0 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.113190 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"27c6f290-ff76-4884-8db6-075c353aa2df","Type":"ContainerDied","Data":"a52be5d468e9737e26bae8c052a17fcdc642093e60bed5709f31f1edc1e620d1"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.113212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"27c6f290-ff76-4884-8db6-075c353aa2df","Type":"ContainerDied","Data":"499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.113222 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="499a6077497c0805ef347a5e83037c4e9a1af17723fe33b47318f46ab8918bac" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.134004 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_4b6c97ea-4885-4b61-880f-bd53acc1928b/ovsdbserver-nb/0.log" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.134080 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.136059 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2ch7q operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" podUID="ae19cd1a-dc30-41be-9ada-464a4159ac6c" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.136857 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_22ab016c-c89d-4fc7-9daa-10dcbb93d493/ovsdbserver-sb/0.log" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.136905 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.136951 5030 generic.go:358] "Generic (PLEG): container finished" podID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerID="df9b619df61a13f1488cb1e18a265966883cac3d23539d81e7e7098e2f469c5d" exitCode=0 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.136969 5030 generic.go:358] "Generic (PLEG): container finished" podID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerID="b1aba8f8b4e2addb25d9ce6ff3cbdad9e6e656092729f8a6106cee5288d47711" exitCode=143 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.137062 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerDied","Data":"df9b619df61a13f1488cb1e18a265966883cac3d23539d81e7e7098e2f469c5d"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.137079 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerDied","Data":"b1aba8f8b4e2addb25d9ce6ff3cbdad9e6e656092729f8a6106cee5288d47711"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.137090 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4bf2baa4-a457-4ae2-b225-ef4828878d62","Type":"ContainerDied","Data":"87e8266f67ef2c6024d087e44ca1c95bb72f2277648dca6a41a904a5c54ba99b"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.137099 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87e8266f67ef2c6024d087e44ca1c95bb72f2277648dca6a41a904a5c54ba99b" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.139363 5030 generic.go:358] "Generic (PLEG): container finished" podID="ee332a01-506b-449e-968e-8ada0f0470e4" containerID="1052f1d94b64dacb4245d627d76e0498e3eeacbc2f3ac8a2fe43735cbc098b4e" exitCode=0 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.139479 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerDied","Data":"1052f1d94b64dacb4245d627d76e0498e3eeacbc2f3ac8a2fe43735cbc098b4e"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.141996 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef","Type":"ContainerDied","Data":"216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.142016 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="216405c65a9cf69068069561faaa15bb3f6dd9ae09bcf673c229cdbd93ecb2fc" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.144831 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.144899 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data podName:2b6c1e85-68d7-448e-81c8-2efabf9e73ef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:26.144880691 +0000 UTC m=+2310.544193238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data") pod "rabbitmq-cell1-server-0" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.145226 5030 scope.go:117] "RemoveContainer" containerID="cf428a1b9f28401055b4d46f0ef2097ebf5b885395f5e937c44aae9f06a8f4f7" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.147458 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.157843 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" event={"ID":"5cab4b11-b0dc-48d8-8eff-1d36808bebe5","Type":"ContainerDied","Data":"f19f8e91e34090ea52472c9431f7c60cf0b1bb40164ce5a919573a4bd67f4f1d"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.157885 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f19f8e91e34090ea52472c9431f7c60cf0b1bb40164ce5a919573a4bd67f4f1d" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.174030 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.223850 5030 scope.go:117] "RemoveContainer" containerID="6501af12ade6721c99ecf9efefc870c95c731c78ce8e913aabab7eb5396cee9b" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.238676 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.240963 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ac6d227c-baa9-4de4-a59e-0a8a42e53c67","Type":"ContainerDied","Data":"5b6d5fc0f2963adaa49270952377845bd23c073d4a537d29ce820e51e6203379"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.241036 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b6d5fc0f2963adaa49270952377845bd23c073d4a537d29ce820e51e6203379" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.241147 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.254861 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.256190 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.258679 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.258837 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.258946 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhgth\" (UniqueName: \"kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth\") pod \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259034 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle\") pod \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259082 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259267 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nphx5\" (UniqueName: \"kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259298 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259356 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data\") pod \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259501 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret\") pod \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259679 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs\") pod \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259769 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259847 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle\") pod \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259887 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259902 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.259992 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.260327 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261207 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom\") pod \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\" (UID: \"5cab4b11-b0dc-48d8-8eff-1d36808bebe5\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261425 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config\") pod \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261587 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts\") pod \"4b6c97ea-4885-4b61-880f-bd53acc1928b\" (UID: \"4b6c97ea-4885-4b61-880f-bd53acc1928b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnc5c\" (UniqueName: \"kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261694 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gz48\" (UniqueName: \"kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48\") pod \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\" (UID: \"b8322c5d-8b32-4542-bc97-97e0ea9053f2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.261732 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs\") pod \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\" (UID: \"22ab016c-c89d-4fc7-9daa-10dcbb93d493\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.262058 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config" (OuterVolumeSpecName: "config") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.263312 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs" (OuterVolumeSpecName: "logs") pod "5cab4b11-b0dc-48d8-8eff-1d36808bebe5" (UID: "5cab4b11-b0dc-48d8-8eff-1d36808bebe5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.263320 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" event={"ID":"b9e2308b-6995-45f8-800e-8f7a4ff5ade9","Type":"ContainerDied","Data":"a40974de403a13837ddedc19ae2e92846c0c411f7ec13c8ac4153563a31f2b97"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.263385 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a40974de403a13837ddedc19ae2e92846c0c411f7ec13c8ac4153563a31f2b97" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.264424 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.264738 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.267419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config" (OuterVolumeSpecName: "config") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.267518 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts" (OuterVolumeSpecName: "scripts") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.269890 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts" (OuterVolumeSpecName: "scripts") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.270472 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5cab4b11-b0dc-48d8-8eff-1d36808bebe5" (UID: "5cab4b11-b0dc-48d8-8eff-1d36808bebe5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.270573 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.270727 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.270656 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.272119 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:26.272098469 +0000 UTC m=+2310.671411017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : configmap "openstack-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272409 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272494 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272625 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272684 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272780 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.272866 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b6c97ea-4885-4b61-880f-bd53acc1928b-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273125 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/22ab016c-c89d-4fc7-9daa-10dcbb93d493-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273262 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273255 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5" (OuterVolumeSpecName: "kube-api-access-nphx5") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "kube-api-access-nphx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273316 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage02-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "local-storage02-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273519 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerDied","Data":"4c455a4b8b95ca1eba09d8e139eac3253f2ce455e476fe5effc103e57a8c8dcc"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273496 5030 generic.go:358] "Generic (PLEG): container finished" podID="6e932185-2e0e-4845-a258-a48580b8af5d" containerID="4c455a4b8b95ca1eba09d8e139eac3253f2ce455e476fe5effc103e57a8c8dcc" exitCode=0 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273654 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273789 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" event={"ID":"6e932185-2e0e-4845-a258-a48580b8af5d","Type":"ContainerDied","Data":"b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11"} Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273803 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1918cbbb4a3470b66cb9c7dc3ea39d872f43bd434e1c79d35fc5f789bb7ad11" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273937 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="8e26e066-ea63-42d9-8853-63bf42e1714d" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://f9da55917cbf0ab4733a021bc717fcf40db775cd7b8dcab7611a4d41900b5aef" gracePeriod=30 Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.273956 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c" (OuterVolumeSpecName: "kube-api-access-qnc5c") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "kube-api-access-qnc5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.274179 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.275109 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.276760 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.291603 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2ch7q for pod openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.291691 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:26.291671751 +0000 UTC m=+2310.690984299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ch7q" (UniqueName: "kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.295337 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.306015 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48" (OuterVolumeSpecName: "kube-api-access-7gz48") pod "b8322c5d-8b32-4542-bc97-97e0ea9053f2" (UID: "b8322c5d-8b32-4542-bc97-97e0ea9053f2"). InnerVolumeSpecName "kube-api-access-7gz48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.308499 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.313803 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.327826 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.331726 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.332098 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.335108 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.347082 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.359964 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth" (OuterVolumeSpecName: "kube-api-access-rhgth") pod "5cab4b11-b0dc-48d8-8eff-1d36808bebe5" (UID: "5cab4b11-b0dc-48d8-8eff-1d36808bebe5"). InnerVolumeSpecName "kube-api-access-rhgth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.361719 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.365964 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.372103 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.376987 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle\") pod \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377039 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377069 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377138 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdlrr\" (UniqueName: \"kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr\") pod \"65b03029-a404-44a7-b76d-fc4dd9b61b12\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377185 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle\") pod \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377331 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g74bx\" (UniqueName: \"kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377474 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb77b\" (UniqueName: \"kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b\") pod \"a7df4d50-0430-4610-b3ec-9c2156f78c04\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377500 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom\") pod \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377539 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data\") pod \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377619 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlkgn\" (UniqueName: \"kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377676 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs\") pod \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377816 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs\") pod \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377881 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data\") pod \"65b03029-a404-44a7-b76d-fc4dd9b61b12\" (UID: \"65b03029-a404-44a7-b76d-fc4dd9b61b12\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.377961 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378079 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378144 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5d4d\" (UniqueName: \"kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d\") pod \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\" (UID: \"5e4d2bc4-0bec-4939-a936-d9a9abc8f23a\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378162 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378183 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvrmp\" (UniqueName: \"kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378274 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378406 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378722 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.378994 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kxlr\" (UniqueName: \"kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr\") pod \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379083 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379121 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379146 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config\") pod \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\" (UID: \"d56ee776-82e2-47a2-bd48-74a5e7e64cef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379175 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data\") pod \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\" (UID: \"345a1b2b-5460-4c84-98b6-3ce8ab810d98\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.379201 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data\") pod \"a7df4d50-0430-4610-b3ec-9c2156f78c04\" (UID: \"a7df4d50-0430-4610-b3ec-9c2156f78c04\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380384 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380410 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnc5c\" (UniqueName: \"kubernetes.io/projected/22ab016c-c89d-4fc7-9daa-10dcbb93d493-kube-api-access-qnc5c\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380422 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gz48\" (UniqueName: \"kubernetes.io/projected/b8322c5d-8b32-4542-bc97-97e0ea9053f2-kube-api-access-7gz48\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380440 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhgth\" (UniqueName: \"kubernetes.io/projected/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-kube-api-access-rhgth\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380451 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nphx5\" (UniqueName: \"kubernetes.io/projected/4b6c97ea-4885-4b61-880f-bd53acc1928b-kube-api-access-nphx5\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380461 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380476 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.380516 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs" (OuterVolumeSpecName: "logs") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.381218 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.384662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "glance") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.386610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs" (OuterVolumeSpecName: "logs") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.388759 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.388828 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts podName:41d5224a-9426-4e7d-8e47-4d4f9aab1ef2 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:25.388811833 +0000 UTC m=+2309.788124380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts") pod "nova-api-b955-account-create-update-654rz" (UID: "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2") : configmap "openstack-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.389919 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs" (OuterVolumeSpecName: "logs") pod "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" (UID: "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.390234 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs" (OuterVolumeSpecName: "logs") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.399759 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.406938 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.409012 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp" (OuterVolumeSpecName: "kube-api-access-nvrmp") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "kube-api-access-nvrmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.409805 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr" (OuterVolumeSpecName: "kube-api-access-9kxlr") pod "d56ee776-82e2-47a2-bd48-74a5e7e64cef" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef"). InnerVolumeSpecName "kube-api-access-9kxlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.433633 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data" (OuterVolumeSpecName: "config-data") pod "65b03029-a404-44a7-b76d-fc4dd9b61b12" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.435666 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data" (OuterVolumeSpecName: "config-data") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.450238 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn" (OuterVolumeSpecName: "kube-api-access-tlkgn") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "kube-api-access-tlkgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.453953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.461575 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d" (OuterVolumeSpecName: "kube-api-access-l5d4d") pod "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" (UID: "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a"). InnerVolumeSpecName "kube-api-access-l5d4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.463175 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data" (OuterVolumeSpecName: "config-data") pod "a7df4d50-0430-4610-b3ec-9c2156f78c04" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.469156 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" (UID: "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.469854 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx" (OuterVolumeSpecName: "kube-api-access-g74bx") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "kube-api-access-g74bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.472884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts" (OuterVolumeSpecName: "scripts") pod "345a1b2b-5460-4c84-98b6-3ce8ab810d98" (UID: "345a1b2b-5460-4c84-98b6-3ce8ab810d98"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.477742 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr" (OuterVolumeSpecName: "kube-api-access-wdlrr") pod "65b03029-a404-44a7-b76d-fc4dd9b61b12" (UID: "65b03029-a404-44a7-b76d-fc4dd9b61b12"). InnerVolumeSpecName "kube-api-access-wdlrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.478132 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.483808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle\") pod \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.483896 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.483946 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484037 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484083 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v48ch\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484208 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ddm4\" (UniqueName: \"kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4\") pod \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484256 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom\") pod \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484280 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484308 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484376 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484396 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484425 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484456 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data\") pod \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484509 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484571 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ckcr\" (UniqueName: \"kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484666 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484696 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484809 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jddz\" (UniqueName: \"kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz\") pod \"27c6f290-ff76-4884-8db6-075c353aa2df\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.484981 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs\") pod \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\" (UID: \"b9e2308b-6995-45f8-800e-8f7a4ff5ade9\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485008 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485051 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd\") pod \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485120 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485117 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs" (OuterVolumeSpecName: "logs") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485149 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs\") pod \"27c6f290-ff76-4884-8db6-075c353aa2df\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.485169 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config\") pod \"27c6f290-ff76-4884-8db6-075c353aa2df\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.488792 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle\") pod \"27c6f290-ff76-4884-8db6-075c353aa2df\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.488917 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd\") pod \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.488955 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjjch\" (UniqueName: \"kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.489010 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs\") pod \"4bf2baa4-a457-4ae2-b225-ef4828878d62\" (UID: \"4bf2baa4-a457-4ae2-b225-ef4828878d62\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.489028 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data\") pod \"27c6f290-ff76-4884-8db6-075c353aa2df\" (UID: \"27c6f290-ff76-4884-8db6-075c353aa2df\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.489085 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift\") pod \"6e932185-2e0e-4845-a258-a48580b8af5d\" (UID: \"6e932185-2e0e-4845-a258-a48580b8af5d\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.496973 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.496996 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4bf2baa4-a457-4ae2-b225-ef4828878d62-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497009 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5d4d\" (UniqueName: \"kubernetes.io/projected/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-kube-api-access-l5d4d\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497021 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvrmp\" (UniqueName: \"kubernetes.io/projected/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-kube-api-access-nvrmp\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497033 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497043 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kxlr\" (UniqueName: \"kubernetes.io/projected/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-api-access-9kxlr\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497052 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/345a1b2b-5460-4c84-98b6-3ce8ab810d98-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497061 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497071 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497094 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497103 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497113 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdlrr\" (UniqueName: \"kubernetes.io/projected/65b03029-a404-44a7-b76d-fc4dd9b61b12-kube-api-access-wdlrr\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497124 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g74bx\" (UniqueName: \"kubernetes.io/projected/345a1b2b-5460-4c84-98b6-3ce8ab810d98-kube-api-access-g74bx\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497135 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497145 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlkgn\" (UniqueName: \"kubernetes.io/projected/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-kube-api-access-tlkgn\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497153 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497162 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.497171 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.505332 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.506621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.507776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "27c6f290-ff76-4884-8db6-075c353aa2df" (UID: "27c6f290-ff76-4884-8db6-075c353aa2df"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.507848 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.508178 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs" (OuterVolumeSpecName: "logs") pod "b9e2308b-6995-45f8-800e-8f7a4ff5ade9" (UID: "b9e2308b-6995-45f8-800e-8f7a4ff5ade9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.508534 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.508806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.509331 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "2d9f383c-c0db-4808-a7ea-95de949c8d9b" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.509379 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.510218 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "2d9f383c-c0db-4808-a7ea-95de949c8d9b" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.512240 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.512806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data" (OuterVolumeSpecName: "config-data") pod "27c6f290-ff76-4884-8db6-075c353aa2df" (UID: "27c6f290-ff76-4884-8db6-075c353aa2df"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.513113 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b" (OuterVolumeSpecName: "kube-api-access-pb77b") pod "a7df4d50-0430-4610-b3ec-9c2156f78c04" (UID: "a7df4d50-0430-4610-b3ec-9c2156f78c04"). InnerVolumeSpecName "kube-api-access-pb77b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.524587 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4" (OuterVolumeSpecName: "kube-api-access-5ddm4") pod "b9e2308b-6995-45f8-800e-8f7a4ff5ade9" (UID: "b9e2308b-6995-45f8-800e-8f7a4ff5ade9"). InnerVolumeSpecName "kube-api-access-5ddm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.525818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts" (OuterVolumeSpecName: "scripts") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.526107 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr" (OuterVolumeSpecName: "kube-api-access-4ckcr") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "kube-api-access-4ckcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.526638 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "b9e2308b-6995-45f8-800e-8f7a4ff5ade9" (UID: "b9e2308b-6995-45f8-800e-8f7a4ff5ade9"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.526755 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz" (OuterVolumeSpecName: "kube-api-access-5jddz") pod "27c6f290-ff76-4884-8db6-075c353aa2df" (UID: "27c6f290-ff76-4884-8db6-075c353aa2df"). InnerVolumeSpecName "kube-api-access-5jddz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.527189 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch" (OuterVolumeSpecName: "kube-api-access-v48ch") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "kube-api-access-v48ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.529112 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.529337 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch" (OuterVolumeSpecName: "kube-api-access-sjjch") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "kube-api-access-sjjch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.535412 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.541979 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-d5db7ddf4-fg6mp"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.543907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.552568 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "mysql-db") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.606374 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.606543 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.606689 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.606831 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.606881 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.607119 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.607231 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.607367 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw5vw\" (UniqueName: \"kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw\") pod \"ee332a01-506b-449e-968e-8ada0f0470e4\" (UID: \"ee332a01-506b-449e-968e-8ada0f0470e4\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.607236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.607645 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.608344 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609427 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609711 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609733 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v48ch\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-kube-api-access-v48ch\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609746 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ddm4\" (UniqueName: \"kubernetes.io/projected/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-kube-api-access-5ddm4\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609757 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609767 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609777 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609786 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609795 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ckcr\" (UniqueName: \"kubernetes.io/projected/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kube-api-access-4ckcr\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609805 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609814 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609834 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609846 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jddz\" (UniqueName: \"kubernetes.io/projected/27c6f290-ff76-4884-8db6-075c353aa2df-kube-api-access-5jddz\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609857 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ee332a01-506b-449e-968e-8ada0f0470e4-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609865 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609876 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609885 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609893 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6e932185-2e0e-4845-a258-a48580b8af5d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609902 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609911 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4bf2baa4-a457-4ae2-b225-ef4828878d62-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609919 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ee332a01-506b-449e-968e-8ada0f0470e4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609928 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609940 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb77b\" (UniqueName: \"kubernetes.io/projected/a7df4d50-0430-4610-b3ec-9c2156f78c04-kube-api-access-pb77b\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609950 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/2d9f383c-c0db-4808-a7ea-95de949c8d9b-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609959 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjjch\" (UniqueName: \"kubernetes.io/projected/4bf2baa4-a457-4ae2-b225-ef4828878d62-kube-api-access-sjjch\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609968 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27c6f290-ff76-4884-8db6-075c353aa2df-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609979 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6e932185-2e0e-4845-a258-a48580b8af5d-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.609988 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.623808 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.635543 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.654031 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b8322c5d-8b32-4542-bc97-97e0ea9053f2" (UID: "b8322c5d-8b32-4542-bc97-97e0ea9053f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.654231 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw" (OuterVolumeSpecName: "kube-api-access-gw5vw") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "kube-api-access-gw5vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.671270 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.676613 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage16-crc" (OuterVolumeSpecName: "mysql-db") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "local-storage16-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.698892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "b8322c5d-8b32-4542-bc97-97e0ea9053f2" (UID: "b8322c5d-8b32-4542-bc97-97e0ea9053f2"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.705190 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.711287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.712372 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") pod \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\" (UID: \"eea15d11-b237-4437-a87c-bfcfd6ba2cd2\") " Mar 16 13:44:24 crc kubenswrapper[5030]: W0316 13:44:24.712526 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/eea15d11-b237-4437-a87c-bfcfd6ba2cd2/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.712642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.715439 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw5vw\" (UniqueName: \"kubernetes.io/projected/ee332a01-506b-449e-968e-8ada0f0470e4-kube-api-access-gw5vw\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.715469 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.715486 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.715499 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.715511 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.716393 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.718342 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.718678 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.718707 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.718882 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data podName:7bffb37f-433d-4562-bf3d-edf49b7cc030 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:28.71870717 +0000 UTC m=+2313.118019717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data") pod "rabbitmq-server-0" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030") : configmap "rabbitmq-config-data" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.719968 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d56ee776-82e2-47a2-bd48-74a5e7e64cef" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.724385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" (UID: "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.733662 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage02-crc" (UniqueName: "kubernetes.io/local-volume/local-storage02-crc") on node "crc" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.735401 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data" (OuterVolumeSpecName: "config-data") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.746579 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.759375 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.766332 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:44:24 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: if [ -n "nova_api" ]; then Mar 16 13:44:24 crc kubenswrapper[5030]: GRANT_DATABASE="nova_api" Mar 16 13:44:24 crc kubenswrapper[5030]: else Mar 16 13:44:24 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:44:24 crc kubenswrapper[5030]: fi Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:44:24 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:44:24 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:44:24 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:44:24 crc kubenswrapper[5030]: # support updates Mar 16 13:44:24 crc kubenswrapper[5030]: Mar 16 13:44:24 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.770968 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" podUID="41d5224a-9426-4e7d-8e47-4d4f9aab1ef2" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.776068 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.812095 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.820216 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data" (OuterVolumeSpecName: "config-data") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.822634 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823181 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c38064ac-98ac-4ec4-8c01-0b537d555047" (UID: "c38064ac-98ac-4ec4-8c01-0b537d555047"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823270 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts\") pod \"c38064ac-98ac-4ec4-8c01-0b537d555047\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") pod \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\" (UID: \"ac6d227c-baa9-4de4-a59e-0a8a42e53c67\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823684 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxwzf\" (UniqueName: \"kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf\") pod \"c38064ac-98ac-4ec4-8c01-0b537d555047\" (UID: \"c38064ac-98ac-4ec4-8c01-0b537d555047\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823737 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkv7l\" (UniqueName: \"kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l\") pod \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.823860 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") pod \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\" (UID: \"6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef\") " Mar 16 13:44:24 crc kubenswrapper[5030]: W0316 13:44:24.825030 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/ac6d227c-baa9-4de4-a59e-0a8a42e53c67/volumes/kubernetes.io~secret/combined-ca-bundle Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.825051 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: W0316 13:44:24.825995 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef/volumes/kubernetes.io~secret/config-data Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.826041 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data" (OuterVolumeSpecName: "config-data") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.826164 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.827075 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-cell1-scripts: configmap "openstack-cell1-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.827181 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:28.827163013 +0000 UTC m=+2313.226475561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : configmap "openstack-cell1-scripts" not found Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827557 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827579 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c38064ac-98ac-4ec4-8c01-0b537d555047-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827596 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827627 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827639 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827648 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827658 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827668 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage02-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage02-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827678 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.827707 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.835662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l" (OuterVolumeSpecName: "kube-api-access-hkv7l") pod "febb1dae-5fff-46f6-82ed-0ea41974dbf0" (UID: "febb1dae-5fff-46f6-82ed-0ea41974dbf0"). InnerVolumeSpecName "kube-api-access-hkv7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.835704 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf" (OuterVolumeSpecName: "kube-api-access-wxwzf") pod "c38064ac-98ac-4ec4-8c01-0b537d555047" (UID: "c38064ac-98ac-4ec4-8c01-0b537d555047"). InnerVolumeSpecName "kube-api-access-wxwzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.848942 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.849857 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.892045 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "27c6f290-ff76-4884-8db6-075c353aa2df" (UID: "27c6f290-ff76-4884-8db6-075c353aa2df"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.921993 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.929951 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5cab4b11-b0dc-48d8-8eff-1d36808bebe5" (UID: "5cab4b11-b0dc-48d8-8eff-1d36808bebe5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.931228 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts\") pod \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\" (UID: \"febb1dae-5fff-46f6-82ed-0ea41974dbf0\") " Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.932532 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") pod \"root-account-create-update-qq7bb\" (UID: \"9a081412-dba3-400c-876e-c0e9720ec513\") " pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933317 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933334 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933343 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933355 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933364 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxwzf\" (UniqueName: \"kubernetes.io/projected/c38064ac-98ac-4ec4-8c01-0b537d555047-kube-api-access-wxwzf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933375 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkv7l\" (UniqueName: \"kubernetes.io/projected/febb1dae-5fff-46f6-82ed-0ea41974dbf0-kube-api-access-hkv7l\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.933384 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:24 crc kubenswrapper[5030]: I0316 13:44:24.944418 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "febb1dae-5fff-46f6-82ed-0ea41974dbf0" (UID: "febb1dae-5fff-46f6-82ed-0ea41974dbf0"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.974856 5030 projected.go:194] Error preparing data for projected volume kube-api-access-rs2p2 for pod openstack-kuttl-tests/root-account-create-update-qq7bb: failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:24 crc kubenswrapper[5030]: E0316 13:44:24.974942 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2 podName:9a081412-dba3-400c-876e-c0e9720ec513 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:28.974918879 +0000 UTC m=+2313.374231425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rs2p2" (UniqueName: "kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2") pod "root-account-create-update-qq7bb" (UID: "9a081412-dba3-400c-876e-c0e9720ec513") : failed to fetch token: serviceaccounts "galera-openstack-cell1" not found Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.001649 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.102:8080/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.002357 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-xh82b" podUID="fba7aa49-e100-4b16-9e75-3483cd17f86b" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.102:8080/healthcheck\": context deadline exceeded" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.023646 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b9e2308b-6995-45f8-800e-8f7a4ff5ade9" (UID: "b9e2308b-6995-45f8-800e-8f7a4ff5ade9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.032662 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.037285 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/febb1dae-5fff-46f6-82ed-0ea41974dbf0-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.037310 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.037322 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.077864 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage16-crc" (UniqueName: "kubernetes.io/local-volume/local-storage16-crc") on node "crc" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.090362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "b8322c5d-8b32-4542-bc97-97e0ea9053f2" (UID: "b8322c5d-8b32-4542-bc97-97e0ea9053f2"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.098305 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.098619 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "27c6f290-ff76-4884-8db6-075c353aa2df" (UID: "27c6f290-ff76-4884-8db6-075c353aa2df"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.103343 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.108995 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.112160 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.115902 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data" (OuterVolumeSpecName: "config-data") pod "5cab4b11-b0dc-48d8-8eff-1d36808bebe5" (UID: "5cab4b11-b0dc-48d8-8eff-1d36808bebe5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.125235 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.129271 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139889 5030 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27c6f290-ff76-4884-8db6-075c353aa2df-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139931 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139941 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139950 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139959 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139968 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.139975 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.140005 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5cab4b11-b0dc-48d8-8eff-1d36808bebe5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.140013 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage16-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage16-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.140022 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/b8322c5d-8b32-4542-bc97-97e0ea9053f2-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.151841 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.151950 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "22ab016c-c89d-4fc7-9daa-10dcbb93d493" (UID: "22ab016c-c89d-4fc7-9daa-10dcbb93d493"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.153449 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "d56ee776-82e2-47a2-bd48-74a5e7e64cef" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.165797 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data" (OuterVolumeSpecName: "config-data") pod "b9e2308b-6995-45f8-800e-8f7a4ff5ade9" (UID: "b9e2308b-6995-45f8-800e-8f7a4ff5ade9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.166077 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" (UID: "6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.166328 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "4b6c97ea-4885-4b61-880f-bd53acc1928b" (UID: "4b6c97ea-4885-4b61-880f-bd53acc1928b"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.167887 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data" (OuterVolumeSpecName: "config-data") pod "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" (UID: "5e4d2bc4-0bec-4939-a936-d9a9abc8f23a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.168136 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ac6d227c-baa9-4de4-a59e-0a8a42e53c67" (UID: "ac6d227c-baa9-4de4-a59e-0a8a42e53c67"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.168495 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "d56ee776-82e2-47a2-bd48-74a5e7e64cef" (UID: "d56ee776-82e2-47a2-bd48-74a5e7e64cef"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.168894 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "ee332a01-506b-449e-968e-8ada0f0470e4" (UID: "ee332a01-506b-449e-968e-8ada0f0470e4"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.169646 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data" (OuterVolumeSpecName: "config-data") pod "4bf2baa4-a457-4ae2-b225-ef4828878d62" (UID: "4bf2baa4-a457-4ae2-b225-ef4828878d62"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.171572 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "eea15d11-b237-4437-a87c-bfcfd6ba2cd2" (UID: "eea15d11-b237-4437-a87c-bfcfd6ba2cd2"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.173733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data" (OuterVolumeSpecName: "config-data") pod "6e932185-2e0e-4845-a258-a48580b8af5d" (UID: "6e932185-2e0e-4845-a258-a48580b8af5d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.242670 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.242786 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.242759368 +0000 UTC m=+2313.642071914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243140 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-public-svc: secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243253 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.24322366 +0000 UTC m=+2313.642536207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "nova-novncproxy-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-public-svc" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243282 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-nova-novncproxy-cell1-vencrypt: secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243362 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.243341812 +0000 UTC m=+2313.642654360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "vencrypt-tls-certs" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "cert-nova-novncproxy-cell1-vencrypt" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243378 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-novncproxy-config-data: secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.243410 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data podName:8e26e066-ea63-42d9-8853-63bf42e1714d nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.243403098 +0000 UTC m=+2313.642715644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data") pod "nova-cell1-novncproxy-0" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d") : secret "nova-cell1-novncproxy-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243676 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b9e2308b-6995-45f8-800e-8f7a4ff5ade9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243700 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243712 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243727 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ee332a01-506b-449e-968e-8ada0f0470e4-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243739 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243752 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6c97ea-4885-4b61-880f-bd53acc1928b-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243763 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243773 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/22ab016c-c89d-4fc7-9daa-10dcbb93d493-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243784 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/d56ee776-82e2-47a2-bd48-74a5e7e64cef-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.243794 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/eea15d11-b237-4437-a87c-bfcfd6ba2cd2-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.245652 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4bf2baa4-a457-4ae2-b225-ef4828878d62-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.245680 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac6d227c-baa9-4de4-a59e-0a8a42e53c67-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.245699 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6e932185-2e0e-4845-a258-a48580b8af5d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.287319 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.287322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"ee332a01-506b-449e-968e-8ada0f0470e4","Type":"ContainerDied","Data":"4d8e17bfcf25cf288c7ff6b11100fb5427966794d0da0f2c7cd21ee16035f6b2"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.287520 5030 scope.go:117] "RemoveContainer" containerID="1052f1d94b64dacb4245d627d76e0498e3eeacbc2f3ac8a2fe43735cbc098b4e" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.293146 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerID="7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021" exitCode=0 Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.293281 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerDied","Data":"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.294854 5030 generic.go:358] "Generic (PLEG): container finished" podID="8e26e066-ea63-42d9-8853-63bf42e1714d" containerID="f9da55917cbf0ab4733a021bc717fcf40db775cd7b8dcab7611a4d41900b5aef" exitCode=0 Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.295011 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8e26e066-ea63-42d9-8853-63bf42e1714d","Type":"ContainerDied","Data":"f9da55917cbf0ab4733a021bc717fcf40db775cd7b8dcab7611a4d41900b5aef"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.295113 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8e26e066-ea63-42d9-8853-63bf42e1714d","Type":"ContainerDied","Data":"284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.295130 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="284f78a9c4b9ee9321f9536bff7d81e1cd2bd1b576fe8efc1bed76fdea383263" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.296340 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" event={"ID":"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2","Type":"ContainerStarted","Data":"791c85ca43b183dbda7a1a93f3a77f5f98f26141103b0b9f84acb26569a97920"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.299046 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" event={"ID":"c38064ac-98ac-4ec4-8c01-0b537d555047","Type":"ContainerDied","Data":"9094d0cf5683df4022688fdfb568cbdcce5d39f19fe0481aee0ef22632f8a695"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.299133 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.300726 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" event={"ID":"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485","Type":"ContainerStarted","Data":"74419613a3c928a509a2593fd8b3e563d46b200ff3e88ae841bcaf54122a7913"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.302234 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.302253 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw" event={"ID":"febb1dae-5fff-46f6-82ed-0ea41974dbf0","Type":"ContainerDied","Data":"6bbe3d1606f1d9ef319ae2680c3ed5046ef83d652556ab8cedd5817d9db944a7"} Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.302506 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.302963 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.302999 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-775558c784-nmdlz" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.303128 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.303441 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.303896 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.305162 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-qq7bb" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.305686 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.306621 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310297 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310583 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310597 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310610 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310621 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310636 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310645 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310656 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310667 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.310677 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.337838 5030 scope.go:117] "RemoveContainer" containerID="ed6801e3398cc288c14bbf6fd1c590b315c74b499bf4a57b7010437770f97910" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.355790 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.355861 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.356148 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.356179 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.356279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.356394 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") pod \"ceilometer-0\" (UID: \"2d9f383c-c0db-4808-a7ea-95de949c8d9b\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.357354 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-scripts: object "openstack-kuttl-tests"/"ceilometer-scripts" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.357423 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.357405594 +0000 UTC m=+2313.756718141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : object "openstack-kuttl-tests"/"ceilometer-scripts" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359408 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: object "openstack-kuttl-tests"/"ceilometer-config-data" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359467 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.359454977 +0000 UTC m=+2313.758767525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "sg-core-conf-yaml" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : object "openstack-kuttl-tests"/"ceilometer-config-data" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359515 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/ceilometer-config-data: object "openstack-kuttl-tests"/"ceilometer-config-data" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359539 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.359533124 +0000 UTC m=+2313.758845661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : object "openstack-kuttl-tests"/"ceilometer-config-data" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359600 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359625 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.359619447 +0000 UTC m=+2313.758931994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359663 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cert-ceilometer-internal-svc: object "openstack-kuttl-tests"/"cert-ceilometer-internal-svc" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.359685 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.359676604 +0000 UTC m=+2313.758989151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "ceilometer-tls-certs" (UniqueName: "kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : object "openstack-kuttl-tests"/"cert-ceilometer-internal-svc" not registered Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.365730 5030 projected.go:194] Error preparing data for projected volume kube-api-access-j5lds for pod openstack-kuttl-tests/ceilometer-0: failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.365783 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds podName:2d9f383c-c0db-4808-a7ea-95de949c8d9b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.365771727 +0000 UTC m=+2313.765084274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5lds" (UniqueName: "kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds") pod "ceilometer-0" (UID: "2d9f383c-c0db-4808-a7ea-95de949c8d9b") : failed to fetch token: serviceaccounts "telemetry-ceilometer" not found Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.404473 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.66:9311/healthcheck\": dial tcp 10.217.0.66:9311: connect: connection refused" Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459215 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459499 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.459472491 +0000 UTC m=+2313.858785029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459694 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459718 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459757 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.459738361 +0000 UTC m=+2313.859050908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459846 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.459778276 +0000 UTC m=+2313.859090823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.459530 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.460006 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts podName:41d5224a-9426-4e7d-8e47-4d4f9aab1ef2 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:27.459994723 +0000 UTC m=+2311.859307269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts") pod "nova-api-b955-account-create-update-654rz" (UID: "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2") : configmap "openstack-scripts" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.460070 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.460129 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.46011049 +0000 UTC m=+2313.859423038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.460189 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: E0316 13:44:25.460275 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:29.460262376 +0000 UTC m=+2313.859574924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.689507 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.704448 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.707220 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.718233 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.727574 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.743495 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.760897 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qq7bb"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.772948 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-qq7bb"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.785249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbksd\" (UniqueName: \"kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd\") pod \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.785499 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts\") pod \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\" (UID: \"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.785520 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r8jb\" (UniqueName: \"kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb\") pod \"8e26e066-ea63-42d9-8853-63bf42e1714d\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.785846 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs\") pod \"8e26e066-ea63-42d9-8853-63bf42e1714d\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.785974 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data\") pod \"8e26e066-ea63-42d9-8853-63bf42e1714d\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.786002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs\") pod \"8e26e066-ea63-42d9-8853-63bf42e1714d\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.786030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle\") pod \"8e26e066-ea63-42d9-8853-63bf42e1714d\" (UID: \"8e26e066-ea63-42d9-8853-63bf42e1714d\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.786314 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2" (UID: "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.787014 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.792258 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb" (OuterVolumeSpecName: "kube-api-access-7r8jb") pod "8e26e066-ea63-42d9-8853-63bf42e1714d" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d"). InnerVolumeSpecName "kube-api-access-7r8jb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.792298 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd" (OuterVolumeSpecName: "kube-api-access-pbksd") pod "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2" (UID: "41d5224a-9426-4e7d-8e47-4d4f9aab1ef2"). InnerVolumeSpecName "kube-api-access-pbksd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.799280 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.806873 5030 status_manager.go:895] "Failed to get status for pod" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.835670 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data" (OuterVolumeSpecName: "config-data") pod "8e26e066-ea63-42d9-8853-63bf42e1714d" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.844715 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e26e066-ea63-42d9-8853-63bf42e1714d" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.853986 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.866109 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "8e26e066-ea63-42d9-8853-63bf42e1714d" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.869236 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.876750 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.880769 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "8e26e066-ea63-42d9-8853-63bf42e1714d" (UID: "8e26e066-ea63-42d9-8853-63bf42e1714d"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890227 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890308 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890377 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890395 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890451 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvfvm\" (UniqueName: \"kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890578 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890598 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890635 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wxgw\" (UniqueName: \"kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890817 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890964 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.890984 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.891045 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs\") pod \"c568069c-06b6-42a4-a263-2e42abbbebd0\" (UID: \"c568069c-06b6-42a4-a263-2e42abbbebd0\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.891075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom\") pod \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\" (UID: \"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5\") " Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892341 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r8jb\" (UniqueName: \"kubernetes.io/projected/8e26e066-ea63-42d9-8853-63bf42e1714d-kube-api-access-7r8jb\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892358 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9a081412-dba3-400c-876e-c0e9720ec513-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892369 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892380 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892387 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892395 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e26e066-ea63-42d9-8853-63bf42e1714d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892403 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbksd\" (UniqueName: \"kubernetes.io/projected/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2-kube-api-access-pbksd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.892413 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs2p2\" (UniqueName: \"kubernetes.io/projected/9a081412-dba3-400c-876e-c0e9720ec513-kube-api-access-rs2p2\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.894650 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs" (OuterVolumeSpecName: "logs") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.894617 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.895669 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs" (OuterVolumeSpecName: "logs") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.902130 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-775558c784-nmdlz"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.902195 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.907357 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts" (OuterVolumeSpecName: "scripts") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.907700 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.909958 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw" (OuterVolumeSpecName: "kube-api-access-5wxgw") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "kube-api-access-5wxgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.910802 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm" (OuterVolumeSpecName: "kube-api-access-lvfvm") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "kube-api-access-lvfvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.920938 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.926238 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.933979 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.940448 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.945258 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.954832 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.970333 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" path="/var/lib/kubelet/pods/08f24da9-a345-4eb5-b643-811fddc089c7/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.970978 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" path="/var/lib/kubelet/pods/1e507f45-9b3e-4be2-ae26-341712344d66/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.971629 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" path="/var/lib/kubelet/pods/22ab016c-c89d-4fc7-9daa-10dcbb93d493/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.972630 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9f383c-c0db-4808-a7ea-95de949c8d9b" path="/var/lib/kubelet/pods/2d9f383c-c0db-4808-a7ea-95de949c8d9b/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.973021 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345a1b2b-5460-4c84-98b6-3ce8ab810d98" path="/var/lib/kubelet/pods/345a1b2b-5460-4c84-98b6-3ce8ab810d98/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.973365 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" path="/var/lib/kubelet/pods/6e932185-2e0e-4845-a258-a48580b8af5d/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.974209 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a081412-dba3-400c-876e-c0e9720ec513" path="/var/lib/kubelet/pods/9a081412-dba3-400c-876e-c0e9720ec513/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.974524 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8322c5d-8b32-4542-bc97-97e0ea9053f2" path="/var/lib/kubelet/pods/b8322c5d-8b32-4542-bc97-97e0ea9053f2/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.975007 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf225c37-5611-47f6-995b-615f1f648742" path="/var/lib/kubelet/pods/bf225c37-5611-47f6-995b-615f1f648742/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.975661 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" path="/var/lib/kubelet/pods/ee332a01-506b-449e-968e-8ada0f0470e4/volumes" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.976649 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:25 crc kubenswrapper[5030]: I0316 13:44:25.976725 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" path="/var/lib/kubelet/pods/eea15d11-b237-4437-a87c-bfcfd6ba2cd2/volumes" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011560 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011601 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011613 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011631 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/345a1b2b-5460-4c84-98b6-3ce8ab810d98-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011642 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011652 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011663 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011676 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/c568069c-06b6-42a4-a263-2e42abbbebd0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011685 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5lds\" (UniqueName: \"kubernetes.io/projected/2d9f383c-c0db-4808-a7ea-95de949c8d9b-kube-api-access-j5lds\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011695 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2d9f383c-c0db-4808-a7ea-95de949c8d9b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011708 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011717 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvfvm\" (UniqueName: \"kubernetes.io/projected/c568069c-06b6-42a4-a263-2e42abbbebd0-kube-api-access-lvfvm\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011727 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011736 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.011748 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wxgw\" (UniqueName: \"kubernetes.io/projected/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-kube-api-access-5wxgw\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.018425 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.028183 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data" (OuterVolumeSpecName: "config-data") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.037881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data" (OuterVolumeSpecName: "config-data") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.045073 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" (UID: "d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.057927 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.102394 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c568069c-06b6-42a4-a263-2e42abbbebd0" (UID: "c568069c-06b6-42a4-a263-2e42abbbebd0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.114445 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6b4d547578-6hb2k"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.114499 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.114513 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-68b6d4cb87-86zn5"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.114525 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.114537 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115271 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115295 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115305 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115316 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115326 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.115334 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c568069c-06b6-42a4-a263-2e42abbbebd0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.132623 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.143958 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.161712 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.165872 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-3f90-account-create-update-qdqjg"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.180832 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.185964 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-3ec7-account-create-update-gx4mw"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.195494 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.199269 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.203443 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.207160 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.210423 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.215663 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.217378 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-cell1-config-data: configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.217545 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data podName:2b6c1e85-68d7-448e-81c8-2efabf9e73ef nodeName:}" failed. No retries permitted until 2026-03-16 13:44:30.217525506 +0000 UTC m=+2314.616838053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data") pod "rabbitmq-cell1-server-0" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef") : configmap "rabbitmq-cell1-config-data" not found Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.221609 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.232030 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.236963 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-5bb4989c79-rlz4z"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.240931 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.245297 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.251975 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.255997 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.260468 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.266098 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.312886 5030 generic.go:358] "Generic (PLEG): container finished" podID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerID="04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6" exitCode=0 Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.312970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.312985 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerDied","Data":"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.313058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj" event={"ID":"d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5","Type":"ContainerDied","Data":"24028acc62ae3bf77de0dcda54499ae2a72a01c1ffd82e1deaa20f180ad04222"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.313083 5030 scope.go:117] "RemoveContainer" containerID="04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.316194 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" event={"ID":"41d5224a-9426-4e7d-8e47-4d4f9aab1ef2","Type":"ContainerDied","Data":"791c85ca43b183dbda7a1a93f3a77f5f98f26141103b0b9f84acb26569a97920"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.316259 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-b955-account-create-update-654rz" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.318791 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.318882 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.318982 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319090 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319167 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319200 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8z2b\" (UniqueName: \"kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319423 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data\") pod \"c95e47e9-8db9-48d4-903e-5f61151a5dff\" (UID: \"c95e47e9-8db9-48d4-903e-5f61151a5dff\") " Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.319953 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.320296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") pod \"keystone-8fdc-account-create-update-wbgpf\" (UID: \"ae19cd1a-dc30-41be-9ada-464a4159ac6c\") " pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.321191 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.321260 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:30.321241645 +0000 UTC m=+2314.720554193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : configmap "openstack-scripts" not found Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.322292 5030 generic.go:358] "Generic (PLEG): container finished" podID="c95e47e9-8db9-48d4-903e-5f61151a5dff" containerID="75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6" exitCode=0 Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.322364 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" event={"ID":"c95e47e9-8db9-48d4-903e-5f61151a5dff","Type":"ContainerDied","Data":"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.322388 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" event={"ID":"c95e47e9-8db9-48d4-903e-5f61151a5dff","Type":"ContainerDied","Data":"38b2f8ee294a96e168ae6a2bbbb88127ebeec784a532d7c643469829d96463eb"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.322469 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.323306 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b" (OuterVolumeSpecName: "kube-api-access-r8z2b") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "kube-api-access-r8z2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.324537 5030 projected.go:194] Error preparing data for projected volume kube-api-access-2ch7q for pod openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.324749 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.325853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.327017 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts" (OuterVolumeSpecName: "scripts") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.328254 5030 generic.go:358] "Generic (PLEG): container finished" podID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerID="d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462" exitCode=0 Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.328495 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerDied","Data":"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.328541 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" event={"ID":"c568069c-06b6-42a4-a263-2e42abbbebd0","Type":"ContainerDied","Data":"79e949624bc830afc2ae690f76b327943daa48416ed63be1edff2808fd750555"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.329175 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-579b7b9cfd-r4kx6" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.330262 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q podName:ae19cd1a-dc30-41be-9ada-464a4159ac6c nodeName:}" failed. No retries permitted until 2026-03-16 13:44:30.328514183 +0000 UTC m=+2314.727826730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2ch7q" (UniqueName: "kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q") pod "keystone-8fdc-account-create-update-wbgpf" (UID: "ae19cd1a-dc30-41be-9ada-464a4159ac6c") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.330811 5030 generic.go:358] "Generic (PLEG): container finished" podID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerID="76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e" exitCode=0 Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.331178 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" event={"ID":"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485","Type":"ContainerDied","Data":"76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e"} Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.333576 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.333705 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.335509 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7df4d50-0430-4610-b3ec-9c2156f78c04-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.336255 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.337366 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.337498 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.338252 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8z2b\" (UniqueName: \"kubernetes.io/projected/c95e47e9-8db9-48d4-903e-5f61151a5dff-kube-api-access-r8z2b\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.338284 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/65b03029-a404-44a7-b76d-fc4dd9b61b12-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.341991 5030 scope.go:117] "RemoveContainer" containerID="2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.355996 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data" (OuterVolumeSpecName: "config-data") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.367809 5030 scope.go:117] "RemoveContainer" containerID="04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.368426 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6\": container with ID starting with 04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6 not found: ID does not exist" containerID="04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.368470 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6"} err="failed to get container status \"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6\": rpc error: code = NotFound desc = could not find container \"04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6\": container with ID starting with 04dca7987dcdbd1a3d941dfaef9e99c2a5f4218e7ea7b96bff543db0310394c6 not found: ID does not exist" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.368493 5030 scope.go:117] "RemoveContainer" containerID="2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.368712 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd\": container with ID starting with 2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd not found: ID does not exist" containerID="2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.368734 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd"} err="failed to get container status \"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd\": rpc error: code = NotFound desc = could not find container \"2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd\": container with ID starting with 2ab33bfe770442e57b521a3e892187a64de6a877dfd71779382270d65b4ebbfd not found: ID does not exist" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.368748 5030 scope.go:117] "RemoveContainer" containerID="75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.370696 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.372276 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.407050 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.410824 5030 scope.go:117] "RemoveContainer" containerID="75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.411627 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6\": container with ID starting with 75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6 not found: ID does not exist" containerID="75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.411672 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6"} err="failed to get container status \"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6\": rpc error: code = NotFound desc = could not find container \"75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6\": container with ID starting with 75da661c6e847b20e6f2a54a056c31124f572fb061f29b97ad00795325d3d6b6 not found: ID does not exist" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.411696 5030 scope.go:117] "RemoveContainer" containerID="d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.416193 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-b955-account-create-update-654rz"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.438038 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.438517 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "c95e47e9-8db9-48d4-903e-5f61151a5dff" (UID: "c95e47e9-8db9-48d4-903e-5f61151a5dff"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.440827 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.441744 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.441776 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.441794 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/c95e47e9-8db9-48d4-903e-5f61151a5dff-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.445470 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-579b7b9cfd-r4kx6"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.452493 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.458609 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.461635 5030 scope.go:117] "RemoveContainer" containerID="3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.472499 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.480322 5030 scope.go:117] "RemoveContainer" containerID="d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.483903 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462\": container with ID starting with d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462 not found: ID does not exist" containerID="d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.483956 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462"} err="failed to get container status \"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462\": rpc error: code = NotFound desc = could not find container \"d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462\": container with ID starting with d7450ac1f511659a4ba5b1a801d60da734cf2da7698f21ed36198de4ace91462 not found: ID does not exist" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.483987 5030 scope.go:117] "RemoveContainer" containerID="3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656" Mar 16 13:44:26 crc kubenswrapper[5030]: E0316 13:44:26.484319 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656\": container with ID starting with 3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656 not found: ID does not exist" containerID="3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.484365 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656"} err="failed to get container status \"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656\": rpc error: code = NotFound desc = could not find container \"3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656\": container with ID starting with 3c15ab330a055086336f357a24825f5fa00c4ca286d4a6950b1108b8cdcbf656 not found: ID does not exist" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.490157 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-8fdc-account-create-update-wbgpf"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.503140 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.512958 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-7645ddb574-r8cpj"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.647832 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ch7q\" (UniqueName: \"kubernetes.io/projected/ae19cd1a-dc30-41be-9ada-464a4159ac6c-kube-api-access-2ch7q\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.648224 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ae19cd1a-dc30-41be-9ada-464a4159ac6c-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.657805 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:44:26 crc kubenswrapper[5030]: I0316 13:44:26.662768 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7ddbbdf7b9-8v9z4"] Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.177910 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.209:5671: connect: connection refused" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.354371 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" event={"ID":"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485","Type":"ContainerStarted","Data":"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888"} Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.354623 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.382375 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" podStartSLOduration=7.382354416 podStartE2EDuration="7.382354416s" podCreationTimestamp="2026-03-16 13:44:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:44:27.371672556 +0000 UTC m=+2311.770985104" watchObservedRunningTime="2026-03-16 13:44:27.382354416 +0000 UTC m=+2311.781666963" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.963898 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c6f290-ff76-4884-8db6-075c353aa2df" path="/var/lib/kubelet/pods/27c6f290-ff76-4884-8db6-075c353aa2df/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.964370 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d5224a-9426-4e7d-8e47-4d4f9aab1ef2" path="/var/lib/kubelet/pods/41d5224a-9426-4e7d-8e47-4d4f9aab1ef2/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.964791 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" path="/var/lib/kubelet/pods/4b6c97ea-4885-4b61-880f-bd53acc1928b/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.965739 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" path="/var/lib/kubelet/pods/4bf2baa4-a457-4ae2-b225-ef4828878d62/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.966348 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" path="/var/lib/kubelet/pods/5cab4b11-b0dc-48d8-8eff-1d36808bebe5/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.966861 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" path="/var/lib/kubelet/pods/5e4d2bc4-0bec-4939-a936-d9a9abc8f23a/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.967774 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b03029-a404-44a7-b76d-fc4dd9b61b12" path="/var/lib/kubelet/pods/65b03029-a404-44a7-b76d-fc4dd9b61b12/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.968087 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" path="/var/lib/kubelet/pods/6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.968563 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e26e066-ea63-42d9-8853-63bf42e1714d" path="/var/lib/kubelet/pods/8e26e066-ea63-42d9-8853-63bf42e1714d/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.969339 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7df4d50-0430-4610-b3ec-9c2156f78c04" path="/var/lib/kubelet/pods/a7df4d50-0430-4610-b3ec-9c2156f78c04/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.969684 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" path="/var/lib/kubelet/pods/ac6d227c-baa9-4de4-a59e-0a8a42e53c67/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.970053 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae19cd1a-dc30-41be-9ada-464a4159ac6c" path="/var/lib/kubelet/pods/ae19cd1a-dc30-41be-9ada-464a4159ac6c/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.970325 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" path="/var/lib/kubelet/pods/b9e2308b-6995-45f8-800e-8f7a4ff5ade9/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.971240 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c38064ac-98ac-4ec4-8c01-0b537d555047" path="/var/lib/kubelet/pods/c38064ac-98ac-4ec4-8c01-0b537d555047/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.971657 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" path="/var/lib/kubelet/pods/c568069c-06b6-42a4-a263-2e42abbbebd0/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.972289 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95e47e9-8db9-48d4-903e-5f61151a5dff" path="/var/lib/kubelet/pods/c95e47e9-8db9-48d4-903e-5f61151a5dff/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.972924 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" path="/var/lib/kubelet/pods/d56ee776-82e2-47a2-bd48-74a5e7e64cef/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.973822 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" path="/var/lib/kubelet/pods/d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: I0316 13:44:27.974269 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febb1dae-5fff-46f6-82ed-0ea41974dbf0" path="/var/lib/kubelet/pods/febb1dae-5fff-46f6-82ed-0ea41974dbf0/volumes" Mar 16 13:44:27 crc kubenswrapper[5030]: E0316 13:44:27.977501 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:27 crc kubenswrapper[5030]: E0316 13:44:27.977976 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:35.977954274 +0000 UTC m=+2320.377266821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.010934 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.012356 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.013709 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.013758 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:28 crc kubenswrapper[5030]: I0316 13:44:28.187082 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.1.210:5671: connect: connection refused" Mar 16 13:44:28 crc kubenswrapper[5030]: I0316 13:44:28.622567 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 13:44:28 crc kubenswrapper[5030]: I0316 13:44:28.641420 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-95df9c4d4-9gfjq" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.153:9311/healthcheck\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.793648 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:44:28 crc kubenswrapper[5030]: E0316 13:44:28.794017 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data podName:7bffb37f-433d-4562-bf3d-edf49b7cc030 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:36.793993003 +0000 UTC m=+2321.193305550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data") pod "rabbitmq-server-0" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030") : configmap "rabbitmq-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.032784 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.032842 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.357965 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.382997 5030 generic.go:358] "Generic (PLEG): container finished" podID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerID="f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7" exitCode=0 Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.383393 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerDied","Data":"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7"} Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.383428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"7bffb37f-433d-4562-bf3d-edf49b7cc030","Type":"ContainerDied","Data":"8f82b6c4af7e4d3255415c8e10d296616dbf009483e049cd843c266b4a960a39"} Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.383456 5030 scope.go:117] "RemoveContainer" containerID="f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.383513 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.389823 5030 generic.go:358] "Generic (PLEG): container finished" podID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerID="f8f9a228c39d74f6171e07f48041b560bd59771df3190e00fdcc1f3f427d342b" exitCode=0 Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.390236 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerDied","Data":"f8f9a228c39d74f6171e07f48041b560bd59771df3190e00fdcc1f3f427d342b"} Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.406284 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.406350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8c78\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.406463 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.406519 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407078 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407201 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407239 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407297 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407405 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407727 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407753 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407765 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf\") pod \"7bffb37f-433d-4562-bf3d-edf49b7cc030\" (UID: \"7bffb37f-433d-4562-bf3d-edf49b7cc030\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.407890 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.408356 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.408377 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.408386 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.413072 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.413701 5030 scope.go:117] "RemoveContainer" containerID="e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.416368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.418716 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "persistence") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.420892 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info" (OuterVolumeSpecName: "pod-info") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.425167 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78" (OuterVolumeSpecName: "kube-api-access-s8c78") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "kube-api-access-s8c78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.426262 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data" (OuterVolumeSpecName: "config-data") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.441114 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf" (OuterVolumeSpecName: "server-conf") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.451087 5030 scope.go:117] "RemoveContainer" containerID="f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7" Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.451633 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7\": container with ID starting with f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7 not found: ID does not exist" containerID="f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.451665 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7"} err="failed to get container status \"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7\": rpc error: code = NotFound desc = could not find container \"f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7\": container with ID starting with f125e701ca19beba035c29ffcc350f43b98fcd2f0dc62758832457178569eec7 not found: ID does not exist" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.451692 5030 scope.go:117] "RemoveContainer" containerID="e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b" Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.456795 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b\": container with ID starting with e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b not found: ID does not exist" containerID="e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.456833 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b"} err="failed to get container status \"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b\": rpc error: code = NotFound desc = could not find container \"e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b\": container with ID starting with e30bc5036580853b2b057e53bc6e91cbd0e2abf590bd07403249dfd76350811b not found: ID does not exist" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.488881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "7bffb37f-433d-4562-bf3d-edf49b7cc030" (UID: "7bffb37f-433d-4562-bf3d-edf49b7cc030"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.510944 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511047 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511048 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:37.511020912 +0000 UTC m=+2321.910333458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511260 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511362 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:37.511336865 +0000 UTC m=+2321.910649512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511396 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:37.511385798 +0000 UTC m=+2321.910698345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511398 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511469 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511496 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:37.511490595 +0000 UTC m=+2321.910803141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511524 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: E0316 13:44:29.511613 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:37.511593949 +0000 UTC m=+2321.910906496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511664 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511689 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/7bffb37f-433d-4562-bf3d-edf49b7cc030-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511702 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511745 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511759 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8c78\" (UniqueName: \"kubernetes.io/projected/7bffb37f-433d-4562-bf3d-edf49b7cc030-kube-api-access-s8c78\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511770 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/7bffb37f-433d-4562-bf3d-edf49b7cc030-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.511812 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/7bffb37f-433d-4562-bf3d-edf49b7cc030-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.529032 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.556892 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612597 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612636 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612660 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612758 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612799 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612946 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612965 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.612996 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613036 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613081 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613105 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfbmr\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr\") pod \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\" (UID: \"2b6c1e85-68d7-448e-81c8-2efabf9e73ef\") " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613772 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613782 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.613790 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.615152 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.616508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr" (OuterVolumeSpecName: "kube-api-access-tfbmr") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "kube-api-access-tfbmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.617049 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.617508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.617991 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage06-crc" (OuterVolumeSpecName: "persistence") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "local-storage06-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.618094 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info" (OuterVolumeSpecName: "pod-info") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.633249 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data" (OuterVolumeSpecName: "config-data") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.644070 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf" (OuterVolumeSpecName: "server-conf") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.671385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "2b6c1e85-68d7-448e-81c8-2efabf9e73ef" (UID: "2b6c1e85-68d7-448e-81c8-2efabf9e73ef"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715706 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715728 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfbmr\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-kube-api-access-tfbmr\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715738 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715770 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715779 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715787 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715794 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715801 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715836 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" " Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.715848 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/2b6c1e85-68d7-448e-81c8-2efabf9e73ef-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.717361 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.724158 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.727793 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage06-crc" (UniqueName: "kubernetes.io/local-volume/local-storage06-crc") on node "crc" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.819411 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage06-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage06-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:29 crc kubenswrapper[5030]: I0316 13:44:29.957257 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" path="/var/lib/kubelet/pods/7bffb37f-433d-4562-bf3d-edf49b7cc030/volumes" Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.405286 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.405286 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"2b6c1e85-68d7-448e-81c8-2efabf9e73ef","Type":"ContainerDied","Data":"f3fac8bc37c915101c0a665c727974dd892d00b6913ba43d04edb344c0b41fb2"} Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.405432 5030 scope.go:117] "RemoveContainer" containerID="f8f9a228c39d74f6171e07f48041b560bd59771df3190e00fdcc1f3f427d342b" Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.427099 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.430408 5030 scope.go:117] "RemoveContainer" containerID="bfce237ce2b0f2cbcaca91f0eb408d1c095cd9539db7259c0acfc71b0de57581" Mar 16 13:44:30 crc kubenswrapper[5030]: I0316 13:44:30.435956 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:44:31 crc kubenswrapper[5030]: I0316 13:44:31.958007 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" path="/var/lib/kubelet/pods/2b6c1e85-68d7-448e-81c8-2efabf9e73ef/volumes" Mar 16 13:44:33 crc kubenswrapper[5030]: E0316 13:44:33.018414 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:33 crc kubenswrapper[5030]: E0316 13:44:33.020768 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:33 crc kubenswrapper[5030]: E0316 13:44:33.022264 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:33 crc kubenswrapper[5030]: E0316 13:44:33.022307 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.368820 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.412708 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.412961 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="dnsmasq-dns" containerID="cri-o://dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54" gracePeriod=10 Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.789492 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.894716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4vfn\" (UniqueName: \"kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn\") pod \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.894910 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config\") pod \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.894949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc\") pod \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.895285 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0\") pod \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\" (UID: \"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38\") " Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.902291 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn" (OuterVolumeSpecName: "kube-api-access-s4vfn") pod "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" (UID: "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38"). InnerVolumeSpecName "kube-api-access-s4vfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.926643 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config" (OuterVolumeSpecName: "config") pod "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" (UID: "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.937047 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" (UID: "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.943498 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" (UID: "8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.998209 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.998234 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.998245 5030 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:33 crc kubenswrapper[5030]: I0316 13:44:33.998257 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4vfn\" (UniqueName: \"kubernetes.io/projected/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38-kube-api-access-s4vfn\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.031736 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.031801 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.453169 5030 generic.go:358] "Generic (PLEG): container finished" podID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerID="dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54" exitCode=0 Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.453233 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" event={"ID":"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38","Type":"ContainerDied","Data":"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54"} Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.453309 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" event={"ID":"8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38","Type":"ContainerDied","Data":"fd96ff05b7c2241c638834b87303273aecf5ec2e3fcf78e0424b08c53ffcd982"} Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.453337 5030 scope.go:117] "RemoveContainer" containerID="dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.453252 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.473476 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.478420 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-6bc57886f5-6j7z5"] Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.480467 5030 scope.go:117] "RemoveContainer" containerID="f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.499611 5030 scope.go:117] "RemoveContainer" containerID="dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54" Mar 16 13:44:34 crc kubenswrapper[5030]: E0316 13:44:34.499961 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54\": container with ID starting with dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54 not found: ID does not exist" containerID="dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.500016 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54"} err="failed to get container status \"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54\": rpc error: code = NotFound desc = could not find container \"dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54\": container with ID starting with dea80e728276d09a309b43f2431b520cd1875e4ccdd85f4fe60b6c513b3b5c54 not found: ID does not exist" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.500038 5030 scope.go:117] "RemoveContainer" containerID="f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff" Mar 16 13:44:34 crc kubenswrapper[5030]: E0316 13:44:34.500404 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff\": container with ID starting with f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff not found: ID does not exist" containerID="f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff" Mar 16 13:44:34 crc kubenswrapper[5030]: I0316 13:44:34.500456 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff"} err="failed to get container status \"f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff\": rpc error: code = NotFound desc = could not find container \"f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff\": container with ID starting with f1f230eb4d1eb85d154c9cae318edbc39fcf5e69c30394bd1f5649936bf9ecff not found: ID does not exist" Mar 16 13:44:35 crc kubenswrapper[5030]: I0316 13:44:35.951125 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:44:35 crc kubenswrapper[5030]: E0316 13:44:35.951701 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:44:35 crc kubenswrapper[5030]: I0316 13:44:35.960109 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" path="/var/lib/kubelet/pods/8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38/volumes" Mar 16 13:44:36 crc kubenswrapper[5030]: E0316 13:44:36.040023 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:36 crc kubenswrapper[5030]: E0316 13:44:36.040140 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:52.040117751 +0000 UTC m=+2336.439430288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.566943 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567035 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:53.56701241 +0000 UTC m=+2337.966324957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567522 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567583 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:44:53.567571432 +0000 UTC m=+2337.966883978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567621 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567665 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:53.567658335 +0000 UTC m=+2337.966970883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567699 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567738 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:53.567731342 +0000 UTC m=+2337.967043890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567769 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:37 crc kubenswrapper[5030]: E0316 13:44:37.567788 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:44:53.567782499 +0000 UTC m=+2337.967095046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:38 crc kubenswrapper[5030]: E0316 13:44:38.011324 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:38 crc kubenswrapper[5030]: E0316 13:44:38.012862 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:38 crc kubenswrapper[5030]: E0316 13:44:38.014212 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:38 crc kubenswrapper[5030]: E0316 13:44:38.014256 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:39 crc kubenswrapper[5030]: I0316 13:44:39.033739 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:39 crc kubenswrapper[5030]: I0316 13:44:39.034187 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:43 crc kubenswrapper[5030]: E0316 13:44:43.011998 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:43 crc kubenswrapper[5030]: E0316 13:44:43.014220 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:43 crc kubenswrapper[5030]: E0316 13:44:43.018483 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:43 crc kubenswrapper[5030]: E0316 13:44:43.018534 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:44 crc kubenswrapper[5030]: I0316 13:44:44.031849 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:44 crc kubenswrapper[5030]: I0316 13:44:44.031944 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:44 crc kubenswrapper[5030]: I0316 13:44:44.340042 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.49:9696/\": dial tcp 10.217.0.49:9696: connect: connection refused" Mar 16 13:44:48 crc kubenswrapper[5030]: E0316 13:44:48.011001 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:48 crc kubenswrapper[5030]: E0316 13:44:48.013771 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:48 crc kubenswrapper[5030]: E0316 13:44:48.014907 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:48 crc kubenswrapper[5030]: E0316 13:44:48.014950 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:49 crc kubenswrapper[5030]: I0316 13:44:49.030984 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:49 crc kubenswrapper[5030]: I0316 13:44:49.031013 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:49 crc kubenswrapper[5030]: I0316 13:44:49.946147 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:44:49 crc kubenswrapper[5030]: E0316 13:44:49.946634 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.317669 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.401381 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74856dd69d-2fjk6_b2c7f837-a64b-44b9-9997-15b709c53acd/neutron-api/0.log" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.401463 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437476 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437525 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437606 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437670 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437722 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4tzx\" (UniqueName: \"kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437760 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.437989 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmj4r\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438049 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438139 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache" (OuterVolumeSpecName: "cache") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438159 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438225 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock\") pod \"46aa0fb6-44eb-478c-829a-7b9c13448128\" (UID: \"46aa0fb6-44eb-478c-829a-7b9c13448128\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438272 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438434 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config\") pod \"b2c7f837-a64b-44b9-9997-15b709c53acd\" (UID: \"b2c7f837-a64b-44b9-9997-15b709c53acd\") " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.438775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock" (OuterVolumeSpecName: "lock") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.439351 5030 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.439369 5030 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/46aa0fb6-44eb-478c-829a-7b9c13448128-cache\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.444007 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r" (OuterVolumeSpecName: "kube-api-access-zmj4r") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "kube-api-access-zmj4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.444127 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx" (OuterVolumeSpecName: "kube-api-access-p4tzx") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "kube-api-access-p4tzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.444796 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage04-crc" (OuterVolumeSpecName: "swift") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "local-storage04-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.445406 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.446953 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.474211 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.474478 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.474539 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.475362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config" (OuterVolumeSpecName: "config") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.487284 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "b2c7f837-a64b-44b9-9997-15b709c53acd" (UID: "b2c7f837-a64b-44b9-9997-15b709c53acd"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541279 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541309 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541321 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541336 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541347 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541358 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541368 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4tzx\" (UniqueName: \"kubernetes.io/projected/b2c7f837-a64b-44b9-9997-15b709c53acd-kube-api-access-p4tzx\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541381 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2c7f837-a64b-44b9-9997-15b709c53acd-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541393 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmj4r\" (UniqueName: \"kubernetes.io/projected/46aa0fb6-44eb-478c-829a-7b9c13448128-kube-api-access-zmj4r\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.541426 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" " Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.552337 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage04-crc" (UniqueName: "kubernetes.io/local-volume/local-storage04-crc") on node "crc" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.610320 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "46aa0fb6-44eb-478c-829a-7b9c13448128" (UID: "46aa0fb6-44eb-478c-829a-7b9c13448128"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.643333 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage04-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage04-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.643361 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/46aa0fb6-44eb-478c-829a-7b9c13448128-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653240 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-74856dd69d-2fjk6_b2c7f837-a64b-44b9-9997-15b709c53acd/neutron-api/0.log" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653307 5030 generic.go:358] "Generic (PLEG): container finished" podID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerID="7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8" exitCode=137 Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653425 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerDied","Data":"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8"} Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653493 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" event={"ID":"b2c7f837-a64b-44b9-9997-15b709c53acd","Type":"ContainerDied","Data":"30614293e0cb68535e326c3c0fe1a3abbd59cd99be176ac7c2e5191b3f8a8e31"} Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653526 5030 scope.go:117] "RemoveContainer" containerID="2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.653434 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-74856dd69d-2fjk6" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.667509 5030 generic.go:358] "Generic (PLEG): container finished" podID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerID="1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313" exitCode=137 Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.667788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313"} Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.667853 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"46aa0fb6-44eb-478c-829a-7b9c13448128","Type":"ContainerDied","Data":"410492c0a6d873c1751654e542b22962ade3799be7a5a105484b055dc71ac9dd"} Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.667859 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.681097 5030 scope.go:117] "RemoveContainer" containerID="7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.693958 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.704618 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-74856dd69d-2fjk6"] Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.713340 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.714368 5030 scope.go:117] "RemoveContainer" containerID="2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f" Mar 16 13:44:51 crc kubenswrapper[5030]: E0316 13:44:51.714739 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f\": container with ID starting with 2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f not found: ID does not exist" containerID="2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.714768 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f"} err="failed to get container status \"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f\": rpc error: code = NotFound desc = could not find container \"2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f\": container with ID starting with 2f03dc1d8f89fedd0d676e1fceb58703f75b73675c7f630cbbf2de28cba2046f not found: ID does not exist" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.714787 5030 scope.go:117] "RemoveContainer" containerID="7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8" Mar 16 13:44:51 crc kubenswrapper[5030]: E0316 13:44:51.715181 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8\": container with ID starting with 7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8 not found: ID does not exist" containerID="7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.715228 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8"} err="failed to get container status \"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8\": rpc error: code = NotFound desc = could not find container \"7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8\": container with ID starting with 7fdb63ed077ec1afcdd0ee2f5747a9e191629bc935852be744a491a503b370d8 not found: ID does not exist" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.715254 5030 scope.go:117] "RemoveContainer" containerID="1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.717351 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.733731 5030 scope.go:117] "RemoveContainer" containerID="ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.757527 5030 scope.go:117] "RemoveContainer" containerID="fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.778599 5030 scope.go:117] "RemoveContainer" containerID="85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.801821 5030 scope.go:117] "RemoveContainer" containerID="45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.824965 5030 scope.go:117] "RemoveContainer" containerID="3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.854946 5030 scope.go:117] "RemoveContainer" containerID="cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.874760 5030 scope.go:117] "RemoveContainer" containerID="138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.891693 5030 scope.go:117] "RemoveContainer" containerID="fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.911203 5030 scope.go:117] "RemoveContainer" containerID="9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.929185 5030 scope.go:117] "RemoveContainer" containerID="fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.944931 5030 scope.go:117] "RemoveContainer" containerID="cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.959272 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" path="/var/lib/kubelet/pods/46aa0fb6-44eb-478c-829a-7b9c13448128/volumes" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.961295 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" path="/var/lib/kubelet/pods/b2c7f837-a64b-44b9-9997-15b709c53acd/volumes" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.965248 5030 scope.go:117] "RemoveContainer" containerID="e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178" Mar 16 13:44:51 crc kubenswrapper[5030]: I0316 13:44:51.989752 5030 scope.go:117] "RemoveContainer" containerID="b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.010535 5030 scope.go:117] "RemoveContainer" containerID="921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.027702 5030 scope.go:117] "RemoveContainer" containerID="1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.028107 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313\": container with ID starting with 1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313 not found: ID does not exist" containerID="1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028142 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313"} err="failed to get container status \"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313\": rpc error: code = NotFound desc = could not find container \"1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313\": container with ID starting with 1ada62898385bef380f4e91a6939320b5583ebc496fcca1c3c0b0db996250313 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028165 5030 scope.go:117] "RemoveContainer" containerID="ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.028667 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842\": container with ID starting with ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842 not found: ID does not exist" containerID="ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028693 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842"} err="failed to get container status \"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842\": rpc error: code = NotFound desc = could not find container \"ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842\": container with ID starting with ae3bcbe4f046482686b21558bb378d80736164e32143cfaad278e75affc34842 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028710 5030 scope.go:117] "RemoveContainer" containerID="fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.028924 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450\": container with ID starting with fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450 not found: ID does not exist" containerID="fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028947 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450"} err="failed to get container status \"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450\": rpc error: code = NotFound desc = could not find container \"fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450\": container with ID starting with fa89a1aa2921291e4ab14e6227ac990efa957e4b2dc385ff08b873526085e450 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.028960 5030 scope.go:117] "RemoveContainer" containerID="85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.029429 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f\": container with ID starting with 85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f not found: ID does not exist" containerID="85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.029462 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f"} err="failed to get container status \"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f\": rpc error: code = NotFound desc = could not find container \"85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f\": container with ID starting with 85fd0dda9ea3fa8c0100e65e9a425603eeb634809b44cb8b2833425adff6bb5f not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.029477 5030 scope.go:117] "RemoveContainer" containerID="45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.029708 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474\": container with ID starting with 45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474 not found: ID does not exist" containerID="45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.029732 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474"} err="failed to get container status \"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474\": rpc error: code = NotFound desc = could not find container \"45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474\": container with ID starting with 45cec4547d52d44180f89d75b67a5feda779469f46d8e30f5070dea603def474 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.029744 5030 scope.go:117] "RemoveContainer" containerID="3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.030018 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5\": container with ID starting with 3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5 not found: ID does not exist" containerID="3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030039 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5"} err="failed to get container status \"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5\": rpc error: code = NotFound desc = could not find container \"3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5\": container with ID starting with 3385ee4693e1df5378b52b0e9b7060adbda1a245101abc92dc2928cdfbd08eb5 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030050 5030 scope.go:117] "RemoveContainer" containerID="cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.030255 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05\": container with ID starting with cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05 not found: ID does not exist" containerID="cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030275 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05"} err="failed to get container status \"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05\": rpc error: code = NotFound desc = could not find container \"cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05\": container with ID starting with cc216a66627f8a79067c44a15934791247505f7da90b3c13d0c6ad89da3d8c05 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030286 5030 scope.go:117] "RemoveContainer" containerID="138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.030601 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4\": container with ID starting with 138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4 not found: ID does not exist" containerID="138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030623 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4"} err="failed to get container status \"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4\": rpc error: code = NotFound desc = could not find container \"138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4\": container with ID starting with 138ee766251acb24f9aa44888fa37b57ad6e8a9d4585259caf83654ffc58b2e4 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030634 5030 scope.go:117] "RemoveContainer" containerID="fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.030858 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1\": container with ID starting with fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1 not found: ID does not exist" containerID="fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030878 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1"} err="failed to get container status \"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1\": rpc error: code = NotFound desc = could not find container \"fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1\": container with ID starting with fa5c7d5d4ad9857ecba14eb8af1121f53e1dfb6025df2c3bf28de1c2189b58e1 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.030890 5030 scope.go:117] "RemoveContainer" containerID="9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.031207 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b\": container with ID starting with 9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b not found: ID does not exist" containerID="9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031228 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b"} err="failed to get container status \"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b\": rpc error: code = NotFound desc = could not find container \"9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b\": container with ID starting with 9fa8262feb977de847e244d926a50b59e38f8779d3d567228cced3c673786a6b not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031240 5030 scope.go:117] "RemoveContainer" containerID="fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.031456 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6\": container with ID starting with fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6 not found: ID does not exist" containerID="fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031476 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6"} err="failed to get container status \"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6\": rpc error: code = NotFound desc = could not find container \"fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6\": container with ID starting with fc6850e879a87e77cc2de834e3bd844441c4209ac1af8130ca0215e6a64c3ee6 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031489 5030 scope.go:117] "RemoveContainer" containerID="cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.031731 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7\": container with ID starting with cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7 not found: ID does not exist" containerID="cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031755 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7"} err="failed to get container status \"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7\": rpc error: code = NotFound desc = could not find container \"cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7\": container with ID starting with cb30af5fc9f0ac973c84a2e5f7ed6eb1b3cfc88023ac35ffb8ccc5dd7e2509e7 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031768 5030 scope.go:117] "RemoveContainer" containerID="e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.031939 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178\": container with ID starting with e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178 not found: ID does not exist" containerID="e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031959 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178"} err="failed to get container status \"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178\": rpc error: code = NotFound desc = could not find container \"e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178\": container with ID starting with e9ee09710e85fdb43dbb56d4e569c5e47dfaabbf2b219f511af8f6032744d178 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.031971 5030 scope.go:117] "RemoveContainer" containerID="b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.032153 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182\": container with ID starting with b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182 not found: ID does not exist" containerID="b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.032174 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182"} err="failed to get container status \"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182\": rpc error: code = NotFound desc = could not find container \"b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182\": container with ID starting with b8607eb93a0780dce47388492b84b7d32069e039b8e3aecce560142ddaaa1182 not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.032187 5030 scope.go:117] "RemoveContainer" containerID="921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.032344 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa\": container with ID starting with 921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa not found: ID does not exist" containerID="921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa" Mar 16 13:44:52 crc kubenswrapper[5030]: I0316 13:44:52.032362 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa"} err="failed to get container status \"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa\": rpc error: code = NotFound desc = could not find container \"921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa\": container with ID starting with 921b4cb633e5279bcae32a04da5850c2fa7698c2842cac5ce17ffcb2482d4aaa not found: ID does not exist" Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.049616 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:52 crc kubenswrapper[5030]: E0316 13:44:52.049697 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:45:24.049678093 +0000 UTC m=+2368.448990639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "combined-ca-bundle" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.012610 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.014855 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.016569 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.016655 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.585982 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/combined-ca-bundle: secret "combined-ca-bundle" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586091 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:25.586066136 +0000 UTC m=+2369.985378683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "combined-ca-bundle" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586285 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/nova-cell1-conductor-config-data: secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586314 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data podName:085f3cd4-d430-49b3-b3a5-8c4196dfed7b nodeName:}" failed. No retries permitted until 2026-03-16 13:45:25.586306007 +0000 UTC m=+2369.985618555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data") pod "nova-cell1-conductor-0" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b") : secret "nova-cell1-conductor-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586697 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-config-data: secret "cinder-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586730 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:25.586723552 +0000 UTC m=+2369.986036100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586763 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scripts: secret "cinder-scripts" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586783 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:25.586777424 +0000 UTC m=+2369.986089971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scripts" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586818 5030 secret.go:189] Couldn't get secret openstack-kuttl-tests/cinder-scheduler-config-data: secret "cinder-scheduler-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.586838 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom podName:eae8efb3-2136-4f74-8ac9-8311210094f4 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:25.58683372 +0000 UTC m=+2369.986146267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "config-data-custom" (UniqueName: "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom") pod "cinder-scheduler-0" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4") : secret "cinder-scheduler-config-data" not found Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.650862 5030 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod0241f5a5-aa18-4cdd-9b37-453180b09fe0"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod0241f5a5-aa18-4cdd-9b37-453180b09fe0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod0241f5a5_aa18_4cdd_9b37_453180b09fe0.slice" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.650912 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to delete cgroup paths for [kubepods besteffort pod0241f5a5-aa18-4cdd-9b37-453180b09fe0] : unable to destroy cgroup paths for cgroup [kubepods besteffort pod0241f5a5-aa18-4cdd-9b37-453180b09fe0] : Timed out while waiting for systemd to remove kubepods-besteffort-pod0241f5a5_aa18_4cdd_9b37_453180b09fe0.slice" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.683795 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.688890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.701651 5030 generic.go:358] "Generic (PLEG): container finished" podID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" exitCode=137 Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.702351 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"085f3cd4-d430-49b3-b3a5-8c4196dfed7b","Type":"ContainerDied","Data":"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e"} Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.702381 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"085f3cd4-d430-49b3-b3a5-8c4196dfed7b","Type":"ContainerDied","Data":"7a4afc982b3ca38513836a97a5de7e0b686fe6a38b0ae0cbe26da402f745a2ab"} Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.702399 5030 scope.go:117] "RemoveContainer" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.704565 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.705652 5030 generic.go:358] "Generic (PLEG): container finished" podID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerID="668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" exitCode=137 Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.705666 5030 generic.go:358] "Generic (PLEG): container finished" podID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerID="4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" exitCode=137 Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.706196 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.706694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerDied","Data":"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd"} Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.706746 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.706762 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerDied","Data":"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe"} Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.706907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"eae8efb3-2136-4f74-8ac9-8311210094f4","Type":"ContainerDied","Data":"9b332c5d196f21e70fe76729f96c6c33e6693a4a4c15083fa9e8a78144584f64"} Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.732093 5030 scope.go:117] "RemoveContainer" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.732906 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e\": container with ID starting with 7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e not found: ID does not exist" containerID="7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.732938 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e"} err="failed to get container status \"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e\": rpc error: code = NotFound desc = could not find container \"7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e\": container with ID starting with 7121510683ebcbd2bdc964b04bd0e6f271004b9cadabc798e8cc1cb48af5a52e not found: ID does not exist" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.732963 5030 scope.go:117] "RemoveContainer" containerID="668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.744917 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.749697 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.758101 5030 scope.go:117] "RemoveContainer" containerID="4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.778985 5030 scope.go:117] "RemoveContainer" containerID="668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.779603 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd\": container with ID starting with 668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd not found: ID does not exist" containerID="668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.779660 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd"} err="failed to get container status \"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd\": rpc error: code = NotFound desc = could not find container \"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd\": container with ID starting with 668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd not found: ID does not exist" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.779695 5030 scope.go:117] "RemoveContainer" containerID="4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.780191 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe\": container with ID starting with 4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe not found: ID does not exist" containerID="4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.780275 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe"} err="failed to get container status \"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe\": rpc error: code = NotFound desc = could not find container \"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe\": container with ID starting with 4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe not found: ID does not exist" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.780354 5030 scope.go:117] "RemoveContainer" containerID="668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.780844 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd"} err="failed to get container status \"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd\": rpc error: code = NotFound desc = could not find container \"668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd\": container with ID starting with 668d890e49b0728a24e7f95fb162dfcc394781617dacc7ef95ad8550f35d7ebd not found: ID does not exist" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.780870 5030 scope.go:117] "RemoveContainer" containerID="4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.781356 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe"} err="failed to get container status \"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe\": rpc error: code = NotFound desc = could not find container \"4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe\": container with ID starting with 4412cae8bea00df7141ad702e25d266570daac2e1299a9845fed69279190d3fe not found: ID does not exist" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789090 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789321 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789404 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789470 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789482 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789846 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data\") pod \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.789945 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs5vh\" (UniqueName: \"kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh\") pod \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.790014 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.790064 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kt2t\" (UniqueName: \"kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t\") pod \"eae8efb3-2136-4f74-8ac9-8311210094f4\" (UID: \"eae8efb3-2136-4f74-8ac9-8311210094f4\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.790297 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle\") pod \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\" (UID: \"085f3cd4-d430-49b3-b3a5-8c4196dfed7b\") " Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.791102 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/eae8efb3-2136-4f74-8ac9-8311210094f4-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.796612 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts" (OuterVolumeSpecName: "scripts") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.796805 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh" (OuterVolumeSpecName: "kube-api-access-gs5vh") pod "085f3cd4-d430-49b3-b3a5-8c4196dfed7b" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b"). InnerVolumeSpecName "kube-api-access-gs5vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.797264 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t" (OuterVolumeSpecName: "kube-api-access-7kt2t") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "kube-api-access-7kt2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.797586 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.810774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "085f3cd4-d430-49b3-b3a5-8c4196dfed7b" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.811278 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data" (OuterVolumeSpecName: "config-data") pod "085f3cd4-d430-49b3-b3a5-8c4196dfed7b" (UID: "085f3cd4-d430-49b3-b3a5-8c4196dfed7b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.824540 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.847210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data" (OuterVolumeSpecName: "config-data") pod "eae8efb3-2136-4f74-8ac9-8311210094f4" (UID: "eae8efb3-2136-4f74-8ac9-8311210094f4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893422 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893489 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kt2t\" (UniqueName: \"kubernetes.io/projected/eae8efb3-2136-4f74-8ac9-8311210094f4-kube-api-access-7kt2t\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893517 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893530 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893544 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893574 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eae8efb3-2136-4f74-8ac9-8311210094f4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893587 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.893600 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs5vh\" (UniqueName: \"kubernetes.io/projected/085f3cd4-d430-49b3-b3a5-8c4196dfed7b-kube-api-access-gs5vh\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:53 crc kubenswrapper[5030]: E0316 13:44:53.911577 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1251438 actualBytes=10240 Mar 16 13:44:53 crc kubenswrapper[5030]: I0316 13:44:53.954411 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0241f5a5-aa18-4cdd-9b37-453180b09fe0" path="/var/lib/kubelet/pods/0241f5a5-aa18-4cdd-9b37-453180b09fe0/volumes" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.033267 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.033298 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" probeResult="failure" output="Get \"https://10.217.0.167:8080/healthcheck\": dial tcp 10.217.0.167:8080: connect: connection refused" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.036844 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.047477 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.055807 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.060375 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.421599 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.507605 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.507756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.507808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.507898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.507942 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqhvk\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.508990 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.509019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.509083 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs\") pod \"6f50eef9-fd16-4e77-9a48-c6989850d346\" (UID: \"6f50eef9-fd16-4e77-9a48-c6989850d346\") " Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.509261 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.509732 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.510296 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.510316 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6f50eef9-fd16-4e77-9a48-c6989850d346-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.513977 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk" (OuterVolumeSpecName: "kube-api-access-jqhvk") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "kube-api-access-jqhvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.514032 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.543840 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.545444 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.551700 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data" (OuterVolumeSpecName: "config-data") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.553597 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "6f50eef9-fd16-4e77-9a48-c6989850d346" (UID: "6f50eef9-fd16-4e77-9a48-c6989850d346"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613246 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613290 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613304 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613316 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqhvk\" (UniqueName: \"kubernetes.io/projected/6f50eef9-fd16-4e77-9a48-c6989850d346-kube-api-access-jqhvk\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613334 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.613343 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6f50eef9-fd16-4e77-9a48-c6989850d346-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.722430 5030 generic.go:358] "Generic (PLEG): container finished" podID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerID="fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8" exitCode=137 Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.722590 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.722591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerDied","Data":"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8"} Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.722677 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj" event={"ID":"6f50eef9-fd16-4e77-9a48-c6989850d346","Type":"ContainerDied","Data":"9035d2480fc5908900d399b7196abcbc55f2e12d9c522ac94b38b5bfba971cd6"} Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.722716 5030 scope.go:117] "RemoveContainer" containerID="fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.755428 5030 scope.go:117] "RemoveContainer" containerID="7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.759462 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.777070 5030 scope.go:117] "RemoveContainer" containerID="fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8" Mar 16 13:44:54 crc kubenswrapper[5030]: E0316 13:44:54.777614 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8\": container with ID starting with fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8 not found: ID does not exist" containerID="fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.777671 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8"} err="failed to get container status \"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8\": rpc error: code = NotFound desc = could not find container \"fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8\": container with ID starting with fb626da569032f3368f83721b2a9e521996d44ac1a6b407cc561ab75f890a6e8 not found: ID does not exist" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.777706 5030 scope.go:117] "RemoveContainer" containerID="7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021" Mar 16 13:44:54 crc kubenswrapper[5030]: E0316 13:44:54.778742 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021\": container with ID starting with 7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021 not found: ID does not exist" containerID="7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.778788 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021"} err="failed to get container status \"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021\": rpc error: code = NotFound desc = could not find container \"7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021\": container with ID starting with 7a3224f61a360e993d74363e4ae04812b0ff5faf25d3636d108693958cd3b021 not found: ID does not exist" Mar 16 13:44:54 crc kubenswrapper[5030]: I0316 13:44:54.781265 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-b56d98484-vtfdj"] Mar 16 13:44:55 crc kubenswrapper[5030]: I0316 13:44:55.962679 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" path="/var/lib/kubelet/pods/085f3cd4-d430-49b3-b3a5-8c4196dfed7b/volumes" Mar 16 13:44:55 crc kubenswrapper[5030]: I0316 13:44:55.963726 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" path="/var/lib/kubelet/pods/6f50eef9-fd16-4e77-9a48-c6989850d346/volumes" Mar 16 13:44:55 crc kubenswrapper[5030]: I0316 13:44:55.964261 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" path="/var/lib/kubelet/pods/eae8efb3-2136-4f74-8ac9-8311210094f4/volumes" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.494522 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-svcl2"] Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.498401 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-svcl2"] Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.597503 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-hsgbr"] Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598617 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598645 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598661 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598667 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598684 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598690 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598703 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598708 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598714 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598720 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598727 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598732 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598744 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" containerName="kube-state-metrics" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598749 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" containerName="kube-state-metrics" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598759 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-expirer" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598765 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-expirer" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598773 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598779 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598785 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598792 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598798 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598803 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598810 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598815 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598825 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598829 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598840 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598845 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598858 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="ovsdbserver-sb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598864 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="ovsdbserver-sb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598870 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598875 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598884 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="rsync" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598888 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="rsync" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598898 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598903 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598916 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598921 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598928 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="mysql-bootstrap" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598933 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="mysql-bootstrap" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598940 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-reaper" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598947 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-reaper" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598955 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598962 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598971 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598976 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598988 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598993 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.598998 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="swift-recon-cron" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599003 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="swift-recon-cron" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599009 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="init" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599014 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="init" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599022 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599027 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599035 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599040 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599046 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599050 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599059 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599065 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599072 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="ovsdbserver-nb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599078 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="ovsdbserver-nb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599084 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="setup-container" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599089 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="setup-container" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599099 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599103 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599110 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599115 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599121 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599125 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599136 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e26e066-ea63-42d9-8853-63bf42e1714d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599141 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e26e066-ea63-42d9-8853-63bf42e1714d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599149 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599154 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599162 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599167 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599175 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599180 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599188 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599194 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599201 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599206 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599213 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599220 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599232 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c6f290-ff76-4884-8db6-075c353aa2df" containerName="memcached" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599237 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c6f290-ff76-4884-8db6-075c353aa2df" containerName="memcached" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599245 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="cinder-scheduler" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599250 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="cinder-scheduler" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599258 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599263 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599270 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599278 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599288 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599293 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599302 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599307 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599315 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599321 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599329 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="mysql-bootstrap" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599335 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="mysql-bootstrap" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599340 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599346 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599351 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-metadata" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599357 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-metadata" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599363 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599368 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599375 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599380 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599394 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="probe" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599399 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="probe" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599408 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599413 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599422 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599427 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599434 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599438 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599447 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95e47e9-8db9-48d4-903e-5f61151a5dff" containerName="keystone-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599461 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95e47e9-8db9-48d4-903e-5f61151a5dff" containerName="keystone-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599469 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="ovn-northd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599475 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="ovn-northd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599484 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="dnsmasq-dns" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599491 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="dnsmasq-dns" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599497 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599502 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599510 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599516 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599523 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="setup-container" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599529 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="setup-container" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599703 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="ovn-northd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599721 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599730 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599739 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599746 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-metadata" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599756 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599764 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599773 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eea15d11-b237-4437-a87c-bfcfd6ba2cd2" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599781 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6dfb78f-7fbe-4daf-a462-c2523b7ff8c5" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599788 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599794 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599800 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599807 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-reaper" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599815 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b6c97ea-4885-4b61-880f-bd53acc1928b" containerName="ovsdbserver-nb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599825 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599831 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee332a01-506b-449e-968e-8ada0f0470e4" containerName="galera" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599839 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599846 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b6c1e85-68d7-448e-81c8-2efabf9e73ef" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599853 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599861 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599867 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599875 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6980b22d-cacf-43fa-9a2d-7b9f5a24a5ef" containerName="nova-metadata-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599880 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599887 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e4d2bc4-0bec-4939-a936-d9a9abc8f23a" containerName="barbican-worker-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599893 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d56ee776-82e2-47a2-bd48-74a5e7e64cef" containerName="kube-state-metrics" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599900 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e932185-2e0e-4845-a258-a48580b8af5d" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599905 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="085f3cd4-d430-49b3-b3a5-8c4196dfed7b" containerName="nova-cell1-conductor-conductor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599913 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599918 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bf225c37-5611-47f6-995b-615f1f648742" containerName="barbican-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599925 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599933 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2c7f837-a64b-44b9-9997-15b709c53acd" containerName="neutron-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599939 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599945 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599951 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="rsync" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599957 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e507f45-9b3e-4be2-ae26-341712344d66" containerName="openstack-network-exporter" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599965 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599971 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9e2308b-6995-45f8-800e-8f7a4ff5ade9" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599976 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac6d227c-baa9-4de4-a59e-0a8a42e53c67" containerName="nova-api-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599983 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-server" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599989 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-auditor" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.599994 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="account-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600001 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c568069c-06b6-42a4-a263-2e42abbbebd0" containerName="placement-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600010 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bffb37f-433d-4562-bf3d-edf49b7cc030" containerName="rabbitmq" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600017 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f50eef9-fd16-4e77-9a48-c6989850d346" containerName="proxy-httpd" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600024 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="27c6f290-ff76-4884-8db6-075c353aa2df" containerName="memcached" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600030 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="cinder-scheduler" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600036 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e26e066-ea63-42d9-8853-63bf42e1714d" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600042 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-expirer" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600049 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="container-updater" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600056 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener-log" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600062 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8034c8d7-c2a7-4cb4-8ba8-fc56227f1a38" containerName="dnsmasq-dns" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600069 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="object-replicator" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600076 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="08f24da9-a345-4eb5-b643-811fddc089c7" containerName="barbican-keystone-listener" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600083 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4bf2baa4-a457-4ae2-b225-ef4828878d62" containerName="cinder-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600090 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="22ab016c-c89d-4fc7-9daa-10dcbb93d493" containerName="ovsdbserver-sb" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600095 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="46aa0fb6-44eb-478c-829a-7b9c13448128" containerName="swift-recon-cron" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600102 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cab4b11-b0dc-48d8-8eff-1d36808bebe5" containerName="barbican-worker" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600109 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c95e47e9-8db9-48d4-903e-5f61151a5dff" containerName="keystone-api" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.600115 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="eae8efb3-2136-4f74-8ac9-8311210094f4" containerName="probe" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.604834 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.608934 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.609911 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hsgbr"] Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.610837 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.610898 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.610970 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.708718 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9xv\" (UniqueName: \"kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.708801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.708941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.827978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9xv\" (UniqueName: \"kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.828063 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.828096 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.829105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.829634 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.846824 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9xv\" (UniqueName: \"kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv\") pod \"crc-storage-crc-hsgbr\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.928152 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:44:59 crc kubenswrapper[5030]: I0316 13:44:59.956919 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a35d0a-5121-41d2-a0af-fa1db9169921" path="/var/lib/kubelet/pods/21a35d0a-5121-41d2-a0af-fa1db9169921/volumes" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.153876 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn"] Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.159758 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.161473 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-dockercfg-vfqp6\"" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.162046 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn"] Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.162588 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operator-lifecycle-manager\"/\"collect-profiles-config\"" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.239788 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.239865 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.239922 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff674\" (UniqueName: \"kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.331000 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-hsgbr"] Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.342193 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ff674\" (UniqueName: \"kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.342424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.342491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.344652 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.348360 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.358313 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff674\" (UniqueName: \"kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674\") pod \"collect-profiles-29561145-4h8fn\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.478936 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.796998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hsgbr" event={"ID":"299ef66c-8448-4ed8-a6b9-dd586fe89c82","Type":"ContainerStarted","Data":"684bc81609b82e2940931e02aa08f1daa867afe2e44fca5ce9cb869c288a7392"} Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.899699 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn"] Mar 16 13:45:00 crc kubenswrapper[5030]: W0316 13:45:00.903660 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad0ea3b_fa8f_4660_8328_d4644423dbdc.slice/crio-cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3 WatchSource:0}: Error finding container cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3: Status 404 returned error can't find the container with id cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3 Mar 16 13:45:00 crc kubenswrapper[5030]: I0316 13:45:00.946149 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:45:00 crc kubenswrapper[5030]: E0316 13:45:00.946394 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:45:01 crc kubenswrapper[5030]: I0316 13:45:01.807035 5030 generic.go:358] "Generic (PLEG): container finished" podID="cad0ea3b-fa8f-4660-8328-d4644423dbdc" containerID="f02bb19f9d17d9b4c53ea1dfb3404c3c39524a236e192a0905a1edad7c87d4da" exitCode=0 Mar 16 13:45:01 crc kubenswrapper[5030]: I0316 13:45:01.807307 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" event={"ID":"cad0ea3b-fa8f-4660-8328-d4644423dbdc","Type":"ContainerDied","Data":"f02bb19f9d17d9b4c53ea1dfb3404c3c39524a236e192a0905a1edad7c87d4da"} Mar 16 13:45:01 crc kubenswrapper[5030]: I0316 13:45:01.808052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" event={"ID":"cad0ea3b-fa8f-4660-8328-d4644423dbdc","Type":"ContainerStarted","Data":"cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3"} Mar 16 13:45:01 crc kubenswrapper[5030]: I0316 13:45:01.811693 5030 generic.go:358] "Generic (PLEG): container finished" podID="299ef66c-8448-4ed8-a6b9-dd586fe89c82" containerID="2891385bde6f8570d32431b51aaaabd41411ea7a488ac3b7427ec8cd6998a91e" exitCode=0 Mar 16 13:45:01 crc kubenswrapper[5030]: I0316 13:45:01.812105 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hsgbr" event={"ID":"299ef66c-8448-4ed8-a6b9-dd586fe89c82","Type":"ContainerDied","Data":"2891385bde6f8570d32431b51aaaabd41411ea7a488ac3b7427ec8cd6998a91e"} Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.048522 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.106438 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.193730 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff674\" (UniqueName: \"kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674\") pod \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.193881 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume\") pod \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.194132 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v9xv\" (UniqueName: \"kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv\") pod \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.194270 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage\") pod \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.194428 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt\") pod \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\" (UID: \"299ef66c-8448-4ed8-a6b9-dd586fe89c82\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.194474 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume\") pod \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\" (UID: \"cad0ea3b-fa8f-4660-8328-d4644423dbdc\") " Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.194860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume" (OuterVolumeSpecName: "config-volume") pod "cad0ea3b-fa8f-4660-8328-d4644423dbdc" (UID: "cad0ea3b-fa8f-4660-8328-d4644423dbdc"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.195075 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "299ef66c-8448-4ed8-a6b9-dd586fe89c82" (UID: "299ef66c-8448-4ed8-a6b9-dd586fe89c82"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.195331 5030 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cad0ea3b-fa8f-4660-8328-d4644423dbdc-config-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.195349 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/299ef66c-8448-4ed8-a6b9-dd586fe89c82-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.201591 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674" (OuterVolumeSpecName: "kube-api-access-ff674") pod "cad0ea3b-fa8f-4660-8328-d4644423dbdc" (UID: "cad0ea3b-fa8f-4660-8328-d4644423dbdc"). InnerVolumeSpecName "kube-api-access-ff674". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.201874 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume" (OuterVolumeSpecName: "secret-volume") pod "cad0ea3b-fa8f-4660-8328-d4644423dbdc" (UID: "cad0ea3b-fa8f-4660-8328-d4644423dbdc"). InnerVolumeSpecName "secret-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.202093 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv" (OuterVolumeSpecName: "kube-api-access-5v9xv") pod "299ef66c-8448-4ed8-a6b9-dd586fe89c82" (UID: "299ef66c-8448-4ed8-a6b9-dd586fe89c82"). InnerVolumeSpecName "kube-api-access-5v9xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.213899 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "299ef66c-8448-4ed8-a6b9-dd586fe89c82" (UID: "299ef66c-8448-4ed8-a6b9-dd586fe89c82"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.297024 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v9xv\" (UniqueName: \"kubernetes.io/projected/299ef66c-8448-4ed8-a6b9-dd586fe89c82-kube-api-access-5v9xv\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.297225 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/299ef66c-8448-4ed8-a6b9-dd586fe89c82-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.297277 5030 reconciler_common.go:299] "Volume detached for volume \"secret-volume\" (UniqueName: \"kubernetes.io/secret/cad0ea3b-fa8f-4660-8328-d4644423dbdc-secret-volume\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.297298 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff674\" (UniqueName: \"kubernetes.io/projected/cad0ea3b-fa8f-4660-8328-d4644423dbdc-kube-api-access-ff674\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.836752 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.836738 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operator-lifecycle-manager/collect-profiles-29561145-4h8fn" event={"ID":"cad0ea3b-fa8f-4660-8328-d4644423dbdc","Type":"ContainerDied","Data":"cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3"} Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.836924 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc3e8d31aeb55302ea25fd5c95fa5acf441329344a0e19f6d95da59b6df725c3" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.839473 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-hsgbr" Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.839490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-hsgbr" event={"ID":"299ef66c-8448-4ed8-a6b9-dd586fe89c82","Type":"ContainerDied","Data":"684bc81609b82e2940931e02aa08f1daa867afe2e44fca5ce9cb869c288a7392"} Mar 16 13:45:03 crc kubenswrapper[5030]: I0316 13:45:03.839564 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="684bc81609b82e2940931e02aa08f1daa867afe2e44fca5ce9cb869c288a7392" Mar 16 13:45:04 crc kubenswrapper[5030]: I0316 13:45:04.136601 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r"] Mar 16 13:45:04 crc kubenswrapper[5030]: I0316 13:45:04.141656 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-operator-lifecycle-manager/collect-profiles-29561100-c546r"] Mar 16 13:45:05 crc kubenswrapper[5030]: I0316 13:45:05.955523 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2912358-9fb0-4563-8c1a-fd845a33c91d" path="/var/lib/kubelet/pods/a2912358-9fb0-4563-8c1a-fd845a33c91d/volumes" Mar 16 13:45:05 crc kubenswrapper[5030]: I0316 13:45:05.987676 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-hsgbr"] Mar 16 13:45:05 crc kubenswrapper[5030]: I0316 13:45:05.992388 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-hsgbr"] Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.087049 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-rbb8g"] Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088064 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad0ea3b-fa8f-4660-8328-d4644423dbdc" containerName="collect-profiles" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088092 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad0ea3b-fa8f-4660-8328-d4644423dbdc" containerName="collect-profiles" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088104 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299ef66c-8448-4ed8-a6b9-dd586fe89c82" containerName="storage" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088110 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="299ef66c-8448-4ed8-a6b9-dd586fe89c82" containerName="storage" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088312 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cad0ea3b-fa8f-4660-8328-d4644423dbdc" containerName="collect-profiles" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.088328 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="299ef66c-8448-4ed8-a6b9-dd586fe89c82" containerName="storage" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.092520 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.103837 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.103939 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.104067 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.107444 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.113152 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rbb8g"] Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.255355 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.255410 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dt9\" (UniqueName: \"kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.255439 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.357318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.357563 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dt9\" (UniqueName: \"kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.357681 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.357973 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.358091 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.376598 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dt9\" (UniqueName: \"kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9\") pod \"crc-storage-crc-rbb8g\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.410991 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.807611 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-rbb8g"] Mar 16 13:45:06 crc kubenswrapper[5030]: I0316 13:45:06.874217 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbb8g" event={"ID":"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234","Type":"ContainerStarted","Data":"a978dc6f38c5bfb35006236e7b67945e794fc08c39efa259745bdcc9b9f41c6f"} Mar 16 13:45:07 crc kubenswrapper[5030]: I0316 13:45:07.892971 5030 generic.go:358] "Generic (PLEG): container finished" podID="5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" containerID="8761f4acce6d39d624c735926d78096cca16bd3d839f8414e302e658e34b825b" exitCode=0 Mar 16 13:45:07 crc kubenswrapper[5030]: I0316 13:45:07.893045 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbb8g" event={"ID":"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234","Type":"ContainerDied","Data":"8761f4acce6d39d624c735926d78096cca16bd3d839f8414e302e658e34b825b"} Mar 16 13:45:07 crc kubenswrapper[5030]: I0316 13:45:07.954449 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299ef66c-8448-4ed8-a6b9-dd586fe89c82" path="/var/lib/kubelet/pods/299ef66c-8448-4ed8-a6b9-dd586fe89c82/volumes" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.132714 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.205823 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4dt9\" (UniqueName: \"kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9\") pod \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.205869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt\") pod \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.205953 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage\") pod \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\" (UID: \"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234\") " Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.206339 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" (UID: "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.206753 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.212639 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9" (OuterVolumeSpecName: "kube-api-access-v4dt9") pod "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" (UID: "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234"). InnerVolumeSpecName "kube-api-access-v4dt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.222027 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" (UID: "5a89ee67-c2b5-4b41-9ca0-c5b98e75a234"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.308913 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4dt9\" (UniqueName: \"kubernetes.io/projected/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-kube-api-access-v4dt9\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.309091 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.915841 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-rbb8g" Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.915844 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-rbb8g" event={"ID":"5a89ee67-c2b5-4b41-9ca0-c5b98e75a234","Type":"ContainerDied","Data":"a978dc6f38c5bfb35006236e7b67945e794fc08c39efa259745bdcc9b9f41c6f"} Mar 16 13:45:09 crc kubenswrapper[5030]: I0316 13:45:09.915906 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a978dc6f38c5bfb35006236e7b67945e794fc08c39efa259745bdcc9b9f41c6f" Mar 16 13:45:13 crc kubenswrapper[5030]: I0316 13:45:13.946690 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:45:13 crc kubenswrapper[5030]: E0316 13:45:13.947455 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.490942 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.492702 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" containerName="storage" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.492720 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" containerName="storage" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.492863 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" containerName="storage" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.496899 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.499824 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-default-user\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.500054 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-plugins-conf\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.500434 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-config-data\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.500796 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-svc\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.500917 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-dockercfg-vxkc6\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.501034 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-server-conf\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.502634 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-erlang-cookie\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.505476 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.528923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.528971 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.528989 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8dxc\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529049 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529082 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529272 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529419 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.529439 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630156 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630208 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630243 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630272 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630292 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8dxc\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630634 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630828 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.630925 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.631087 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.631638 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") device mount path \"/mnt/openstack/pv01\"" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.632133 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.632393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.632622 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.632972 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.633751 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.638359 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.638358 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.641267 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.641290 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.648795 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8dxc\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.653145 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"rabbitmq-server-0\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.729858 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.734394 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.737378 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-rabbitmq-cell1-svc\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.737925 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-plugins-conf\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.738067 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-dockercfg-gmnsk\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.738256 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-erlang-cookie\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.739701 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-config-data\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.739842 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-server-conf\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.741449 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.741532 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"rabbitmq-cell1-default-user\"" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.814790 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.840919 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.840966 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841058 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841188 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841273 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841357 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841392 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841413 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdrq\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841459 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.841503 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944070 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944185 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944331 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944381 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944415 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdrq\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944489 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944543 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944640 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944771 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.944798 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.945300 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.945967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.946259 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") device mount path \"/mnt/openstack/pv19\"" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.946448 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.947764 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.949512 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.953146 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.954379 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.967337 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.972397 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdrq\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.974666 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:21 crc kubenswrapper[5030]: I0316 13:45:21.973338 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:22 crc kubenswrapper[5030]: I0316 13:45:22.056228 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:22 crc kubenswrapper[5030]: I0316 13:45:22.229309 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:45:22 crc kubenswrapper[5030]: I0316 13:45:22.482777 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:45:22 crc kubenswrapper[5030]: W0316 13:45:22.487316 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c59eb5b_6079_45f0_828c_d4757cd3ed92.slice/crio-de646043637783c0834d07818cbe781257e1b7566ae734fce6604ee97a829b92 WatchSource:0}: Error finding container de646043637783c0834d07818cbe781257e1b7566ae734fce6604ee97a829b92: Status 404 returned error can't find the container with id de646043637783c0834d07818cbe781257e1b7566ae734fce6604ee97a829b92 Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.051329 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerStarted","Data":"253231d193aa902e019ac71e4e1fc445ba41814cec9e70a8820eb87e6d7db67e"} Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.053155 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerStarted","Data":"de646043637783c0834d07818cbe781257e1b7566ae734fce6604ee97a829b92"} Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.352103 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.361429 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.361602 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.365619 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-svc\"" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.365760 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-scripts\"" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.365899 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-dockercfg-kxv4c\"" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.365968 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-data\"" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.371670 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"combined-ca-bundle\"" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.473425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.473508 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.473740 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.473841 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.474038 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.474289 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.474332 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.474493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg94h\" (UniqueName: \"kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575736 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575774 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575823 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg94h\" (UniqueName: \"kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.575962 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.576001 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.576046 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.578290 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.578579 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.579140 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.579226 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") device mount path \"/mnt/openstack/pv13\"" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.584280 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.584651 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.585698 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.602687 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg94h\" (UniqueName: \"kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.611534 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"openstack-galera-0\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:23 crc kubenswrapper[5030]: I0316 13:45:23.686238 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.065580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerStarted","Data":"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501"} Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.083997 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerStarted","Data":"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367"} Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.106311 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.652867 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.658924 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.661594 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-galera-openstack-cell1-svc\"" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.661794 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-config-data\"" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.662113 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-scripts\"" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.663020 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"galera-openstack-cell1-dockercfg-tvgj7\"" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.665520 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.699982 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpvr\" (UniqueName: \"kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700201 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700260 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700359 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700577 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700636 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.700748 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802049 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802399 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpvr\" (UniqueName: \"kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802532 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802622 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802656 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.802979 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") device mount path \"/mnt/openstack/pv03\"" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.803304 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.803828 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.803945 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.804332 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.804976 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.810360 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.812391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.833042 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpvr\" (UniqueName: \"kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.840672 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"openstack-cell1-galera-0\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:24 crc kubenswrapper[5030]: I0316 13:45:24.986359 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.074096 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.078980 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.081324 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-memcached-svc\"" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.081644 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"memcached-config-data\"" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.084899 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"memcached-memcached-dockercfg-4dlrx\"" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.086304 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.099422 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerStarted","Data":"0da97836cea3d42bd6dbf4cc35e11fbc5e30df5a13c9d69423f186d9e6f5637d"} Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.099459 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerStarted","Data":"070f8f11b752923cbcc6262acd023f8f80be959092914a57d389835b04c7c4e1"} Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.115135 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6699\" (UniqueName: \"kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.115213 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.115260 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.115415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.115451 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.207113 5030 scope.go:117] "RemoveContainer" containerID="b20c2906693fa3b58bb912b70cdc7469321d3ba4257b0c0f8ea9ad757cc3eb2d" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.217170 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6699\" (UniqueName: \"kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.217242 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.217291 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.217480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.217531 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.220777 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.220901 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.222867 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.223153 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.233646 5030 scope.go:117] "RemoveContainer" containerID="e9def6e1d634313b4fe8b88883de934a46a973f714edf43e2bb78e0b8b3cda7d" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.234418 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6699\" (UniqueName: \"kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699\") pod \"memcached-0\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.261569 5030 scope.go:117] "RemoveContainer" containerID="82eb0ec799d35803aeaf894e7c558bb44e80a29cc62dd4356b93943aaf3e64d8" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.286206 5030 scope.go:117] "RemoveContainer" containerID="d05277fe3d566f4707731dcb914f5be26c907ccaf0b2c041269d4a1ad8a72846" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.397107 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.457304 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:45:25 crc kubenswrapper[5030]: I0316 13:45:25.824157 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:45:25 crc kubenswrapper[5030]: W0316 13:45:25.828834 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod134ba5b6_d1b8_43ef_8d86_f929c7885553.slice/crio-34d39bf1f5ea3861aaee0f1552ccfecceae7edf04116ff30ac6668c7c0c7ac2a WatchSource:0}: Error finding container 34d39bf1f5ea3861aaee0f1552ccfecceae7edf04116ff30ac6668c7c0c7ac2a: Status 404 returned error can't find the container with id 34d39bf1f5ea3861aaee0f1552ccfecceae7edf04116ff30ac6668c7c0c7ac2a Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.118182 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerStarted","Data":"e0bfb7aae5bdc7eac38ee8673af4c85029e5773c8b8d08fa7e901787a2a7c1f9"} Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.118582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerStarted","Data":"54d1dc087c1e26cf07d3af64ac83a252a1221a857f4e889b8c0cc3638623a098"} Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.122862 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"134ba5b6-d1b8-43ef-8d86-f929c7885553","Type":"ContainerStarted","Data":"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0"} Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.122912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"134ba5b6-d1b8-43ef-8d86-f929c7885553","Type":"ContainerStarted","Data":"34d39bf1f5ea3861aaee0f1552ccfecceae7edf04116ff30ac6668c7c0c7ac2a"} Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.123033 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:26 crc kubenswrapper[5030]: I0316 13:45:26.946087 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:45:26 crc kubenswrapper[5030]: E0316 13:45:26.946540 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.343921 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/memcached-0" podStartSLOduration=2.343902231 podStartE2EDuration="2.343902231s" podCreationTimestamp="2026-03-16 13:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:26.153052203 +0000 UTC m=+2370.552364750" watchObservedRunningTime="2026-03-16 13:45:27.343902231 +0000 UTC m=+2371.743214779" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.346580 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.351889 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.353539 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"telemetry-ceilometer-dockercfg-qq9fv\"" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.360807 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.367566 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8nv\" (UniqueName: \"kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv\") pod \"kube-state-metrics-0\" (UID: \"b85e4267-3e18-4dcc-8b88-bd30e5acc693\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.469262 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8nv\" (UniqueName: \"kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv\") pod \"kube-state-metrics-0\" (UID: \"b85e4267-3e18-4dcc-8b88-bd30e5acc693\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.486945 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8nv\" (UniqueName: \"kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv\") pod \"kube-state-metrics-0\" (UID: \"b85e4267-3e18-4dcc-8b88-bd30e5acc693\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:27 crc kubenswrapper[5030]: I0316 13:45:27.667049 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:28 crc kubenswrapper[5030]: I0316 13:45:28.080504 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:45:28 crc kubenswrapper[5030]: W0316 13:45:28.084566 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb85e4267_3e18_4dcc_8b88_bd30e5acc693.slice/crio-74eb02ca24ffd8da1be68999efb1507fd5b33828e1a79d0e72c025f46c086a03 WatchSource:0}: Error finding container 74eb02ca24ffd8da1be68999efb1507fd5b33828e1a79d0e72c025f46c086a03: Status 404 returned error can't find the container with id 74eb02ca24ffd8da1be68999efb1507fd5b33828e1a79d0e72c025f46c086a03 Mar 16 13:45:28 crc kubenswrapper[5030]: I0316 13:45:28.146097 5030 generic.go:358] "Generic (PLEG): container finished" podID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerID="0da97836cea3d42bd6dbf4cc35e11fbc5e30df5a13c9d69423f186d9e6f5637d" exitCode=0 Mar 16 13:45:28 crc kubenswrapper[5030]: I0316 13:45:28.146195 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerDied","Data":"0da97836cea3d42bd6dbf4cc35e11fbc5e30df5a13c9d69423f186d9e6f5637d"} Mar 16 13:45:28 crc kubenswrapper[5030]: I0316 13:45:28.148998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b85e4267-3e18-4dcc-8b88-bd30e5acc693","Type":"ContainerStarted","Data":"74eb02ca24ffd8da1be68999efb1507fd5b33828e1a79d0e72c025f46c086a03"} Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.168776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerStarted","Data":"938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf"} Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.173291 5030 generic.go:358] "Generic (PLEG): container finished" podID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerID="e0bfb7aae5bdc7eac38ee8673af4c85029e5773c8b8d08fa7e901787a2a7c1f9" exitCode=0 Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.173363 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerDied","Data":"e0bfb7aae5bdc7eac38ee8673af4c85029e5773c8b8d08fa7e901787a2a7c1f9"} Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.176512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b85e4267-3e18-4dcc-8b88-bd30e5acc693","Type":"ContainerStarted","Data":"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad"} Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.176824 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.196718 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-galera-0" podStartSLOduration=7.196684188 podStartE2EDuration="7.196684188s" podCreationTimestamp="2026-03-16 13:45:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:29.189591189 +0000 UTC m=+2373.588903736" watchObservedRunningTime="2026-03-16 13:45:29.196684188 +0000 UTC m=+2373.595996735" Mar 16 13:45:29 crc kubenswrapper[5030]: I0316 13:45:29.212678 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=1.940745003 podStartE2EDuration="2.212656208s" podCreationTimestamp="2026-03-16 13:45:27 +0000 UTC" firstStartedPulling="2026-03-16 13:45:28.086517482 +0000 UTC m=+2372.485830029" lastFinishedPulling="2026-03-16 13:45:28.358428687 +0000 UTC m=+2372.757741234" observedRunningTime="2026-03-16 13:45:29.205709423 +0000 UTC m=+2373.605021970" watchObservedRunningTime="2026-03-16 13:45:29.212656208 +0000 UTC m=+2373.611968755" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.146371 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.152580 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.156379 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovn-metrics\"" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.156663 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-nb-dockercfg-cpfxc\"" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.156698 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-nb-ovndbs\"" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.157062 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-config\"" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.157800 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-nb-scripts\"" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.168743 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.200173 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerStarted","Data":"ae4faffab9b35ffbb273cdf593d94c7c7746bd8ca2af26429ab866bf3061b4d6"} Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228203 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzks2\" (UniqueName: \"kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228340 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228413 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228723 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228873 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228906 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.228927 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.229435 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podStartSLOduration=7.229416674 podStartE2EDuration="7.229416674s" podCreationTimestamp="2026-03-16 13:45:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:30.219936545 +0000 UTC m=+2374.619249092" watchObservedRunningTime="2026-03-16 13:45:30.229416674 +0000 UTC m=+2374.628729222" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.331794 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzks2\" (UniqueName: \"kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.331944 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332179 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332299 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332357 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.332865 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.333966 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") device mount path \"/mnt/openstack/pv09\"" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.334969 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.337070 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.339642 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.339753 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.341082 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.349707 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzks2\" (UniqueName: \"kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.353629 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"ovsdbserver-nb-0\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.479693 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:30 crc kubenswrapper[5030]: I0316 13:45:30.891935 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:45:31 crc kubenswrapper[5030]: I0316 13:45:31.210615 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerStarted","Data":"3ebe995bdaf85be1f8006a4e9927f55ec6e2849e3dcf60d7c31f588b2d3cc449"} Mar 16 13:45:31 crc kubenswrapper[5030]: I0316 13:45:31.211057 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerStarted","Data":"97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68"} Mar 16 13:45:31 crc kubenswrapper[5030]: I0316 13:45:31.211076 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerStarted","Data":"c268ca4dad34d49ce054e6fae3d330ab144a8e98e54ae2e8775123e8b67a17f4"} Mar 16 13:45:31 crc kubenswrapper[5030]: I0316 13:45:31.245428 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podStartSLOduration=2.245405781 podStartE2EDuration="2.245405781s" podCreationTimestamp="2026-03-16 13:45:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:31.22644966 +0000 UTC m=+2375.625762207" watchObservedRunningTime="2026-03-16 13:45:31.245405781 +0000 UTC m=+2375.644718329" Mar 16 13:45:32 crc kubenswrapper[5030]: I0316 13:45:32.135086 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.094967 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.099338 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.101943 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-scripts\"" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.101985 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncluster-ovndbcluster-sb-dockercfg-xhbwq\"" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.102225 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovndbcluster-sb-ovndbs\"" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.102789 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovndbcluster-sb-config\"" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.108867 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192050 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192329 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192729 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192889 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.192926 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.193112 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.193157 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvhkn\" (UniqueName: \"kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.296201 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.296245 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.296338 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.296366 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvhkn\" (UniqueName: \"kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.296539 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.297481 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.297567 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.297616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.297693 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.297942 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.298040 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") device mount path \"/mnt/openstack/pv05\"" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.298349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.311241 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.311661 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.315911 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvhkn\" (UniqueName: \"kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.316767 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.326372 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"ovsdbserver-sb-0\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.418049 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.480687 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.686635 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.686696 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:33 crc kubenswrapper[5030]: I0316 13:45:33.804148 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:45:33 crc kubenswrapper[5030]: W0316 13:45:33.807434 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d156d48_d663_4128_905b_428afb256015.slice/crio-4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b WatchSource:0}: Error finding container 4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b: Status 404 returned error can't find the container with id 4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.252199 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerStarted","Data":"026cb6c1982f6523c4904526089b228b9695141373d6e9981af0e54eac6ea449"} Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.252281 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerStarted","Data":"3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628"} Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.252297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerStarted","Data":"4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b"} Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.275941 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podStartSLOduration=2.275926138 podStartE2EDuration="2.275926138s" podCreationTimestamp="2026-03-16 13:45:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:34.268925341 +0000 UTC m=+2378.668237919" watchObservedRunningTime="2026-03-16 13:45:34.275926138 +0000 UTC m=+2378.675238685" Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.987178 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:34 crc kubenswrapper[5030]: I0316 13:45:34.987240 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:35 crc kubenswrapper[5030]: I0316 13:45:35.479940 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:35 crc kubenswrapper[5030]: I0316 13:45:35.960207 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.023057 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.312423 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tk6xr"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.316262 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.317787 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tk6xr"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.418456 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.430818 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.434746 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.436644 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.443499 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.456630 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpjg\" (UniqueName: \"kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.456723 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.459883 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.516104 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.528173 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-create-p9dl6"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.540950 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.545896 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p9dl6"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.547340 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.558886 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twpjg\" (UniqueName: \"kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.558994 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.559056 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj6fm\" (UniqueName: \"kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.559184 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.561024 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.581854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpjg\" (UniqueName: \"kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg\") pod \"keystone-db-create-tk6xr\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.629930 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-3285-account-create-update-qbb57"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.633885 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.634027 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.636256 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3285-account-create-update-qbb57"] Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.636492 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-db-secret\"" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.662832 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swlf2\" (UniqueName: \"kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.663978 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.664063 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kj6fm\" (UniqueName: \"kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.664289 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.665877 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.680399 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj6fm\" (UniqueName: \"kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm\") pod \"keystone-7db8-account-create-update-pnx7t\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.748817 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.765811 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zjng\" (UniqueName: \"kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.765875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.766179 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.766469 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swlf2\" (UniqueName: \"kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.769743 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.787042 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swlf2\" (UniqueName: \"kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2\") pod \"placement-db-create-p9dl6\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.855820 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.868489 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zjng\" (UniqueName: \"kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.868641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.869445 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:36 crc kubenswrapper[5030]: I0316 13:45:36.885954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zjng\" (UniqueName: \"kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng\") pod \"placement-3285-account-create-update-qbb57\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.029427 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.030403 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tk6xr"] Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.156384 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t"] Mar 16 13:45:37 crc kubenswrapper[5030]: W0316 13:45:37.158517 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafa70386_e350_4623_a2b0_1bc46a2077e7.slice/crio-018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793 WatchSource:0}: Error finding container 018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793: Status 404 returned error can't find the container with id 018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793 Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.233358 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.294601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" event={"ID":"f95c43f2-74f9-4cb8-89f9-49b67eab0552","Type":"ContainerStarted","Data":"1d6b68d87d99bba78f6f6d5239ec45bc9af8d75abcbd57011401915e4f23ea11"} Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.294650 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" event={"ID":"f95c43f2-74f9-4cb8-89f9-49b67eab0552","Type":"ContainerStarted","Data":"d80060f2917a727686045e9b298a14dcaede10c5f963229a7a7b7b8316bf631d"} Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.294918 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p9dl6"] Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.297855 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" event={"ID":"afa70386-e350-4623-a2b0-1bc46a2077e7","Type":"ContainerStarted","Data":"018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793"} Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.298359 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:37 crc kubenswrapper[5030]: W0316 13:45:37.306569 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4067d79_8bb0_4cac_b216_943b6e8bf29e.slice/crio-8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81 WatchSource:0}: Error finding container 8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81: Status 404 returned error can't find the container with id 8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81 Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.311141 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" podStartSLOduration=1.311120586 podStartE2EDuration="1.311120586s" podCreationTimestamp="2026-03-16 13:45:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:37.304844933 +0000 UTC m=+2381.704157480" watchObservedRunningTime="2026-03-16 13:45:37.311120586 +0000 UTC m=+2381.710433132" Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.335596 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:45:37 crc kubenswrapper[5030]: I0316 13:45:37.439880 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-3285-account-create-update-qbb57"] Mar 16 13:45:37 crc kubenswrapper[5030]: W0316 13:45:37.474851 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e83fd8e_6323_44d0_82e9_1cedf5e8509e.slice/crio-a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8 WatchSource:0}: Error finding container a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8: Status 404 returned error can't find the container with id a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8 Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.314233 5030 generic.go:358] "Generic (PLEG): container finished" podID="afa70386-e350-4623-a2b0-1bc46a2077e7" containerID="f89966d58fa68ddb3cd258d6f5f811ebc861a6ced57e8b7ed808a6d2e00697eb" exitCode=0 Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.314759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" event={"ID":"afa70386-e350-4623-a2b0-1bc46a2077e7","Type":"ContainerDied","Data":"f89966d58fa68ddb3cd258d6f5f811ebc861a6ced57e8b7ed808a6d2e00697eb"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.322627 5030 generic.go:358] "Generic (PLEG): container finished" podID="9e83fd8e-6323-44d0-82e9-1cedf5e8509e" containerID="d31695151d7a95dc118506726c05de013026f795d2351a64880d58900c791872" exitCode=0 Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.322712 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" event={"ID":"9e83fd8e-6323-44d0-82e9-1cedf5e8509e","Type":"ContainerDied","Data":"d31695151d7a95dc118506726c05de013026f795d2351a64880d58900c791872"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.322776 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" event={"ID":"9e83fd8e-6323-44d0-82e9-1cedf5e8509e","Type":"ContainerStarted","Data":"a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.324196 5030 generic.go:358] "Generic (PLEG): container finished" podID="c4067d79-8bb0-4cac-b216-943b6e8bf29e" containerID="15d6c8c90adae8e902480132895c41bee1da5f889a468b31ce3cfd23c998d43d" exitCode=0 Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.324307 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p9dl6" event={"ID":"c4067d79-8bb0-4cac-b216-943b6e8bf29e","Type":"ContainerDied","Data":"15d6c8c90adae8e902480132895c41bee1da5f889a468b31ce3cfd23c998d43d"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.324332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p9dl6" event={"ID":"c4067d79-8bb0-4cac-b216-943b6e8bf29e","Type":"ContainerStarted","Data":"8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.326134 5030 generic.go:358] "Generic (PLEG): container finished" podID="f95c43f2-74f9-4cb8-89f9-49b67eab0552" containerID="1d6b68d87d99bba78f6f6d5239ec45bc9af8d75abcbd57011401915e4f23ea11" exitCode=0 Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.326241 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" event={"ID":"f95c43f2-74f9-4cb8-89f9-49b67eab0552","Type":"ContainerDied","Data":"1d6b68d87d99bba78f6f6d5239ec45bc9af8d75abcbd57011401915e4f23ea11"} Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.365983 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.534501 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.544623 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.548239 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-scripts\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.548529 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-ovnnorthd-dockercfg-gmkbq\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.548732 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovnnorthd-config\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.549024 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovnnorthd-ovndbs\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.557103 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714284 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714365 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ftz\" (UniqueName: \"kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714565 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714640 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714669 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.714698 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.745158 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.760987 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.767182 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-conf\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.767238 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-swift-dockercfg-mwmmz\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.768025 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.768031 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-storage-config-data\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.768599 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-files\"" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.816759 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.816818 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ftz\" (UniqueName: \"kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817095 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817153 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817205 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817236 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817259 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.817896 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.818335 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.818368 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.823689 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.823988 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.829535 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.832522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ftz\" (UniqueName: \"kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz\") pod \"ovn-northd-0\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.867397 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.919521 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.919602 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.919696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.919724 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.919758 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww42\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:38 crc kubenswrapper[5030]: I0316 13:45:38.920071 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022497 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022539 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022686 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.022725 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zww42\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.023077 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.023597 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.023640 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.023656 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.023727 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift podName:f6be6653-85cb-4980-934b-a4835fed9ec1 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:39.523700534 +0000 UTC m=+2383.923013082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift") pod "swift-storage-0" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1") : configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.023740 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") device mount path \"/mnt/openstack/pv14\"" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.035761 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.059752 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.063485 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww42\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.123214 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btngw"] Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.129527 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.134680 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.135064 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-config-data\"" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.135257 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"swift-ring-scripts\"" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.138612 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btngw"] Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.229330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.229882 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.230115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9knf\" (UniqueName: \"kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.230225 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.230736 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.230897 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.231305 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.269122 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333573 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9knf\" (UniqueName: \"kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333778 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.333906 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.334040 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.334794 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.335918 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.336271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.336672 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerStarted","Data":"aa371de1ade3f67776fdc0ada94082d60d46c84b594b4f7c966372d7d451cb85"} Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.337516 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.338772 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.341068 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.350596 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9knf\" (UniqueName: \"kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf\") pod \"swift-ring-rebalance-btngw\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.452822 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.547018 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.547216 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.547245 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: E0316 13:45:39.547309 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift podName:f6be6653-85cb-4980-934b-a4835fed9ec1 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:40.547289952 +0000 UTC m=+2384.946602499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift") pod "swift-storage-0" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1") : configmap "swift-ring-files" not found Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.578766 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.751114 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zjng\" (UniqueName: \"kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng\") pod \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.752146 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts\") pod \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\" (UID: \"9e83fd8e-6323-44d0-82e9-1cedf5e8509e\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.752933 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9e83fd8e-6323-44d0-82e9-1cedf5e8509e" (UID: "9e83fd8e-6323-44d0-82e9-1cedf5e8509e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.753615 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.757909 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng" (OuterVolumeSpecName: "kube-api-access-9zjng") pod "9e83fd8e-6323-44d0-82e9-1cedf5e8509e" (UID: "9e83fd8e-6323-44d0-82e9-1cedf5e8509e"). InnerVolumeSpecName "kube-api-access-9zjng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.798885 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.815089 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.816589 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.856449 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zjng\" (UniqueName: \"kubernetes.io/projected/9e83fd8e-6323-44d0-82e9-1cedf5e8509e-kube-api-access-9zjng\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957335 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts\") pod \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts\") pod \"afa70386-e350-4623-a2b0-1bc46a2077e7\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957588 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj6fm\" (UniqueName: \"kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm\") pod \"afa70386-e350-4623-a2b0-1bc46a2077e7\" (UID: \"afa70386-e350-4623-a2b0-1bc46a2077e7\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957688 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swlf2\" (UniqueName: \"kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2\") pod \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\" (UID: \"c4067d79-8bb0-4cac-b216-943b6e8bf29e\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957841 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts\") pod \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.957884 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twpjg\" (UniqueName: \"kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg\") pod \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\" (UID: \"f95c43f2-74f9-4cb8-89f9-49b67eab0552\") " Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.958699 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "afa70386-e350-4623-a2b0-1bc46a2077e7" (UID: "afa70386-e350-4623-a2b0-1bc46a2077e7"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.958735 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f95c43f2-74f9-4cb8-89f9-49b67eab0552" (UID: "f95c43f2-74f9-4cb8-89f9-49b67eab0552"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.958693 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c4067d79-8bb0-4cac-b216-943b6e8bf29e" (UID: "c4067d79-8bb0-4cac-b216-943b6e8bf29e"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.962244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2" (OuterVolumeSpecName: "kube-api-access-swlf2") pod "c4067d79-8bb0-4cac-b216-943b6e8bf29e" (UID: "c4067d79-8bb0-4cac-b216-943b6e8bf29e"). InnerVolumeSpecName "kube-api-access-swlf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.962301 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg" (OuterVolumeSpecName: "kube-api-access-twpjg") pod "f95c43f2-74f9-4cb8-89f9-49b67eab0552" (UID: "f95c43f2-74f9-4cb8-89f9-49b67eab0552"). InnerVolumeSpecName "kube-api-access-twpjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:39 crc kubenswrapper[5030]: I0316 13:45:39.964746 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm" (OuterVolumeSpecName: "kube-api-access-kj6fm") pod "afa70386-e350-4623-a2b0-1bc46a2077e7" (UID: "afa70386-e350-4623-a2b0-1bc46a2077e7"). InnerVolumeSpecName "kube-api-access-kj6fm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.011808 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btngw"] Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061115 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f95c43f2-74f9-4cb8-89f9-49b67eab0552-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061483 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twpjg\" (UniqueName: \"kubernetes.io/projected/f95c43f2-74f9-4cb8-89f9-49b67eab0552-kube-api-access-twpjg\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061507 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c4067d79-8bb0-4cac-b216-943b6e8bf29e-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061517 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/afa70386-e350-4623-a2b0-1bc46a2077e7-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061526 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj6fm\" (UniqueName: \"kubernetes.io/projected/afa70386-e350-4623-a2b0-1bc46a2077e7-kube-api-access-kj6fm\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.061535 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swlf2\" (UniqueName: \"kubernetes.io/projected/c4067d79-8bb0-4cac-b216-943b6e8bf29e-kube-api-access-swlf2\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.203869 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.355231 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" event={"ID":"f95c43f2-74f9-4cb8-89f9-49b67eab0552","Type":"ContainerDied","Data":"d80060f2917a727686045e9b298a14dcaede10c5f963229a7a7b7b8316bf631d"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.355278 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d80060f2917a727686045e9b298a14dcaede10c5f963229a7a7b7b8316bf631d" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.355254 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-create-tk6xr" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.358919 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerStarted","Data":"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.358948 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerStarted","Data":"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.358998 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.361588 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" event={"ID":"afa70386-e350-4623-a2b0-1bc46a2077e7","Type":"ContainerDied","Data":"018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.362389 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="018bb47327da246c6da54fc234dbbcfa3a203db3d2b2cdbad755a578e0a6d793" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.361652 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.363623 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" event={"ID":"9e83fd8e-6323-44d0-82e9-1cedf5e8509e","Type":"ContainerDied","Data":"a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.363652 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a37f7dedb659a0d381917fba34cc02dee81a20483f3cfc8af4df8547070d5dc8" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.363698 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-3285-account-create-update-qbb57" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.366381 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-create-p9dl6" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.366469 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-create-p9dl6" event={"ID":"c4067d79-8bb0-4cac-b216-943b6e8bf29e","Type":"ContainerDied","Data":"8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.366562 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c6d5b92fe6d97bfd0263932cdd208e21c6109760f712442df8146d04b4fdf81" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.368779 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" event={"ID":"fb3fe588-6a14-46b5-a78a-776dec80e5eb","Type":"ContainerStarted","Data":"4e9834408f3f565f16a08ba4622dc7e533c71403b922de240c7769d242671c6b"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.368812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" event={"ID":"fb3fe588-6a14-46b5-a78a-776dec80e5eb","Type":"ContainerStarted","Data":"a560bd83d071e779fca6c7e05865c5d1f96ef4c1071f246fee446a4b46d38d41"} Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.383071 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-northd-0" podStartSLOduration=2.383059238 podStartE2EDuration="2.383059238s" podCreationTimestamp="2026-03-16 13:45:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:40.371910761 +0000 UTC m=+2384.771223308" watchObservedRunningTime="2026-03-16 13:45:40.383059238 +0000 UTC m=+2384.782371785" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.403238 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" podStartSLOduration=1.403219784 podStartE2EDuration="1.403219784s" podCreationTimestamp="2026-03-16 13:45:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:40.396723858 +0000 UTC m=+2384.796036404" watchObservedRunningTime="2026-03-16 13:45:40.403219784 +0000 UTC m=+2384.802532331" Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.575291 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:40 crc kubenswrapper[5030]: E0316 13:45:40.575472 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:45:40 crc kubenswrapper[5030]: E0316 13:45:40.575528 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:45:40 crc kubenswrapper[5030]: E0316 13:45:40.575681 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift podName:f6be6653-85cb-4980-934b-a4835fed9ec1 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:42.575643753 +0000 UTC m=+2386.974956299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift") pod "swift-storage-0" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1") : configmap "swift-ring-files" not found Mar 16 13:45:40 crc kubenswrapper[5030]: I0316 13:45:40.946018 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:45:40 crc kubenswrapper[5030]: E0316 13:45:40.946273 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.260541 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-create-rzhmd"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263414 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa70386-e350-4623-a2b0-1bc46a2077e7" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263445 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa70386-e350-4623-a2b0-1bc46a2077e7" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263468 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e83fd8e-6323-44d0-82e9-1cedf5e8509e" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e83fd8e-6323-44d0-82e9-1cedf5e8509e" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263500 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f95c43f2-74f9-4cb8-89f9-49b67eab0552" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263505 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f95c43f2-74f9-4cb8-89f9-49b67eab0552" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263607 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4067d79-8bb0-4cac-b216-943b6e8bf29e" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263613 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4067d79-8bb0-4cac-b216-943b6e8bf29e" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263867 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4067d79-8bb0-4cac-b216-943b6e8bf29e" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263886 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f95c43f2-74f9-4cb8-89f9-49b67eab0552" containerName="mariadb-database-create" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263899 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e83fd8e-6323-44d0-82e9-1cedf5e8509e" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.263921 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="afa70386-e350-4623-a2b0-1bc46a2077e7" containerName="mariadb-account-create-update" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.271874 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.274235 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rzhmd"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.282124 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.286342 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.287856 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.290239 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.330011 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5cj2\" (UniqueName: \"kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.330381 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.330534 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.330605 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvsld\" (UniqueName: \"kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.384800 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-l5rns"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.390994 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.393416 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-mariadb-root-db-secret\"" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.396128 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-l5rns"] Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.433503 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ww9q\" (UniqueName: \"kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.433877 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5cj2\" (UniqueName: \"kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.434372 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.434421 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.434535 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.434610 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvsld\" (UniqueName: \"kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.435361 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.435962 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.455046 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5cj2\" (UniqueName: \"kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2\") pod \"glance-ee2c-account-create-update-slkxb\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.460060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvsld\" (UniqueName: \"kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld\") pod \"glance-db-create-rzhmd\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.537540 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.537895 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ww9q\" (UniqueName: \"kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.538187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.556398 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ww9q\" (UniqueName: \"kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q\") pod \"root-account-create-update-l5rns\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.593511 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.606823 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.640424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:42 crc kubenswrapper[5030]: E0316 13:45:42.640844 5030 projected.go:289] Couldn't get configMap openstack-kuttl-tests/swift-ring-files: configmap "swift-ring-files" not found Mar 16 13:45:42 crc kubenswrapper[5030]: E0316 13:45:42.640873 5030 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack-kuttl-tests/swift-storage-0: configmap "swift-ring-files" not found Mar 16 13:45:42 crc kubenswrapper[5030]: E0316 13:45:42.640932 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift podName:f6be6653-85cb-4980-934b-a4835fed9ec1 nodeName:}" failed. No retries permitted until 2026-03-16 13:45:46.640915912 +0000 UTC m=+2391.040228459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift") pod "swift-storage-0" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1") : configmap "swift-ring-files" not found Mar 16 13:45:42 crc kubenswrapper[5030]: I0316 13:45:42.709203 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.030050 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb"] Mar 16 13:45:43 crc kubenswrapper[5030]: W0316 13:45:43.031459 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bfffea9_2963_4342_8370_75a75b0c18d9.slice/crio-56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9 WatchSource:0}: Error finding container 56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9: Status 404 returned error can't find the container with id 56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9 Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.080002 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rzhmd"] Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.151432 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-l5rns"] Mar 16 13:45:43 crc kubenswrapper[5030]: W0316 13:45:43.160640 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d5d20e5_be3e_45ac_bd7d_b3bf9fa1fa55.slice/crio-41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e WatchSource:0}: Error finding container 41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e: Status 404 returned error can't find the container with id 41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.401512 5030 generic.go:358] "Generic (PLEG): container finished" podID="9bfffea9-2963-4342-8370-75a75b0c18d9" containerID="1f98d6eb4f8e932b423b7ca7a684ff0ddf6fc5feb6bcabfafd0cd1d722776711" exitCode=0 Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.401728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" event={"ID":"9bfffea9-2963-4342-8370-75a75b0c18d9","Type":"ContainerDied","Data":"1f98d6eb4f8e932b423b7ca7a684ff0ddf6fc5feb6bcabfafd0cd1d722776711"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.401760 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" event={"ID":"9bfffea9-2963-4342-8370-75a75b0c18d9","Type":"ContainerStarted","Data":"56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.403646 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-l5rns" event={"ID":"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55","Type":"ContainerStarted","Data":"b0c10a81f194df8b4b0c7ec5581a4e5d000140c693e168d387b3efbc5b8800fc"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.403674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-l5rns" event={"ID":"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55","Type":"ContainerStarted","Data":"41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.405818 5030 generic.go:358] "Generic (PLEG): container finished" podID="cce65a30-3a10-4db3-be16-21137c576520" containerID="bf17f9db9db3b62f0ab3e6f6e14324676bf53b58825bf1592d97164989f804d2" exitCode=0 Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.405875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rzhmd" event={"ID":"cce65a30-3a10-4db3-be16-21137c576520","Type":"ContainerDied","Data":"bf17f9db9db3b62f0ab3e6f6e14324676bf53b58825bf1592d97164989f804d2"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.405890 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rzhmd" event={"ID":"cce65a30-3a10-4db3-be16-21137c576520","Type":"ContainerStarted","Data":"656cda1f3cb1565ffe51f3cb7b21eb6956ccbca3f44f9fb7ee4eface28929731"} Mar 16 13:45:43 crc kubenswrapper[5030]: I0316 13:45:43.431125 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-l5rns" podStartSLOduration=1.431109975 podStartE2EDuration="1.431109975s" podCreationTimestamp="2026-03-16 13:45:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:43.425657681 +0000 UTC m=+2387.824970228" watchObservedRunningTime="2026-03-16 13:45:43.431109975 +0000 UTC m=+2387.830422511" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.420743 5030 generic.go:358] "Generic (PLEG): container finished" podID="9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" containerID="b0c10a81f194df8b4b0c7ec5581a4e5d000140c693e168d387b3efbc5b8800fc" exitCode=0 Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.420988 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-l5rns" event={"ID":"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55","Type":"ContainerDied","Data":"b0c10a81f194df8b4b0c7ec5581a4e5d000140c693e168d387b3efbc5b8800fc"} Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.799781 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.811857 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.891230 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts\") pod \"9bfffea9-2963-4342-8370-75a75b0c18d9\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.891609 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvsld\" (UniqueName: \"kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld\") pod \"cce65a30-3a10-4db3-be16-21137c576520\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.891658 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5cj2\" (UniqueName: \"kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2\") pod \"9bfffea9-2963-4342-8370-75a75b0c18d9\" (UID: \"9bfffea9-2963-4342-8370-75a75b0c18d9\") " Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.891789 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts\") pod \"cce65a30-3a10-4db3-be16-21137c576520\" (UID: \"cce65a30-3a10-4db3-be16-21137c576520\") " Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.891776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9bfffea9-2963-4342-8370-75a75b0c18d9" (UID: "9bfffea9-2963-4342-8370-75a75b0c18d9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.892198 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "cce65a30-3a10-4db3-be16-21137c576520" (UID: "cce65a30-3a10-4db3-be16-21137c576520"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.892999 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9bfffea9-2963-4342-8370-75a75b0c18d9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.893019 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/cce65a30-3a10-4db3-be16-21137c576520-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.897394 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld" (OuterVolumeSpecName: "kube-api-access-tvsld") pod "cce65a30-3a10-4db3-be16-21137c576520" (UID: "cce65a30-3a10-4db3-be16-21137c576520"). InnerVolumeSpecName "kube-api-access-tvsld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.897447 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2" (OuterVolumeSpecName: "kube-api-access-s5cj2") pod "9bfffea9-2963-4342-8370-75a75b0c18d9" (UID: "9bfffea9-2963-4342-8370-75a75b0c18d9"). InnerVolumeSpecName "kube-api-access-s5cj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.995473 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvsld\" (UniqueName: \"kubernetes.io/projected/cce65a30-3a10-4db3-be16-21137c576520-kube-api-access-tvsld\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:44 crc kubenswrapper[5030]: I0316 13:45:44.995513 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5cj2\" (UniqueName: \"kubernetes.io/projected/9bfffea9-2963-4342-8370-75a75b0c18d9-kube-api-access-s5cj2\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.433277 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-create-rzhmd" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.433308 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-create-rzhmd" event={"ID":"cce65a30-3a10-4db3-be16-21137c576520","Type":"ContainerDied","Data":"656cda1f3cb1565ffe51f3cb7b21eb6956ccbca3f44f9fb7ee4eface28929731"} Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.433383 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="656cda1f3cb1565ffe51f3cb7b21eb6956ccbca3f44f9fb7ee4eface28929731" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.436506 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" event={"ID":"9bfffea9-2963-4342-8370-75a75b0c18d9","Type":"ContainerDied","Data":"56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9"} Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.436604 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56609ba81a5209bdb66b9f9d18ce21e76c28a0e18969877cce2de051b578d1d9" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.436617 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.705366 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.811862 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ww9q\" (UniqueName: \"kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q\") pod \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.812692 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts\") pod \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\" (UID: \"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55\") " Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.813365 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" (UID: "9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.817354 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q" (OuterVolumeSpecName: "kube-api-access-4ww9q") pod "9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" (UID: "9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55"). InnerVolumeSpecName "kube-api-access-4ww9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.914841 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:45 crc kubenswrapper[5030]: I0316 13:45:45.914879 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ww9q\" (UniqueName: \"kubernetes.io/projected/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55-kube-api-access-4ww9q\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.450404 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-l5rns" event={"ID":"9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55","Type":"ContainerDied","Data":"41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e"} Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.450794 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41757c1e458a91d6bd6649c5a6f151e9d75d45526ae8f8685cb0b7defce3366e" Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.450425 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-l5rns" Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.452457 5030 generic.go:358] "Generic (PLEG): container finished" podID="fb3fe588-6a14-46b5-a78a-776dec80e5eb" containerID="4e9834408f3f565f16a08ba4622dc7e533c71403b922de240c7769d242671c6b" exitCode=0 Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.452893 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" event={"ID":"fb3fe588-6a14-46b5-a78a-776dec80e5eb","Type":"ContainerDied","Data":"4e9834408f3f565f16a08ba4622dc7e533c71403b922de240c7769d242671c6b"} Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.732147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.752542 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"swift-storage-0\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:46 crc kubenswrapper[5030]: I0316 13:45:46.874995 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.303331 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:45:47 crc kubenswrapper[5030]: W0316 13:45:47.306941 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6be6653_85cb_4980_934b_a4835fed9ec1.slice/crio-92544a801a8f87e09948f8cacbd43f5db3b6210c5aab5a896988a54d9e45e6c3 WatchSource:0}: Error finding container 92544a801a8f87e09948f8cacbd43f5db3b6210c5aab5a896988a54d9e45e6c3: Status 404 returned error can't find the container with id 92544a801a8f87e09948f8cacbd43f5db3b6210c5aab5a896988a54d9e45e6c3 Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.388013 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-db-sync-r5vgh"] Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.388979 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfffea9-2963-4342-8370-75a75b0c18d9" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389000 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfffea9-2963-4342-8370-75a75b0c18d9" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389013 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389019 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389044 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce65a30-3a10-4db3-be16-21137c576520" containerName="mariadb-database-create" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389049 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce65a30-3a10-4db3-be16-21137c576520" containerName="mariadb-database-create" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389192 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cce65a30-3a10-4db3-be16-21137c576520" containerName="mariadb-database-create" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389207 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.389218 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9bfffea9-2963-4342-8370-75a75b0c18d9" containerName="mariadb-account-create-update" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.392196 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.395475 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-2z57w\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.395724 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-config-data\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.401791 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-r5vgh"] Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.467163 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"92544a801a8f87e09948f8cacbd43f5db3b6210c5aab5a896988a54d9e45e6c3"} Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.559789 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.559850 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6vsp\" (UniqueName: \"kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.559911 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.559953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.661454 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.661540 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6vsp\" (UniqueName: \"kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.661641 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.661660 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.667415 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.668249 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.670271 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.677003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6vsp\" (UniqueName: \"kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp\") pod \"glance-db-sync-r5vgh\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.727775 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.750931 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867175 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9knf\" (UniqueName: \"kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867600 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867800 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867836 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.867936 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.868007 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift\") pod \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\" (UID: \"fb3fe588-6a14-46b5-a78a-776dec80e5eb\") " Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.872115 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.872129 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices" (OuterVolumeSpecName: "ring-data-devices") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "ring-data-devices". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.877797 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf" (OuterVolumeSpecName: "kube-api-access-l9knf") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "kube-api-access-l9knf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.893541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf" (OuterVolumeSpecName: "swiftconf") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "swiftconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.895391 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.896859 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts" (OuterVolumeSpecName: "scripts") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.897371 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf" (OuterVolumeSpecName: "dispersionconf") pod "fb3fe588-6a14-46b5-a78a-776dec80e5eb" (UID: "fb3fe588-6a14-46b5-a78a-776dec80e5eb"). InnerVolumeSpecName "dispersionconf". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.971843 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972201 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/empty-dir/fb3fe588-6a14-46b5-a78a-776dec80e5eb-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972265 5030 reconciler_common.go:299] "Volume detached for volume \"dispersionconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-dispersionconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972326 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9knf\" (UniqueName: \"kubernetes.io/projected/fb3fe588-6a14-46b5-a78a-776dec80e5eb-kube-api-access-l9knf\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972391 5030 reconciler_common.go:299] "Volume detached for volume \"swiftconf\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-swiftconf\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972921 5030 reconciler_common.go:299] "Volume detached for volume \"ring-data-devices\" (UniqueName: \"kubernetes.io/configmap/fb3fe588-6a14-46b5-a78a-776dec80e5eb-ring-data-devices\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:47 crc kubenswrapper[5030]: I0316 13:45:47.972987 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fb3fe588-6a14-46b5-a78a-776dec80e5eb-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.200411 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-r5vgh"] Mar 16 13:45:48 crc kubenswrapper[5030]: W0316 13:45:48.203889 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7004b6c_61a4_446c_bbe1_fb964134ec49.slice/crio-379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c WatchSource:0}: Error finding container 379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c: Status 404 returned error can't find the container with id 379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508932 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508952 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508969 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.508976 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.511827 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" event={"ID":"a7004b6c-61a4-446c-bbe1-fb964134ec49","Type":"ContainerStarted","Data":"379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.514218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" event={"ID":"fb3fe588-6a14-46b5-a78a-776dec80e5eb","Type":"ContainerDied","Data":"a560bd83d071e779fca6c7e05865c5d1f96ef4c1071f246fee446a4b46d38d41"} Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.514244 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a560bd83d071e779fca6c7e05865c5d1f96ef4c1071f246fee446a4b46d38d41" Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.514305 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-ring-rebalance-btngw" Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.638614 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-l5rns"] Mar 16 13:45:48 crc kubenswrapper[5030]: I0316 13:45:48.665486 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-l5rns"] Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.526580 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" event={"ID":"a7004b6c-61a4-446c-bbe1-fb964134ec49","Type":"ContainerStarted","Data":"9ad9f1b81e4325a4ffaa4200c7f76923e7878225e55e2abe60aaf5f023eb05c6"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532354 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532407 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532418 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532426 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532437 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532445 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.532454 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8"} Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.549851 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" podStartSLOduration=2.549837821 podStartE2EDuration="2.549837821s" podCreationTimestamp="2026-03-16 13:45:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:49.54286114 +0000 UTC m=+2393.942173687" watchObservedRunningTime="2026-03-16 13:45:49.549837821 +0000 UTC m=+2393.949150358" Mar 16 13:45:49 crc kubenswrapper[5030]: I0316 13:45:49.957204 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55" path="/var/lib/kubelet/pods/9d5d20e5-be3e-45ac-bd7d-b3bf9fa1fa55/volumes" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.553275 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerStarted","Data":"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c"} Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.596477 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-storage-0" podStartSLOduration=13.596454148 podStartE2EDuration="13.596454148s" podCreationTimestamp="2026-03-16 13:45:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:50.588229019 +0000 UTC m=+2394.987541566" watchObservedRunningTime="2026-03-16 13:45:50.596454148 +0000 UTC m=+2394.995766695" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.716508 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.717929 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb3fe588-6a14-46b5-a78a-776dec80e5eb" containerName="swift-ring-rebalance" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.717957 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb3fe588-6a14-46b5-a78a-776dec80e5eb" containerName="swift-ring-rebalance" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.718255 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb3fe588-6a14-46b5-a78a-776dec80e5eb" containerName="swift-ring-rebalance" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.722676 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.724800 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"dns-swift-storage-0\"" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.749209 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.829051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4567\" (UniqueName: \"kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.829111 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.829173 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.829541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.931277 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.932697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.932781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.933314 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.933518 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.934079 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.934241 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4567\" (UniqueName: \"kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:50 crc kubenswrapper[5030]: I0316 13:45:50.953919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4567\" (UniqueName: \"kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567\") pod \"dnsmasq-dnsmasq-d755c5cb5-hjvjl\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:51 crc kubenswrapper[5030]: I0316 13:45:51.044682 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:51 crc kubenswrapper[5030]: I0316 13:45:51.439610 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:45:51 crc kubenswrapper[5030]: I0316 13:45:51.460280 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:45:51 crc kubenswrapper[5030]: W0316 13:45:51.462261 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod596265d5_481b_4e3c_8577_e99f029f8cc2.slice/crio-1c351b489d523838424fc2caf6f2498932f9d8b41c43298fe8ff1464291d6482 WatchSource:0}: Error finding container 1c351b489d523838424fc2caf6f2498932f9d8b41c43298fe8ff1464291d6482: Status 404 returned error can't find the container with id 1c351b489d523838424fc2caf6f2498932f9d8b41c43298fe8ff1464291d6482 Mar 16 13:45:51 crc kubenswrapper[5030]: I0316 13:45:51.577264 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" event={"ID":"596265d5-481b-4e3c-8577-e99f029f8cc2","Type":"ContainerStarted","Data":"1c351b489d523838424fc2caf6f2498932f9d8b41c43298fe8ff1464291d6482"} Mar 16 13:45:52 crc kubenswrapper[5030]: I0316 13:45:52.589738 5030 generic.go:358] "Generic (PLEG): container finished" podID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerID="84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5" exitCode=0 Mar 16 13:45:52 crc kubenswrapper[5030]: I0316 13:45:52.589794 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" event={"ID":"596265d5-481b-4e3c-8577-e99f029f8cc2","Type":"ContainerDied","Data":"84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5"} Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.606157 5030 generic.go:358] "Generic (PLEG): container finished" podID="a7004b6c-61a4-446c-bbe1-fb964134ec49" containerID="9ad9f1b81e4325a4ffaa4200c7f76923e7878225e55e2abe60aaf5f023eb05c6" exitCode=0 Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.606328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" event={"ID":"a7004b6c-61a4-446c-bbe1-fb964134ec49","Type":"ContainerDied","Data":"9ad9f1b81e4325a4ffaa4200c7f76923e7878225e55e2abe60aaf5f023eb05c6"} Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.616298 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" event={"ID":"596265d5-481b-4e3c-8577-e99f029f8cc2","Type":"ContainerStarted","Data":"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614"} Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.616857 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.681923 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" podStartSLOduration=3.681905815 podStartE2EDuration="3.681905815s" podCreationTimestamp="2026-03-16 13:45:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:53.638713844 +0000 UTC m=+2398.038026410" watchObservedRunningTime="2026-03-16 13:45:53.681905815 +0000 UTC m=+2398.081218361" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.692394 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-45gq2"] Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.697988 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-45gq2"] Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.698104 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.700313 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.797176 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvsk\" (UniqueName: \"kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.797228 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.899204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvsk\" (UniqueName: \"kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.899251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.900101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: I0316 13:45:53.918433 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvsk\" (UniqueName: \"kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk\") pod \"root-account-create-update-45gq2\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:53 crc kubenswrapper[5030]: E0316 13:45:53.975939 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1415777 actualBytes=10240 Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.018242 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.412314 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-45gq2"] Mar 16 13:45:54 crc kubenswrapper[5030]: W0316 13:45:54.419325 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7a4a11_683c_45f9_b43b_9939e548c6d8.slice/crio-80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3 WatchSource:0}: Error finding container 80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3: Status 404 returned error can't find the container with id 80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3 Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.630788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-45gq2" event={"ID":"dc7a4a11-683c-45f9-b43b-9939e548c6d8","Type":"ContainerStarted","Data":"34f543d18abeb72ac2ada43dcf7a7327e2865225bc87721ee9bf7a6c089c5be6"} Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.630842 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-45gq2" event={"ID":"dc7a4a11-683c-45f9-b43b-9939e548c6d8","Type":"ContainerStarted","Data":"80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3"} Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.646313 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/root-account-create-update-45gq2" podStartSLOduration=1.6462934649999998 podStartE2EDuration="1.646293465s" podCreationTimestamp="2026-03-16 13:45:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:54.643149161 +0000 UTC m=+2399.042461708" watchObservedRunningTime="2026-03-16 13:45:54.646293465 +0000 UTC m=+2399.045606011" Mar 16 13:45:54 crc kubenswrapper[5030]: I0316 13:45:54.887189 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.024994 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle\") pod \"a7004b6c-61a4-446c-bbe1-fb964134ec49\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.025193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data\") pod \"a7004b6c-61a4-446c-bbe1-fb964134ec49\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.025536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6vsp\" (UniqueName: \"kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp\") pod \"a7004b6c-61a4-446c-bbe1-fb964134ec49\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.025796 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data\") pod \"a7004b6c-61a4-446c-bbe1-fb964134ec49\" (UID: \"a7004b6c-61a4-446c-bbe1-fb964134ec49\") " Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.032500 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp" (OuterVolumeSpecName: "kube-api-access-z6vsp") pod "a7004b6c-61a4-446c-bbe1-fb964134ec49" (UID: "a7004b6c-61a4-446c-bbe1-fb964134ec49"). InnerVolumeSpecName "kube-api-access-z6vsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.034174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "a7004b6c-61a4-446c-bbe1-fb964134ec49" (UID: "a7004b6c-61a4-446c-bbe1-fb964134ec49"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.050640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a7004b6c-61a4-446c-bbe1-fb964134ec49" (UID: "a7004b6c-61a4-446c-bbe1-fb964134ec49"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.066705 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data" (OuterVolumeSpecName: "config-data") pod "a7004b6c-61a4-446c-bbe1-fb964134ec49" (UID: "a7004b6c-61a4-446c-bbe1-fb964134ec49"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.128535 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6vsp\" (UniqueName: \"kubernetes.io/projected/a7004b6c-61a4-446c-bbe1-fb964134ec49-kube-api-access-z6vsp\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.128589 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.128602 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.128613 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/a7004b6c-61a4-446c-bbe1-fb964134ec49-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.642885 5030 generic.go:358] "Generic (PLEG): container finished" podID="dc7a4a11-683c-45f9-b43b-9939e548c6d8" containerID="34f543d18abeb72ac2ada43dcf7a7327e2865225bc87721ee9bf7a6c089c5be6" exitCode=0 Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.642996 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-45gq2" event={"ID":"dc7a4a11-683c-45f9-b43b-9939e548c6d8","Type":"ContainerDied","Data":"34f543d18abeb72ac2ada43dcf7a7327e2865225bc87721ee9bf7a6c089c5be6"} Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.645790 5030 generic.go:358] "Generic (PLEG): container finished" podID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerID="b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501" exitCode=0 Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.645876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerDied","Data":"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501"} Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.647950 5030 generic.go:358] "Generic (PLEG): container finished" podID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerID="e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367" exitCode=0 Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.647989 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerDied","Data":"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367"} Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.650579 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.650583 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-db-sync-r5vgh" event={"ID":"a7004b6c-61a4-446c-bbe1-fb964134ec49","Type":"ContainerDied","Data":"379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c"} Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.650792 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="379f643fadd22a9be24787cd522218161e710c381c1487a5e854fc1d303a098c" Mar 16 13:45:55 crc kubenswrapper[5030]: I0316 13:45:55.953529 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:45:55 crc kubenswrapper[5030]: E0316 13:45:55.953949 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.666874 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerStarted","Data":"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432"} Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.668462 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.671280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerStarted","Data":"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f"} Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.671839 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.703205 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-server-0" podStartSLOduration=36.703181174 podStartE2EDuration="36.703181174s" podCreationTimestamp="2026-03-16 13:45:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:56.700468653 +0000 UTC m=+2401.099781200" watchObservedRunningTime="2026-03-16 13:45:56.703181174 +0000 UTC m=+2401.102493722" Mar 16 13:45:56 crc kubenswrapper[5030]: I0316 13:45:56.728949 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podStartSLOduration=36.728934739 podStartE2EDuration="36.728934739s" podCreationTimestamp="2026-03-16 13:45:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:45:56.723744979 +0000 UTC m=+2401.123057536" watchObservedRunningTime="2026-03-16 13:45:56.728934739 +0000 UTC m=+2401.128247286" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.018223 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.076567 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts\") pod \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.076864 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnvsk\" (UniqueName: \"kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk\") pod \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\" (UID: \"dc7a4a11-683c-45f9-b43b-9939e548c6d8\") " Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.079915 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "dc7a4a11-683c-45f9-b43b-9939e548c6d8" (UID: "dc7a4a11-683c-45f9-b43b-9939e548c6d8"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.087163 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk" (OuterVolumeSpecName: "kube-api-access-wnvsk") pod "dc7a4a11-683c-45f9-b43b-9939e548c6d8" (UID: "dc7a4a11-683c-45f9-b43b-9939e548c6d8"). InnerVolumeSpecName "kube-api-access-wnvsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.100140 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.107029 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.140702 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.167118 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.178996 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/dc7a4a11-683c-45f9-b43b-9939e548c6d8-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.179121 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnvsk\" (UniqueName: \"kubernetes.io/projected/dc7a4a11-683c-45f9-b43b-9939e548c6d8-kube-api-access-wnvsk\") on node \"crc\" DevicePath \"\"" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.684530 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-45gq2" Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.684568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-45gq2" event={"ID":"dc7a4a11-683c-45f9-b43b-9939e548c6d8","Type":"ContainerDied","Data":"80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3"} Mar 16 13:45:57 crc kubenswrapper[5030]: I0316 13:45:57.684955 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a55f319036ef7f7a409e8e74e8d86d6aec4a754b32f35ef69b2b3ae49949c3" Mar 16 13:45:59 crc kubenswrapper[5030]: I0316 13:45:59.632764 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:45:59 crc kubenswrapper[5030]: I0316 13:45:59.680185 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:45:59 crc kubenswrapper[5030]: I0316 13:45:59.680414 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="dnsmasq-dns" containerID="cri-o://87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888" gracePeriod=10 Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.130024 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561146-vw9mc"] Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.130914 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7004b6c-61a4-446c-bbe1-fb964134ec49" containerName="glance-db-sync" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.130932 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7004b6c-61a4-446c-bbe1-fb964134ec49" containerName="glance-db-sync" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.130955 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7a4a11-683c-45f9-b43b-9939e548c6d8" containerName="mariadb-account-create-update" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.130962 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7a4a11-683c-45f9-b43b-9939e548c6d8" containerName="mariadb-account-create-update" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.131105 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7004b6c-61a4-446c-bbe1-fb964134ec49" containerName="glance-db-sync" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.131116 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc7a4a11-683c-45f9-b43b-9939e548c6d8" containerName="mariadb-account-create-update" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.135859 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.137424 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.137845 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.137985 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.141245 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561146-vw9mc"] Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.144375 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.250626 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc\") pod \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.251147 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config\") pod \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.251668 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9csc\" (UniqueName: \"kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc\") pod \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\" (UID: \"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485\") " Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.252670 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7dd\" (UniqueName: \"kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd\") pod \"auto-csr-approver-29561146-vw9mc\" (UID: \"d449f3fd-3527-43e3-9a22-bd0f47c772f4\") " pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.265853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc" (OuterVolumeSpecName: "kube-api-access-t9csc") pod "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" (UID: "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485"). InnerVolumeSpecName "kube-api-access-t9csc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.289410 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config" (OuterVolumeSpecName: "config") pod "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" (UID: "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.291185 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" (UID: "02e62f5e-a36f-4c1f-ac2c-526cbc4f7485"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.355401 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7dd\" (UniqueName: \"kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd\") pod \"auto-csr-approver-29561146-vw9mc\" (UID: \"d449f3fd-3527-43e3-9a22-bd0f47c772f4\") " pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.355823 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9csc\" (UniqueName: \"kubernetes.io/projected/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-kube-api-access-t9csc\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.355846 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.355860 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.372441 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7dd\" (UniqueName: \"kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd\") pod \"auto-csr-approver-29561146-vw9mc\" (UID: \"d449f3fd-3527-43e3-9a22-bd0f47c772f4\") " pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.464717 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.716436 5030 generic.go:358] "Generic (PLEG): container finished" podID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerID="87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888" exitCode=0 Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.716572 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" event={"ID":"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485","Type":"ContainerDied","Data":"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888"} Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.716896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" event={"ID":"02e62f5e-a36f-4c1f-ac2c-526cbc4f7485","Type":"ContainerDied","Data":"74419613a3c928a509a2593fd8b3e563d46b200ff3e88ae841bcaf54122a7913"} Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.716603 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.716931 5030 scope.go:117] "RemoveContainer" containerID="87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.737265 5030 scope.go:117] "RemoveContainer" containerID="76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.750511 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.758635 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-rkkxz"] Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.793668 5030 scope.go:117] "RemoveContainer" containerID="87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888" Mar 16 13:46:00 crc kubenswrapper[5030]: E0316 13:46:00.794432 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888\": container with ID starting with 87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888 not found: ID does not exist" containerID="87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.794483 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888"} err="failed to get container status \"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888\": rpc error: code = NotFound desc = could not find container \"87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888\": container with ID starting with 87178dbf62ba125449e5e58fd7d925eecae68df0a31b06f7aa486e4e23295888 not found: ID does not exist" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.794523 5030 scope.go:117] "RemoveContainer" containerID="76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e" Mar 16 13:46:00 crc kubenswrapper[5030]: E0316 13:46:00.796872 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e\": container with ID starting with 76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e not found: ID does not exist" containerID="76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.796921 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e"} err="failed to get container status \"76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e\": rpc error: code = NotFound desc = could not find container \"76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e\": container with ID starting with 76dc48fb69157bde09cff6b774bd77c79b949f1d4bb823c88418096a6e43af0e not found: ID does not exist" Mar 16 13:46:00 crc kubenswrapper[5030]: I0316 13:46:00.866374 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561146-vw9mc"] Mar 16 13:46:00 crc kubenswrapper[5030]: W0316 13:46:00.871290 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd449f3fd_3527_43e3_9a22_bd0f47c772f4.slice/crio-7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99 WatchSource:0}: Error finding container 7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99: Status 404 returned error can't find the container with id 7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99 Mar 16 13:46:01 crc kubenswrapper[5030]: I0316 13:46:01.730927 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" event={"ID":"d449f3fd-3527-43e3-9a22-bd0f47c772f4","Type":"ContainerStarted","Data":"7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99"} Mar 16 13:46:01 crc kubenswrapper[5030]: I0316 13:46:01.960284 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" path="/var/lib/kubelet/pods/02e62f5e-a36f-4c1f-ac2c-526cbc4f7485/volumes" Mar 16 13:46:02 crc kubenswrapper[5030]: I0316 13:46:02.748772 5030 generic.go:358] "Generic (PLEG): container finished" podID="d449f3fd-3527-43e3-9a22-bd0f47c772f4" containerID="ba32e3f1fa95c54997db3a7f3722c7cf0585fc888d3bd4a9d2b3c28b2c0aaef3" exitCode=0 Mar 16 13:46:02 crc kubenswrapper[5030]: I0316 13:46:02.748819 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" event={"ID":"d449f3fd-3527-43e3-9a22-bd0f47c772f4","Type":"ContainerDied","Data":"ba32e3f1fa95c54997db3a7f3722c7cf0585fc888d3bd4a9d2b3c28b2c0aaef3"} Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.084650 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.234391 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq7dd\" (UniqueName: \"kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd\") pod \"d449f3fd-3527-43e3-9a22-bd0f47c772f4\" (UID: \"d449f3fd-3527-43e3-9a22-bd0f47c772f4\") " Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.241501 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd" (OuterVolumeSpecName: "kube-api-access-qq7dd") pod "d449f3fd-3527-43e3-9a22-bd0f47c772f4" (UID: "d449f3fd-3527-43e3-9a22-bd0f47c772f4"). InnerVolumeSpecName "kube-api-access-qq7dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.336661 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq7dd\" (UniqueName: \"kubernetes.io/projected/d449f3fd-3527-43e3-9a22-bd0f47c772f4-kube-api-access-qq7dd\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.778109 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.778117 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561146-vw9mc" event={"ID":"d449f3fd-3527-43e3-9a22-bd0f47c772f4","Type":"ContainerDied","Data":"7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99"} Mar 16 13:46:04 crc kubenswrapper[5030]: I0316 13:46:04.778588 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7baacf9922c2abdef4b864112011dfd5eaf63f32eac7dff8ab104053dc887d99" Mar 16 13:46:05 crc kubenswrapper[5030]: I0316 13:46:05.166543 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561140-5l6vr"] Mar 16 13:46:05 crc kubenswrapper[5030]: I0316 13:46:05.175391 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561140-5l6vr"] Mar 16 13:46:05 crc kubenswrapper[5030]: I0316 13:46:05.956228 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab88cf12-1d1a-4467-be46-59018f5ce7d8" path="/var/lib/kubelet/pods/ab88cf12-1d1a-4467-be46-59018f5ce7d8/volumes" Mar 16 13:46:06 crc kubenswrapper[5030]: I0316 13:46:06.945866 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:46:06 crc kubenswrapper[5030]: E0316 13:46:06.946581 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:46:07 crc kubenswrapper[5030]: I0316 13:46:07.688778 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:46:07 crc kubenswrapper[5030]: I0316 13:46:07.689201 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.160582 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bdns7"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161464 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="init" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161484 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="init" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161509 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="dnsmasq-dns" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161517 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="dnsmasq-dns" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161538 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d449f3fd-3527-43e3-9a22-bd0f47c772f4" containerName="oc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161544 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d449f3fd-3527-43e3-9a22-bd0f47c772f4" containerName="oc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161742 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="02e62f5e-a36f-4c1f-ac2c-526cbc4f7485" containerName="dnsmasq-dns" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.161762 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d449f3fd-3527-43e3-9a22-bd0f47c772f4" containerName="oc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.166534 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.178226 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bdns7"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.235873 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf699\" (UniqueName: \"kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.236358 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.265025 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.268611 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.271989 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-db-secret\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.279883 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.337871 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g759\" (UniqueName: \"kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.337923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sf699\" (UniqueName: \"kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.338119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.338200 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.338791 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.361297 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-create-9rf58"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.366630 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf699\" (UniqueName: \"kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699\") pod \"cinder-db-create-bdns7\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.367526 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.380497 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-9rf58"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.440103 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g759\" (UniqueName: \"kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.440276 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.440346 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.440462 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmx2p\" (UniqueName: \"kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.441644 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.460956 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-create-d9wp5"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.469771 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g759\" (UniqueName: \"kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759\") pod \"cinder-f3e7-account-create-update-88mb9\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.470156 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.474831 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-d9wp5"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.474933 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.475509 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.477996 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.480479 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.502068 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.537458 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-j2clz"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.542893 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmx2p\" (UniqueName: \"kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.544560 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbddg\" (UniqueName: \"kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.545705 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.549728 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9m4\" (UniqueName: \"kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.549842 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.549988 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.552415 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.565316 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.569951 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-j2clz"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.573043 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.573378 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.573422 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.573435 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-vh8nj\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.574722 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmx2p\" (UniqueName: \"kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p\") pod \"neutron-db-create-9rf58\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.584613 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.585921 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.614527 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8"] Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.614688 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.618293 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657212 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbddg\" (UniqueName: \"kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657655 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9m4\" (UniqueName: \"kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657798 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657826 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657870 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657899 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgx5v\" (UniqueName: \"kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.657953 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68khl\" (UniqueName: \"kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.658335 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.658870 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.677833 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbddg\" (UniqueName: \"kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg\") pod \"barbican-db-create-d9wp5\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.679700 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9m4\" (UniqueName: \"kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4\") pod \"barbican-f18e-account-create-update-wmxpc\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.697636 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.759860 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68khl\" (UniqueName: \"kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.760076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.760130 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.760178 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.760207 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgx5v\" (UniqueName: \"kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.761428 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.766197 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.773518 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.778058 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgx5v\" (UniqueName: \"kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v\") pod \"neutron-6528-account-create-update-qz5s8\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.780673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68khl\" (UniqueName: \"kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl\") pod \"keystone-db-sync-j2clz\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.907679 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.915070 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.951845 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:09 crc kubenswrapper[5030]: I0316 13:46:09.968889 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.005227 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bdns7"] Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.098701 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9"] Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.175085 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-9rf58"] Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.356218 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc"] Mar 16 13:46:10 crc kubenswrapper[5030]: W0316 13:46:10.368217 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode456a925_fab1_441b_a24b_78f1625e2c6d.slice/crio-67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46 WatchSource:0}: Error finding container 67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46: Status 404 returned error can't find the container with id 67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46 Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.415878 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-d9wp5"] Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.543526 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8"] Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.550684 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-j2clz"] Mar 16 13:46:10 crc kubenswrapper[5030]: W0316 13:46:10.603973 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8771434_e9f7_4da1_add8_6c9ccef64ea9.slice/crio-a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a WatchSource:0}: Error finding container a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a: Status 404 returned error can't find the container with id a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a Mar 16 13:46:10 crc kubenswrapper[5030]: W0316 13:46:10.650474 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97ed19e7_208e_4e6f_817f_aab6967f9c76.slice/crio-9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f WatchSource:0}: Error finding container 9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f: Status 404 returned error can't find the container with id 9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.843872 5030 generic.go:358] "Generic (PLEG): container finished" podID="b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" containerID="e6baa12be0b98a6230e7c6900cb93a3be034870475c4f6291c0185ade25ac2f1" exitCode=0 Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.843966 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bdns7" event={"ID":"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4","Type":"ContainerDied","Data":"e6baa12be0b98a6230e7c6900cb93a3be034870475c4f6291c0185ade25ac2f1"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.844239 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bdns7" event={"ID":"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4","Type":"ContainerStarted","Data":"1b6d2e8fb574df99abc0044f0c290bfea738f378db4d59abe7e6d4e6b94bb87f"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.845815 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" event={"ID":"c8771434-e9f7-4da1-add8-6c9ccef64ea9","Type":"ContainerStarted","Data":"dc17b375819ccb3599f6ea75b11c64b63e907caee28a8f084907caea41263b30"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.845857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" event={"ID":"c8771434-e9f7-4da1-add8-6c9ccef64ea9","Type":"ContainerStarted","Data":"a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.847716 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" event={"ID":"f0610696-b8aa-423b-8b74-76b4c0f841a4","Type":"ContainerStarted","Data":"72496ec6dd12b61aba860304bf8bd0d30f519f5f1ba7600b9a40adc5bf9f0f70"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.847771 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" event={"ID":"f0610696-b8aa-423b-8b74-76b4c0f841a4","Type":"ContainerStarted","Data":"0cc819e3be5a487acc6cff83c7f1b29090c43c78f7c48a91721881389f41beea"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.849322 5030 generic.go:358] "Generic (PLEG): container finished" podID="51430a79-d9c7-4738-8de8-a381007a813d" containerID="35877326fcabc628d8b7f82c91e5dd8a3bf01a5798854ebdac1c27be6a853cda" exitCode=0 Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.849454 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" event={"ID":"51430a79-d9c7-4738-8de8-a381007a813d","Type":"ContainerDied","Data":"35877326fcabc628d8b7f82c91e5dd8a3bf01a5798854ebdac1c27be6a853cda"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.849607 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" event={"ID":"51430a79-d9c7-4738-8de8-a381007a813d","Type":"ContainerStarted","Data":"362b74f90f58a3b4824ba22e5b515f24189764326216092aa466e10089164d81"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.851353 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" event={"ID":"97ed19e7-208e-4e6f-817f-aab6967f9c76","Type":"ContainerStarted","Data":"7e6dec1a00efa9e3b419c9e35e6a73669aa06c5a072a5af2bd948370e3857cc1"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.851383 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" event={"ID":"97ed19e7-208e-4e6f-817f-aab6967f9c76","Type":"ContainerStarted","Data":"9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.853135 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" event={"ID":"e456a925-fab1-441b-a24b-78f1625e2c6d","Type":"ContainerStarted","Data":"06cf6e0e6e77605851e5d669badc9f365e14f0651549f5fdd1a561e045d94ae2"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.853166 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" event={"ID":"e456a925-fab1-441b-a24b-78f1625e2c6d","Type":"ContainerStarted","Data":"67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.855314 5030 generic.go:358] "Generic (PLEG): container finished" podID="785604e1-c89a-461b-9d6c-acb054a9d884" containerID="d9ae0bfc027c7f6d2e494401276f154ac533aec68bce8f72171aca8fda570793" exitCode=0 Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.855345 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-9rf58" event={"ID":"785604e1-c89a-461b-9d6c-acb054a9d884","Type":"ContainerDied","Data":"d9ae0bfc027c7f6d2e494401276f154ac533aec68bce8f72171aca8fda570793"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.855388 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-9rf58" event={"ID":"785604e1-c89a-461b-9d6c-acb054a9d884","Type":"ContainerStarted","Data":"0d491934fc014f8994efdf49bb7057e7c0efb8f3d023da0fe3f4048c7f2cd5ec"} Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.877981 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" podStartSLOduration=1.877962998 podStartE2EDuration="1.877962998s" podCreationTimestamp="2026-03-16 13:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:10.872391869 +0000 UTC m=+2415.271704417" watchObservedRunningTime="2026-03-16 13:46:10.877962998 +0000 UTC m=+2415.277275545" Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.892396 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" podStartSLOduration=1.892379269 podStartE2EDuration="1.892379269s" podCreationTimestamp="2026-03-16 13:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:10.886632382 +0000 UTC m=+2415.285944929" watchObservedRunningTime="2026-03-16 13:46:10.892379269 +0000 UTC m=+2415.291691817" Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.970390 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" podStartSLOduration=1.970374846 podStartE2EDuration="1.970374846s" podCreationTimestamp="2026-03-16 13:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:10.969176123 +0000 UTC m=+2415.368488669" watchObservedRunningTime="2026-03-16 13:46:10.970374846 +0000 UTC m=+2415.369687393" Mar 16 13:46:10 crc kubenswrapper[5030]: I0316 13:46:10.973309 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" podStartSLOduration=1.973295419 podStartE2EDuration="1.973295419s" podCreationTimestamp="2026-03-16 13:46:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:10.947414906 +0000 UTC m=+2415.346727453" watchObservedRunningTime="2026-03-16 13:46:10.973295419 +0000 UTC m=+2415.372607967" Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.867032 5030 generic.go:358] "Generic (PLEG): container finished" podID="e456a925-fab1-441b-a24b-78f1625e2c6d" containerID="06cf6e0e6e77605851e5d669badc9f365e14f0651549f5fdd1a561e045d94ae2" exitCode=0 Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.867086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" event={"ID":"e456a925-fab1-441b-a24b-78f1625e2c6d","Type":"ContainerDied","Data":"06cf6e0e6e77605851e5d669badc9f365e14f0651549f5fdd1a561e045d94ae2"} Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.869674 5030 generic.go:358] "Generic (PLEG): container finished" podID="c8771434-e9f7-4da1-add8-6c9ccef64ea9" containerID="dc17b375819ccb3599f6ea75b11c64b63e907caee28a8f084907caea41263b30" exitCode=0 Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.869781 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" event={"ID":"c8771434-e9f7-4da1-add8-6c9ccef64ea9","Type":"ContainerDied","Data":"dc17b375819ccb3599f6ea75b11c64b63e907caee28a8f084907caea41263b30"} Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.871789 5030 generic.go:358] "Generic (PLEG): container finished" podID="f0610696-b8aa-423b-8b74-76b4c0f841a4" containerID="72496ec6dd12b61aba860304bf8bd0d30f519f5f1ba7600b9a40adc5bf9f0f70" exitCode=0 Mar 16 13:46:11 crc kubenswrapper[5030]: I0316 13:46:11.871806 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" event={"ID":"f0610696-b8aa-423b-8b74-76b4c0f841a4","Type":"ContainerDied","Data":"72496ec6dd12b61aba860304bf8bd0d30f519f5f1ba7600b9a40adc5bf9f0f70"} Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.291159 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.300880 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.317970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.419838 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts\") pod \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.419978 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts\") pod \"785604e1-c89a-461b-9d6c-acb054a9d884\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420215 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmx2p\" (UniqueName: \"kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p\") pod \"785604e1-c89a-461b-9d6c-acb054a9d884\" (UID: \"785604e1-c89a-461b-9d6c-acb054a9d884\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420264 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts\") pod \"51430a79-d9c7-4738-8de8-a381007a813d\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420423 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "785604e1-c89a-461b-9d6c-acb054a9d884" (UID: "785604e1-c89a-461b-9d6c-acb054a9d884"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g759\" (UniqueName: \"kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759\") pod \"51430a79-d9c7-4738-8de8-a381007a813d\" (UID: \"51430a79-d9c7-4738-8de8-a381007a813d\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" (UID: "b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.420620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf699\" (UniqueName: \"kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699\") pod \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\" (UID: \"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4\") " Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.421142 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "51430a79-d9c7-4738-8de8-a381007a813d" (UID: "51430a79-d9c7-4738-8de8-a381007a813d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.421580 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/51430a79-d9c7-4738-8de8-a381007a813d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.421608 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.421621 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/785604e1-c89a-461b-9d6c-acb054a9d884-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.428614 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699" (OuterVolumeSpecName: "kube-api-access-sf699") pod "b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" (UID: "b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4"). InnerVolumeSpecName "kube-api-access-sf699". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.429655 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759" (OuterVolumeSpecName: "kube-api-access-4g759") pod "51430a79-d9c7-4738-8de8-a381007a813d" (UID: "51430a79-d9c7-4738-8de8-a381007a813d"). InnerVolumeSpecName "kube-api-access-4g759". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.450418 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p" (OuterVolumeSpecName: "kube-api-access-qmx2p") pod "785604e1-c89a-461b-9d6c-acb054a9d884" (UID: "785604e1-c89a-461b-9d6c-acb054a9d884"). InnerVolumeSpecName "kube-api-access-qmx2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.522893 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmx2p\" (UniqueName: \"kubernetes.io/projected/785604e1-c89a-461b-9d6c-acb054a9d884-kube-api-access-qmx2p\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.522924 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g759\" (UniqueName: \"kubernetes.io/projected/51430a79-d9c7-4738-8de8-a381007a813d-kube-api-access-4g759\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.522936 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf699\" (UniqueName: \"kubernetes.io/projected/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4-kube-api-access-sf699\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.890624 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" event={"ID":"51430a79-d9c7-4738-8de8-a381007a813d","Type":"ContainerDied","Data":"362b74f90f58a3b4824ba22e5b515f24189764326216092aa466e10089164d81"} Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.890691 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="362b74f90f58a3b4824ba22e5b515f24189764326216092aa466e10089164d81" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.890706 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.893597 5030 generic.go:358] "Generic (PLEG): container finished" podID="97ed19e7-208e-4e6f-817f-aab6967f9c76" containerID="7e6dec1a00efa9e3b419c9e35e6a73669aa06c5a072a5af2bd948370e3857cc1" exitCode=0 Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.893654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" event={"ID":"97ed19e7-208e-4e6f-817f-aab6967f9c76","Type":"ContainerDied","Data":"7e6dec1a00efa9e3b419c9e35e6a73669aa06c5a072a5af2bd948370e3857cc1"} Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.896218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-create-9rf58" event={"ID":"785604e1-c89a-461b-9d6c-acb054a9d884","Type":"ContainerDied","Data":"0d491934fc014f8994efdf49bb7057e7c0efb8f3d023da0fe3f4048c7f2cd5ec"} Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.896250 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d491934fc014f8994efdf49bb7057e7c0efb8f3d023da0fe3f4048c7f2cd5ec" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.896267 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-create-9rf58" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.897964 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-create-bdns7" Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.897966 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-create-bdns7" event={"ID":"b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4","Type":"ContainerDied","Data":"1b6d2e8fb574df99abc0044f0c290bfea738f378db4d59abe7e6d4e6b94bb87f"} Mar 16 13:46:12 crc kubenswrapper[5030]: I0316 13:46:12.898118 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b6d2e8fb574df99abc0044f0c290bfea738f378db4d59abe7e6d4e6b94bb87f" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.171732 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.239636 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.242291 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts\") pod \"f0610696-b8aa-423b-8b74-76b4c0f841a4\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.242881 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f0610696-b8aa-423b-8b74-76b4c0f841a4" (UID: "f0610696-b8aa-423b-8b74-76b4c0f841a4"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.242897 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbddg\" (UniqueName: \"kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg\") pod \"f0610696-b8aa-423b-8b74-76b4c0f841a4\" (UID: \"f0610696-b8aa-423b-8b74-76b4c0f841a4\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.243526 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f0610696-b8aa-423b-8b74-76b4c0f841a4-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.244919 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.247412 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg" (OuterVolumeSpecName: "kube-api-access-vbddg") pod "f0610696-b8aa-423b-8b74-76b4c0f841a4" (UID: "f0610696-b8aa-423b-8b74-76b4c0f841a4"). InnerVolumeSpecName "kube-api-access-vbddg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.345481 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgx5v\" (UniqueName: \"kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v\") pod \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.345865 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts\") pod \"e456a925-fab1-441b-a24b-78f1625e2c6d\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.346467 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts\") pod \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\" (UID: \"c8771434-e9f7-4da1-add8-6c9ccef64ea9\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.346415 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e456a925-fab1-441b-a24b-78f1625e2c6d" (UID: "e456a925-fab1-441b-a24b-78f1625e2c6d"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.346914 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf9m4\" (UniqueName: \"kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4\") pod \"e456a925-fab1-441b-a24b-78f1625e2c6d\" (UID: \"e456a925-fab1-441b-a24b-78f1625e2c6d\") " Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.346916 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "c8771434-e9f7-4da1-add8-6c9ccef64ea9" (UID: "c8771434-e9f7-4da1-add8-6c9ccef64ea9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.348015 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbddg\" (UniqueName: \"kubernetes.io/projected/f0610696-b8aa-423b-8b74-76b4c0f841a4-kube-api-access-vbddg\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.348113 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e456a925-fab1-441b-a24b-78f1625e2c6d-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.348314 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c8771434-e9f7-4da1-add8-6c9ccef64ea9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.349224 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v" (OuterVolumeSpecName: "kube-api-access-zgx5v") pod "c8771434-e9f7-4da1-add8-6c9ccef64ea9" (UID: "c8771434-e9f7-4da1-add8-6c9ccef64ea9"). InnerVolumeSpecName "kube-api-access-zgx5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.351189 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4" (OuterVolumeSpecName: "kube-api-access-rf9m4") pod "e456a925-fab1-441b-a24b-78f1625e2c6d" (UID: "e456a925-fab1-441b-a24b-78f1625e2c6d"). InnerVolumeSpecName "kube-api-access-rf9m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.451516 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgx5v\" (UniqueName: \"kubernetes.io/projected/c8771434-e9f7-4da1-add8-6c9ccef64ea9-kube-api-access-zgx5v\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.451576 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf9m4\" (UniqueName: \"kubernetes.io/projected/e456a925-fab1-441b-a24b-78f1625e2c6d-kube-api-access-rf9m4\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.913273 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.913320 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8" event={"ID":"c8771434-e9f7-4da1-add8-6c9ccef64ea9","Type":"ContainerDied","Data":"a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a"} Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.913371 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a563ed0fd149e559a50f85b6fe993a8136c8d8c159c2eaa2ff06956ba4f98a2a" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.916684 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.916718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-create-d9wp5" event={"ID":"f0610696-b8aa-423b-8b74-76b4c0f841a4","Type":"ContainerDied","Data":"0cc819e3be5a487acc6cff83c7f1b29090c43c78f7c48a91721881389f41beea"} Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.916769 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cc819e3be5a487acc6cff83c7f1b29090c43c78f7c48a91721881389f41beea" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.918528 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.918524 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc" event={"ID":"e456a925-fab1-441b-a24b-78f1625e2c6d","Type":"ContainerDied","Data":"67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46"} Mar 16 13:46:13 crc kubenswrapper[5030]: I0316 13:46:13.918710 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67ed2882f9b6a918d46ca6173555bceeb72bcd77f052334430233dfea2ae2c46" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.208481 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.371065 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68khl\" (UniqueName: \"kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl\") pod \"97ed19e7-208e-4e6f-817f-aab6967f9c76\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.371150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle\") pod \"97ed19e7-208e-4e6f-817f-aab6967f9c76\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.371221 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data\") pod \"97ed19e7-208e-4e6f-817f-aab6967f9c76\" (UID: \"97ed19e7-208e-4e6f-817f-aab6967f9c76\") " Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.378335 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl" (OuterVolumeSpecName: "kube-api-access-68khl") pod "97ed19e7-208e-4e6f-817f-aab6967f9c76" (UID: "97ed19e7-208e-4e6f-817f-aab6967f9c76"). InnerVolumeSpecName "kube-api-access-68khl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.395093 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "97ed19e7-208e-4e6f-817f-aab6967f9c76" (UID: "97ed19e7-208e-4e6f-817f-aab6967f9c76"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.434249 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data" (OuterVolumeSpecName: "config-data") pod "97ed19e7-208e-4e6f-817f-aab6967f9c76" (UID: "97ed19e7-208e-4e6f-817f-aab6967f9c76"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.474413 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68khl\" (UniqueName: \"kubernetes.io/projected/97ed19e7-208e-4e6f-817f-aab6967f9c76-kube-api-access-68khl\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.474436 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.474447 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/97ed19e7-208e-4e6f-817f-aab6967f9c76-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.947688 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.947676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-db-sync-j2clz" event={"ID":"97ed19e7-208e-4e6f-817f-aab6967f9c76","Type":"ContainerDied","Data":"9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f"} Mar 16 13:46:14 crc kubenswrapper[5030]: I0316 13:46:14.947959 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9af1889ff73c5d6782b59880ec4af69a666244cb22ed5b64a3d927e762547d1f" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.103632 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-w8hwk"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104385 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104403 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104411 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ed19e7-208e-4e6f-817f-aab6967f9c76" containerName="keystone-db-sync" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104417 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ed19e7-208e-4e6f-817f-aab6967f9c76" containerName="keystone-db-sync" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104445 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785604e1-c89a-461b-9d6c-acb054a9d884" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104452 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="785604e1-c89a-461b-9d6c-acb054a9d884" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104470 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e456a925-fab1-441b-a24b-78f1625e2c6d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104477 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e456a925-fab1-441b-a24b-78f1625e2c6d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104487 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51430a79-d9c7-4738-8de8-a381007a813d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104492 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="51430a79-d9c7-4738-8de8-a381007a813d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104517 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0610696-b8aa-423b-8b74-76b4c0f841a4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104523 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0610696-b8aa-423b-8b74-76b4c0f841a4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104530 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8771434-e9f7-4da1-add8-6c9ccef64ea9" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104534 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8771434-e9f7-4da1-add8-6c9ccef64ea9" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104673 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f0610696-b8aa-423b-8b74-76b4c0f841a4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104683 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104692 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="785604e1-c89a-461b-9d6c-acb054a9d884" containerName="mariadb-database-create" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104699 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e456a925-fab1-441b-a24b-78f1625e2c6d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104710 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="97ed19e7-208e-4e6f-817f-aab6967f9c76" containerName="keystone-db-sync" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104716 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8771434-e9f7-4da1-add8-6c9ccef64ea9" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.104725 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="51430a79-d9c7-4738-8de8-a381007a813d" containerName="mariadb-account-create-update" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.108754 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.111892 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.112076 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.112219 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.112519 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.112756 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-vh8nj\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.120085 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-w8hwk"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.268207 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mkrb2"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.274041 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.288350 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.288508 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.288590 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-jqmd7\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.293616 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mkrb2"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297231 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297328 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297408 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5xp5\" (UniqueName: \"kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297441 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.297629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.347100 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-db-sync-878g8"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.351210 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-22qdg"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.354877 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.355433 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.357978 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-config-data\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.358193 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.358481 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-xzjgx\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.358561 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-cinder-dockercfg-52lsq\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.358654 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scripts\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.365618 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-22qdg"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.370924 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-878g8"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.376785 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.384607 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.390528 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.391142 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.392936 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.399142 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401204 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401251 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401309 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401324 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5xp5\" (UniqueName: \"kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.401406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402015 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402077 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgrbm\" (UniqueName: \"kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402170 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkzs2\" (UniqueName: \"kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402253 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402405 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402487 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.402624 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.404943 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.404980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405019 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405241 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405300 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405370 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dz9\" (UniqueName: \"kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405390 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405523 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hn5\" (UniqueName: \"kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405592 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405628 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.405646 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.407673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.409327 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.409398 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.411436 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.415120 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.419075 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5xp5\" (UniqueName: \"kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5\") pod \"keystone-bootstrap-w8hwk\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.426219 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.494830 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqdxv"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.500463 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.502853 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-bcwgg\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.504288 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.507892 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.507956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.507980 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgrbm\" (UniqueName: \"kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508123 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkzs2\" (UniqueName: \"kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508154 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508188 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508212 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508241 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508286 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508384 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508408 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vvv\" (UniqueName: \"kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508431 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508466 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508508 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45dz9\" (UniqueName: \"kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508529 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55hn5\" (UniqueName: \"kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508666 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508684 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508740 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.508769 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.511045 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.513311 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.514710 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.515490 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.516276 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.524874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.524938 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqdxv"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.526998 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.531352 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.531630 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.531743 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.533098 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.534318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkzs2\" (UniqueName: \"kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.535280 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.535288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.535771 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.538195 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgrbm\" (UniqueName: \"kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm\") pod \"neutron-db-sync-mkrb2\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.538238 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.539072 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dz9\" (UniqueName: \"kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.539920 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.540638 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hn5\" (UniqueName: \"kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5\") pod \"placement-db-sync-878g8\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.548785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts\") pod \"cinder-db-sync-22qdg\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.596351 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.610470 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.610563 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vvv\" (UniqueName: \"kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.610702 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.615729 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.616107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.630036 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vvv\" (UniqueName: \"kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv\") pod \"barbican-db-sync-cqdxv\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.682113 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.690756 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.703167 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.910809 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.913062 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-w8hwk"] Mar 16 13:46:15 crc kubenswrapper[5030]: I0316 13:46:15.976259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" event={"ID":"cd67ef6d-add0-436d-b8be-286412496892","Type":"ContainerStarted","Data":"1f13d81ae9e8fe681dae98ff36030a99e5416c02ba61e51315166e39594dbcf8"} Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.046629 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mkrb2"] Mar 16 13:46:16 crc kubenswrapper[5030]: W0316 13:46:16.054753 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd80ea153_6106_465b_98fc_cf8c8c6f3ec3.slice/crio-e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607 WatchSource:0}: Error finding container e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607: Status 404 returned error can't find the container with id e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607 Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.146534 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-22qdg"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.194096 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.203993 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.210926 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.215509 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-scripts\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.215746 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.215564 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.216071 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.216259 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-glance-dockercfg-2z57w\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.231872 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.231932 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232063 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwqlr\" (UniqueName: \"kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232125 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232153 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232180 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.232303 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.280803 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.290630 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.290760 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.293200 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.293276 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.296568 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-878g8"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.339851 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.340163 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348567 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348725 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348785 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwqlr\" (UniqueName: \"kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348882 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348909 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.348961 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.349133 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.351995 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.352113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.356107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.357559 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.359030 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.366959 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.369582 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.369868 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwqlr\" (UniqueName: \"kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr\") pod \"glance-default-external-api-0\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.385560 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqdxv"] Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461115 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461595 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461625 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461682 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjll\" (UniqueName: \"kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461852 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.461935 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.462015 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.527834 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564344 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564435 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564533 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564570 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564602 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjll\" (UniqueName: \"kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564694 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.564742 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.565635 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.565882 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.565994 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.576301 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.576702 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.577606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.579774 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.587814 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjll\" (UniqueName: \"kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.603785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:16 crc kubenswrapper[5030]: I0316 13:46:16.906518 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.016436 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.033588 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" event={"ID":"cd67ef6d-add0-436d-b8be-286412496892","Type":"ContainerStarted","Data":"ec1d328c918e092fdf003c485c23cf8144f1c2ccef88ab5f9a30bb365d0395a7"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.052119 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" event={"ID":"faccda56-3b06-407e-8265-dcd18d9b8283","Type":"ContainerStarted","Data":"1cc3f77a4586b11d2e14e46782e5fb57ff440e6778fe9a81dc219c2326680988"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.052154 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" event={"ID":"faccda56-3b06-407e-8265-dcd18d9b8283","Type":"ContainerStarted","Data":"2bae4188ed0b4cb47433f6f421d150a999beada4f404cb03be807a55a1fd9146"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.075020 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerStarted","Data":"ab8eab92b8f132b62a77d91ee55a83c6febd84fdc0451fdfd9139bb333e589fd"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.069123 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" podStartSLOduration=2.069110092 podStartE2EDuration="2.069110092s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:17.064859589 +0000 UTC m=+2421.464172135" watchObservedRunningTime="2026-03-16 13:46:17.069110092 +0000 UTC m=+2421.468422650" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.096029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-878g8" event={"ID":"1a55e3ee-2333-465c-93e6-f4beb09d6b3f","Type":"ContainerStarted","Data":"4b4ca9717a2a77f7757b200110b8e7eb5335f3246cf8753c3fd2907cadae25a3"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.096072 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-878g8" event={"ID":"1a55e3ee-2333-465c-93e6-f4beb09d6b3f","Type":"ContainerStarted","Data":"4da02de8f903c6cbdd0e24cdd208b4d0cdddcb4daf32f438ea7f2f3496de76c3"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.104723 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.117686 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" podStartSLOduration=2.117665882 podStartE2EDuration="2.117665882s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:17.08510272 +0000 UTC m=+2421.484415258" watchObservedRunningTime="2026-03-16 13:46:17.117665882 +0000 UTC m=+2421.516978420" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.118513 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" event={"ID":"fcba89fa-970e-49c4-887a-2b253d4c535a","Type":"ContainerStarted","Data":"185166b155784a9ba495ee2b310dfa73693c2268af5a520b15bdf7ab74d35953"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.118582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" event={"ID":"fcba89fa-970e-49c4-887a-2b253d4c535a","Type":"ContainerStarted","Data":"5a9ebdbf047aa036a3f527e724d9410f9d41107f5b4cc9c684def6036ca56594"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.139123 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" event={"ID":"d80ea153-6106-465b-98fc-cf8c8c6f3ec3","Type":"ContainerStarted","Data":"b0d122fbb6c976f7fde39ab30ae914b7076aa4f825738d6d3615f339809f591f"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.139180 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" event={"ID":"d80ea153-6106-465b-98fc-cf8c8c6f3ec3","Type":"ContainerStarted","Data":"e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607"} Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.146286 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-db-sync-878g8" podStartSLOduration=2.146267744 podStartE2EDuration="2.146267744s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:17.118072407 +0000 UTC m=+2421.517384954" watchObservedRunningTime="2026-03-16 13:46:17.146267744 +0000 UTC m=+2421.545580291" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.177782 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" podStartSLOduration=2.177756455 podStartE2EDuration="2.177756455s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:17.142387786 +0000 UTC m=+2421.541700333" watchObservedRunningTime="2026-03-16 13:46:17.177756455 +0000 UTC m=+2421.577069012" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.205864 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.207756 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" podStartSLOduration=2.207744403 podStartE2EDuration="2.207744403s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:17.165352856 +0000 UTC m=+2421.564665394" watchObservedRunningTime="2026-03-16 13:46:17.207744403 +0000 UTC m=+2421.607056940" Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.220026 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:17 crc kubenswrapper[5030]: I0316 13:46:17.379575 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:18 crc kubenswrapper[5030]: I0316 13:46:18.162349 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerStarted","Data":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} Mar 16 13:46:18 crc kubenswrapper[5030]: I0316 13:46:18.179880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerStarted","Data":"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8"} Mar 16 13:46:18 crc kubenswrapper[5030]: I0316 13:46:18.179933 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerStarted","Data":"5beb00ea709771bbc387f172707e8c131313fde3323c600ddf803406b9c64fa9"} Mar 16 13:46:18 crc kubenswrapper[5030]: I0316 13:46:18.194921 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerStarted","Data":"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7"} Mar 16 13:46:18 crc kubenswrapper[5030]: I0316 13:46:18.194998 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerStarted","Data":"ac2c26c454ff1d4157c7380e9374cc79a0cf4ec98672bd192157e5049a8e56c1"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.211427 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerStarted","Data":"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.211664 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-log" containerID="cri-o://55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" gracePeriod=30 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.211728 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-httpd" containerID="cri-o://6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" gracePeriod=30 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.223388 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerStarted","Data":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.223451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerStarted","Data":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.229676 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerStarted","Data":"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.229869 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-log" containerID="cri-o://f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" gracePeriod=30 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.229918 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-httpd" containerID="cri-o://38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" gracePeriod=30 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.244595 5030 generic.go:358] "Generic (PLEG): container finished" podID="1a55e3ee-2333-465c-93e6-f4beb09d6b3f" containerID="4b4ca9717a2a77f7757b200110b8e7eb5335f3246cf8753c3fd2907cadae25a3" exitCode=0 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.244691 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-878g8" event={"ID":"1a55e3ee-2333-465c-93e6-f4beb09d6b3f","Type":"ContainerDied","Data":"4b4ca9717a2a77f7757b200110b8e7eb5335f3246cf8753c3fd2907cadae25a3"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.245043 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=4.245032503 podStartE2EDuration="4.245032503s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:19.238908936 +0000 UTC m=+2423.638221482" watchObservedRunningTime="2026-03-16 13:46:19.245032503 +0000 UTC m=+2423.644345050" Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.248075 5030 generic.go:358] "Generic (PLEG): container finished" podID="fcba89fa-970e-49c4-887a-2b253d4c535a" containerID="185166b155784a9ba495ee2b310dfa73693c2268af5a520b15bdf7ab74d35953" exitCode=0 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.248347 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" event={"ID":"fcba89fa-970e-49c4-887a-2b253d4c535a","Type":"ContainerDied","Data":"185166b155784a9ba495ee2b310dfa73693c2268af5a520b15bdf7ab74d35953"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.251809 5030 generic.go:358] "Generic (PLEG): container finished" podID="cd67ef6d-add0-436d-b8be-286412496892" containerID="ec1d328c918e092fdf003c485c23cf8144f1c2ccef88ab5f9a30bb365d0395a7" exitCode=0 Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.251857 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" event={"ID":"cd67ef6d-add0-436d-b8be-286412496892","Type":"ContainerDied","Data":"ec1d328c918e092fdf003c485c23cf8144f1c2ccef88ab5f9a30bb365d0395a7"} Mar 16 13:46:19 crc kubenswrapper[5030]: I0316 13:46:19.259218 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.25921234 podStartE2EDuration="4.25921234s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:19.257672756 +0000 UTC m=+2423.656985303" watchObservedRunningTime="2026-03-16 13:46:19.25921234 +0000 UTC m=+2423.658524888" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.050511 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.132848 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162228 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162341 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162493 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162542 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162614 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162801 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162868 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.162974 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwqlr\" (UniqueName: \"kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr\") pod \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\" (UID: \"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.163299 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.163325 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs" (OuterVolumeSpecName: "logs") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.163653 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.163675 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.172113 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts" (OuterVolumeSpecName: "scripts") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.175329 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.178210 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr" (OuterVolumeSpecName: "kube-api-access-vwqlr") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "kube-api-access-vwqlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.196690 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.210544 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data" (OuterVolumeSpecName: "config-data") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.219393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" (UID: "d67fdbd2-8b2a-4f26-b9ad-44c01f44b106"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.264814 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265257 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265536 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265613 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265661 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvjll\" (UniqueName: \"kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265763 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.265839 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data\") pod \"198a48d1-2b1b-40b0-a93d-02669549ad83\" (UID: \"198a48d1-2b1b-40b0-a93d-02669549ad83\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266807 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266825 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266852 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266864 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwqlr\" (UniqueName: \"kubernetes.io/projected/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-kube-api-access-vwqlr\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266874 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.266882 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.268909 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts" (OuterVolumeSpecName: "scripts") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.269347 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs" (OuterVolumeSpecName: "logs") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.269364 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.271851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.273685 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll" (OuterVolumeSpecName: "kube-api-access-vvjll") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "kube-api-access-vvjll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.291955 5030 generic.go:358] "Generic (PLEG): container finished" podID="faccda56-3b06-407e-8265-dcd18d9b8283" containerID="1cc3f77a4586b11d2e14e46782e5fb57ff440e6778fe9a81dc219c2326680988" exitCode=0 Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.292276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" event={"ID":"faccda56-3b06-407e-8265-dcd18d9b8283","Type":"ContainerDied","Data":"1cc3f77a4586b11d2e14e46782e5fb57ff440e6778fe9a81dc219c2326680988"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301186 5030 generic.go:358] "Generic (PLEG): container finished" podID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerID="6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" exitCode=0 Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301207 5030 generic.go:358] "Generic (PLEG): container finished" podID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerID="55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" exitCode=143 Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301410 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerDied","Data":"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301436 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerDied","Data":"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301465 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"d67fdbd2-8b2a-4f26-b9ad-44c01f44b106","Type":"ContainerDied","Data":"ac2c26c454ff1d4157c7380e9374cc79a0cf4ec98672bd192157e5049a8e56c1"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301487 5030 scope.go:117] "RemoveContainer" containerID="6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301850 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.301969 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304374 5030 generic.go:358] "Generic (PLEG): container finished" podID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerID="38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" exitCode=0 Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304404 5030 generic.go:358] "Generic (PLEG): container finished" podID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerID="f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" exitCode=143 Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304688 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304839 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerDied","Data":"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304877 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerDied","Data":"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.304888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"198a48d1-2b1b-40b0-a93d-02669549ad83","Type":"ContainerDied","Data":"5beb00ea709771bbc387f172707e8c131313fde3323c600ddf803406b9c64fa9"} Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.307764 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.340424 5030 scope.go:117] "RemoveContainer" containerID="55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.346713 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.350231 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data" (OuterVolumeSpecName: "config-data") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.351878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "198a48d1-2b1b-40b0-a93d-02669549ad83" (UID: "198a48d1-2b1b-40b0-a93d-02669549ad83"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.361798 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374106 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374142 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374153 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/198a48d1-2b1b-40b0-a93d-02669549ad83-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374164 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374173 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvjll\" (UniqueName: \"kubernetes.io/projected/198a48d1-2b1b-40b0-a93d-02669549ad83-kube-api-access-vvjll\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374208 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374217 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374228 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.374236 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/198a48d1-2b1b-40b0-a93d-02669549ad83-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.379019 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.380315 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.380428 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.380841 5030 scope.go:117] "RemoveContainer" containerID="6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381083 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381191 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381317 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381399 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381651 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.381745 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.382069 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.382162 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.382242 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-httpd" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.382306 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" containerName="glance-log" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.388292 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.388477 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: E0316 13:46:20.381574 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6\": container with ID starting with 6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6 not found: ID does not exist" containerID="6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.389797 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6"} err="failed to get container status \"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6\": rpc error: code = NotFound desc = could not find container \"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6\": container with ID starting with 6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.389936 5030 scope.go:117] "RemoveContainer" containerID="55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.401096 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:46:20 crc kubenswrapper[5030]: E0316 13:46:20.401454 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7\": container with ID starting with 55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7 not found: ID does not exist" containerID="55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.401582 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7"} err="failed to get container status \"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7\": rpc error: code = NotFound desc = could not find container \"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7\": container with ID starting with 55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.402792 5030 scope.go:117] "RemoveContainer" containerID="6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.402967 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.403205 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6"} err="failed to get container status \"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6\": rpc error: code = NotFound desc = could not find container \"6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6\": container with ID starting with 6a805dea3dbf10c86a2ec1d3ab786045dc5ba341433e9c4b1e85321081e549a6 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.403298 5030 scope.go:117] "RemoveContainer" containerID="55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.403646 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7"} err="failed to get container status \"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7\": rpc error: code = NotFound desc = could not find container \"55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7\": container with ID starting with 55d4774213177c95d6c7280e7af02efd10a2169721336fc0a38b5888db44d7c7 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.403753 5030 scope.go:117] "RemoveContainer" containerID="38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.436375 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.447296 5030 scope.go:117] "RemoveContainer" containerID="f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477285 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j96f4\" (UniqueName: \"kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477333 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477425 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477601 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.477924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.478123 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.478280 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.480002 5030 scope.go:117] "RemoveContainer" containerID="38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" Mar 16 13:46:20 crc kubenswrapper[5030]: E0316 13:46:20.480831 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb\": container with ID starting with 38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb not found: ID does not exist" containerID="38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.480873 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb"} err="failed to get container status \"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb\": rpc error: code = NotFound desc = could not find container \"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb\": container with ID starting with 38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.480902 5030 scope.go:117] "RemoveContainer" containerID="f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" Mar 16 13:46:20 crc kubenswrapper[5030]: E0316 13:46:20.482333 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8\": container with ID starting with f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8 not found: ID does not exist" containerID="f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.482387 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8"} err="failed to get container status \"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8\": rpc error: code = NotFound desc = could not find container \"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8\": container with ID starting with f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.482417 5030 scope.go:117] "RemoveContainer" containerID="38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.482803 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb"} err="failed to get container status \"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb\": rpc error: code = NotFound desc = could not find container \"38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb\": container with ID starting with 38d8120503122e98370d52a53bf994550e38fd4b66d8eeb7c73a03384966a3fb not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.482842 5030 scope.go:117] "RemoveContainer" containerID="f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.488741 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8"} err="failed to get container status \"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8\": rpc error: code = NotFound desc = could not find container \"f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8\": container with ID starting with f99ba3f3f81fe91e17bd003405be4ee9169593705940304ade4249c625c958c8 not found: ID does not exist" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580218 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580254 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j96f4\" (UniqueName: \"kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580300 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580352 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580369 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580581 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.580973 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.581047 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.581765 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.585980 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.586001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.586019 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.588967 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.599235 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j96f4\" (UniqueName: \"kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.601583 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.711204 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.716053 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.722786 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.723073 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.729073 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.741588 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.784820 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5xp5\" (UniqueName: \"kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785189 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785369 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs\") pod \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785441 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785495 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts\") pod \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785680 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle\") pod \"fcba89fa-970e-49c4-887a-2b253d4c535a\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785781 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55hn5\" (UniqueName: \"kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5\") pod \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785823 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785859 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8vvv\" (UniqueName: \"kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv\") pod \"fcba89fa-970e-49c4-887a-2b253d4c535a\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785885 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785905 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle\") pod \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data\") pod \"cd67ef6d-add0-436d-b8be-286412496892\" (UID: \"cd67ef6d-add0-436d-b8be-286412496892\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.785979 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data\") pod \"fcba89fa-970e-49c4-887a-2b253d4c535a\" (UID: \"fcba89fa-970e-49c4-887a-2b253d4c535a\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.786099 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data\") pod \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\" (UID: \"1a55e3ee-2333-465c-93e6-f4beb09d6b3f\") " Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.792290 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs" (OuterVolumeSpecName: "logs") pod "1a55e3ee-2333-465c-93e6-f4beb09d6b3f" (UID: "1a55e3ee-2333-465c-93e6-f4beb09d6b3f"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.799769 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts" (OuterVolumeSpecName: "scripts") pod "1a55e3ee-2333-465c-93e6-f4beb09d6b3f" (UID: "1a55e3ee-2333-465c-93e6-f4beb09d6b3f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.800717 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.801171 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts" (OuterVolumeSpecName: "scripts") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.804979 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "fcba89fa-970e-49c4-887a-2b253d4c535a" (UID: "fcba89fa-970e-49c4-887a-2b253d4c535a"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.805183 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5" (OuterVolumeSpecName: "kube-api-access-55hn5") pod "1a55e3ee-2333-465c-93e6-f4beb09d6b3f" (UID: "1a55e3ee-2333-465c-93e6-f4beb09d6b3f"). InnerVolumeSpecName "kube-api-access-55hn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.805265 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.815933 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv" (OuterVolumeSpecName: "kube-api-access-d8vvv") pod "fcba89fa-970e-49c4-887a-2b253d4c535a" (UID: "fcba89fa-970e-49c4-887a-2b253d4c535a"). InnerVolumeSpecName "kube-api-access-d8vvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.827939 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.828865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5" (OuterVolumeSpecName: "kube-api-access-n5xp5") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "kube-api-access-n5xp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829381 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcba89fa-970e-49c4-887a-2b253d4c535a" containerName="barbican-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829413 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcba89fa-970e-49c4-887a-2b253d4c535a" containerName="barbican-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829428 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a55e3ee-2333-465c-93e6-f4beb09d6b3f" containerName="placement-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829435 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a55e3ee-2333-465c-93e6-f4beb09d6b3f" containerName="placement-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829480 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd67ef6d-add0-436d-b8be-286412496892" containerName="keystone-bootstrap" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829486 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd67ef6d-add0-436d-b8be-286412496892" containerName="keystone-bootstrap" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829903 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcba89fa-970e-49c4-887a-2b253d4c535a" containerName="barbican-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829944 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1a55e3ee-2333-465c-93e6-f4beb09d6b3f" containerName="placement-db-sync" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.829957 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd67ef6d-add0-436d-b8be-286412496892" containerName="keystone-bootstrap" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.831393 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data" (OuterVolumeSpecName: "config-data") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.832040 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fcba89fa-970e-49c4-887a-2b253d4c535a" (UID: "fcba89fa-970e-49c4-887a-2b253d4c535a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.833898 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.836012 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.837001 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.843428 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.845085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cd67ef6d-add0-436d-b8be-286412496892" (UID: "cd67ef6d-add0-436d-b8be-286412496892"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.845287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data" (OuterVolumeSpecName: "config-data") pod "1a55e3ee-2333-465c-93e6-f4beb09d6b3f" (UID: "1a55e3ee-2333-465c-93e6-f4beb09d6b3f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.846130 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1a55e3ee-2333-465c-93e6-f4beb09d6b3f" (UID: "1a55e3ee-2333-465c-93e6-f4beb09d6b3f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889140 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889164 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889315 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889648 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889717 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vc9c\" (UniqueName: \"kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.889950 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890061 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890079 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890091 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5xp5\" (UniqueName: \"kubernetes.io/projected/cd67ef6d-add0-436d-b8be-286412496892-kube-api-access-n5xp5\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890101 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890109 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890118 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890127 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890137 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcba89fa-970e-49c4-887a-2b253d4c535a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890147 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55hn5\" (UniqueName: \"kubernetes.io/projected/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-kube-api-access-55hn5\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890155 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890164 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8vvv\" (UniqueName: \"kubernetes.io/projected/fcba89fa-970e-49c4-887a-2b253d4c535a-kube-api-access-d8vvv\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890172 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890180 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1a55e3ee-2333-465c-93e6-f4beb09d6b3f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.890188 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd67ef6d-add0-436d-b8be-286412496892-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.991919 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.991981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992044 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992147 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992204 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992235 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vc9c\" (UniqueName: \"kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992350 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992430 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.992458 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.993641 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.997930 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.998026 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.998115 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:20 crc kubenswrapper[5030]: I0316 13:46:20.999752 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.012493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vc9c\" (UniqueName: \"kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.016493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.153170 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.224919 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:46:21 crc kubenswrapper[5030]: W0316 13:46:21.236434 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e9e9ceb_6363_4a9e_ab98_a41e5ad59bc0.slice/crio-8108f4dac792e97c40b1562f2f49ed2eb036440c003e11682a3291435745f22e WatchSource:0}: Error finding container 8108f4dac792e97c40b1562f2f49ed2eb036440c003e11682a3291435745f22e: Status 404 returned error can't find the container with id 8108f4dac792e97c40b1562f2f49ed2eb036440c003e11682a3291435745f22e Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.412934 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-db-sync-878g8" event={"ID":"1a55e3ee-2333-465c-93e6-f4beb09d6b3f","Type":"ContainerDied","Data":"4da02de8f903c6cbdd0e24cdd208b4d0cdddcb4daf32f438ea7f2f3496de76c3"} Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.413168 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4da02de8f903c6cbdd0e24cdd208b4d0cdddcb4daf32f438ea7f2f3496de76c3" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.413243 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-db-sync-878g8" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.444289 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" event={"ID":"fcba89fa-970e-49c4-887a-2b253d4c535a","Type":"ContainerDied","Data":"5a9ebdbf047aa036a3f527e724d9410f9d41107f5b4cc9c684def6036ca56594"} Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.444323 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a9ebdbf047aa036a3f527e724d9410f9d41107f5b4cc9c684def6036ca56594" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.444392 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-db-sync-cqdxv" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.448865 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-w8hwk"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.458887 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerStarted","Data":"8108f4dac792e97c40b1562f2f49ed2eb036440c003e11682a3291435745f22e"} Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.464806 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-w8hwk"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.474106 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.474124 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f13d81ae9e8fe681dae98ff36030a99e5416c02ba61e51315166e39594dbcf8" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.621420 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.634017 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.638038 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.638563 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-keystone-listener-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.638788 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.639568 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-barbican-dockercfg-bcwgg\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.657387 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.663770 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.666023 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-worker-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.669133 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.670300 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.687976 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.697811 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.701735 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.702308 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-scripts\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.704531 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-public-svc\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.705473 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-placement-dockercfg-xzjgx\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.706240 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"placement-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.706505 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-placement-internal-svc\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.710537 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.710706 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.710843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttml\" (UniqueName: \"kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711018 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711540 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711643 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711704 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711795 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711874 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.711945 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrc9\" (UniqueName: \"kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.728701 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.732749 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-2qlll"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.744699 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.744812 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.747028 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.747945 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.748256 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-vh8nj\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.748403 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"osp-secret\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.751687 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.751918 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.753543 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-2qlll"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.763849 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.812673 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.816483 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.818775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.818815 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.818880 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.818918 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgkm\" (UniqueName: \"kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.818972 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819025 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819042 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819060 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819092 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819116 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819165 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xttml\" (UniqueName: \"kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819193 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819306 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819340 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819383 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819403 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jg4\" (UniqueName: \"kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819433 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819446 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819460 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819482 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819514 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.819543 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trrc9\" (UniqueName: \"kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.821984 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-api-config-data\"" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.825158 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.827049 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.827148 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.828219 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.828378 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.829590 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.836414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.836954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.839099 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.841480 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrc9\" (UniqueName: \"kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9\") pod \"barbican-worker-658f6984f-qkvll\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.842601 5030 status_manager.go:895] "Failed to get status for pod" podUID="cd67ef6d-add0-436d-b8be-286412496892" pod="openstack-kuttl-tests/keystone-bootstrap-w8hwk" err="pods \"keystone-bootstrap-w8hwk\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.849649 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttml\" (UniqueName: \"kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml\") pod \"barbican-keystone-listener-866c995988-7pmgh\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923342 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jg4\" (UniqueName: \"kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923393 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923446 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923476 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923505 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923560 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923592 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgkm\" (UniqueName: \"kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923622 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923668 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923683 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923726 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps558\" (UniqueName: \"kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923745 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923766 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923811 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923855 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923894 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.923911 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.924236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.934439 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.935663 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.937145 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.937430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.937854 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.944748 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.945820 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.946706 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: E0316 13:46:21.946874 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.947543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jg4\" (UniqueName: \"kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.947761 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgkm\" (UniqueName: \"kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.954932 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle\") pod \"keystone-bootstrap-2qlll\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.956946 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.957909 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts\") pod \"placement-749fdbbf86-7rdwk\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.981266 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:21 crc kubenswrapper[5030]: I0316 13:46:21.990152 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.006942 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198a48d1-2b1b-40b0-a93d-02669549ad83" path="/var/lib/kubelet/pods/198a48d1-2b1b-40b0-a93d-02669549ad83/volumes" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.007859 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd67ef6d-add0-436d-b8be-286412496892" path="/var/lib/kubelet/pods/cd67ef6d-add0-436d-b8be-286412496892/volumes" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.009322 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67fdbd2-8b2a-4f26-b9ad-44c01f44b106" path="/var/lib/kubelet/pods/d67fdbd2-8b2a-4f26-b9ad-44c01f44b106/volumes" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps558\" (UniqueName: \"kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026090 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026167 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026301 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026433 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.026844 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.032484 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.033062 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.033163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.033452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.036778 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.047904 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps558\" (UniqueName: \"kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558\") pod \"barbican-api-f5564dbf8-j792g\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: W0316 13:46:22.058942 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf37da94e_3023_4456_8723_0e2f1787d7fc.slice/crio-6655aaf5ced0d981ba552459e8887f4a57789dd910fbdb44874ae77384ac04b5 WatchSource:0}: Error finding container 6655aaf5ced0d981ba552459e8887f4a57789dd910fbdb44874ae77384ac04b5: Status 404 returned error can't find the container with id 6655aaf5ced0d981ba552459e8887f4a57789dd910fbdb44874ae77384ac04b5 Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.066760 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.099244 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128281 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128379 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128412 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128433 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128729 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dz9\" (UniqueName: \"kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.128767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data\") pod \"faccda56-3b06-407e-8265-dcd18d9b8283\" (UID: \"faccda56-3b06-407e-8265-dcd18d9b8283\") " Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.129818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.148244 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data" (OuterVolumeSpecName: "db-sync-config-data") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "db-sync-config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.149024 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts" (OuterVolumeSpecName: "scripts") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.158640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.162664 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9" (OuterVolumeSpecName: "kube-api-access-45dz9") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "kube-api-access-45dz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.182741 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data" (OuterVolumeSpecName: "config-data") pod "faccda56-3b06-407e-8265-dcd18d9b8283" (UID: "faccda56-3b06-407e-8265-dcd18d9b8283"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.222914 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232263 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232293 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232303 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232314 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/faccda56-3b06-407e-8265-dcd18d9b8283-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232323 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dz9\" (UniqueName: \"kubernetes.io/projected/faccda56-3b06-407e-8265-dcd18d9b8283-kube-api-access-45dz9\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.232333 5030 reconciler_common.go:299] "Volume detached for volume \"db-sync-config-data\" (UniqueName: \"kubernetes.io/secret/faccda56-3b06-407e-8265-dcd18d9b8283-db-sync-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.546402 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.547683 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faccda56-3b06-407e-8265-dcd18d9b8283" containerName="cinder-db-sync" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.547698 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="faccda56-3b06-407e-8265-dcd18d9b8283" containerName="cinder-db-sync" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.547844 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="faccda56-3b06-407e-8265-dcd18d9b8283" containerName="cinder-db-sync" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.557618 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.562309 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.569534 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.574446 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrk6x\" (UniqueName: \"kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.574636 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.574753 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.574923 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.581250 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.592604 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.602785 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerStarted","Data":"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8"} Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.617837 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.646118 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.655380 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.655570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-db-sync-22qdg" event={"ID":"faccda56-3b06-407e-8265-dcd18d9b8283","Type":"ContainerDied","Data":"2bae4188ed0b4cb47433f6f421d150a999beada4f404cb03be807a55a1fd9146"} Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.655611 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bae4188ed0b4cb47433f6f421d150a999beada4f404cb03be807a55a1fd9146" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682677 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682833 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682895 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrk6x\" (UniqueName: \"kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.682947 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.689678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerStarted","Data":"6655aaf5ced0d981ba552459e8887f4a57789dd910fbdb44874ae77384ac04b5"} Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.689848 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.699284 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.702950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.703805 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.708074 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerStarted","Data":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718091 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-central-agent" containerID="cri-o://82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" gracePeriod=30 Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718333 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-notification-agent" containerID="cri-o://88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" gracePeriod=30 Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718453 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="sg-core" containerID="cri-o://6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" gracePeriod=30 Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718719 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.718766 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="proxy-httpd" containerID="cri-o://7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" gracePeriod=30 Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.723270 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrk6x\" (UniqueName: \"kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x\") pod \"cinder-scheduler-0\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.723321 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.727027 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.732091 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.745915 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.769440 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.7044523160000002 podStartE2EDuration="7.769418025s" podCreationTimestamp="2026-03-16 13:46:15 +0000 UTC" firstStartedPulling="2026-03-16 13:46:16.196952793 +0000 UTC m=+2420.596265339" lastFinishedPulling="2026-03-16 13:46:21.261918502 +0000 UTC m=+2425.661231048" observedRunningTime="2026-03-16 13:46:22.74253758 +0000 UTC m=+2427.141850127" watchObservedRunningTime="2026-03-16 13:46:22.769418025 +0000 UTC m=+2427.168730571" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.784967 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28s7\" (UniqueName: \"kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.785252 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.786716 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.787114 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.787247 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.787445 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.787801 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.845068 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-2qlll"] Mar 16 13:46:22 crc kubenswrapper[5030]: W0316 13:46:22.848689 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode19c60f0_f4d4_4c18_8572_19da4a39607f.slice/crio-b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b WatchSource:0}: Error finding container b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b: Status 404 returned error can't find the container with id b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889491 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w28s7\" (UniqueName: \"kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889681 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889702 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889730 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889793 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889906 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.889930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.890375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.895759 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.897707 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.901476 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.903954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.906373 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28s7\" (UniqueName: \"kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7\") pod \"cinder-api-0\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:22 crc kubenswrapper[5030]: I0316 13:46:22.922162 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.038142 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.081816 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.178508 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:23 crc kubenswrapper[5030]: W0316 13:46:23.230536 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0235e081_524b_4c49_93db_0c681992f156.slice/crio-ea91bd8866ebc00d6b303a8eb07cbf09379f44e6eb054dcdeb21a7e1457719b6 WatchSource:0}: Error finding container ea91bd8866ebc00d6b303a8eb07cbf09379f44e6eb054dcdeb21a7e1457719b6: Status 404 returned error can't find the container with id ea91bd8866ebc00d6b303a8eb07cbf09379f44e6eb054dcdeb21a7e1457719b6 Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.481007 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.527659 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.611920 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.612363 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.612741 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.613009 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.621535 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.621631 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkzs2\" (UniqueName: \"kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.621685 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.621285 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.629633 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.631236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts" (OuterVolumeSpecName: "scripts") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.634722 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.641910 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.642371 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2" (OuterVolumeSpecName: "kube-api-access-pkzs2") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "kube-api-access-pkzs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.645792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.708918 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.733641 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data" (OuterVolumeSpecName: "config-data") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.737521 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") pod \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\" (UID: \"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4\") " Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738019 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738031 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738041 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738050 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkzs2\" (UniqueName: \"kubernetes.io/projected/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-kube-api-access-pkzs2\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738060 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: W0316 13:46:23.738134 5030 empty_dir.go:511] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4/volumes/kubernetes.io~secret/config-data Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.738145 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data" (OuterVolumeSpecName: "config-data") pod "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" (UID: "01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762215 5030 generic.go:358] "Generic (PLEG): container finished" podID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" exitCode=0 Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762239 5030 generic.go:358] "Generic (PLEG): container finished" podID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" exitCode=2 Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762246 5030 generic.go:358] "Generic (PLEG): container finished" podID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" exitCode=0 Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762252 5030 generic.go:358] "Generic (PLEG): container finished" podID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" exitCode=0 Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerDied","Data":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762415 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerDied","Data":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762426 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerDied","Data":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762457 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerDied","Data":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762466 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4","Type":"ContainerDied","Data":"ab8eab92b8f132b62a77d91ee55a83c6febd84fdc0451fdfd9139bb333e589fd"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762481 5030 scope.go:117] "RemoveContainer" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.762688 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.783340 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerStarted","Data":"2366d2e0a71265f8ea5577d53820707ad7fe1310fd1c81b142eb35ea147a92b9"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.783644 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerStarted","Data":"7aee6e94aef2cf98e93d0ade1fbf4c956c043ee88e50c9ae2da37ab83e049984"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.796627 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.799490 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerStarted","Data":"2b0c721523ea3eade3c3fc98255597c95190164bc230da59a3c2b3f79bad6cb9"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.803468 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.807276 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" event={"ID":"e19c60f0-f4d4-4c18-8572-19da4a39607f","Type":"ContainerStarted","Data":"1b149c09d873d033682338884e977ebbfbed549dca169ad32c7298360c93fbd2"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.807325 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" event={"ID":"e19c60f0-f4d4-4c18-8572-19da4a39607f","Type":"ContainerStarted","Data":"b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.815596 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerStarted","Data":"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.815635 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerStarted","Data":"ea91bd8866ebc00d6b303a8eb07cbf09379f44e6eb054dcdeb21a7e1457719b6"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.822050 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824237 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-central-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824257 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-central-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824308 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="sg-core" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824314 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="sg-core" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824337 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-notification-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824344 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-notification-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824413 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="proxy-httpd" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824432 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="proxy-httpd" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824768 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-central-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824791 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="sg-core" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824803 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="proxy-httpd" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.824824 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" containerName="ceilometer-notification-agent" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.841827 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.846226 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.854013 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.857225 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerStarted","Data":"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.863891 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.892015 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.893002 5030 scope.go:117] "RemoveContainer" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.892523 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" podStartSLOduration=2.892510241 podStartE2EDuration="2.892510241s" podCreationTimestamp="2026-03-16 13:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:23.843445424 +0000 UTC m=+2428.242757971" watchObservedRunningTime="2026-03-16 13:46:23.892510241 +0000 UTC m=+2428.291822788" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.904468 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerStarted","Data":"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.904515 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerStarted","Data":"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.904530 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerStarted","Data":"0a3c6435a5feb0f4889b4c52186aff64471ec29e6ae0d9debb8e38f63c4b4f4c"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.914189 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerStarted","Data":"2dfdf8af032d5de7c4fd9e9bc99920a85362ec3c1e754a26f6c783abfc083df4"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.924154 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerStarted","Data":"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.924185 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerStarted","Data":"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.924200 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerStarted","Data":"415c9fdde236bde6bb6ad9285ede52b3bf518eb7e64a236d47156691b87ffb97"} Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976410 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976579 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976609 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976642 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976655 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l87h\" (UniqueName: \"kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.976720 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.984212 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.9841902940000002 podStartE2EDuration="3.984190294s" podCreationTimestamp="2026-03-16 13:46:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:23.908896289 +0000 UTC m=+2428.308208835" watchObservedRunningTime="2026-03-16 13:46:23.984190294 +0000 UTC m=+2428.383502840" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.988425 5030 scope.go:117] "RemoveContainer" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.989397 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" podStartSLOduration=2.989389501 podStartE2EDuration="2.989389501s" podCreationTimestamp="2026-03-16 13:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:23.930742254 +0000 UTC m=+2428.330054800" watchObservedRunningTime="2026-03-16 13:46:23.989389501 +0000 UTC m=+2428.388702048" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.990957 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4" path="/var/lib/kubelet/pods/01c3b7ac-cfd3-41f1-a672-d5ce9720f5e4/volumes" Mar 16 13:46:23 crc kubenswrapper[5030]: I0316 13:46:23.995704 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" podStartSLOduration=2.995695592 podStartE2EDuration="2.995695592s" podCreationTimestamp="2026-03-16 13:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:23.970194923 +0000 UTC m=+2428.369507470" watchObservedRunningTime="2026-03-16 13:46:23.995695592 +0000 UTC m=+2428.395008139" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.039939 5030 scope.go:117] "RemoveContainer" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078002 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078134 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078172 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078209 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078224 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l87h\" (UniqueName: \"kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078256 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.078294 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.081891 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.082025 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.088401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.093655 5030 scope.go:117] "RemoveContainer" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.093853 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.094997 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.095114 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.097032 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l87h\" (UniqueName: \"kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h\") pod \"ceilometer-0\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: E0316 13:46:24.109817 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": container with ID starting with 7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243 not found: ID does not exist" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.109860 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} err="failed to get container status \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": rpc error: code = NotFound desc = could not find container \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": container with ID starting with 7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243 not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.109883 5030 scope.go:117] "RemoveContainer" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:24 crc kubenswrapper[5030]: E0316 13:46:24.111175 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": container with ID starting with 6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c not found: ID does not exist" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.111215 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} err="failed to get container status \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": rpc error: code = NotFound desc = could not find container \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": container with ID starting with 6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.111240 5030 scope.go:117] "RemoveContainer" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:24 crc kubenswrapper[5030]: E0316 13:46:24.111810 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": container with ID starting with 88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b not found: ID does not exist" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.111835 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} err="failed to get container status \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": rpc error: code = NotFound desc = could not find container \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": container with ID starting with 88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.111849 5030 scope.go:117] "RemoveContainer" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: E0316 13:46:24.112138 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": container with ID starting with 82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a not found: ID does not exist" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.112159 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} err="failed to get container status \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": rpc error: code = NotFound desc = could not find container \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": container with ID starting with 82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.112171 5030 scope.go:117] "RemoveContainer" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.112587 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} err="failed to get container status \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": rpc error: code = NotFound desc = could not find container \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": container with ID starting with 7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243 not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.112607 5030 scope.go:117] "RemoveContainer" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.117634 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} err="failed to get container status \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": rpc error: code = NotFound desc = could not find container \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": container with ID starting with 6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.117661 5030 scope.go:117] "RemoveContainer" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.117911 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} err="failed to get container status \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": rpc error: code = NotFound desc = could not find container \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": container with ID starting with 88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.117934 5030 scope.go:117] "RemoveContainer" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.120630 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} err="failed to get container status \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": rpc error: code = NotFound desc = could not find container \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": container with ID starting with 82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.120651 5030 scope.go:117] "RemoveContainer" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121078 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} err="failed to get container status \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": rpc error: code = NotFound desc = could not find container \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": container with ID starting with 7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243 not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121091 5030 scope.go:117] "RemoveContainer" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121580 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} err="failed to get container status \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": rpc error: code = NotFound desc = could not find container \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": container with ID starting with 6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121603 5030 scope.go:117] "RemoveContainer" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121898 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} err="failed to get container status \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": rpc error: code = NotFound desc = could not find container \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": container with ID starting with 88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.121927 5030 scope.go:117] "RemoveContainer" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.122245 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} err="failed to get container status \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": rpc error: code = NotFound desc = could not find container \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": container with ID starting with 82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.122283 5030 scope.go:117] "RemoveContainer" containerID="7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.122867 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243"} err="failed to get container status \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": rpc error: code = NotFound desc = could not find container \"7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243\": container with ID starting with 7cac107fdf1faa84d9f347d60cf16c715b0779cbffe109b287069a57584bc243 not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.122887 5030 scope.go:117] "RemoveContainer" containerID="6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.123146 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c"} err="failed to get container status \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": rpc error: code = NotFound desc = could not find container \"6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c\": container with ID starting with 6e11db15044c3f1d71597829d705a78eda605e2f903c351c4e01194acd64005c not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.123167 5030 scope.go:117] "RemoveContainer" containerID="88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.123643 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b"} err="failed to get container status \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": rpc error: code = NotFound desc = could not find container \"88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b\": container with ID starting with 88edc4fe37d551ebddecccf1523fd7a562c5ff223114c36111822cf4cdcc105b not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.123664 5030 scope.go:117] "RemoveContainer" containerID="82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.123938 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a"} err="failed to get container status \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": rpc error: code = NotFound desc = could not find container \"82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a\": container with ID starting with 82e9e2b72c097a38e90cac13fe7fa6aca6f7dd81b7bee616e59145c19c98b89a not found: ID does not exist" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.156723 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.749016 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.944278 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerStarted","Data":"25f2317ecdf2f2d3e3a43eac119006ca67a173b2d74f60a2e956f5fe89818f39"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.956326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerStarted","Data":"55286fa35543852bfe06fa91bca1d16c17823aeaab0b1c059152c37067f13a55"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.956477 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.956521 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.961703 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerStarted","Data":"33494744bf421c59536f576dd55d79e99faf5b8a4837992301a892dddf886390"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.971158 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerStarted","Data":"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.972915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerStarted","Data":"ee9859c9797d0755e199f244957c48e9acb6f6a4ddafa02a1858149bbe6ff5e2"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.973069 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=4.973057161 podStartE2EDuration="4.973057161s" podCreationTimestamp="2026-03-16 13:46:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:24.959727152 +0000 UTC m=+2429.359039709" watchObservedRunningTime="2026-03-16 13:46:24.973057161 +0000 UTC m=+2429.372369708" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.982763 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" podStartSLOduration=3.982751163 podStartE2EDuration="3.982751163s" podCreationTimestamp="2026-03-16 13:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:24.980121207 +0000 UTC m=+2429.379433754" watchObservedRunningTime="2026-03-16 13:46:24.982751163 +0000 UTC m=+2429.382063710" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.988433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerStarted","Data":"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9"} Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.990050 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:24 crc kubenswrapper[5030]: I0316 13:46:24.990079 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.011765 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" podStartSLOduration=4.011751343 podStartE2EDuration="4.011751343s" podCreationTimestamp="2026-03-16 13:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:25.004601467 +0000 UTC m=+2429.403914013" watchObservedRunningTime="2026-03-16 13:46:25.011751343 +0000 UTC m=+2429.411063890" Mar 16 13:46:25 crc kubenswrapper[5030]: E0316 13:46:25.160071 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd80ea153_6106_465b_98fc_cf8c8c6f3ec3.slice/crio-b0d122fbb6c976f7fde39ab30ae914b7076aa4f825738d6d3615f339809f591f.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.709106 5030 scope.go:117] "RemoveContainer" containerID="d7aaf5653af2c3b0e4504e9821685d5cbb2d8c6af31ed7f6057b9f7107d72305" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.736677 5030 scope.go:117] "RemoveContainer" containerID="759b622a148dd2e33f826c0cf69e4aaac01d97fca2125fd28de509d21fd6b02c" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.781388 5030 scope.go:117] "RemoveContainer" containerID="531bfb3e1a951bc9f5c1f8d6920f737f51dd45ef67dbac259b97bfae251a0515" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.802766 5030 scope.go:117] "RemoveContainer" containerID="1a78c3ff51f11753f989bf5b0abb9ea3abf115e17234fd71b6e61e3809b68fd5" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.822609 5030 scope.go:117] "RemoveContainer" containerID="2540b9f55f5dd5210d2023b712015c59bc01114c91b473bb7262592899b29ed5" Mar 16 13:46:25 crc kubenswrapper[5030]: I0316 13:46:25.847292 5030 scope.go:117] "RemoveContainer" containerID="50a080e443229b9e659e8e56bce945023aede62f3e4e686c83419286600654fa" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.013798 5030 scope.go:117] "RemoveContainer" containerID="1d94c1df2d8f3777dacd2247cd7c0f810cff7d0284f5a7d4dae540b8af7b3f7e" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.014715 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerStarted","Data":"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.014750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerStarted","Data":"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.016047 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.020391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerStarted","Data":"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.022377 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerStarted","Data":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.025916 5030 generic.go:358] "Generic (PLEG): container finished" podID="e19c60f0-f4d4-4c18-8572-19da4a39607f" containerID="1b149c09d873d033682338884e977ebbfbed549dca169ad32c7298360c93fbd2" exitCode=0 Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.026031 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" event={"ID":"e19c60f0-f4d4-4c18-8572-19da4a39607f","Type":"ContainerDied","Data":"1b149c09d873d033682338884e977ebbfbed549dca169ad32c7298360c93fbd2"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.037634 5030 generic.go:358] "Generic (PLEG): container finished" podID="d80ea153-6106-465b-98fc-cf8c8c6f3ec3" containerID="b0d122fbb6c976f7fde39ab30ae914b7076aa4f825738d6d3615f339809f591f" exitCode=0 Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.037728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" event={"ID":"d80ea153-6106-465b-98fc-cf8c8c6f3ec3","Type":"ContainerDied","Data":"b0d122fbb6c976f7fde39ab30ae914b7076aa4f825738d6d3615f339809f591f"} Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.046845 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=4.046832337 podStartE2EDuration="4.046832337s" podCreationTimestamp="2026-03-16 13:46:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:26.033599119 +0000 UTC m=+2430.432911667" watchObservedRunningTime="2026-03-16 13:46:26.046832337 +0000 UTC m=+2430.446144874" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.087302 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=4.08728672 podStartE2EDuration="4.08728672s" podCreationTimestamp="2026-03-16 13:46:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:26.075099709 +0000 UTC m=+2430.474412257" watchObservedRunningTime="2026-03-16 13:46:26.08728672 +0000 UTC m=+2430.486599266" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.218373 5030 scope.go:117] "RemoveContainer" containerID="55b0dd9cbe7c78a059ff94488ede93b2263143907abfd15feeb231f25ac1960a" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.249451 5030 scope.go:117] "RemoveContainer" containerID="93ab8ec6277e313313c7fe2e5ca6d5d574d0ea9d7002f7288dfba307b34a2eb2" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.298999 5030 scope.go:117] "RemoveContainer" containerID="416aee296fca8e5d91acc1fc611a6a4c6e6613d075bc4b15b51d2d09cb9c91c9" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.341327 5030 scope.go:117] "RemoveContainer" containerID="95fbb4006226b7a376cba582e792561c2c545e4b5048ee1d55c1da49b7564735" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.362222 5030 scope.go:117] "RemoveContainer" containerID="aae6ed44cf0342264ca94e4115612511d19026671de98dd42589cacbf8cca1ff" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.404221 5030 scope.go:117] "RemoveContainer" containerID="84a70fb589d2876fbee128602632edbdf0756d0033997388dfd19ba63023f400" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.428981 5030 scope.go:117] "RemoveContainer" containerID="a52be5d468e9737e26bae8c052a17fcdc642093e60bed5709f31f1edc1e620d1" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.469883 5030 scope.go:117] "RemoveContainer" containerID="880f0da0d08d80bc36327e02f2290993b6d05572dcbe8f2cc51c738b85f3b8a9" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.509401 5030 scope.go:117] "RemoveContainer" containerID="63aa8dabdfcad39c36035d74bb70a939093ac0d9ca18868bcd6adf9ccb011454" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.551035 5030 scope.go:117] "RemoveContainer" containerID="49f05c10e499f257241d61f17af9ed3abdb4510d9e9e8c5f149db711edcfeee2" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.596067 5030 scope.go:117] "RemoveContainer" containerID="b18154b45383b351cbe47196ec5be89b7a4198ee1c5d107dd602c2085e2cdd0b" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.643926 5030 scope.go:117] "RemoveContainer" containerID="f528204e7ce812978b1b4c5c0816bfc669ec75a9157881de1e574df2705fe754" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.674086 5030 scope.go:117] "RemoveContainer" containerID="92c4b328a870a223745d65ad5620b02dc7bcb39f55fe33fcb54dcd5ee9776f2a" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.709626 5030 scope.go:117] "RemoveContainer" containerID="58540f742909b9c7d67366440fbde7d05d0e263af58a6725c443ddce79442b49" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.735290 5030 scope.go:117] "RemoveContainer" containerID="255f41b41c2f1917725cfb73e48190234aef3c673d3145965f8d12cdc8afd76b" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.774719 5030 scope.go:117] "RemoveContainer" containerID="d829ea6354a1e1f20b21cb0bea22bdcad785de339be7d3be3fcaf3d344af4f2c" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.790927 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.796747 5030 scope.go:117] "RemoveContainer" containerID="9e1564d8caf887bd9da1e282e39228f2391a87545f9b78098d196ee429ececed" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.885563 5030 scope.go:117] "RemoveContainer" containerID="9facb9baec27c82da7cce05bdd3ac24effe523b84cf912c82da1101ca1f85d38" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.909701 5030 scope.go:117] "RemoveContainer" containerID="ee474b73147b07b54ed3dd5adad0b72ed6061f1b7dcf3684c7c525acfed80170" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.944956 5030 scope.go:117] "RemoveContainer" containerID="1f06f3446a3e0c7091a601fd9757b75ecce7cac5f8b2263bb08486f0e4fd30ba" Mar 16 13:46:26 crc kubenswrapper[5030]: I0316 13:46:26.980639 5030 scope.go:117] "RemoveContainer" containerID="b09da0ef7c40697186c1e8b0a1b2804f8b88a5212be35bae6c691ec49874f741" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.006904 5030 scope.go:117] "RemoveContainer" containerID="aba762d97e4630a834be496441a66fa8a982b3ca2f1eeaec502c242437de81cd" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.051616 5030 scope.go:117] "RemoveContainer" containerID="9292b9d45c29df81747eaf49ceaf4e33f2ed3e2ee938b3dcaf1ab5dc2953f8aa" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.099324 5030 scope.go:117] "RemoveContainer" containerID="b4b81634f0cf5ec18f6a4a859e3404f2129691cca4aff72511100ee179541d79" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.112624 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerStarted","Data":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.165495 5030 scope.go:117] "RemoveContainer" containerID="d3297ede49c51ccf1261e055fd5c28cd006d991bb9a6dfe1a54440eee3b2d257" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.474998 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.500896 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.597796 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.597913 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8jg4\" (UniqueName: \"kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.598011 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.598072 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.598282 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.598754 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys\") pod \"e19c60f0-f4d4-4c18-8572-19da4a39607f\" (UID: \"e19c60f0-f4d4-4c18-8572-19da4a39607f\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.604091 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.604116 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts" (OuterVolumeSpecName: "scripts") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.604216 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.604918 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4" (OuterVolumeSpecName: "kube-api-access-b8jg4") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "kube-api-access-b8jg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.620339 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data" (OuterVolumeSpecName: "config-data") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.632872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e19c60f0-f4d4-4c18-8572-19da4a39607f" (UID: "e19c60f0-f4d4-4c18-8572-19da4a39607f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.702968 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config\") pod \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.703653 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle\") pod \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.703767 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgrbm\" (UniqueName: \"kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm\") pod \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\" (UID: \"d80ea153-6106-465b-98fc-cf8c8c6f3ec3\") " Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704772 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704791 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704802 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704812 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704822 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8jg4\" (UniqueName: \"kubernetes.io/projected/e19c60f0-f4d4-4c18-8572-19da4a39607f-kube-api-access-b8jg4\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.704833 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/e19c60f0-f4d4-4c18-8572-19da4a39607f-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.708228 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm" (OuterVolumeSpecName: "kube-api-access-dgrbm") pod "d80ea153-6106-465b-98fc-cf8c8c6f3ec3" (UID: "d80ea153-6106-465b-98fc-cf8c8c6f3ec3"). InnerVolumeSpecName "kube-api-access-dgrbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.725510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d80ea153-6106-465b-98fc-cf8c8c6f3ec3" (UID: "d80ea153-6106-465b-98fc-cf8c8c6f3ec3"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.730247 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config" (OuterVolumeSpecName: "config") pod "d80ea153-6106-465b-98fc-cf8c8c6f3ec3" (UID: "d80ea153-6106-465b-98fc-cf8c8c6f3ec3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.807589 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.807629 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.807643 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgrbm\" (UniqueName: \"kubernetes.io/projected/d80ea153-6106-465b-98fc-cf8c8c6f3ec3-kube-api-access-dgrbm\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:27 crc kubenswrapper[5030]: I0316 13:46:27.923275 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.162027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerStarted","Data":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.163997 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" event={"ID":"e19c60f0-f4d4-4c18-8572-19da4a39607f","Type":"ContainerDied","Data":"b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b"} Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.164027 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4a1f572453f0e73897db76b3248b09f7fdaee3cfee2bcef1708863e63a1909b" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.164101 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bootstrap-2qlll" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.171675 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.172086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-db-sync-mkrb2" event={"ID":"d80ea153-6106-465b-98fc-cf8c8c6f3ec3","Type":"ContainerDied","Data":"e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607"} Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.172105 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e32bcf57a911e589b9049611c847f4aa1323b817e50ce2015e7be8b9a7b9e607" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.172921 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api-log" containerID="cri-o://c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" gracePeriod=30 Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.173234 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api" containerID="cri-o://99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" gracePeriod=30 Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.232037 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233030 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e19c60f0-f4d4-4c18-8572-19da4a39607f" containerName="keystone-bootstrap" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233052 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e19c60f0-f4d4-4c18-8572-19da4a39607f" containerName="keystone-bootstrap" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233090 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d80ea153-6106-465b-98fc-cf8c8c6f3ec3" containerName="neutron-db-sync" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233095 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d80ea153-6106-465b-98fc-cf8c8c6f3ec3" containerName="neutron-db-sync" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233265 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d80ea153-6106-465b-98fc-cf8c8c6f3ec3" containerName="neutron-db-sync" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.233291 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e19c60f0-f4d4-4c18-8572-19da4a39607f" containerName="keystone-bootstrap" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.236414 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.252353 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-public-svc\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.252659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.252811 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-keystone-internal-svc\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.252950 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.253031 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-scripts\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.253051 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-config-data\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.253224 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-keystone-dockercfg-vh8nj\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.318853 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319004 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319044 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319065 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319119 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319136 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319174 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrt42\" (UniqueName: \"kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.319193 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.427946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428227 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428246 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428331 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428353 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428405 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrt42\" (UniqueName: \"kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.428444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.437822 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.437947 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.438975 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.439009 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.440768 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.440881 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.441078 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.444113 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.446396 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrt42\" (UniqueName: \"kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42\") pod \"keystone-bff6bf4bc-qg26w\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.514225 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.527738 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.527846 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.531989 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-neutron-dockercfg-jqmd7\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.532667 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-config\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.533884 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-httpd-config\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.541871 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-ovndbs\"" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.557223 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.633311 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.633444 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.633630 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.633764 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6jlk\" (UniqueName: \"kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.633917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.737939 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.738119 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.738219 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6jlk\" (UniqueName: \"kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.738309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.738625 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.745843 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.748203 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.748339 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.749616 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.763162 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6jlk\" (UniqueName: \"kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk\") pod \"neutron-75f5dc577c-wnj7z\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.888182 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:28 crc kubenswrapper[5030]: I0316 13:46:28.956701 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048046 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048371 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048472 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w28s7\" (UniqueName: \"kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048833 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.048849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle\") pod \"03590c95-6f6a-4472-8bcd-94577bd4c190\" (UID: \"03590c95-6f6a-4472-8bcd-94577bd4c190\") " Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.061659 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.071845 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs" (OuterVolumeSpecName: "logs") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.086621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.088621 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts" (OuterVolumeSpecName: "scripts") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.107724 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7" (OuterVolumeSpecName: "kube-api-access-w28s7") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "kube-api-access-w28s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.134679 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data" (OuterVolumeSpecName: "config-data") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.149388 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158014 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158040 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158050 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/03590c95-6f6a-4472-8bcd-94577bd4c190-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158061 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w28s7\" (UniqueName: \"kubernetes.io/projected/03590c95-6f6a-4472-8bcd-94577bd4c190-kube-api-access-w28s7\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158077 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/03590c95-6f6a-4472-8bcd-94577bd4c190-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.158085 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.160668 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "03590c95-6f6a-4472-8bcd-94577bd4c190" (UID: "03590c95-6f6a-4472-8bcd-94577bd4c190"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.230903 5030 generic.go:358] "Generic (PLEG): container finished" podID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerID="99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" exitCode=0 Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.230940 5030 generic.go:358] "Generic (PLEG): container finished" podID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerID="c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" exitCode=143 Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.231023 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerDied","Data":"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476"} Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.231055 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerDied","Data":"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2"} Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.231065 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"03590c95-6f6a-4472-8bcd-94577bd4c190","Type":"ContainerDied","Data":"33494744bf421c59536f576dd55d79e99faf5b8a4837992301a892dddf886390"} Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.231083 5030 scope.go:117] "RemoveContainer" containerID="99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.231250 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.246297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" event={"ID":"7840f19b-4f77-48da-b8c3-4e5c3e57b412","Type":"ContainerStarted","Data":"ecfde79771710ca0cec19294c60a1e3b314026bb210854d3a80b5839ba2f75f9"} Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.261577 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03590c95-6f6a-4472-8bcd-94577bd4c190-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.278787 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.278980 5030 scope.go:117] "RemoveContainer" containerID="c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.294138 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.308671 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.309890 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.309914 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.309949 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api-log" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.309954 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api-log" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.310165 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.310192 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" containerName="cinder-api-log" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.326203 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.326356 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.328541 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.329387 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.329636 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.365080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.366493 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.366784 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.366947 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f5g\" (UniqueName: \"kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.367055 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.367210 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.367330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.367482 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.368257 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.378761 5030 scope.go:117] "RemoveContainer" containerID="99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" Mar 16 13:46:29 crc kubenswrapper[5030]: E0316 13:46:29.385150 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476\": container with ID starting with 99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476 not found: ID does not exist" containerID="99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.385191 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476"} err="failed to get container status \"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476\": rpc error: code = NotFound desc = could not find container \"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476\": container with ID starting with 99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476 not found: ID does not exist" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.385217 5030 scope.go:117] "RemoveContainer" containerID="c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" Mar 16 13:46:29 crc kubenswrapper[5030]: E0316 13:46:29.385585 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2\": container with ID starting with c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2 not found: ID does not exist" containerID="c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.385603 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2"} err="failed to get container status \"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2\": rpc error: code = NotFound desc = could not find container \"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2\": container with ID starting with c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2 not found: ID does not exist" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.385615 5030 scope.go:117] "RemoveContainer" containerID="99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.386689 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476"} err="failed to get container status \"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476\": rpc error: code = NotFound desc = could not find container \"99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476\": container with ID starting with 99663ce19d1a3715de94564bf03f5f29f26dd302e079be1d14ec74bae7f17476 not found: ID does not exist" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.386720 5030 scope.go:117] "RemoveContainer" containerID="c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.386999 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2"} err="failed to get container status \"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2\": rpc error: code = NotFound desc = could not find container \"c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2\": container with ID starting with c8a5c9bbc911efc2ec8ff95b89f3dcd66983dc37ffe0e57a17e52d71dbef63a2 not found: ID does not exist" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.472005 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.474107 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97f5g\" (UniqueName: \"kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.474544 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.475086 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.475874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.475542 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.476202 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.476273 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.476447 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.476596 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.477598 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.478520 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.482213 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.482517 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.482986 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.483176 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.490164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.495377 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f5g\" (UniqueName: \"kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g\") pod \"cinder-api-0\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.496822 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:46:29 crc kubenswrapper[5030]: W0316 13:46:29.498220 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod592d29bc_ad6a_4216_a71a_f2380dec5670.slice/crio-c065dd04568ff01b3640af36c607015e84ff6edb00c06e844fbc17b9bc92d30e WatchSource:0}: Error finding container c065dd04568ff01b3640af36c607015e84ff6edb00c06e844fbc17b9bc92d30e: Status 404 returned error can't find the container with id c065dd04568ff01b3640af36c607015e84ff6edb00c06e844fbc17b9bc92d30e Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.653224 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:29 crc kubenswrapper[5030]: I0316 13:46:29.964265 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03590c95-6f6a-4472-8bcd-94577bd4c190" path="/var/lib/kubelet/pods/03590c95-6f6a-4472-8bcd-94577bd4c190/volumes" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.088230 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.266623 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerStarted","Data":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.267089 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-central-agent" containerID="cri-o://9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" gracePeriod=30 Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.267115 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="proxy-httpd" containerID="cri-o://0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" gracePeriod=30 Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.267128 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.267222 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-notification-agent" containerID="cri-o://f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" gracePeriod=30 Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.267235 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="sg-core" containerID="cri-o://f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" gracePeriod=30 Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.272328 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerStarted","Data":"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.272384 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerStarted","Data":"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.272396 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerStarted","Data":"c065dd04568ff01b3640af36c607015e84ff6edb00c06e844fbc17b9bc92d30e"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.276986 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerStarted","Data":"46e8e8cd1dc13bc8ae55a3d2aed7ad82446cc42cf9c0a3b694455c2beb6dcfea"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.278311 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.288743 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" event={"ID":"7840f19b-4f77-48da-b8c3-4e5c3e57b412","Type":"ContainerStarted","Data":"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c"} Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.289850 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.297055 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.909311761 podStartE2EDuration="7.297035788s" podCreationTimestamp="2026-03-16 13:46:23 +0000 UTC" firstStartedPulling="2026-03-16 13:46:24.76706462 +0000 UTC m=+2429.166377168" lastFinishedPulling="2026-03-16 13:46:29.154788647 +0000 UTC m=+2433.554101195" observedRunningTime="2026-03-16 13:46:30.289060119 +0000 UTC m=+2434.688372666" watchObservedRunningTime="2026-03-16 13:46:30.297035788 +0000 UTC m=+2434.696348336" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.327197 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" podStartSLOduration=2.327178349 podStartE2EDuration="2.327178349s" podCreationTimestamp="2026-03-16 13:46:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:30.324730394 +0000 UTC m=+2434.724042941" watchObservedRunningTime="2026-03-16 13:46:30.327178349 +0000 UTC m=+2434.726490895" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.329117 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" podStartSLOduration=2.329103739 podStartE2EDuration="2.329103739s" podCreationTimestamp="2026-03-16 13:46:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:30.311934198 +0000 UTC m=+2434.711246745" watchObservedRunningTime="2026-03-16 13:46:30.329103739 +0000 UTC m=+2434.728416366" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.723895 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.724117 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.760799 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.761617 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:30 crc kubenswrapper[5030]: I0316 13:46:30.974863 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.114469 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.114952 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l87h\" (UniqueName: \"kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115158 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115253 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115475 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115714 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115756 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.115803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts\") pod \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\" (UID: \"88d39849-ea82-4d5a-a8ea-9328a41e4afc\") " Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.116369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.116382 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.121769 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts" (OuterVolumeSpecName: "scripts") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.123674 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h" (OuterVolumeSpecName: "kube-api-access-8l87h") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "kube-api-access-8l87h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.140665 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.153439 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.153494 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.169201 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.185734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.185804 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.206981 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data" (OuterVolumeSpecName: "config-data") pod "88d39849-ea82-4d5a-a8ea-9328a41e4afc" (UID: "88d39849-ea82-4d5a-a8ea-9328a41e4afc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218868 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l87h\" (UniqueName: \"kubernetes.io/projected/88d39849-ea82-4d5a-a8ea-9328a41e4afc-kube-api-access-8l87h\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218897 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/88d39849-ea82-4d5a-a8ea-9328a41e4afc-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218908 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218919 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218928 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.218936 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/88d39849-ea82-4d5a-a8ea-9328a41e4afc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.301094 5030 generic.go:358] "Generic (PLEG): container finished" podID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" exitCode=0 Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.301123 5030 generic.go:358] "Generic (PLEG): container finished" podID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" exitCode=2 Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.301129 5030 generic.go:358] "Generic (PLEG): container finished" podID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" exitCode=0 Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.301135 5030 generic.go:358] "Generic (PLEG): container finished" podID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" exitCode=0 Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.301606 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306828 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerDied","Data":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerDied","Data":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306894 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerDied","Data":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306905 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerDied","Data":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"88d39849-ea82-4d5a-a8ea-9328a41e4afc","Type":"ContainerDied","Data":"ee9859c9797d0755e199f244957c48e9acb6f6a4ddafa02a1858149bbe6ff5e2"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.306934 5030 scope.go:117] "RemoveContainer" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.324670 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerStarted","Data":"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7"} Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.327474 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.327655 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.327741 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.334835 5030 scope.go:117] "RemoveContainer" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.361917 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.361971 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.411174 5030 scope.go:117] "RemoveContainer" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.413660 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.427497 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428590 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-notification-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428611 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-notification-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428625 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-central-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428631 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-central-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428652 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="sg-core" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428658 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="sg-core" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428672 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="proxy-httpd" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428678 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="proxy-httpd" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428899 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="proxy-httpd" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428915 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-notification-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428925 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="sg-core" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.428937 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" containerName="ceilometer-central-agent" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.440370 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.440488 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.453289 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.453485 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.469283 5030 scope.go:117] "RemoveContainer" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.503699 5030 scope.go:117] "RemoveContainer" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: E0316 13:46:31.505044 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": container with ID starting with 0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106 not found: ID does not exist" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.505103 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} err="failed to get container status \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": rpc error: code = NotFound desc = could not find container \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": container with ID starting with 0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.505137 5030 scope.go:117] "RemoveContainer" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: E0316 13:46:31.508824 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": container with ID starting with f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552 not found: ID does not exist" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.508847 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} err="failed to get container status \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": rpc error: code = NotFound desc = could not find container \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": container with ID starting with f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.508861 5030 scope.go:117] "RemoveContainer" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: E0316 13:46:31.509774 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": container with ID starting with f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb not found: ID does not exist" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.509803 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} err="failed to get container status \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": rpc error: code = NotFound desc = could not find container \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": container with ID starting with f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.509821 5030 scope.go:117] "RemoveContainer" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: E0316 13:46:31.513778 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": container with ID starting with 9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c not found: ID does not exist" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.513802 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} err="failed to get container status \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": rpc error: code = NotFound desc = could not find container \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": container with ID starting with 9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.513816 5030 scope.go:117] "RemoveContainer" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.515438 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} err="failed to get container status \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": rpc error: code = NotFound desc = could not find container \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": container with ID starting with 0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.515460 5030 scope.go:117] "RemoveContainer" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.516783 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} err="failed to get container status \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": rpc error: code = NotFound desc = could not find container \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": container with ID starting with f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.516824 5030 scope.go:117] "RemoveContainer" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.519875 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} err="failed to get container status \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": rpc error: code = NotFound desc = could not find container \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": container with ID starting with f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.519922 5030 scope.go:117] "RemoveContainer" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.520201 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} err="failed to get container status \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": rpc error: code = NotFound desc = could not find container \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": container with ID starting with 9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.520244 5030 scope.go:117] "RemoveContainer" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.520588 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} err="failed to get container status \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": rpc error: code = NotFound desc = could not find container \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": container with ID starting with 0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.520610 5030 scope.go:117] "RemoveContainer" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.521782 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} err="failed to get container status \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": rpc error: code = NotFound desc = could not find container \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": container with ID starting with f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.521823 5030 scope.go:117] "RemoveContainer" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522048 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} err="failed to get container status \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": rpc error: code = NotFound desc = could not find container \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": container with ID starting with f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522069 5030 scope.go:117] "RemoveContainer" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522287 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} err="failed to get container status \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": rpc error: code = NotFound desc = could not find container \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": container with ID starting with 9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522326 5030 scope.go:117] "RemoveContainer" containerID="0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522828 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106"} err="failed to get container status \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": rpc error: code = NotFound desc = could not find container \"0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106\": container with ID starting with 0b4cf9026d8baa773ce6730f75b0b633eb690bdcf6eb7d4bd3eae6f648bc8106 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.522869 5030 scope.go:117] "RemoveContainer" containerID="f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.523251 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552"} err="failed to get container status \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": rpc error: code = NotFound desc = could not find container \"f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552\": container with ID starting with f9c464726d2b5d7bbf704a3c5e4f50d22a567c4ba6d98b338f02935b8562b552 not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.523271 5030 scope.go:117] "RemoveContainer" containerID="f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.523517 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb"} err="failed to get container status \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": rpc error: code = NotFound desc = could not find container \"f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb\": container with ID starting with f404601616dd61340ef8d01efbc18919e6279ae26e939d39cf3b62acc97877eb not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.523567 5030 scope.go:117] "RemoveContainer" containerID="9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.525824 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c"} err="failed to get container status \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": rpc error: code = NotFound desc = could not find container \"9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c\": container with ID starting with 9eb1f37e3977b32c6f020defb0bbaac57bb1a239bf6fc9566e8bba0999530c6c not found: ID does not exist" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529097 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529163 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529211 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529234 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98t9\" (UniqueName: \"kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529528 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.529768 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.631990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632076 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632133 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632185 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632267 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c98t9\" (UniqueName: \"kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.632944 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.633629 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.642783 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.643989 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.649910 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.657988 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.692187 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98t9\" (UniqueName: \"kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9\") pod \"ceilometer-0\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.792947 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:31 crc kubenswrapper[5030]: I0316 13:46:31.968468 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d39849-ea82-4d5a-a8ea-9328a41e4afc" path="/var/lib/kubelet/pods/88d39849-ea82-4d5a-a8ea-9328a41e4afc/volumes" Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.237003 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.334152 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerStarted","Data":"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3"} Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.334279 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.335099 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerStarted","Data":"56478c24330144e680ae8a952ac14f25aacb4395bb0ae6a263b033b27099b518"} Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.352802 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.352790869 podStartE2EDuration="3.352790869s" podCreationTimestamp="2026-03-16 13:46:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:32.350862823 +0000 UTC m=+2436.750175369" watchObservedRunningTime="2026-03-16 13:46:32.352790869 +0000 UTC m=+2436.752103416" Mar 16 13:46:32 crc kubenswrapper[5030]: I0316 13:46:32.946195 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:46:32 crc kubenswrapper[5030]: E0316 13:46:32.946613 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.076476 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.138893 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.149401 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.236290 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.247746 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.303176 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.354563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerStarted","Data":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.355600 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="cinder-scheduler" containerID="cri-o://ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670" gracePeriod=30 Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.355702 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="probe" containerID="cri-o://ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb" gracePeriod=30 Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.443162 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.464098 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.539648 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.746354 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.752384 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.757797 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.761423 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.763659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.772616 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778427 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778474 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778567 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4lpc\" (UniqueName: \"kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778619 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t52pb\" (UniqueName: \"kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778660 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778734 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778781 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.778892 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.887584 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.887772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.887866 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.887915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.887977 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.888014 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.888052 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4lpc\" (UniqueName: \"kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.888104 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t52pb\" (UniqueName: \"kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.888171 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.888275 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.891021 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.891043 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.916236 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.917875 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.918278 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.919147 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.927614 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.928254 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.933444 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.936484 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4lpc\" (UniqueName: \"kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc\") pod \"barbican-worker-56cb6b7d9-b6j8s\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.942699 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.951448 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-internal-svc\"" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.951647 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-neutron-public-svc\"" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.959060 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t52pb\" (UniqueName: \"kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb\") pod \"barbican-keystone-listener-6f9b49dc46-9r4jg\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.979071 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.989995 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.992383 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.992455 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9shg\" (UniqueName: \"kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.992614 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.992696 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.995978 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.996051 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:33 crc kubenswrapper[5030]: I0316 13:46:33.996163 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.004805 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.010600 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.071144 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.078182 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097362 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097428 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097467 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097568 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097593 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097623 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097661 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097689 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097721 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntvj\" (UniqueName: \"kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097752 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097781 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9shg\" (UniqueName: \"kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.097805 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.106183 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.119299 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.123414 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.123454 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.123973 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.139353 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9shg\" (UniqueName: \"kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.142984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs\") pod \"neutron-6bb7556d4d-hp4sg\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.212430 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.212526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntvj\" (UniqueName: \"kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.212915 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.213144 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.213318 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.213737 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.221070 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.221530 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.231493 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.237444 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntvj\" (UniqueName: \"kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj\") pod \"barbican-api-75bc6586d-8bpvs\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.341209 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.341768 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.343987 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.394791 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerStarted","Data":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.398730 5030 generic.go:358] "Generic (PLEG): container finished" podID="74acab88-03a2-4157-855b-425f886e1a81" containerID="ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb" exitCode=0 Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.400161 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api-log" containerID="cri-o://133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" gracePeriod=30 Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.400577 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerDied","Data":"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb"} Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.400925 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api" containerID="cri-o://c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" gracePeriod=30 Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.415745 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.430209 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.433299 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-internal-svc\"" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.433567 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-barbican-public-svc\"" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.445956 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.461628 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:46:34 crc kubenswrapper[5030]: W0316 13:46:34.505787 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92cd8b90_d16f_4a1b_b2c8_0cb160ca548c.slice/crio-88ae39da0c2ac87adb1d943d4cdf7598271549caea409541649daabcf01cfad0 WatchSource:0}: Error finding container 88ae39da0c2ac87adb1d943d4cdf7598271549caea409541649daabcf01cfad0: Status 404 returned error can't find the container with id 88ae39da0c2ac87adb1d943d4cdf7598271549caea409541649daabcf01cfad0 Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.521103 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8rl4\" (UniqueName: \"kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.521888 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.521980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.522069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.522139 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.522206 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.522569 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.623819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8rl4\" (UniqueName: \"kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.623889 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.623923 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.623960 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.623992 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.624029 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.624156 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.629692 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.629927 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.635785 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.642055 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.643365 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.645956 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.656013 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8rl4\" (UniqueName: \"kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4\") pod \"barbican-api-6ff778688b-j9j5q\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.698890 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:46:34 crc kubenswrapper[5030]: I0316 13:46:34.775796 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.118450 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.395829 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.428371 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerStarted","Data":"d4674cd5ba101972c2a362d9349a3482c4ca936a1086985a257627f70085e93c"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.428599 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerStarted","Data":"f884f150183c448938566fd9390fae8fe16a52672af9855c7a1d2f81e3448c9f"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432229 5030 generic.go:358] "Generic (PLEG): container finished" podID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerID="c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" exitCode=0 Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432329 5030 generic.go:358] "Generic (PLEG): container finished" podID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerID="133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" exitCode=143 Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432522 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerDied","Data":"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432628 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerDied","Data":"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432696 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"29d71b56-7d26-4a8b-aa1f-07ed36e86b51","Type":"ContainerDied","Data":"46e8e8cd1dc13bc8ae55a3d2aed7ad82446cc42cf9c0a3b694455c2beb6dcfea"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.432821 5030 scope.go:117] "RemoveContainer" containerID="c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.433033 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.444906 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerStarted","Data":"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.444950 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerStarted","Data":"88ae39da0c2ac87adb1d943d4cdf7598271549caea409541649daabcf01cfad0"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.462541 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.462935 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463038 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463182 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs" (OuterVolumeSpecName: "logs") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463495 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97f5g\" (UniqueName: \"kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463698 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.463815 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.464401 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.464540 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts\") pod \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\" (UID: \"29d71b56-7d26-4a8b-aa1f-07ed36e86b51\") " Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.465437 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.470781 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts" (OuterVolumeSpecName: "scripts") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.471445 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.496937 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.497709 5030 scope.go:117] "RemoveContainer" containerID="133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.498020 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g" (OuterVolumeSpecName: "kube-api-access-97f5g") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "kube-api-access-97f5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.499949 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerStarted","Data":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.506563 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerStarted","Data":"f923032b894642c19b84619320c1a3b108481e7a9d28a05c2dadff50da9e7451"} Mar 16 13:46:35 crc kubenswrapper[5030]: W0316 13:46:35.519987 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod847dd3c8_0de1_40bb_8709_8fba30c37d28.slice/crio-52fdb1379a1d0933148dfead5e76d4f50a64aa535e17fe2db944cfbf89f8c4df WatchSource:0}: Error finding container 52fdb1379a1d0933148dfead5e76d4f50a64aa535e17fe2db944cfbf89f8c4df: Status 404 returned error can't find the container with id 52fdb1379a1d0933148dfead5e76d4f50a64aa535e17fe2db944cfbf89f8c4df Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.520702 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.528729 5030 scope.go:117] "RemoveContainer" containerID="c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" Mar 16 13:46:35 crc kubenswrapper[5030]: E0316 13:46:35.529911 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3\": container with ID starting with c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3 not found: ID does not exist" containerID="c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.529947 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3"} err="failed to get container status \"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3\": rpc error: code = NotFound desc = could not find container \"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3\": container with ID starting with c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3 not found: ID does not exist" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.529973 5030 scope.go:117] "RemoveContainer" containerID="133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" Mar 16 13:46:35 crc kubenswrapper[5030]: E0316 13:46:35.532545 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7\": container with ID starting with 133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7 not found: ID does not exist" containerID="133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.532601 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7"} err="failed to get container status \"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7\": rpc error: code = NotFound desc = could not find container \"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7\": container with ID starting with 133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7 not found: ID does not exist" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.532671 5030 scope.go:117] "RemoveContainer" containerID="c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.533708 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3"} err="failed to get container status \"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3\": rpc error: code = NotFound desc = could not find container \"c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3\": container with ID starting with c2f01b2d1dc164e7fb44522c11a64d0b4afbefdf142e7068ad7fe1a7e0610ba3 not found: ID does not exist" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.533756 5030 scope.go:117] "RemoveContainer" containerID="133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.534208 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7"} err="failed to get container status \"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7\": rpc error: code = NotFound desc = could not find container \"133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7\": container with ID starting with 133d7fee43e52d6170fde47202f4ee4754bcb9a883ab315c26227e3a8eff63b7 not found: ID does not exist" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.577402 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97f5g\" (UniqueName: \"kubernetes.io/projected/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-kube-api-access-97f5g\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.577426 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.577436 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.577450 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.670016 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.671965 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.680619 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.700746 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data" (OuterVolumeSpecName: "config-data") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.714645 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.719807 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "29d71b56-7d26-4a8b-aa1f-07ed36e86b51" (UID: "29d71b56-7d26-4a8b-aa1f-07ed36e86b51"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.772610 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.783943 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.785764 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.785791 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.785802 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/29d71b56-7d26-4a8b-aa1f-07ed36e86b51-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.802536 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804385 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api-log" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804411 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api-log" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804439 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804445 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804659 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api-log" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.804685 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" containerName="cinder-api" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.811319 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.815344 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-public-svc\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.815606 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-cinder-internal-svc\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.819189 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.819838 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-api-config-data\"" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.887979 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888131 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2dv6\" (UniqueName: \"kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888182 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888219 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888298 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888379 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.888401 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.982396 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29d71b56-7d26-4a8b-aa1f-07ed36e86b51" path="/var/lib/kubelet/pods/29d71b56-7d26-4a8b-aa1f-07ed36e86b51/volumes" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.990990 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991061 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991098 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2dv6\" (UniqueName: \"kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991179 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991233 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991335 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991351 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991481 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.991497 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.992061 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.992374 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:35 crc kubenswrapper[5030]: I0316 13:46:35.996678 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.001067 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.005918 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.015459 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.019988 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.021676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.023066 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2dv6\" (UniqueName: \"kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6\") pod \"cinder-api-0\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.104650 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.109196 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.196949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrk6x\" (UniqueName: \"kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.197192 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.197262 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.197302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.197414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.197465 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom\") pod \"74acab88-03a2-4157-855b-425f886e1a81\" (UID: \"74acab88-03a2-4157-855b-425f886e1a81\") " Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.203737 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x" (OuterVolumeSpecName: "kube-api-access-rrk6x") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "kube-api-access-rrk6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.205728 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.233630 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts" (OuterVolumeSpecName: "scripts") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.237650 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.300036 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrk6x\" (UniqueName: \"kubernetes.io/projected/74acab88-03a2-4157-855b-425f886e1a81-kube-api-access-rrk6x\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.300306 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/74acab88-03a2-4157-855b-425f886e1a81-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.300318 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.300328 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.387403 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.403004 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.439779 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data" (OuterVolumeSpecName: "config-data") pod "74acab88-03a2-4157-855b-425f886e1a81" (UID: "74acab88-03a2-4157-855b-425f886e1a81"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.505451 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/74acab88-03a2-4157-855b-425f886e1a81-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.525354 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerStarted","Data":"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.535865 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerStarted","Data":"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.535919 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerStarted","Data":"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.536282 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.544564 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" podStartSLOduration=3.544538362 podStartE2EDuration="3.544538362s" podCreationTimestamp="2026-03-16 13:46:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:36.539731593 +0000 UTC m=+2440.939044140" watchObservedRunningTime="2026-03-16 13:46:36.544538362 +0000 UTC m=+2440.943850909" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.545736 5030 generic.go:358] "Generic (PLEG): container finished" podID="74acab88-03a2-4157-855b-425f886e1a81" containerID="ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670" exitCode=0 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.545872 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.545910 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerDied","Data":"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.545943 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"74acab88-03a2-4157-855b-425f886e1a81","Type":"ContainerDied","Data":"2b0c721523ea3eade3c3fc98255597c95190164bc230da59a3c2b3f79bad6cb9"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.545965 5030 scope.go:117] "RemoveContainer" containerID="ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.561893 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.562091 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker-log" containerID="cri-o://4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.562235 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker" containerID="cri-o://e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.574613 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerStarted","Data":"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.574678 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerStarted","Data":"66b720b1469423d5306629fe3c2d5002464243c0cdf4391494177ac1232c5a8b"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.574739 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.574766 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.588523 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerStarted","Data":"62038ccaff50077bb6c604f695759dfc7d5f1bf6e310a2110e12a86087abc5c1"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.590700 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" podStartSLOduration=3.590683578 podStartE2EDuration="3.590683578s" podCreationTimestamp="2026-03-16 13:46:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:36.573701219 +0000 UTC m=+2440.973013766" watchObservedRunningTime="2026-03-16 13:46:36.590683578 +0000 UTC m=+2440.989996126" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerStarted","Data":"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595774 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595786 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerStarted","Data":"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595795 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerStarted","Data":"52fdb1379a1d0933148dfead5e76d4f50a64aa535e17fe2db944cfbf89f8c4df"} Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595805 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595880 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api" containerID="cri-o://667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.595852 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api-log" containerID="cri-o://bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.609357 5030 scope.go:117] "RemoveContainer" containerID="ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.622822 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" podStartSLOduration=2.6228071330000002 podStartE2EDuration="2.622807133s" podCreationTimestamp="2026-03-16 13:46:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:36.610158574 +0000 UTC m=+2441.009471122" watchObservedRunningTime="2026-03-16 13:46:36.622807133 +0000 UTC m=+2441.022119680" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.659762 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.675727 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" podStartSLOduration=3.675705409 podStartE2EDuration="3.675705409s" podCreationTimestamp="2026-03-16 13:46:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:36.630320002 +0000 UTC m=+2441.029632569" watchObservedRunningTime="2026-03-16 13:46:36.675705409 +0000 UTC m=+2441.075017956" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.683456 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" podStartSLOduration=3.683437971 podStartE2EDuration="3.683437971s" podCreationTimestamp="2026-03-16 13:46:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:36.645249581 +0000 UTC m=+2441.044562127" watchObservedRunningTime="2026-03-16 13:46:36.683437971 +0000 UTC m=+2441.082750519" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.695660 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.696001 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener-log" containerID="cri-o://61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.696599 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener" containerID="cri-o://b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc" gracePeriod=30 Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.697654 5030 scope.go:117] "RemoveContainer" containerID="ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb" Mar 16 13:46:36 crc kubenswrapper[5030]: E0316 13:46:36.698744 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb\": container with ID starting with ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb not found: ID does not exist" containerID="ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.698864 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb"} err="failed to get container status \"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb\": rpc error: code = NotFound desc = could not find container \"ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb\": container with ID starting with ab6cf2e27efae91b94bbeabc50244f0dfd10b913d566978c044ad2a48fdf1adb not found: ID does not exist" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.698950 5030 scope.go:117] "RemoveContainer" containerID="ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670" Mar 16 13:46:36 crc kubenswrapper[5030]: E0316 13:46:36.699356 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670\": container with ID starting with ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670 not found: ID does not exist" containerID="ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.699716 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670"} err="failed to get container status \"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670\": rpc error: code = NotFound desc = could not find container \"ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670\": container with ID starting with ca6c0731d69882416e65c902d3ce444592bec9c76d423ddb35b8fac7be48c670 not found: ID does not exist" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.700856 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.717246 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.721934 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.725582 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="probe" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.725799 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="probe" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.725826 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="cinder-scheduler" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.725833 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="cinder-scheduler" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.727529 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="probe" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.727578 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="74acab88-03a2-4157-855b-425f886e1a81" containerName="cinder-scheduler" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.752711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.755164 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cinder-scheduler-config-data\"" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.787196 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.812527 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.812614 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.812681 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.812701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.812996 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfpg\" (UniqueName: \"kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.816733 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.920174 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.920596 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.920750 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfpg\" (UniqueName: \"kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.920884 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.921111 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.921228 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.921419 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.932455 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.938835 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.944007 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.946227 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:36 crc kubenswrapper[5030]: I0316 13:46:36.959327 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfpg\" (UniqueName: \"kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg\") pod \"cinder-scheduler-0\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.071101 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.196837 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.329135 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data\") pod \"847dd3c8-0de1-40bb-8709-8fba30c37d28\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.329258 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs\") pod \"847dd3c8-0de1-40bb-8709-8fba30c37d28\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.329417 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle\") pod \"847dd3c8-0de1-40bb-8709-8fba30c37d28\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.329492 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ntvj\" (UniqueName: \"kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj\") pod \"847dd3c8-0de1-40bb-8709-8fba30c37d28\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.329761 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom\") pod \"847dd3c8-0de1-40bb-8709-8fba30c37d28\" (UID: \"847dd3c8-0de1-40bb-8709-8fba30c37d28\") " Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.331792 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs" (OuterVolumeSpecName: "logs") pod "847dd3c8-0de1-40bb-8709-8fba30c37d28" (UID: "847dd3c8-0de1-40bb-8709-8fba30c37d28"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.335223 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "847dd3c8-0de1-40bb-8709-8fba30c37d28" (UID: "847dd3c8-0de1-40bb-8709-8fba30c37d28"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.336378 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj" (OuterVolumeSpecName: "kube-api-access-2ntvj") pod "847dd3c8-0de1-40bb-8709-8fba30c37d28" (UID: "847dd3c8-0de1-40bb-8709-8fba30c37d28"). InnerVolumeSpecName "kube-api-access-2ntvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.353422 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "847dd3c8-0de1-40bb-8709-8fba30c37d28" (UID: "847dd3c8-0de1-40bb-8709-8fba30c37d28"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.370261 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data" (OuterVolumeSpecName: "config-data") pod "847dd3c8-0de1-40bb-8709-8fba30c37d28" (UID: "847dd3c8-0de1-40bb-8709-8fba30c37d28"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.432567 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.432602 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/847dd3c8-0de1-40bb-8709-8fba30c37d28-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.432613 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.432625 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ntvj\" (UniqueName: \"kubernetes.io/projected/847dd3c8-0de1-40bb-8709-8fba30c37d28-kube-api-access-2ntvj\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.432633 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/847dd3c8-0de1-40bb-8709-8fba30c37d28-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.520095 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:46:37 crc kubenswrapper[5030]: W0316 13:46:37.521738 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07969d90_48f5_40c7_83df_10f59ad41589.slice/crio-a2f1518966b7da306601410263c42183bb5e08dc004942c6ab231190b483b341 WatchSource:0}: Error finding container a2f1518966b7da306601410263c42183bb5e08dc004942c6ab231190b483b341: Status 404 returned error can't find the container with id a2f1518966b7da306601410263c42183bb5e08dc004942c6ab231190b483b341 Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.611419 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerID="4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc" exitCode=143 Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.611559 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerDied","Data":"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.615363 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerStarted","Data":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.615478 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.619591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerStarted","Data":"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.619642 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerStarted","Data":"3764b8369576aec4bf56d992d662c7363472a66682e9a6fc2abf99199bc37fde"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.624280 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerStarted","Data":"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.626996 5030 generic.go:358] "Generic (PLEG): container finished" podID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerID="667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" exitCode=1 Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627020 5030 generic.go:358] "Generic (PLEG): container finished" podID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerID="bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" exitCode=143 Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627077 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerDied","Data":"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627114 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerDied","Data":"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627125 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" event={"ID":"847dd3c8-0de1-40bb-8709-8fba30c37d28","Type":"ContainerDied","Data":"52fdb1379a1d0933148dfead5e76d4f50a64aa535e17fe2db944cfbf89f8c4df"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627142 5030 scope.go:117] "RemoveContainer" containerID="667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.627263 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.642265 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.815776589 podStartE2EDuration="6.64225223s" podCreationTimestamp="2026-03-16 13:46:31 +0000 UTC" firstStartedPulling="2026-03-16 13:46:32.243876363 +0000 UTC m=+2436.643188910" lastFinishedPulling="2026-03-16 13:46:37.070352004 +0000 UTC m=+2441.469664551" observedRunningTime="2026-03-16 13:46:37.63745639 +0000 UTC m=+2442.036768997" watchObservedRunningTime="2026-03-16 13:46:37.64225223 +0000 UTC m=+2442.041564777" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.644487 5030 generic.go:358] "Generic (PLEG): container finished" podID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerID="61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327" exitCode=143 Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.644533 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerDied","Data":"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.646990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerStarted","Data":"a2f1518966b7da306601410263c42183bb5e08dc004942c6ab231190b483b341"} Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.674392 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.683562 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-75bc6586d-8bpvs"] Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.685340 5030 scope.go:117] "RemoveContainer" containerID="bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.708883 5030 scope.go:117] "RemoveContainer" containerID="667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" Mar 16 13:46:37 crc kubenswrapper[5030]: E0316 13:46:37.709192 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039\": container with ID starting with 667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039 not found: ID does not exist" containerID="667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709234 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039"} err="failed to get container status \"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039\": rpc error: code = NotFound desc = could not find container \"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039\": container with ID starting with 667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039 not found: ID does not exist" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709261 5030 scope.go:117] "RemoveContainer" containerID="bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" Mar 16 13:46:37 crc kubenswrapper[5030]: E0316 13:46:37.709504 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d\": container with ID starting with bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d not found: ID does not exist" containerID="bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709539 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d"} err="failed to get container status \"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d\": rpc error: code = NotFound desc = could not find container \"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d\": container with ID starting with bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d not found: ID does not exist" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709566 5030 scope.go:117] "RemoveContainer" containerID="667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709927 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039"} err="failed to get container status \"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039\": rpc error: code = NotFound desc = could not find container \"667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039\": container with ID starting with 667c7d9d6b8235aea3379f386fa5b1d465703ba0860d78e65b651d3e32a4e039 not found: ID does not exist" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.709985 5030 scope.go:117] "RemoveContainer" containerID="bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.710537 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d"} err="failed to get container status \"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d\": rpc error: code = NotFound desc = could not find container \"bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d\": container with ID starting with bbe0be98c5a198fc237a8c12cc7add065bd66725c8e8cf26717d7284d6ae548d not found: ID does not exist" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.959050 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74acab88-03a2-4157-855b-425f886e1a81" path="/var/lib/kubelet/pods/74acab88-03a2-4157-855b-425f886e1a81/volumes" Mar 16 13:46:37 crc kubenswrapper[5030]: I0316 13:46:37.959995 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" path="/var/lib/kubelet/pods/847dd3c8-0de1-40bb-8709-8fba30c37d28/volumes" Mar 16 13:46:38 crc kubenswrapper[5030]: I0316 13:46:38.666248 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerStarted","Data":"6099679102d083b474c9ddfd661c9831f56d26793167606899cdbc4988425712"} Mar 16 13:46:38 crc kubenswrapper[5030]: I0316 13:46:38.672348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerStarted","Data":"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e"} Mar 16 13:46:38 crc kubenswrapper[5030]: I0316 13:46:38.672959 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:38 crc kubenswrapper[5030]: I0316 13:46:38.692113 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-api-0" podStartSLOduration=3.692090046 podStartE2EDuration="3.692090046s" podCreationTimestamp="2026-03-16 13:46:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:38.688312782 +0000 UTC m=+2443.087625328" watchObservedRunningTime="2026-03-16 13:46:38.692090046 +0000 UTC m=+2443.091402592" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.011962 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.077455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle\") pod \"7e2c2574-d94a-4c14-b979-9f6b21160531\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.077686 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data\") pod \"7e2c2574-d94a-4c14-b979-9f6b21160531\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.077740 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom\") pod \"7e2c2574-d94a-4c14-b979-9f6b21160531\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.078088 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trrc9\" (UniqueName: \"kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9\") pod \"7e2c2574-d94a-4c14-b979-9f6b21160531\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.078199 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs\") pod \"7e2c2574-d94a-4c14-b979-9f6b21160531\" (UID: \"7e2c2574-d94a-4c14-b979-9f6b21160531\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.078812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs" (OuterVolumeSpecName: "logs") pod "7e2c2574-d94a-4c14-b979-9f6b21160531" (UID: "7e2c2574-d94a-4c14-b979-9f6b21160531"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.079190 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7e2c2574-d94a-4c14-b979-9f6b21160531-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.085349 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "7e2c2574-d94a-4c14-b979-9f6b21160531" (UID: "7e2c2574-d94a-4c14-b979-9f6b21160531"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.086224 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9" (OuterVolumeSpecName: "kube-api-access-trrc9") pod "7e2c2574-d94a-4c14-b979-9f6b21160531" (UID: "7e2c2574-d94a-4c14-b979-9f6b21160531"). InnerVolumeSpecName "kube-api-access-trrc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.105539 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7e2c2574-d94a-4c14-b979-9f6b21160531" (UID: "7e2c2574-d94a-4c14-b979-9f6b21160531"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.129377 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data" (OuterVolumeSpecName: "config-data") pod "7e2c2574-d94a-4c14-b979-9f6b21160531" (UID: "7e2c2574-d94a-4c14-b979-9f6b21160531"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.181863 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.181896 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.181908 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/7e2c2574-d94a-4c14-b979-9f6b21160531-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.181918 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trrc9\" (UniqueName: \"kubernetes.io/projected/7e2c2574-d94a-4c14-b979-9f6b21160531-kube-api-access-trrc9\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.460822 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595043 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xttml\" (UniqueName: \"kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml\") pod \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595291 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data\") pod \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595466 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs\") pod \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595541 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom\") pod \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595612 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle\") pod \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\" (UID: \"e5f0543f-94e0-4aa4-a45c-d73e09cafca7\") " Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.595916 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs" (OuterVolumeSpecName: "logs") pod "e5f0543f-94e0-4aa4-a45c-d73e09cafca7" (UID: "e5f0543f-94e0-4aa4-a45c-d73e09cafca7"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.596847 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.599337 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml" (OuterVolumeSpecName: "kube-api-access-xttml") pod "e5f0543f-94e0-4aa4-a45c-d73e09cafca7" (UID: "e5f0543f-94e0-4aa4-a45c-d73e09cafca7"). InnerVolumeSpecName "kube-api-access-xttml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.599369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "e5f0543f-94e0-4aa4-a45c-d73e09cafca7" (UID: "e5f0543f-94e0-4aa4-a45c-d73e09cafca7"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.617191 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "e5f0543f-94e0-4aa4-a45c-d73e09cafca7" (UID: "e5f0543f-94e0-4aa4-a45c-d73e09cafca7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.637829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data" (OuterVolumeSpecName: "config-data") pod "e5f0543f-94e0-4aa4-a45c-d73e09cafca7" (UID: "e5f0543f-94e0-4aa4-a45c-d73e09cafca7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.682813 5030 generic.go:358] "Generic (PLEG): container finished" podID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerID="e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8" exitCode=0 Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.682919 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerDied","Data":"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8"} Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.682990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" event={"ID":"7e2c2574-d94a-4c14-b979-9f6b21160531","Type":"ContainerDied","Data":"415c9fdde236bde6bb6ad9285ede52b3bf518eb7e64a236d47156691b87ffb97"} Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.683015 5030 scope.go:117] "RemoveContainer" containerID="e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.683573 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-658f6984f-qkvll" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.688170 5030 generic.go:358] "Generic (PLEG): container finished" podID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerID="b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc" exitCode=0 Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.688340 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerDied","Data":"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc"} Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.688409 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" event={"ID":"e5f0543f-94e0-4aa4-a45c-d73e09cafca7","Type":"ContainerDied","Data":"0a3c6435a5feb0f4889b4c52186aff64471ec29e6ae0d9debb8e38f63c4b4f4c"} Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.688352 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.705698 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerStarted","Data":"0afa20db4ecbcb36232ca7614fe3c74b15da50f67a1bd02fa80881b9803dc867"} Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.708222 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xttml\" (UniqueName: \"kubernetes.io/projected/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-kube-api-access-xttml\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.708248 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.708265 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.708277 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5f0543f-94e0-4aa4-a45c-d73e09cafca7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.731104 5030 scope.go:117] "RemoveContainer" containerID="4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.743198 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/cinder-scheduler-0" podStartSLOduration=3.743181569 podStartE2EDuration="3.743181569s" podCreationTimestamp="2026-03-16 13:46:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:39.731429507 +0000 UTC m=+2444.130742054" watchObservedRunningTime="2026-03-16 13:46:39.743181569 +0000 UTC m=+2444.142494116" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.754807 5030 scope.go:117] "RemoveContainer" containerID="e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8" Mar 16 13:46:39 crc kubenswrapper[5030]: E0316 13:46:39.755108 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8\": container with ID starting with e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8 not found: ID does not exist" containerID="e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.755142 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8"} err="failed to get container status \"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8\": rpc error: code = NotFound desc = could not find container \"e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8\": container with ID starting with e2266b7ae2158f97560e5d946b7177c7e2004a7b879162990efb7bc9095fc5e8 not found: ID does not exist" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.755160 5030 scope.go:117] "RemoveContainer" containerID="4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc" Mar 16 13:46:39 crc kubenswrapper[5030]: E0316 13:46:39.755642 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc\": container with ID starting with 4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc not found: ID does not exist" containerID="4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.755663 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc"} err="failed to get container status \"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc\": rpc error: code = NotFound desc = could not find container \"4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc\": container with ID starting with 4ef88431404cb78523035b7c63c760d3ef4458f7cceb2672c8fa86314364bafc not found: ID does not exist" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.755677 5030 scope.go:117] "RemoveContainer" containerID="b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.760334 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.767075 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-658f6984f-qkvll"] Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.772079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.776350 5030 scope.go:117] "RemoveContainer" containerID="61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.777781 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-866c995988-7pmgh"] Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.793675 5030 scope.go:117] "RemoveContainer" containerID="b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc" Mar 16 13:46:39 crc kubenswrapper[5030]: E0316 13:46:39.794005 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc\": container with ID starting with b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc not found: ID does not exist" containerID="b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.794059 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc"} err="failed to get container status \"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc\": rpc error: code = NotFound desc = could not find container \"b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc\": container with ID starting with b0197f52999d4cf552305bb66c945dc310b68d62622bc8acf674b1b01fee02fc not found: ID does not exist" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.794083 5030 scope.go:117] "RemoveContainer" containerID="61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327" Mar 16 13:46:39 crc kubenswrapper[5030]: E0316 13:46:39.794398 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327\": container with ID starting with 61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327 not found: ID does not exist" containerID="61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.794428 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327"} err="failed to get container status \"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327\": rpc error: code = NotFound desc = could not find container \"61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327\": container with ID starting with 61b18aa4d5c938c126d1ff94b717d6ff2d6dd0f8c9fe0ec93058a158b6227327 not found: ID does not exist" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.984104 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" path="/var/lib/kubelet/pods/7e2c2574-d94a-4c14-b979-9f6b21160531/volumes" Mar 16 13:46:39 crc kubenswrapper[5030]: I0316 13:46:39.985978 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" path="/var/lib/kubelet/pods/e5f0543f-94e0-4aa4-a45c-d73e09cafca7/volumes" Mar 16 13:46:42 crc kubenswrapper[5030]: I0316 13:46:42.071886 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:44 crc kubenswrapper[5030]: I0316 13:46:44.977942 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:44 crc kubenswrapper[5030]: I0316 13:46:44.989803 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:46:45 crc kubenswrapper[5030]: I0316 13:46:45.048537 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:45 crc kubenswrapper[5030]: I0316 13:46:45.048805 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api-log" containerID="cri-o://a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3" gracePeriod=30 Mar 16 13:46:45 crc kubenswrapper[5030]: I0316 13:46:45.048936 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api" containerID="cri-o://afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9" gracePeriod=30 Mar 16 13:46:45 crc kubenswrapper[5030]: I0316 13:46:45.805910 5030 generic.go:358] "Generic (PLEG): container finished" podID="0235e081-524b-4c49-93db-0c681992f156" containerID="a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3" exitCode=143 Mar 16 13:46:45 crc kubenswrapper[5030]: I0316 13:46:45.805962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerDied","Data":"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3"} Mar 16 13:46:46 crc kubenswrapper[5030]: I0316 13:46:46.946894 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:46:46 crc kubenswrapper[5030]: E0316 13:46:46.947381 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:46:47 crc kubenswrapper[5030]: I0316 13:46:47.354449 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:46:47 crc kubenswrapper[5030]: I0316 13:46:47.434507 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.197054 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api" probeResult="failure" output="Get \"http://10.217.0.224:9311/healthcheck\": read tcp 10.217.0.2:58626->10.217.0.224:9311: read: connection reset by peer" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.605608 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.718866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs\") pod \"0235e081-524b-4c49-93db-0c681992f156\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.718965 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps558\" (UniqueName: \"kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558\") pod \"0235e081-524b-4c49-93db-0c681992f156\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.719006 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle\") pod \"0235e081-524b-4c49-93db-0c681992f156\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.719085 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom\") pod \"0235e081-524b-4c49-93db-0c681992f156\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.719106 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data\") pod \"0235e081-524b-4c49-93db-0c681992f156\" (UID: \"0235e081-524b-4c49-93db-0c681992f156\") " Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.720627 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs" (OuterVolumeSpecName: "logs") pod "0235e081-524b-4c49-93db-0c681992f156" (UID: "0235e081-524b-4c49-93db-0c681992f156"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.725085 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "0235e081-524b-4c49-93db-0c681992f156" (UID: "0235e081-524b-4c49-93db-0c681992f156"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.728183 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558" (OuterVolumeSpecName: "kube-api-access-ps558") pod "0235e081-524b-4c49-93db-0c681992f156" (UID: "0235e081-524b-4c49-93db-0c681992f156"). InnerVolumeSpecName "kube-api-access-ps558". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.742230 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0235e081-524b-4c49-93db-0c681992f156" (UID: "0235e081-524b-4c49-93db-0c681992f156"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.757841 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data" (OuterVolumeSpecName: "config-data") pod "0235e081-524b-4c49-93db-0c681992f156" (UID: "0235e081-524b-4c49-93db-0c681992f156"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.823495 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/0235e081-524b-4c49-93db-0c681992f156-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.823540 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps558\" (UniqueName: \"kubernetes.io/projected/0235e081-524b-4c49-93db-0c681992f156-kube-api-access-ps558\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.823597 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.823609 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.823622 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/0235e081-524b-4c49-93db-0c681992f156-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.842906 5030 generic.go:358] "Generic (PLEG): container finished" podID="0235e081-524b-4c49-93db-0c681992f156" containerID="afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9" exitCode=0 Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.843094 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.843153 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerDied","Data":"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9"} Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.844153 5030 scope.go:117] "RemoveContainer" containerID="afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.846463 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" event={"ID":"0235e081-524b-4c49-93db-0c681992f156","Type":"ContainerDied","Data":"ea91bd8866ebc00d6b303a8eb07cbf09379f44e6eb054dcdeb21a7e1457719b6"} Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.880323 5030 scope.go:117] "RemoveContainer" containerID="a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.885668 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.891054 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-f5564dbf8-j792g"] Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.899085 5030 scope.go:117] "RemoveContainer" containerID="afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9" Mar 16 13:46:48 crc kubenswrapper[5030]: E0316 13:46:48.899686 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9\": container with ID starting with afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9 not found: ID does not exist" containerID="afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.899870 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9"} err="failed to get container status \"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9\": rpc error: code = NotFound desc = could not find container \"afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9\": container with ID starting with afd4a131ca1ec667a08efa3aadafb6755c3f8099e5d278cca2f58551c07c02d9 not found: ID does not exist" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.899943 5030 scope.go:117] "RemoveContainer" containerID="a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3" Mar 16 13:46:48 crc kubenswrapper[5030]: E0316 13:46:48.900537 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3\": container with ID starting with a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3 not found: ID does not exist" containerID="a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3" Mar 16 13:46:48 crc kubenswrapper[5030]: I0316 13:46:48.900593 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3"} err="failed to get container status \"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3\": rpc error: code = NotFound desc = could not find container \"a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3\": container with ID starting with a4a790f30e6c0967f60cc71ebf046ff6e740628ba9963152cb2e45858ebe5ee3 not found: ID does not exist" Mar 16 13:46:49 crc kubenswrapper[5030]: I0316 13:46:49.956540 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0235e081-524b-4c49-93db-0c681992f156" path="/var/lib/kubelet/pods/0235e081-524b-4c49-93db-0c681992f156/volumes" Mar 16 13:46:53 crc kubenswrapper[5030]: I0316 13:46:53.465286 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-f5564dbf8-j792g" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api-log" probeResult="failure" output="Get \"http://10.217.0.224:9311/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:46:53 crc kubenswrapper[5030]: E0316 13:46:53.811307 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1597795 actualBytes=10240 Mar 16 13:46:56 crc kubenswrapper[5030]: I0316 13:46:56.081223 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:56 crc kubenswrapper[5030]: I0316 13:46:56.874364 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.181532 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.182701 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.182731 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.182772 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183447 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183462 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183471 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183503 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183508 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183532 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183537 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183574 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183582 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183593 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183600 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183606 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183611 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183894 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183914 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183927 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183936 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5f0543f-94e0-4aa4-a45c-d73e09cafca7" containerName="barbican-keystone-listener" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183946 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183962 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="847dd3c8-0de1-40bb-8709-8fba30c37d28" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183970 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e2c2574-d94a-4c14-b979-9f6b21160531" containerName="barbican-worker" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.183986 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0235e081-524b-4c49-93db-0c681992f156" containerName="barbican-api-log" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.189341 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.200770 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207491 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207596 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9nzw\" (UniqueName: \"kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207813 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207847 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207902 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207941 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.207975 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.309817 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310003 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310051 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310163 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9nzw\" (UniqueName: \"kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310320 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310639 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310689 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.310774 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.318606 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.319490 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.319589 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.320600 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.322580 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.325628 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9nzw\" (UniqueName: \"kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw\") pod \"placement-798fdd79cd-2b8zn\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.506097 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.911819 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:46:57 crc kubenswrapper[5030]: I0316 13:46:57.933194 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerStarted","Data":"882121b8e890e4b216728330a0f8762948bac0cf898f99d3999e3c28a0056945"} Mar 16 13:46:58 crc kubenswrapper[5030]: I0316 13:46:58.944418 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerStarted","Data":"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717"} Mar 16 13:46:58 crc kubenswrapper[5030]: I0316 13:46:58.945082 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerStarted","Data":"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817"} Mar 16 13:46:58 crc kubenswrapper[5030]: I0316 13:46:58.946222 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:58 crc kubenswrapper[5030]: I0316 13:46:58.946247 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:46:58 crc kubenswrapper[5030]: I0316 13:46:58.966992 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" podStartSLOduration=1.966969336 podStartE2EDuration="1.966969336s" podCreationTimestamp="2026-03-16 13:46:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:46:58.964468673 +0000 UTC m=+2463.363781221" watchObservedRunningTime="2026-03-16 13:46:58.966969336 +0000 UTC m=+2463.366281883" Mar 16 13:47:01 crc kubenswrapper[5030]: I0316 13:47:01.329125 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:47:01 crc kubenswrapper[5030]: I0316 13:47:01.945964 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:47:01 crc kubenswrapper[5030]: E0316 13:47:01.946211 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:47:03 crc kubenswrapper[5030]: I0316 13:47:03.596876 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.766739 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.771395 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.772845 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstackclient-openstackclient-dockercfg-2xgg7\"" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.773491 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config-secret\"" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.774536 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.782290 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"openstack-config\"" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.783149 5030 status_manager.go:919] "Failed to update status for pod" pod="openstack-kuttl-tests/openstackclient" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e9e62630-573f-4784-996f-3696559afd67\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:47:06Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:47:06Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:47:06Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-03-16T13:47:06Z\\\",\\\"message\\\":\\\"containers with unready status: [openstackclient]\\\",\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/podified-antelope-centos9/openstack-openstackclient@sha256:d765b589a5f7bc8573b3b192ed265654699012e6342cc4829bd8ea65a7b239a5\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"openstackclient\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/clouds.yaml\\\",\\\"name\\\":\\\"openstack-config\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/.config/openstack/secure.yaml\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/home/cloud-admin/cloudrc\\\",\\\"name\\\":\\\"openstack-config-secret\\\"},{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem\\\",\\\"name\\\":\\\"combined-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-lmdcb\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"192.168.126.11\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"192.168.126.11\\\"}],\\\"startTime\\\":\\\"2026-03-16T13:47:06Z\\\"}}\" for pod \"openstack-kuttl-tests\"/\"openstackclient\": pods \"openstackclient\" not found" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.790838 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: E0316 13:47:06.791793 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle kube-api-access-lmdcb openstack-config openstack-config-secret], unattached volumes=[], failed to process volumes=[combined-ca-bundle kube-api-access-lmdcb openstack-config openstack-config-secret]: context canceled" pod="openstack-kuttl-tests/openstackclient" podUID="e9e62630-573f-4784-996f-3696559afd67" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.798618 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.821828 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.825883 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.851487 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e9e62630-573f-4784-996f-3696559afd67" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.855015 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.936886 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.936975 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72kk\" (UniqueName: \"kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.937023 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:06 crc kubenswrapper[5030]: I0316 13:47:06.937052 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.038898 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.039041 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m72kk\" (UniqueName: \"kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.039159 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.039222 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.039900 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.046037 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.047303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.047347 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.050345 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e9e62630-573f-4784-996f-3696559afd67" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.060100 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72kk\" (UniqueName: \"kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk\") pod \"openstackclient\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.109483 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.111674 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e9e62630-573f-4784-996f-3696559afd67" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.143856 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.610544 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.700170 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.766961 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.767214 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-api" containerID="cri-o://52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43" gracePeriod=30 Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.767373 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-httpd" containerID="cri-o://af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3" gracePeriod=30 Mar 16 13:47:07 crc kubenswrapper[5030]: I0316 13:47:07.957491 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e62630-573f-4784-996f-3696559afd67" path="/var/lib/kubelet/pods/e9e62630-573f-4784-996f-3696559afd67/volumes" Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.061694 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"cb834cf0-6581-470e-a411-b5282d7ea2ac","Type":"ContainerStarted","Data":"3335e93e1e658911548cee3db03f9ad772154f956acec98edff3ba021dff913e"} Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.061759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstackclient" event={"ID":"cb834cf0-6581-470e-a411-b5282d7ea2ac","Type":"ContainerStarted","Data":"35f6406d0cb7777778b91dc836815f53466a7e2eb9594d1a257c6b6f26448646"} Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.070326 5030 generic.go:358] "Generic (PLEG): container finished" podID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerID="af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3" exitCode=0 Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.070421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerDied","Data":"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3"} Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.070514 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.082301 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e9e62630-573f-4784-996f-3696559afd67" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.088231 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/openstackclient" podStartSLOduration=2.088215366 podStartE2EDuration="2.088215366s" podCreationTimestamp="2026-03-16 13:47:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:08.079584574 +0000 UTC m=+2472.478897121" watchObservedRunningTime="2026-03-16 13:47:08.088215366 +0000 UTC m=+2472.487527913" Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.092717 5030 status_manager.go:905] "Pod was deleted and then recreated, skipping status update" pod="openstack-kuttl-tests/openstackclient" oldPodUID="e9e62630-573f-4784-996f-3696559afd67" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" Mar 16 13:47:08 crc kubenswrapper[5030]: I0316 13:47:08.678007 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.975423 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.985210 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.987217 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-internal-svc\"" Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.987367 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"swift-proxy-config-data\"" Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.987511 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-swift-public-svc\"" Mar 16 13:47:09 crc kubenswrapper[5030]: I0316 13:47:09.992598 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122066 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122143 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122317 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122388 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122475 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122509 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk7bk\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122670 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.122701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224712 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224772 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224803 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224823 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224854 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224872 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jk7bk\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224927 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.224946 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.227416 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.227704 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.233033 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.233083 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.235445 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.241735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk7bk\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.244756 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.251138 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data\") pod \"swift-proxy-5875978dcd-9x9tb\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.303539 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:10 crc kubenswrapper[5030]: I0316 13:47:10.740815 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.115489 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerStarted","Data":"7d745b62fc387b53a6b083f78854e5cd4dadc9e3979efd7633da39dba293e5f9"} Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.115589 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerStarted","Data":"1590ccd5da4da63792efdbad28f04eefecd1ab244abfd42491bb986dacb402d5"} Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.115609 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerStarted","Data":"0075fa2dfd3434a2515d07227bc31774bcb774e65657372d85e6739109e6232a"} Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.115665 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.115678 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.151369 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" podStartSLOduration=2.151346384 podStartE2EDuration="2.151346384s" podCreationTimestamp="2026-03-16 13:47:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:11.141997962 +0000 UTC m=+2475.541310509" watchObservedRunningTime="2026-03-16 13:47:11.151346384 +0000 UTC m=+2475.550658931" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.186561 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.187023 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-central-agent" containerID="cri-o://31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" gracePeriod=30 Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.187114 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="sg-core" containerID="cri-o://5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" gracePeriod=30 Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.187138 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-notification-agent" containerID="cri-o://e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" gracePeriod=30 Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.187056 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="proxy-httpd" containerID="cri-o://b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" gracePeriod=30 Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.882189 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.973723 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.973889 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.973980 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.974066 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.974152 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c98t9\" (UniqueName: \"kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.974292 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.974471 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data\") pod \"3d4064c7-c2be-4846-9cb2-48587cca3337\" (UID: \"3d4064c7-c2be-4846-9cb2-48587cca3337\") " Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.975610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.975837 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.979486 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts" (OuterVolumeSpecName: "scripts") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:11 crc kubenswrapper[5030]: I0316 13:47:11.980932 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9" (OuterVolumeSpecName: "kube-api-access-c98t9") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "kube-api-access-c98t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.026783 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.080958 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.082097 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c98t9\" (UniqueName: \"kubernetes.io/projected/3d4064c7-c2be-4846-9cb2-48587cca3337-kube-api-access-c98t9\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.082217 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.082292 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.082350 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/3d4064c7-c2be-4846-9cb2-48587cca3337-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.090196 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.094403 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data" (OuterVolumeSpecName: "config-data") pod "3d4064c7-c2be-4846-9cb2-48587cca3337" (UID: "3d4064c7-c2be-4846-9cb2-48587cca3337"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.158693 5030 generic.go:358] "Generic (PLEG): container finished" podID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" exitCode=0 Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.159714 5030 generic.go:358] "Generic (PLEG): container finished" podID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" exitCode=2 Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.159789 5030 generic.go:358] "Generic (PLEG): container finished" podID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" exitCode=0 Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.159841 5030 generic.go:358] "Generic (PLEG): container finished" podID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" exitCode=0 Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.161163 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.162713 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerDied","Data":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.162978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerDied","Data":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.163373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerDied","Data":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.163451 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerDied","Data":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.163503 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"3d4064c7-c2be-4846-9cb2-48587cca3337","Type":"ContainerDied","Data":"56478c24330144e680ae8a952ac14f25aacb4395bb0ae6a263b033b27099b518"} Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.163034 5030 scope.go:117] "RemoveContainer" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.184831 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.185000 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3d4064c7-c2be-4846-9cb2-48587cca3337-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.237908 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.247590 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.281470 5030 scope.go:117] "RemoveContainer" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.316694 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326494 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="sg-core" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326518 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="sg-core" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326600 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-notification-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326608 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-notification-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326648 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-central-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326653 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-central-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326668 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="proxy-httpd" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.326673 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="proxy-httpd" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.327071 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="proxy-httpd" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.327091 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-central-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.327113 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="sg-core" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.327133 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" containerName="ceilometer-notification-agent" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.358009 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.358187 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.364457 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.365035 5030 scope.go:117] "RemoveContainer" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.365327 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.438051 5030 scope.go:117] "RemoveContainer" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.466888 5030 scope.go:117] "RemoveContainer" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: E0316 13:47:12.467343 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": container with ID starting with b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c not found: ID does not exist" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.467383 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} err="failed to get container status \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": rpc error: code = NotFound desc = could not find container \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": container with ID starting with b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.467426 5030 scope.go:117] "RemoveContainer" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: E0316 13:47:12.471436 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": container with ID starting with 5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf not found: ID does not exist" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.471778 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} err="failed to get container status \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": rpc error: code = NotFound desc = could not find container \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": container with ID starting with 5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.471811 5030 scope.go:117] "RemoveContainer" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: E0316 13:47:12.472535 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": container with ID starting with e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08 not found: ID does not exist" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.472595 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} err="failed to get container status \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": rpc error: code = NotFound desc = could not find container \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": container with ID starting with e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08 not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.472616 5030 scope.go:117] "RemoveContainer" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: E0316 13:47:12.472895 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": container with ID starting with 31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc not found: ID does not exist" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.472922 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} err="failed to get container status \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": rpc error: code = NotFound desc = could not find container \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": container with ID starting with 31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.472937 5030 scope.go:117] "RemoveContainer" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473323 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} err="failed to get container status \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": rpc error: code = NotFound desc = could not find container \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": container with ID starting with b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473346 5030 scope.go:117] "RemoveContainer" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473593 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} err="failed to get container status \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": rpc error: code = NotFound desc = could not find container \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": container with ID starting with 5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473613 5030 scope.go:117] "RemoveContainer" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473847 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} err="failed to get container status \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": rpc error: code = NotFound desc = could not find container \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": container with ID starting with e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08 not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.473871 5030 scope.go:117] "RemoveContainer" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.474206 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} err="failed to get container status \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": rpc error: code = NotFound desc = could not find container \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": container with ID starting with 31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.474224 5030 scope.go:117] "RemoveContainer" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.474396 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} err="failed to get container status \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": rpc error: code = NotFound desc = could not find container \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": container with ID starting with b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.474412 5030 scope.go:117] "RemoveContainer" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.475472 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} err="failed to get container status \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": rpc error: code = NotFound desc = could not find container \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": container with ID starting with 5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.475490 5030 scope.go:117] "RemoveContainer" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.475754 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} err="failed to get container status \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": rpc error: code = NotFound desc = could not find container \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": container with ID starting with e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08 not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.475772 5030 scope.go:117] "RemoveContainer" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.475998 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} err="failed to get container status \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": rpc error: code = NotFound desc = could not find container \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": container with ID starting with 31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.476014 5030 scope.go:117] "RemoveContainer" containerID="b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.478605 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c"} err="failed to get container status \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": rpc error: code = NotFound desc = could not find container \"b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c\": container with ID starting with b9ee4810ddb00b677f600f45c0265fd5516591a214909a34ecdca41b1a78653c not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.478622 5030 scope.go:117] "RemoveContainer" containerID="5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.478801 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf"} err="failed to get container status \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": rpc error: code = NotFound desc = could not find container \"5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf\": container with ID starting with 5764bbc563659062fb5d9962744fdbb8c2bb8008f7d3c44b0d0434444d2294bf not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.478817 5030 scope.go:117] "RemoveContainer" containerID="e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.479009 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08"} err="failed to get container status \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": rpc error: code = NotFound desc = could not find container \"e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08\": container with ID starting with e2d18abb4921a66b60b6f20bb3c51b985df6a1ca227aba4157fc9d9c14ffbd08 not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.479026 5030 scope.go:117] "RemoveContainer" containerID="31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.479255 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc"} err="failed to get container status \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": rpc error: code = NotFound desc = could not find container \"31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc\": container with ID starting with 31dd939d00ba054f87373aecc91b47b0c273f900a34fcea85d05c1a2998f6acc not found: ID does not exist" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.501995 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502074 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwsp\" (UniqueName: \"kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502221 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502278 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502348 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.502505 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605229 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605279 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605406 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605440 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.605493 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwsp\" (UniqueName: \"kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.606674 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.606738 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.611135 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.611407 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.611849 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.613391 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.622934 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwsp\" (UniqueName: \"kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp\") pod \"ceilometer-0\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.680610 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.690744 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.809245 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config\") pod \"592d29bc-ad6a-4216-a71a-f2380dec5670\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.809403 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs\") pod \"592d29bc-ad6a-4216-a71a-f2380dec5670\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.809617 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config\") pod \"592d29bc-ad6a-4216-a71a-f2380dec5670\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.809739 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle\") pod \"592d29bc-ad6a-4216-a71a-f2380dec5670\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.809919 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6jlk\" (UniqueName: \"kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk\") pod \"592d29bc-ad6a-4216-a71a-f2380dec5670\" (UID: \"592d29bc-ad6a-4216-a71a-f2380dec5670\") " Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.814903 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "592d29bc-ad6a-4216-a71a-f2380dec5670" (UID: "592d29bc-ad6a-4216-a71a-f2380dec5670"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.815514 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk" (OuterVolumeSpecName: "kube-api-access-q6jlk") pod "592d29bc-ad6a-4216-a71a-f2380dec5670" (UID: "592d29bc-ad6a-4216-a71a-f2380dec5670"). InnerVolumeSpecName "kube-api-access-q6jlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.854162 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "592d29bc-ad6a-4216-a71a-f2380dec5670" (UID: "592d29bc-ad6a-4216-a71a-f2380dec5670"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.855589 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config" (OuterVolumeSpecName: "config") pod "592d29bc-ad6a-4216-a71a-f2380dec5670" (UID: "592d29bc-ad6a-4216-a71a-f2380dec5670"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.872462 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "592d29bc-ad6a-4216-a71a-f2380dec5670" (UID: "592d29bc-ad6a-4216-a71a-f2380dec5670"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.912487 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.912518 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.912538 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.912565 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6jlk\" (UniqueName: \"kubernetes.io/projected/592d29bc-ad6a-4216-a71a-f2380dec5670-kube-api-access-q6jlk\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:12 crc kubenswrapper[5030]: I0316 13:47:12.912577 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/592d29bc-ad6a-4216-a71a-f2380dec5670-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.072650 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.172086 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerStarted","Data":"643dd6774cb67eb6ec826e46733e1b65b5d60a1e01efc6b6f6959d89035ee0d4"} Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.174470 5030 generic.go:358] "Generic (PLEG): container finished" podID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerID="52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43" exitCode=0 Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.174534 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerDied","Data":"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43"} Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.174593 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.174618 5030 scope.go:117] "RemoveContainer" containerID="af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.174602 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-75f5dc577c-wnj7z" event={"ID":"592d29bc-ad6a-4216-a71a-f2380dec5670","Type":"ContainerDied","Data":"c065dd04568ff01b3640af36c607015e84ff6edb00c06e844fbc17b9bc92d30e"} Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.199142 5030 scope.go:117] "RemoveContainer" containerID="52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.217444 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.222742 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-75f5dc577c-wnj7z"] Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.222863 5030 scope.go:117] "RemoveContainer" containerID="af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3" Mar 16 13:47:13 crc kubenswrapper[5030]: E0316 13:47:13.223253 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3\": container with ID starting with af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3 not found: ID does not exist" containerID="af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.223283 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3"} err="failed to get container status \"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3\": rpc error: code = NotFound desc = could not find container \"af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3\": container with ID starting with af33077249abc7c1911fe9700027e6ef9ad13fe744bbd860bdb1ab7b186250a3 not found: ID does not exist" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.223303 5030 scope.go:117] "RemoveContainer" containerID="52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43" Mar 16 13:47:13 crc kubenswrapper[5030]: E0316 13:47:13.223719 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43\": container with ID starting with 52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43 not found: ID does not exist" containerID="52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.223751 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43"} err="failed to get container status \"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43\": rpc error: code = NotFound desc = could not find container \"52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43\": container with ID starting with 52de67597d8edca51ecb82b14adf24383bed2c658c22874fbf74b5562ee04c43 not found: ID does not exist" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.957226 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d4064c7-c2be-4846-9cb2-48587cca3337" path="/var/lib/kubelet/pods/3d4064c7-c2be-4846-9cb2-48587cca3337/volumes" Mar 16 13:47:13 crc kubenswrapper[5030]: I0316 13:47:13.958158 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" path="/var/lib/kubelet/pods/592d29bc-ad6a-4216-a71a-f2380dec5670/volumes" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.146737 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7kslm"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.147985 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-httpd" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.148073 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-httpd" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.148134 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-api" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.148184 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-api" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.148409 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-httpd" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.148478 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="592d29bc-ad6a-4216-a71a-f2380dec5670" containerName="neutron-api" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.151589 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.156857 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7kslm"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.188659 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerStarted","Data":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.245775 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r7cdg"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.249342 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.249410 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8ctt\" (UniqueName: \"kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.253222 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.266809 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.270637 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.274098 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.277994 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r7cdg"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.286090 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.345926 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jdpcp"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.349970 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.351703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsqj6\" (UniqueName: \"kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.351856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwv6k\" (UniqueName: \"kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.352025 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.352103 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.352235 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8ctt\" (UniqueName: \"kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.352346 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.353513 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.359910 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jdpcp"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.376040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8ctt\" (UniqueName: \"kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt\") pod \"nova-api-db-create-7kslm\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455472 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kn5\" (UniqueName: \"kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455569 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsqj6\" (UniqueName: \"kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455636 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwv6k\" (UniqueName: \"kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455664 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455708 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.455812 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.456539 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.456577 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.456838 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.464372 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.468129 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.474503 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.476806 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwv6k\" (UniqueName: \"kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k\") pod \"nova-api-9af0-account-create-update-glcbb\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.480306 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsqj6\" (UniqueName: \"kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6\") pod \"nova-cell0-db-create-r7cdg\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.486619 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.557992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt96s\" (UniqueName: \"kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.558159 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27kn5\" (UniqueName: \"kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.558297 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.558345 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.559280 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.566860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.573074 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kn5\" (UniqueName: \"kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5\") pod \"nova-cell1-db-create-jdpcp\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.585012 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.661995 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.662614 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wt96s\" (UniqueName: \"kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.662822 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.664958 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.665446 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.682716 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.689345 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt96s\" (UniqueName: \"kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s\") pod \"nova-cell0-9b48-account-create-update-r2788\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.692259 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.700268 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.766246 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbz57\" (UniqueName: \"kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.766637 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.868912 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbz57\" (UniqueName: \"kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.869080 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.869843 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.872514 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.888164 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbz57\" (UniqueName: \"kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57\") pod \"nova-cell1-82b1-account-create-update-ggvrl\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.940297 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7kslm"] Mar 16 13:47:14 crc kubenswrapper[5030]: I0316 13:47:14.947485 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:47:14 crc kubenswrapper[5030]: E0316 13:47:14.947856 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.023266 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.039980 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r7cdg"] Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.126096 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb"] Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.204570 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jdpcp"] Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.204631 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" event={"ID":"0a14e681-873c-445c-81bc-554e16743823","Type":"ContainerStarted","Data":"7a3bfcdda719270760bcddbd833306f14832e2f38f133352bd4b854ce685b703"} Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.209826 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerStarted","Data":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.211250 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" event={"ID":"245c2333-5b26-4154-b9bf-315faff25601","Type":"ContainerStarted","Data":"31d099dec6df4bc4eae9b6f43f28d53f6a19e7f5012d8d1c133fbd5e486e1050"} Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.212720 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" event={"ID":"8cd6ae34-5864-4e58-919f-2baa460ad648","Type":"ContainerStarted","Data":"dfd6a6195f9c40cef75e1c13909aa167ead61e19b783c6a31138b2de93fcd7b3"} Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.212748 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" event={"ID":"8cd6ae34-5864-4e58-919f-2baa460ad648","Type":"ContainerStarted","Data":"5e00f75286a8eed3d68a2617081756b6bce10e50ae0307d0d5b91c090572b801"} Mar 16 13:47:15 crc kubenswrapper[5030]: W0316 13:47:15.242344 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod569578b7_bd00_4113_8252_c22cfec99a30.slice/crio-d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29 WatchSource:0}: Error finding container d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29: Status 404 returned error can't find the container with id d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29 Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.320509 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" podStartSLOduration=1.320487622 podStartE2EDuration="1.320487622s" podCreationTimestamp="2026-03-16 13:47:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:15.236797976 +0000 UTC m=+2479.636110524" watchObservedRunningTime="2026-03-16 13:47:15.320487622 +0000 UTC m=+2479.719800169" Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.327699 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788"] Mar 16 13:47:15 crc kubenswrapper[5030]: W0316 13:47:15.401963 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3289dace_a0cb_484f_824a_beb050021e38.slice/crio-2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536 WatchSource:0}: Error finding container 2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536: Status 404 returned error can't find the container with id 2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536 Mar 16 13:47:15 crc kubenswrapper[5030]: I0316 13:47:15.445926 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl"] Mar 16 13:47:15 crc kubenswrapper[5030]: W0316 13:47:15.486686 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61bd70b_b7a0_4d05_abec_84dd341f7130.slice/crio-64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749 WatchSource:0}: Error finding container 64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749: Status 404 returned error can't find the container with id 64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.225676 5030 generic.go:358] "Generic (PLEG): container finished" podID="0a14e681-873c-445c-81bc-554e16743823" containerID="49036d1a512d2271c5d2970c5d34646aad5c69251f9f3a1f8a26f83eb65909e4" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.225788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" event={"ID":"0a14e681-873c-445c-81bc-554e16743823","Type":"ContainerDied","Data":"49036d1a512d2271c5d2970c5d34646aad5c69251f9f3a1f8a26f83eb65909e4"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.228978 5030 generic.go:358] "Generic (PLEG): container finished" podID="a61bd70b-b7a0-4d05-abec-84dd341f7130" containerID="739ded1d773075ddc251ac3860fe5a159f0ba37f68b2070c389d8708b2215b1c" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.229113 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" event={"ID":"a61bd70b-b7a0-4d05-abec-84dd341f7130","Type":"ContainerDied","Data":"739ded1d773075ddc251ac3860fe5a159f0ba37f68b2070c389d8708b2215b1c"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.229187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" event={"ID":"a61bd70b-b7a0-4d05-abec-84dd341f7130","Type":"ContainerStarted","Data":"64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.236568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerStarted","Data":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.239158 5030 generic.go:358] "Generic (PLEG): container finished" podID="245c2333-5b26-4154-b9bf-315faff25601" containerID="6ddde1f1026c8903839642b3ce29f426cc45819093d67148661da695fc99ee0c" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.239207 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" event={"ID":"245c2333-5b26-4154-b9bf-315faff25601","Type":"ContainerDied","Data":"6ddde1f1026c8903839642b3ce29f426cc45819093d67148661da695fc99ee0c"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.242016 5030 generic.go:358] "Generic (PLEG): container finished" podID="8cd6ae34-5864-4e58-919f-2baa460ad648" containerID="dfd6a6195f9c40cef75e1c13909aa167ead61e19b783c6a31138b2de93fcd7b3" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.242116 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" event={"ID":"8cd6ae34-5864-4e58-919f-2baa460ad648","Type":"ContainerDied","Data":"dfd6a6195f9c40cef75e1c13909aa167ead61e19b783c6a31138b2de93fcd7b3"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.246672 5030 generic.go:358] "Generic (PLEG): container finished" podID="3289dace-a0cb-484f-824a-beb050021e38" containerID="74809179b6af4eac4d7e98968bdde6e80674a71a265e4d51a40d1410b7890fea" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.246890 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" event={"ID":"3289dace-a0cb-484f-824a-beb050021e38","Type":"ContainerDied","Data":"74809179b6af4eac4d7e98968bdde6e80674a71a265e4d51a40d1410b7890fea"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.246991 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" event={"ID":"3289dace-a0cb-484f-824a-beb050021e38","Type":"ContainerStarted","Data":"2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.250324 5030 generic.go:358] "Generic (PLEG): container finished" podID="569578b7-bd00-4113-8252-c22cfec99a30" containerID="4c733e8827d2bbf6968dbbad0d84ca0ffd44edab5257d4212628d56e940b2d68" exitCode=0 Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.250455 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" event={"ID":"569578b7-bd00-4113-8252-c22cfec99a30","Type":"ContainerDied","Data":"4c733e8827d2bbf6968dbbad0d84ca0ffd44edab5257d4212628d56e940b2d68"} Mar 16 13:47:16 crc kubenswrapper[5030]: I0316 13:47:16.250496 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" event={"ID":"569578b7-bd00-4113-8252-c22cfec99a30","Type":"ContainerStarted","Data":"d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29"} Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.168685 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.171718 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.622700 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.738283 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbz57\" (UniqueName: \"kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57\") pod \"a61bd70b-b7a0-4d05-abec-84dd341f7130\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.738726 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts\") pod \"a61bd70b-b7a0-4d05-abec-84dd341f7130\" (UID: \"a61bd70b-b7a0-4d05-abec-84dd341f7130\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.740880 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "a61bd70b-b7a0-4d05-abec-84dd341f7130" (UID: "a61bd70b-b7a0-4d05-abec-84dd341f7130"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.749851 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57" (OuterVolumeSpecName: "kube-api-access-pbz57") pod "a61bd70b-b7a0-4d05-abec-84dd341f7130" (UID: "a61bd70b-b7a0-4d05-abec-84dd341f7130"). InnerVolumeSpecName "kube-api-access-pbz57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.811116 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.816423 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.822066 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.835694 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.842922 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8ctt\" (UniqueName: \"kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt\") pod \"8cd6ae34-5864-4e58-919f-2baa460ad648\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.843404 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts\") pod \"8cd6ae34-5864-4e58-919f-2baa460ad648\" (UID: \"8cd6ae34-5864-4e58-919f-2baa460ad648\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.844252 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbz57\" (UniqueName: \"kubernetes.io/projected/a61bd70b-b7a0-4d05-abec-84dd341f7130-kube-api-access-pbz57\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.844279 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/a61bd70b-b7a0-4d05-abec-84dd341f7130-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.844371 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.844714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "8cd6ae34-5864-4e58-919f-2baa460ad648" (UID: "8cd6ae34-5864-4e58-919f-2baa460ad648"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.848519 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt" (OuterVolumeSpecName: "kube-api-access-l8ctt") pod "8cd6ae34-5864-4e58-919f-2baa460ad648" (UID: "8cd6ae34-5864-4e58-919f-2baa460ad648"). InnerVolumeSpecName "kube-api-access-l8ctt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946150 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts\") pod \"569578b7-bd00-4113-8252-c22cfec99a30\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946225 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27kn5\" (UniqueName: \"kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5\") pod \"569578b7-bd00-4113-8252-c22cfec99a30\" (UID: \"569578b7-bd00-4113-8252-c22cfec99a30\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946272 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwv6k\" (UniqueName: \"kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k\") pod \"0a14e681-873c-445c-81bc-554e16743823\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946321 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsqj6\" (UniqueName: \"kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6\") pod \"245c2333-5b26-4154-b9bf-315faff25601\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946409 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts\") pod \"245c2333-5b26-4154-b9bf-315faff25601\" (UID: \"245c2333-5b26-4154-b9bf-315faff25601\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946502 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts\") pod \"0a14e681-873c-445c-81bc-554e16743823\" (UID: \"0a14e681-873c-445c-81bc-554e16743823\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946565 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt96s\" (UniqueName: \"kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s\") pod \"3289dace-a0cb-484f-824a-beb050021e38\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.946608 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts\") pod \"3289dace-a0cb-484f-824a-beb050021e38\" (UID: \"3289dace-a0cb-484f-824a-beb050021e38\") " Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.947606 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8ctt\" (UniqueName: \"kubernetes.io/projected/8cd6ae34-5864-4e58-919f-2baa460ad648-kube-api-access-l8ctt\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.947624 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/8cd6ae34-5864-4e58-919f-2baa460ad648-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.948407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "3289dace-a0cb-484f-824a-beb050021e38" (UID: "3289dace-a0cb-484f-824a-beb050021e38"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.949431 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "569578b7-bd00-4113-8252-c22cfec99a30" (UID: "569578b7-bd00-4113-8252-c22cfec99a30"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.949775 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "0a14e681-873c-445c-81bc-554e16743823" (UID: "0a14e681-873c-445c-81bc-554e16743823"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.949759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "245c2333-5b26-4154-b9bf-315faff25601" (UID: "245c2333-5b26-4154-b9bf-315faff25601"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.951119 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6" (OuterVolumeSpecName: "kube-api-access-fsqj6") pod "245c2333-5b26-4154-b9bf-315faff25601" (UID: "245c2333-5b26-4154-b9bf-315faff25601"). InnerVolumeSpecName "kube-api-access-fsqj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.953980 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5" (OuterVolumeSpecName: "kube-api-access-27kn5") pod "569578b7-bd00-4113-8252-c22cfec99a30" (UID: "569578b7-bd00-4113-8252-c22cfec99a30"). InnerVolumeSpecName "kube-api-access-27kn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.954408 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k" (OuterVolumeSpecName: "kube-api-access-cwv6k") pod "0a14e681-873c-445c-81bc-554e16743823" (UID: "0a14e681-873c-445c-81bc-554e16743823"). InnerVolumeSpecName "kube-api-access-cwv6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:17 crc kubenswrapper[5030]: I0316 13:47:17.955460 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s" (OuterVolumeSpecName: "kube-api-access-wt96s") pod "3289dace-a0cb-484f-824a-beb050021e38" (UID: "3289dace-a0cb-484f-824a-beb050021e38"). InnerVolumeSpecName "kube-api-access-wt96s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050319 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/569578b7-bd00-4113-8252-c22cfec99a30-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050355 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27kn5\" (UniqueName: \"kubernetes.io/projected/569578b7-bd00-4113-8252-c22cfec99a30-kube-api-access-27kn5\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050368 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwv6k\" (UniqueName: \"kubernetes.io/projected/0a14e681-873c-445c-81bc-554e16743823-kube-api-access-cwv6k\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050384 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsqj6\" (UniqueName: \"kubernetes.io/projected/245c2333-5b26-4154-b9bf-315faff25601-kube-api-access-fsqj6\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050393 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/245c2333-5b26-4154-b9bf-315faff25601-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050403 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/0a14e681-873c-445c-81bc-554e16743823-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050412 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt96s\" (UniqueName: \"kubernetes.io/projected/3289dace-a0cb-484f-824a-beb050021e38-kube-api-access-wt96s\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.050422 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/3289dace-a0cb-484f-824a-beb050021e38-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.276477 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.276495 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl" event={"ID":"a61bd70b-b7a0-4d05-abec-84dd341f7130","Type":"ContainerDied","Data":"64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.276618 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64b40c04e034802d9142534008a7e8828f0dc60b4de9fd11fb08e1d29200b749" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.278794 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.278870 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-db-create-r7cdg" event={"ID":"245c2333-5b26-4154-b9bf-315faff25601","Type":"ContainerDied","Data":"31d099dec6df4bc4eae9b6f43f28d53f6a19e7f5012d8d1c133fbd5e486e1050"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.278930 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31d099dec6df4bc4eae9b6f43f28d53f6a19e7f5012d8d1c133fbd5e486e1050" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.281269 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" event={"ID":"8cd6ae34-5864-4e58-919f-2baa460ad648","Type":"ContainerDied","Data":"5e00f75286a8eed3d68a2617081756b6bce10e50ae0307d0d5b91c090572b801"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.281311 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e00f75286a8eed3d68a2617081756b6bce10e50ae0307d0d5b91c090572b801" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.281441 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-db-create-7kslm" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.284146 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.284150 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788" event={"ID":"3289dace-a0cb-484f-824a-beb050021e38","Type":"ContainerDied","Data":"2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.284181 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ff6bbdf69233f8e220dad6fff7b4e27db0e172e23b5d92268cc8e70cd276536" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.287356 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.287523 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-db-create-jdpcp" event={"ID":"569578b7-bd00-4113-8252-c22cfec99a30","Type":"ContainerDied","Data":"d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.287586 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0f0a502bdff159e444af5a4bb894cd015166d95fb73840f9774bd5dfaebab29" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.290005 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" event={"ID":"0a14e681-873c-445c-81bc-554e16743823","Type":"ContainerDied","Data":"7a3bfcdda719270760bcddbd833306f14832e2f38f133352bd4b854ce685b703"} Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.290028 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a3bfcdda719270760bcddbd833306f14832e2f38f133352bd4b854ce685b703" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.290092 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb" Mar 16 13:47:18 crc kubenswrapper[5030]: I0316 13:47:18.781746 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.302023 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerStarted","Data":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.302354 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.368795 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.888994265 podStartE2EDuration="7.368774399s" podCreationTimestamp="2026-03-16 13:47:12 +0000 UTC" firstStartedPulling="2026-03-16 13:47:13.077492308 +0000 UTC m=+2477.476804855" lastFinishedPulling="2026-03-16 13:47:18.557272442 +0000 UTC m=+2482.956584989" observedRunningTime="2026-03-16 13:47:19.356558544 +0000 UTC m=+2483.755871090" watchObservedRunningTime="2026-03-16 13:47:19.368774399 +0000 UTC m=+2483.768086935" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.630286 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5"] Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631244 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a14e681-873c-445c-81bc-554e16743823" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631264 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a14e681-873c-445c-81bc-554e16743823" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631285 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6ae34-5864-4e58-919f-2baa460ad648" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631291 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6ae34-5864-4e58-919f-2baa460ad648" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631308 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3289dace-a0cb-484f-824a-beb050021e38" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631314 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3289dace-a0cb-484f-824a-beb050021e38" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631324 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61bd70b-b7a0-4d05-abec-84dd341f7130" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631329 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61bd70b-b7a0-4d05-abec-84dd341f7130" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631359 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="569578b7-bd00-4113-8252-c22cfec99a30" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631365 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="569578b7-bd00-4113-8252-c22cfec99a30" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631375 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245c2333-5b26-4154-b9bf-315faff25601" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631380 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="245c2333-5b26-4154-b9bf-315faff25601" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631517 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a14e681-873c-445c-81bc-554e16743823" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631536 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a61bd70b-b7a0-4d05-abec-84dd341f7130" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631559 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3289dace-a0cb-484f-824a-beb050021e38" containerName="mariadb-account-create-update" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631567 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="245c2333-5b26-4154-b9bf-315faff25601" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631580 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="569578b7-bd00-4113-8252-c22cfec99a30" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.631591 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd6ae34-5864-4e58-919f-2baa460ad648" containerName="mariadb-database-create" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.635092 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.638841 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.639146 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-scripts\"" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.640368 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-684ml\"" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.654472 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5"] Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.701401 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.701492 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.701738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.702045 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxksm\" (UniqueName: \"kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.804138 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.804316 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxksm\" (UniqueName: \"kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.804386 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.804424 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.811839 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.816106 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.816909 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.820952 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxksm\" (UniqueName: \"kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm\") pod \"nova-cell0-conductor-db-sync-p5cj5\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:19 crc kubenswrapper[5030]: I0316 13:47:19.959045 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.314493 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-central-agent" containerID="cri-o://de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" gracePeriod=30 Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.315298 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="proxy-httpd" containerID="cri-o://28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" gracePeriod=30 Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.315379 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="sg-core" containerID="cri-o://421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" gracePeriod=30 Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.315429 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-notification-agent" containerID="cri-o://19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" gracePeriod=30 Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.360412 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5"] Mar 16 13:47:20 crc kubenswrapper[5030]: W0316 13:47:20.360823 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod311e6755_5d51_4fd5_8c7b_fa7793a2e7b7.slice/crio-c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf WatchSource:0}: Error finding container c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf: Status 404 returned error can't find the container with id c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf Mar 16 13:47:20 crc kubenswrapper[5030]: I0316 13:47:20.933079 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.034455 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzwsp\" (UniqueName: \"kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.034810 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.034943 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035050 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035077 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035124 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035168 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle\") pod \"93e28f9a-7a4a-4203-8bf4-254fefe26750\" (UID: \"93e28f9a-7a4a-4203-8bf4-254fefe26750\") " Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035328 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.035834 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.036289 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.036307 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/93e28f9a-7a4a-4203-8bf4-254fefe26750-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.040391 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp" (OuterVolumeSpecName: "kube-api-access-jzwsp") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "kube-api-access-jzwsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.040497 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts" (OuterVolumeSpecName: "scripts") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.058615 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.103773 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.113251 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data" (OuterVolumeSpecName: "config-data") pod "93e28f9a-7a4a-4203-8bf4-254fefe26750" (UID: "93e28f9a-7a4a-4203-8bf4-254fefe26750"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.138242 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzwsp\" (UniqueName: \"kubernetes.io/projected/93e28f9a-7a4a-4203-8bf4-254fefe26750-kube-api-access-jzwsp\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.138271 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.138282 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.138293 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.138318 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e28f9a-7a4a-4203-8bf4-254fefe26750-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328855 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" exitCode=0 Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328890 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" exitCode=2 Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328899 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" exitCode=0 Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328907 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" exitCode=0 Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328915 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerDied","Data":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328965 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.329007 5030 scope.go:117] "RemoveContainer" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.328991 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerDied","Data":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.329162 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerDied","Data":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.329183 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerDied","Data":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.329194 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"93e28f9a-7a4a-4203-8bf4-254fefe26750","Type":"ContainerDied","Data":"643dd6774cb67eb6ec826e46733e1b65b5d60a1e01efc6b6f6959d89035ee0d4"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.332212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" event={"ID":"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7","Type":"ContainerStarted","Data":"4430e7120b5600989f84e88c239f78e55662b8f77e9b8823151d8eed8e9c5c27"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.332257 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" event={"ID":"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7","Type":"ContainerStarted","Data":"c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf"} Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.348043 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" podStartSLOduration=2.348032209 podStartE2EDuration="2.348032209s" podCreationTimestamp="2026-03-16 13:47:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:21.344670006 +0000 UTC m=+2485.743982553" watchObservedRunningTime="2026-03-16 13:47:21.348032209 +0000 UTC m=+2485.747344757" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.353865 5030 scope.go:117] "RemoveContainer" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.393441 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.402996 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.407571 5030 scope.go:117] "RemoveContainer" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.418591 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419710 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-notification-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419731 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-notification-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419757 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="sg-core" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419765 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="sg-core" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419781 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="proxy-httpd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419786 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="proxy-httpd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419798 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-central-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419804 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-central-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.419980 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="sg-core" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.420002 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-notification-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.420015 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="ceilometer-central-agent" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.420025 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" containerName="proxy-httpd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.432665 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.432837 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.438860 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.458524 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.487870 5030 scope.go:117] "RemoveContainer" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.534339 5030 scope.go:117] "RemoveContainer" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: E0316 13:47:21.534635 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": container with ID starting with 28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9 not found: ID does not exist" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.534727 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} err="failed to get container status \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": rpc error: code = NotFound desc = could not find container \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": container with ID starting with 28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9 not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.534801 5030 scope.go:117] "RemoveContainer" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: E0316 13:47:21.535056 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": container with ID starting with 421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e not found: ID does not exist" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.535127 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} err="failed to get container status \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": rpc error: code = NotFound desc = could not find container \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": container with ID starting with 421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.535183 5030 scope.go:117] "RemoveContainer" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: E0316 13:47:21.535576 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": container with ID starting with 19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd not found: ID does not exist" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.535667 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} err="failed to get container status \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": rpc error: code = NotFound desc = could not find container \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": container with ID starting with 19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.535729 5030 scope.go:117] "RemoveContainer" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: E0316 13:47:21.535955 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": container with ID starting with de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f not found: ID does not exist" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.536020 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} err="failed to get container status \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": rpc error: code = NotFound desc = could not find container \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": container with ID starting with de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.536078 5030 scope.go:117] "RemoveContainer" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.537680 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} err="failed to get container status \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": rpc error: code = NotFound desc = could not find container \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": container with ID starting with 28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9 not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.537749 5030 scope.go:117] "RemoveContainer" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538002 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} err="failed to get container status \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": rpc error: code = NotFound desc = could not find container \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": container with ID starting with 421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538072 5030 scope.go:117] "RemoveContainer" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538282 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} err="failed to get container status \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": rpc error: code = NotFound desc = could not find container \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": container with ID starting with 19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538363 5030 scope.go:117] "RemoveContainer" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538599 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} err="failed to get container status \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": rpc error: code = NotFound desc = could not find container \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": container with ID starting with de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538662 5030 scope.go:117] "RemoveContainer" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538868 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} err="failed to get container status \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": rpc error: code = NotFound desc = could not find container \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": container with ID starting with 28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9 not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.538931 5030 scope.go:117] "RemoveContainer" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539153 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} err="failed to get container status \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": rpc error: code = NotFound desc = could not find container \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": container with ID starting with 421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539223 5030 scope.go:117] "RemoveContainer" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539414 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} err="failed to get container status \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": rpc error: code = NotFound desc = could not find container \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": container with ID starting with 19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539476 5030 scope.go:117] "RemoveContainer" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539707 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} err="failed to get container status \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": rpc error: code = NotFound desc = could not find container \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": container with ID starting with de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539772 5030 scope.go:117] "RemoveContainer" containerID="28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.539963 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9"} err="failed to get container status \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": rpc error: code = NotFound desc = could not find container \"28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9\": container with ID starting with 28a3434da1050305d81390807fad880b50e47c81a439b35377af57af0a97c0b9 not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.540039 5030 scope.go:117] "RemoveContainer" containerID="421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.541878 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e"} err="failed to get container status \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": rpc error: code = NotFound desc = could not find container \"421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e\": container with ID starting with 421c4e1764a5b5b19d8ed85fb56a99262bdbb4b46d1dd277a0ca8800cf5eab5e not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.541967 5030 scope.go:117] "RemoveContainer" containerID="19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.542211 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd"} err="failed to get container status \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": rpc error: code = NotFound desc = could not find container \"19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd\": container with ID starting with 19e4799d74d817d07684cf116e691c9e092adf1b10bad29f20faf9eb691a77dd not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.542280 5030 scope.go:117] "RemoveContainer" containerID="de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.545254 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f"} err="failed to get container status \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": rpc error: code = NotFound desc = could not find container \"de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f\": container with ID starting with de7885a250774140a0417f54a017021f75aa754ff28faaf390ed66e07f7a172f not found: ID does not exist" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563222 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vhgt\" (UniqueName: \"kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563286 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563325 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563394 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563515 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.563603 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667093 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vhgt\" (UniqueName: \"kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667444 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667590 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667671 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667778 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.667959 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.668040 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.668125 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.670198 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.679001 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.680157 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.680229 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.682260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.691011 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vhgt\" (UniqueName: \"kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt\") pod \"ceilometer-0\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.773873 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:21 crc kubenswrapper[5030]: I0316 13:47:21.958863 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e28f9a-7a4a-4203-8bf4-254fefe26750" path="/var/lib/kubelet/pods/93e28f9a-7a4a-4203-8bf4-254fefe26750/volumes" Mar 16 13:47:22 crc kubenswrapper[5030]: I0316 13:47:22.170529 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:22 crc kubenswrapper[5030]: I0316 13:47:22.346262 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerStarted","Data":"7756af7ec6a0e366f6f052f0308baa3bff777da9a3f9def6e1a29a294c50deaa"} Mar 16 13:47:22 crc kubenswrapper[5030]: I0316 13:47:22.748269 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:23 crc kubenswrapper[5030]: I0316 13:47:23.362424 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerStarted","Data":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} Mar 16 13:47:24 crc kubenswrapper[5030]: I0316 13:47:24.378229 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerStarted","Data":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} Mar 16 13:47:25 crc kubenswrapper[5030]: I0316 13:47:25.391759 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerStarted","Data":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404048 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerStarted","Data":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404404 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404207 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="proxy-httpd" containerID="cri-o://5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" gracePeriod=30 Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404158 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-central-agent" containerID="cri-o://28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" gracePeriod=30 Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404226 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-notification-agent" containerID="cri-o://c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" gracePeriod=30 Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.404263 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="sg-core" containerID="cri-o://d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" gracePeriod=30 Mar 16 13:47:26 crc kubenswrapper[5030]: I0316 13:47:26.427360 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.595652976 podStartE2EDuration="5.427345442s" podCreationTimestamp="2026-03-16 13:47:21 +0000 UTC" firstStartedPulling="2026-03-16 13:47:22.189733983 +0000 UTC m=+2486.589046530" lastFinishedPulling="2026-03-16 13:47:26.021426448 +0000 UTC m=+2490.420738996" observedRunningTime="2026-03-16 13:47:26.42217604 +0000 UTC m=+2490.821488648" watchObservedRunningTime="2026-03-16 13:47:26.427345442 +0000 UTC m=+2490.826657989" Mar 16 13:47:26 crc kubenswrapper[5030]: E0316 13:47:26.672249 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1efc22cc_d312_4dfe_8a54_80d8dbd762a9.slice/crio-5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.416626 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418187 5030 generic.go:358] "Generic (PLEG): container finished" podID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" exitCode=0 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418214 5030 generic.go:358] "Generic (PLEG): container finished" podID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" exitCode=2 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418222 5030 generic.go:358] "Generic (PLEG): container finished" podID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" exitCode=0 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418228 5030 generic.go:358] "Generic (PLEG): container finished" podID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" exitCode=0 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerDied","Data":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418417 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerDied","Data":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418430 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerDied","Data":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418440 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerDied","Data":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"1efc22cc-d312-4dfe-8a54-80d8dbd762a9","Type":"ContainerDied","Data":"7756af7ec6a0e366f6f052f0308baa3bff777da9a3f9def6e1a29a294c50deaa"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.418467 5030 scope.go:117] "RemoveContainer" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.422062 5030 generic.go:358] "Generic (PLEG): container finished" podID="311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" containerID="4430e7120b5600989f84e88c239f78e55662b8f77e9b8823151d8eed8e9c5c27" exitCode=0 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.422307 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" event={"ID":"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7","Type":"ContainerDied","Data":"4430e7120b5600989f84e88c239f78e55662b8f77e9b8823151d8eed8e9c5c27"} Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.459457 5030 scope.go:117] "RemoveContainer" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.478313 5030 scope.go:117] "RemoveContainer" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.504451 5030 scope.go:117] "RemoveContainer" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.506812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vhgt\" (UniqueName: \"kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.506876 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.506994 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.507061 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.507089 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.507250 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.507430 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle\") pod \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\" (UID: \"1efc22cc-d312-4dfe-8a54-80d8dbd762a9\") " Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.509012 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.509930 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.514751 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts" (OuterVolumeSpecName: "scripts") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.518517 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt" (OuterVolumeSpecName: "kube-api-access-8vhgt") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "kube-api-access-8vhgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.540243 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.540741 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-log" containerID="cri-o://72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8" gracePeriod=30 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.541175 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-httpd" containerID="cri-o://9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f" gracePeriod=30 Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.577647 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.592765 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.603975 5030 scope.go:117] "RemoveContainer" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: E0316 13:47:27.604440 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": container with ID starting with 5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3 not found: ID does not exist" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604473 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} err="failed to get container status \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": rpc error: code = NotFound desc = could not find container \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": container with ID starting with 5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604493 5030 scope.go:117] "RemoveContainer" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: E0316 13:47:27.604726 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": container with ID starting with d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4 not found: ID does not exist" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604750 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} err="failed to get container status \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": rpc error: code = NotFound desc = could not find container \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": container with ID starting with d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604764 5030 scope.go:117] "RemoveContainer" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: E0316 13:47:27.604960 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": container with ID starting with c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c not found: ID does not exist" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604980 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} err="failed to get container status \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": rpc error: code = NotFound desc = could not find container \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": container with ID starting with c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.604992 5030 scope.go:117] "RemoveContainer" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: E0316 13:47:27.605182 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": container with ID starting with 28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab not found: ID does not exist" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605199 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} err="failed to get container status \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": rpc error: code = NotFound desc = could not find container \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": container with ID starting with 28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605211 5030 scope.go:117] "RemoveContainer" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605387 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} err="failed to get container status \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": rpc error: code = NotFound desc = could not find container \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": container with ID starting with 5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605403 5030 scope.go:117] "RemoveContainer" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605761 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} err="failed to get container status \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": rpc error: code = NotFound desc = could not find container \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": container with ID starting with d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.605778 5030 scope.go:117] "RemoveContainer" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606067 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} err="failed to get container status \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": rpc error: code = NotFound desc = could not find container \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": container with ID starting with c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606083 5030 scope.go:117] "RemoveContainer" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606348 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} err="failed to get container status \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": rpc error: code = NotFound desc = could not find container \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": container with ID starting with 28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606366 5030 scope.go:117] "RemoveContainer" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606560 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} err="failed to get container status \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": rpc error: code = NotFound desc = could not find container \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": container with ID starting with 5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606577 5030 scope.go:117] "RemoveContainer" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606794 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} err="failed to get container status \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": rpc error: code = NotFound desc = could not find container \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": container with ID starting with d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.606810 5030 scope.go:117] "RemoveContainer" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607022 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} err="failed to get container status \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": rpc error: code = NotFound desc = could not find container \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": container with ID starting with c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607039 5030 scope.go:117] "RemoveContainer" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607254 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} err="failed to get container status \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": rpc error: code = NotFound desc = could not find container \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": container with ID starting with 28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607269 5030 scope.go:117] "RemoveContainer" containerID="5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607465 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3"} err="failed to get container status \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": rpc error: code = NotFound desc = could not find container \"5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3\": container with ID starting with 5e3c03e81ad9f512b5292ee15c08eafcc96f9b8ae30e2859f52906edbc9615a3 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607483 5030 scope.go:117] "RemoveContainer" containerID="d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607935 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4"} err="failed to get container status \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": rpc error: code = NotFound desc = could not find container \"d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4\": container with ID starting with d5025d4adea78126726a1283061a20ca9be9e7ee3751ee725ec4a212560a8de4 not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.607957 5030 scope.go:117] "RemoveContainer" containerID="c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.608160 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c"} err="failed to get container status \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": rpc error: code = NotFound desc = could not find container \"c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c\": container with ID starting with c2799635ce394013b4aaffa3f6f19a55c005394a4b0f06b02c2546c14fce210c not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.608176 5030 scope.go:117] "RemoveContainer" containerID="28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.608715 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab"} err="failed to get container status \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": rpc error: code = NotFound desc = could not find container \"28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab\": container with ID starting with 28ef049f48eaa780a5c168038313fd297b957286d9f075ab2f46715e041192ab not found: ID does not exist" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.609970 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.609990 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.609999 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.610009 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vhgt\" (UniqueName: \"kubernetes.io/projected/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-kube-api-access-8vhgt\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.610020 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.610028 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.641839 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data" (OuterVolumeSpecName: "config-data") pod "1efc22cc-d312-4dfe-8a54-80d8dbd762a9" (UID: "1efc22cc-d312-4dfe-8a54-80d8dbd762a9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.713183 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/1efc22cc-d312-4dfe-8a54-80d8dbd762a9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.846481 5030 scope.go:117] "RemoveContainer" containerID="620e54500b3f2913d4f7a4505bacc843ee3f4f635e3dc04182e7cd4cebc71395" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.881738 5030 scope.go:117] "RemoveContainer" containerID="5595452be3e86c16401b0473831849bd2ab014dfde3e2188166c384f78d711a4" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.907269 5030 scope.go:117] "RemoveContainer" containerID="532844fff7ac3a729df0e9ab476589874e9e6ac20f747e51bca916efc13ce969" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.935503 5030 scope.go:117] "RemoveContainer" containerID="57b965efcf0dac146c0045cccc6ffe7a12468f11d383da1342d478d057c18714" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.947313 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:47:27 crc kubenswrapper[5030]: E0316 13:47:27.947594 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:47:27 crc kubenswrapper[5030]: I0316 13:47:27.985732 5030 scope.go:117] "RemoveContainer" containerID="d7a46c98af4d8254d6ce592a8ef1c617646a4a8e2aa3a8722f21842dac09f0a5" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.012325 5030 scope.go:117] "RemoveContainer" containerID="150321c1d96b951976ada4aca4aa13e42d186d2b5fefbf388595bd62eaac35bc" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.032097 5030 scope.go:117] "RemoveContainer" containerID="6b0c780547169536bd68de9cb7ee694d4bc6a1f87039ab52cc2a5d098f4bd7c2" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.076685 5030 scope.go:117] "RemoveContainer" containerID="e272c747a9e069784c4b7572752e27d9ef35253b15109a62b81a237de16ba5bc" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.107808 5030 scope.go:117] "RemoveContainer" containerID="99f708a93ac65bd1f46af0997d3ffde748fa251265c8456c6e48049cdb6b446a" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.148013 5030 scope.go:117] "RemoveContainer" containerID="3313d4e068be3e30966a1423d9a65a8af30edb28ac82b59805e1f7c82089b9d8" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.166242 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.166583 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-log" containerID="cri-o://2dfdf8af032d5de7c4fd9e9bc99920a85362ec3c1e754a26f6c783abfc083df4" gracePeriod=30 Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.166654 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-httpd" containerID="cri-o://25f2317ecdf2f2d3e3a43eac119006ca67a173b2d74f60a2e956f5fe89818f39" gracePeriod=30 Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.185891 5030 scope.go:117] "RemoveContainer" containerID="3d10b607799eb7e94ceff156c14d1ca73111e7ae90c788baf57abba38c84cfea" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.222203 5030 scope.go:117] "RemoveContainer" containerID="9b01349e0d5296ed55c2a323b03a5e33cbf350558a5e692a00c9254c54ca5f57" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.241782 5030 scope.go:117] "RemoveContainer" containerID="8ca8c1f12b5943203f7105670ddfef0dc34422cdfc166891c4c1b0a2bd026067" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.440730 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.461956 5030 generic.go:358] "Generic (PLEG): container finished" podID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerID="72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8" exitCode=143 Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.462042 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerDied","Data":"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8"} Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.463135 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.473138 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.480598 5030 generic.go:358] "Generic (PLEG): container finished" podID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerID="2dfdf8af032d5de7c4fd9e9bc99920a85362ec3c1e754a26f6c783abfc083df4" exitCode=143 Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.480701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerDied","Data":"2dfdf8af032d5de7c4fd9e9bc99920a85362ec3c1e754a26f6c783abfc083df4"} Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.481502 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482391 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-central-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482406 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-central-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482415 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="proxy-httpd" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482421 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="proxy-httpd" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482438 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="sg-core" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482443 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="sg-core" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482469 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-notification-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.482474 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-notification-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.485190 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="sg-core" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.485217 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-central-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.485238 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="ceilometer-notification-agent" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.485247 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" containerName="proxy-httpd" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.489794 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.492010 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.492961 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.506357 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530667 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530917 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47m5t\" (UniqueName: \"kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530946 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.530998 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.531201 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637164 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637308 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637347 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637384 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637472 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47m5t\" (UniqueName: \"kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637510 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.637562 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.639522 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.639856 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.649618 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.655888 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.656036 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.656105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.664107 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47m5t\" (UniqueName: \"kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t\") pod \"ceilometer-0\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.755605 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.818692 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.842371 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle\") pod \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.842674 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxksm\" (UniqueName: \"kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm\") pod \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.842836 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data\") pod \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.843042 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts\") pod \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\" (UID: \"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7\") " Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.850565 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm" (OuterVolumeSpecName: "kube-api-access-nxksm") pod "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" (UID: "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7"). InnerVolumeSpecName "kube-api-access-nxksm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.851746 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts" (OuterVolumeSpecName: "scripts") pod "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" (UID: "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.863744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" (UID: "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.867446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data" (OuterVolumeSpecName: "config-data") pod "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" (UID: "311e6755-5d51-4fd5-8c7b-fa7793a2e7b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.945919 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.946039 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.946109 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:28 crc kubenswrapper[5030]: I0316 13:47:28.946158 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxksm\" (UniqueName: \"kubernetes.io/projected/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7-kube-api-access-nxksm\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.066471 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.262992 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:29 crc kubenswrapper[5030]: W0316 13:47:29.264248 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod294a7b44_0940_41c8_9db0_63d671259955.slice/crio-3ea72f10030a473efd17d963e948153d15ad87b98bb938bb3c40a1b97c608e0d WatchSource:0}: Error finding container 3ea72f10030a473efd17d963e948153d15ad87b98bb938bb3c40a1b97c608e0d: Status 404 returned error can't find the container with id 3ea72f10030a473efd17d963e948153d15ad87b98bb938bb3c40a1b97c608e0d Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.494514 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.494546 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5" event={"ID":"311e6755-5d51-4fd5-8c7b-fa7793a2e7b7","Type":"ContainerDied","Data":"c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf"} Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.494649 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5b85a59cf3626d4c1be49ecf126ceeac620a8bfa30ee0262ac54596a3e241cf" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.496147 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerStarted","Data":"3ea72f10030a473efd17d963e948153d15ad87b98bb938bb3c40a1b97c608e0d"} Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.539785 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.541162 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" containerName="nova-cell0-conductor-db-sync" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.541191 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" containerName="nova-cell0-conductor-db-sync" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.541433 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" containerName="nova-cell0-conductor-db-sync" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.547916 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.550385 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-684ml\"" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.550660 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.557411 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.665939 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xf5\" (UniqueName: \"kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.666506 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.666785 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.769023 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-66xf5\" (UniqueName: \"kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.769115 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.769320 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.775573 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.780855 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.783542 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xf5\" (UniqueName: \"kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5\") pod \"nova-cell0-conductor-0\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.866295 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:29 crc kubenswrapper[5030]: I0316 13:47:29.997213 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1efc22cc-d312-4dfe-8a54-80d8dbd762a9" path="/var/lib/kubelet/pods/1efc22cc-d312-4dfe-8a54-80d8dbd762a9/volumes" Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.298201 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:47:30 crc kubenswrapper[5030]: W0316 13:47:30.299271 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod205b16d0_0928_430b_b228_3e4dc2be7163.slice/crio-09cc16906a0d6b8ff1386328497cf85733b1949817fe3e6b31d404252414e51e WatchSource:0}: Error finding container 09cc16906a0d6b8ff1386328497cf85733b1949817fe3e6b31d404252414e51e: Status 404 returned error can't find the container with id 09cc16906a0d6b8ff1386328497cf85733b1949817fe3e6b31d404252414e51e Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.510148 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerStarted","Data":"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50"} Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.513322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"205b16d0-0928-430b-b228-3e4dc2be7163","Type":"ContainerStarted","Data":"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e"} Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.513405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"205b16d0-0928-430b-b228-3e4dc2be7163","Type":"ContainerStarted","Data":"09cc16906a0d6b8ff1386328497cf85733b1949817fe3e6b31d404252414e51e"} Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.514482 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:47:30 crc kubenswrapper[5030]: I0316 13:47:30.985444 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.010425 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.010407865 podStartE2EDuration="2.010407865s" podCreationTimestamp="2026-03-16 13:47:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:30.534785619 +0000 UTC m=+2494.934098165" watchObservedRunningTime="2026-03-16 13:47:31.010407865 +0000 UTC m=+2495.409720412" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.164270 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.319578 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320037 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320067 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320095 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320169 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320254 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320528 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320705 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j96f4\" (UniqueName: \"kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4\") pod \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\" (UID: \"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.320852 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs" (OuterVolumeSpecName: "logs") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.321383 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.321908 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.326690 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4" (OuterVolumeSpecName: "kube-api-access-j96f4") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "kube-api-access-j96f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.331663 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.356860 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts" (OuterVolumeSpecName: "scripts") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.362975 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.382100 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.383957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data" (OuterVolumeSpecName: "config-data") pod "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" (UID: "3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425148 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425574 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425619 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425631 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425644 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425655 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.425666 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j96f4\" (UniqueName: \"kubernetes.io/projected/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0-kube-api-access-j96f4\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.443122 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.511412 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.528408 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.541445 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerStarted","Data":"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d"} Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.543745 5030 generic.go:358] "Generic (PLEG): container finished" podID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerID="9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f" exitCode=0 Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.543838 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.544079 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerDied","Data":"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f"} Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.544166 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0","Type":"ContainerDied","Data":"8108f4dac792e97c40b1562f2f49ed2eb036440c003e11682a3291435745f22e"} Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.544237 5030 scope.go:117] "RemoveContainer" containerID="9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.559456 5030 generic.go:358] "Generic (PLEG): container finished" podID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerID="25f2317ecdf2f2d3e3a43eac119006ca67a173b2d74f60a2e956f5fe89818f39" exitCode=0 Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.560216 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerDied","Data":"25f2317ecdf2f2d3e3a43eac119006ca67a173b2d74f60a2e956f5fe89818f39"} Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.596172 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.610756 5030 scope.go:117] "RemoveContainer" containerID="72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.636253 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.642648 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.643543 5030 scope.go:117] "RemoveContainer" containerID="9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.643787 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-httpd" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.643806 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-httpd" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.643851 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-log" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.643859 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-log" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.644007 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-httpd" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.644039 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" containerName="glance-log" Mar 16 13:47:31 crc kubenswrapper[5030]: E0316 13:47:31.645798 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f\": container with ID starting with 9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f not found: ID does not exist" containerID="9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.645838 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f"} err="failed to get container status \"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f\": rpc error: code = NotFound desc = could not find container \"9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f\": container with ID starting with 9d98ea6636c6590bc7b7bb71215faa9276d0ace4f7724f29168a0297cb598b6f not found: ID does not exist" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.645863 5030 scope.go:117] "RemoveContainer" containerID="72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8" Mar 16 13:47:31 crc kubenswrapper[5030]: E0316 13:47:31.650584 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8\": container with ID starting with 72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8 not found: ID does not exist" containerID="72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.650615 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8"} err="failed to get container status \"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8\": rpc error: code = NotFound desc = could not find container \"72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8\": container with ID starting with 72eb11c0e883d0c9b0f994f2f8337346a4be19e510826f987298a267c73349e8 not found: ID does not exist" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.653623 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.653733 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.659080 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-external-config-data\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.662834 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-public-svc\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.836471 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.843992 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844136 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844472 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844531 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lql6s\" (UniqueName: \"kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844632 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844840 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.844964 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946338 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946374 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946644 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946841 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs" (OuterVolumeSpecName: "logs") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946880 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.946982 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vc9c\" (UniqueName: \"kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947057 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947126 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts\") pod \"f37da94e-3023-4456-8723-0e2f1787d7fc\" (UID: \"f37da94e-3023-4456-8723-0e2f1787d7fc\") " Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947257 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947297 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947398 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947485 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947582 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lql6s\" (UniqueName: \"kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947617 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.947721 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.949105 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.949341 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.950695 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.950907 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") device mount path \"/mnt/openstack/pv08\"" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.955296 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c" (OuterVolumeSpecName: "kube-api-access-8vc9c") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "kube-api-access-8vc9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.956084 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.958573 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.959486 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.961029 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0" path="/var/lib/kubelet/pods/3e9e9ceb-6363-4a9e-ab98-a41e5ad59bc0/volumes" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.965165 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.966227 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts" (OuterVolumeSpecName: "scripts") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.966874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.970122 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lql6s\" (UniqueName: \"kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.984672 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:31 crc kubenswrapper[5030]: I0316 13:47:31.993386 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"glance-default-external-api-0\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.008287 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.038642 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data" (OuterVolumeSpecName: "config-data") pod "f37da94e-3023-4456-8723-0e2f1787d7fc" (UID: "f37da94e-3023-4456-8723-0e2f1787d7fc"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054624 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054679 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054700 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054712 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vc9c\" (UniqueName: \"kubernetes.io/projected/f37da94e-3023-4456-8723-0e2f1787d7fc-kube-api-access-8vc9c\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054726 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/f37da94e-3023-4456-8723-0e2f1787d7fc-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054753 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.054768 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f37da94e-3023-4456-8723-0e2f1787d7fc-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.079828 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.140067 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.157011 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.189277 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.189921 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-api" containerID="cri-o://55286fa35543852bfe06fa91bca1d16c17823aeaab0b1c059152c37067f13a55" gracePeriod=30 Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.189542 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-log" containerID="cri-o://2366d2e0a71265f8ea5577d53820707ad7fe1310fd1c81b142eb35ea147a92b9" gracePeriod=30 Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.277093 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.542941 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.572719 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerStarted","Data":"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6"} Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.577442 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.577428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"f37da94e-3023-4456-8723-0e2f1787d7fc","Type":"ContainerDied","Data":"6655aaf5ced0d981ba552459e8887f4a57789dd910fbdb44874ae77384ac04b5"} Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.577734 5030 scope.go:117] "RemoveContainer" containerID="25f2317ecdf2f2d3e3a43eac119006ca67a173b2d74f60a2e956f5fe89818f39" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.580107 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerStarted","Data":"857737ff16095142914e41498bfe15391595ac1bd823e10b9d93e50595bd6723"} Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.583516 5030 generic.go:358] "Generic (PLEG): container finished" podID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerID="2366d2e0a71265f8ea5577d53820707ad7fe1310fd1c81b142eb35ea147a92b9" exitCode=143 Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.583656 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerDied","Data":"2366d2e0a71265f8ea5577d53820707ad7fe1310fd1c81b142eb35ea147a92b9"} Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.583743 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" containerID="cri-o://208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" gracePeriod=30 Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.604745 5030 scope.go:117] "RemoveContainer" containerID="2dfdf8af032d5de7c4fd9e9bc99920a85362ec3c1e754a26f6c783abfc083df4" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.629867 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.649638 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.682571 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.683710 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-httpd" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.683733 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-httpd" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.683887 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-log" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.683901 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-log" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.684160 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-httpd" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.684184 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" containerName="glance-log" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.691645 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.691743 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.695028 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-glance-default-internal-svc\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.700088 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-default-internal-config-data\"" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.782485 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.782686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.782799 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.782916 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.782956 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wb75\" (UniqueName: \"kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.783076 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.783126 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.783293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.886855 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.886970 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887052 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887191 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887351 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887427 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.887480 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wb75\" (UniqueName: \"kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.888334 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.888385 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.889005 5030 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") device mount path \"/mnt/openstack/pv11\"" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.895929 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.897713 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.902345 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.906940 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.907532 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wb75\" (UniqueName: \"kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:32 crc kubenswrapper[5030]: I0316 13:47:32.915250 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"glance-default-internal-api-0\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:33 crc kubenswrapper[5030]: I0316 13:47:33.019368 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:33 crc kubenswrapper[5030]: I0316 13:47:33.585390 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:47:33 crc kubenswrapper[5030]: W0316 13:47:33.592317 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ecfb6c9_6c28_474f_8d41_80920bb5ddb9.slice/crio-f8f882ca047f949dfafda652782984b58bd2be9430a340f91d03b2376546af24 WatchSource:0}: Error finding container f8f882ca047f949dfafda652782984b58bd2be9430a340f91d03b2376546af24: Status 404 returned error can't find the container with id f8f882ca047f949dfafda652782984b58bd2be9430a340f91d03b2376546af24 Mar 16 13:47:33 crc kubenswrapper[5030]: I0316 13:47:33.607713 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerStarted","Data":"e25341c45b6c41e75570a09f5a607a9b7da3a21b641e7b03efc2fe4b45ba594f"} Mar 16 13:47:33 crc kubenswrapper[5030]: I0316 13:47:33.967653 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37da94e-3023-4456-8723-0e2f1787d7fc" path="/var/lib/kubelet/pods/f37da94e-3023-4456-8723-0e2f1787d7fc/volumes" Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.622860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerStarted","Data":"4bad9050af1bf8cf77ac8fc0ab764eeff8232492b2b32f9b959560206834d9f3"} Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.632170 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerStarted","Data":"9956dea0f45533038136c04cedce98249a5779dd925ca83e504eb5e140e8df73"} Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.632218 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerStarted","Data":"f8f882ca047f949dfafda652782984b58bd2be9430a340f91d03b2376546af24"} Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.644612 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-external-api-0" podStartSLOduration=3.64459475 podStartE2EDuration="3.64459475s" podCreationTimestamp="2026-03-16 13:47:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:34.643748349 +0000 UTC m=+2499.043060896" watchObservedRunningTime="2026-03-16 13:47:34.64459475 +0000 UTC m=+2499.043907297" Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645309 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-central-agent" containerID="cri-o://bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50" gracePeriod=30 Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645527 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerStarted","Data":"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4"} Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645659 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="proxy-httpd" containerID="cri-o://30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4" gracePeriod=30 Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645823 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-notification-agent" containerID="cri-o://3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d" gracePeriod=30 Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645875 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="sg-core" containerID="cri-o://019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6" gracePeriod=30 Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.645921 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:34 crc kubenswrapper[5030]: I0316 13:47:34.665203 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.5583353949999998 podStartE2EDuration="6.665191307s" podCreationTimestamp="2026-03-16 13:47:28 +0000 UTC" firstStartedPulling="2026-03-16 13:47:29.265816361 +0000 UTC m=+2493.665128909" lastFinishedPulling="2026-03-16 13:47:34.372672275 +0000 UTC m=+2498.771984821" observedRunningTime="2026-03-16 13:47:34.665050712 +0000 UTC m=+2499.064363259" watchObservedRunningTime="2026-03-16 13:47:34.665191307 +0000 UTC m=+2499.064503854" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.658671 5030 generic.go:358] "Generic (PLEG): container finished" podID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerID="55286fa35543852bfe06fa91bca1d16c17823aeaab0b1c059152c37067f13a55" exitCode=0 Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.659261 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerDied","Data":"55286fa35543852bfe06fa91bca1d16c17823aeaab0b1c059152c37067f13a55"} Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.661484 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerStarted","Data":"59482e3f943fc36862143276cbb748e4c432f023b1654ed34ff92f0cb3cd2ae9"} Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.666700 5030 generic.go:358] "Generic (PLEG): container finished" podID="294a7b44-0940-41c8-9db0-63d671259955" containerID="30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4" exitCode=0 Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.666722 5030 generic.go:358] "Generic (PLEG): container finished" podID="294a7b44-0940-41c8-9db0-63d671259955" containerID="019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6" exitCode=2 Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.666729 5030 generic.go:358] "Generic (PLEG): container finished" podID="294a7b44-0940-41c8-9db0-63d671259955" containerID="3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d" exitCode=0 Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.667436 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerDied","Data":"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4"} Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.667462 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerDied","Data":"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6"} Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.667473 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerDied","Data":"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d"} Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.687714 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/glance-default-internal-api-0" podStartSLOduration=3.687699013 podStartE2EDuration="3.687699013s" podCreationTimestamp="2026-03-16 13:47:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:47:35.680637693 +0000 UTC m=+2500.079950239" watchObservedRunningTime="2026-03-16 13:47:35.687699013 +0000 UTC m=+2500.087011560" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.746129 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.892583 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.892704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.892808 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.892904 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.893019 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.893067 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktgkm\" (UniqueName: \"kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.893181 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle\") pod \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\" (UID: \"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed\") " Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.900121 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs" (OuterVolumeSpecName: "logs") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.902806 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts" (OuterVolumeSpecName: "scripts") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.904823 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm" (OuterVolumeSpecName: "kube-api-access-ktgkm") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "kube-api-access-ktgkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.938687 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data" (OuterVolumeSpecName: "config-data") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.940059 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.966856 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.980777 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" (UID: "fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996217 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996249 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996264 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996275 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996285 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996295 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktgkm\" (UniqueName: \"kubernetes.io/projected/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-kube-api-access-ktgkm\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:35 crc kubenswrapper[5030]: I0316 13:47:35.996308 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.680613 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.680815 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-749fdbbf86-7rdwk" event={"ID":"fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed","Type":"ContainerDied","Data":"7aee6e94aef2cf98e93d0ade1fbf4c956c043ee88e50c9ae2da37ab83e049984"} Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.680983 5030 scope.go:117] "RemoveContainer" containerID="55286fa35543852bfe06fa91bca1d16c17823aeaab0b1c059152c37067f13a55" Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.722292 5030 scope.go:117] "RemoveContainer" containerID="2366d2e0a71265f8ea5577d53820707ad7fe1310fd1c81b142eb35ea147a92b9" Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.730378 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:47:36 crc kubenswrapper[5030]: I0316 13:47:36.738583 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-749fdbbf86-7rdwk"] Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.387445 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536290 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536385 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536448 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536642 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536728 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.536771 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47m5t\" (UniqueName: \"kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t\") pod \"294a7b44-0940-41c8-9db0-63d671259955\" (UID: \"294a7b44-0940-41c8-9db0-63d671259955\") " Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.537605 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.537593 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.544469 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts" (OuterVolumeSpecName: "scripts") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.545566 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t" (OuterVolumeSpecName: "kube-api-access-47m5t") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "kube-api-access-47m5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.585711 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.593503 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.595387 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.597529 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.597670 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.619686 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.632865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data" (OuterVolumeSpecName: "config-data") pod "294a7b44-0940-41c8-9db0-63d671259955" (UID: "294a7b44-0940-41c8-9db0-63d671259955"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640687 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640716 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640733 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47m5t\" (UniqueName: \"kubernetes.io/projected/294a7b44-0940-41c8-9db0-63d671259955-kube-api-access-47m5t\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640744 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640755 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640764 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/294a7b44-0940-41c8-9db0-63d671259955-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.640771 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/294a7b44-0940-41c8-9db0-63d671259955-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.694947 5030 generic.go:358] "Generic (PLEG): container finished" podID="294a7b44-0940-41c8-9db0-63d671259955" containerID="bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50" exitCode=0 Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.695026 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerDied","Data":"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50"} Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.695069 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.696032 5030 scope.go:117] "RemoveContainer" containerID="30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.703139 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"294a7b44-0940-41c8-9db0-63d671259955","Type":"ContainerDied","Data":"3ea72f10030a473efd17d963e948153d15ad87b98bb938bb3c40a1b97c608e0d"} Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.733308 5030 scope.go:117] "RemoveContainer" containerID="019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.734663 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.742963 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.754079 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755373 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-notification-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755399 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-notification-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755445 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-central-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755452 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-central-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755462 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-api" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755467 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-api" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755483 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-log" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755489 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-log" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755503 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="proxy-httpd" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755507 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="proxy-httpd" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755520 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="sg-core" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.755525 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="sg-core" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757786 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-central-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757850 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="ceilometer-notification-agent" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757872 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="sg-core" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757892 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-api" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757913 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" containerName="placement-log" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.757919 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="294a7b44-0940-41c8-9db0-63d671259955" containerName="proxy-httpd" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.764505 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.767072 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.767605 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.768712 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.768917 5030 scope.go:117] "RemoveContainer" containerID="3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.800736 5030 scope.go:117] "RemoveContainer" containerID="bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.820844 5030 scope.go:117] "RemoveContainer" containerID="30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4" Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.821217 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4\": container with ID starting with 30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4 not found: ID does not exist" containerID="30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821261 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4"} err="failed to get container status \"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4\": rpc error: code = NotFound desc = could not find container \"30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4\": container with ID starting with 30e592c4902622fe31b1328fc4fb002b187f4ed8eb1124a3d61cff1729a683f4 not found: ID does not exist" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821289 5030 scope.go:117] "RemoveContainer" containerID="019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6" Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.821600 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6\": container with ID starting with 019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6 not found: ID does not exist" containerID="019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821623 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6"} err="failed to get container status \"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6\": rpc error: code = NotFound desc = could not find container \"019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6\": container with ID starting with 019aa29d205ecc8cdc754a1f1506522dfa48c11121bc08d79745e8e3766813e6 not found: ID does not exist" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821638 5030 scope.go:117] "RemoveContainer" containerID="3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d" Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.821914 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d\": container with ID starting with 3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d not found: ID does not exist" containerID="3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821938 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d"} err="failed to get container status \"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d\": rpc error: code = NotFound desc = could not find container \"3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d\": container with ID starting with 3759106ca15d93e3fb73380847c28be848a840b36529f5840fb57a9baa64c00d not found: ID does not exist" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.821951 5030 scope.go:117] "RemoveContainer" containerID="bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50" Mar 16 13:47:37 crc kubenswrapper[5030]: E0316 13:47:37.822436 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50\": container with ID starting with bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50 not found: ID does not exist" containerID="bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.822464 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50"} err="failed to get container status \"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50\": rpc error: code = NotFound desc = could not find container \"bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50\": container with ID starting with bf59e82ae606d1082b1a1e65949a0921502016dc36157696621e9f0a847b0b50 not found: ID does not exist" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.848955 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.849096 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njr5z\" (UniqueName: \"kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.849393 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.849440 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.849583 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.849626 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.850156 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952284 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952356 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952415 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njr5z\" (UniqueName: \"kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952501 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952526 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952613 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.952635 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.953195 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.953455 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.958805 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.959069 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.960126 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.962215 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294a7b44-0940-41c8-9db0-63d671259955" path="/var/lib/kubelet/pods/294a7b44-0940-41c8-9db0-63d671259955/volumes" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.963007 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed" path="/var/lib/kubelet/pods/fedcdc0f-f4f9-406e-a9ff-1a5b0a0322ed/volumes" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.964006 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:37 crc kubenswrapper[5030]: I0316 13:47:37.973870 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njr5z\" (UniqueName: \"kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z\") pod \"ceilometer-0\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:38 crc kubenswrapper[5030]: I0316 13:47:38.094116 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:38 crc kubenswrapper[5030]: W0316 13:47:38.498293 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecc041a5_06de_4c6b_847b_382d6ff2c83d.slice/crio-c84d90094c08be27adc07dcad12c07a6eeff05951b6d64a77b0b12d1e0d01407 WatchSource:0}: Error finding container c84d90094c08be27adc07dcad12c07a6eeff05951b6d64a77b0b12d1e0d01407: Status 404 returned error can't find the container with id c84d90094c08be27adc07dcad12c07a6eeff05951b6d64a77b0b12d1e0d01407 Mar 16 13:47:38 crc kubenswrapper[5030]: I0316 13:47:38.504795 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:47:38 crc kubenswrapper[5030]: I0316 13:47:38.710243 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerStarted","Data":"c84d90094c08be27adc07dcad12c07a6eeff05951b6d64a77b0b12d1e0d01407"} Mar 16 13:47:39 crc kubenswrapper[5030]: I0316 13:47:39.737322 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerStarted","Data":"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9"} Mar 16 13:47:40 crc kubenswrapper[5030]: I0316 13:47:40.750615 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerStarted","Data":"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524"} Mar 16 13:47:40 crc kubenswrapper[5030]: I0316 13:47:40.946622 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:47:40 crc kubenswrapper[5030]: E0316 13:47:40.946989 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:47:41 crc kubenswrapper[5030]: I0316 13:47:41.764733 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerStarted","Data":"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90"} Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.278435 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.278640 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.309523 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.313959 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:42 crc kubenswrapper[5030]: E0316 13:47:42.586880 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:42 crc kubenswrapper[5030]: E0316 13:47:42.588448 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:42 crc kubenswrapper[5030]: E0316 13:47:42.589817 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:42 crc kubenswrapper[5030]: E0316 13:47:42.589959 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.778874 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:42 crc kubenswrapper[5030]: I0316 13:47:42.779173 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.020504 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.020578 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.046476 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.052262 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.791093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerStarted","Data":"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e"} Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.792943 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.792989 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.793000 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:43 crc kubenswrapper[5030]: I0316 13:47:43.820465 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=2.572231054 podStartE2EDuration="6.820449523s" podCreationTimestamp="2026-03-16 13:47:37 +0000 UTC" firstStartedPulling="2026-03-16 13:47:38.500177577 +0000 UTC m=+2502.899490124" lastFinishedPulling="2026-03-16 13:47:42.748396045 +0000 UTC m=+2507.147708593" observedRunningTime="2026-03-16 13:47:43.816093591 +0000 UTC m=+2508.215406138" watchObservedRunningTime="2026-03-16 13:47:43.820449523 +0000 UTC m=+2508.219762069" Mar 16 13:47:44 crc kubenswrapper[5030]: I0316 13:47:44.512032 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:44 crc kubenswrapper[5030]: I0316 13:47:44.514816 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:47:45 crc kubenswrapper[5030]: I0316 13:47:45.437828 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:45 crc kubenswrapper[5030]: I0316 13:47:45.440734 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:47:47 crc kubenswrapper[5030]: E0316 13:47:47.586939 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:47 crc kubenswrapper[5030]: E0316 13:47:47.590370 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:47 crc kubenswrapper[5030]: E0316 13:47:47.592016 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:47 crc kubenswrapper[5030]: E0316 13:47:47.592066 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:47:51 crc kubenswrapper[5030]: I0316 13:47:51.945751 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:47:51 crc kubenswrapper[5030]: E0316 13:47:51.946653 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:47:52 crc kubenswrapper[5030]: E0316 13:47:52.586629 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:52 crc kubenswrapper[5030]: E0316 13:47:52.588479 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:52 crc kubenswrapper[5030]: E0316 13:47:52.590400 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:52 crc kubenswrapper[5030]: E0316 13:47:52.590433 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:47:53 crc kubenswrapper[5030]: E0316 13:47:53.843842 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1612419 actualBytes=10240 Mar 16 13:47:57 crc kubenswrapper[5030]: E0316 13:47:57.586126 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:57 crc kubenswrapper[5030]: E0316 13:47:57.588131 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:57 crc kubenswrapper[5030]: E0316 13:47:57.589969 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:47:57 crc kubenswrapper[5030]: E0316 13:47:57.590055 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.139091 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561148-tlpbz"] Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.144987 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.147371 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561148-tlpbz"] Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.147777 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.147806 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.147810 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.282022 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbn8n\" (UniqueName: \"kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n\") pod \"auto-csr-approver-29561148-tlpbz\" (UID: \"9c3eb07d-6762-49d5-8e23-20531ec885eb\") " pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.384477 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbn8n\" (UniqueName: \"kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n\") pod \"auto-csr-approver-29561148-tlpbz\" (UID: \"9c3eb07d-6762-49d5-8e23-20531ec885eb\") " pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.404240 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbn8n\" (UniqueName: \"kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n\") pod \"auto-csr-approver-29561148-tlpbz\" (UID: \"9c3eb07d-6762-49d5-8e23-20531ec885eb\") " pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.461075 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.866486 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561148-tlpbz"] Mar 16 13:48:00 crc kubenswrapper[5030]: I0316 13:48:00.973037 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" event={"ID":"9c3eb07d-6762-49d5-8e23-20531ec885eb","Type":"ContainerStarted","Data":"d35a4d2ba9a66bf5934286a4ce46d1c9b3d25b864271f69e9aff1e2292657aae"} Mar 16 13:48:02 crc kubenswrapper[5030]: E0316 13:48:02.587842 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:48:02 crc kubenswrapper[5030]: E0316 13:48:02.590016 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:48:02 crc kubenswrapper[5030]: E0316 13:48:02.594316 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:48:02 crc kubenswrapper[5030]: E0316 13:48:02.594365 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:48:02 crc kubenswrapper[5030]: I0316 13:48:02.998758 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.001417 5030 generic.go:358] "Generic (PLEG): container finished" podID="9c3eb07d-6762-49d5-8e23-20531ec885eb" containerID="a1e0bd76fb71811108735ab94308647424122529d38a4412528691cb08185439" exitCode=0 Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.001518 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" event={"ID":"9c3eb07d-6762-49d5-8e23-20531ec885eb","Type":"ContainerDied","Data":"a1e0bd76fb71811108735ab94308647424122529d38a4412528691cb08185439"} Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.003762 5030 generic.go:358] "Generic (PLEG): container finished" podID="205b16d0-0928-430b-b228-3e4dc2be7163" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" exitCode=137 Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.003871 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.004074 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"205b16d0-0928-430b-b228-3e4dc2be7163","Type":"ContainerDied","Data":"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e"} Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.004093 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"205b16d0-0928-430b-b228-3e4dc2be7163","Type":"ContainerDied","Data":"09cc16906a0d6b8ff1386328497cf85733b1949817fe3e6b31d404252414e51e"} Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.004125 5030 scope.go:117] "RemoveContainer" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.030157 5030 scope.go:117] "RemoveContainer" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" Mar 16 13:48:03 crc kubenswrapper[5030]: E0316 13:48:03.030521 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e\": container with ID starting with 208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e not found: ID does not exist" containerID="208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.030664 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e"} err="failed to get container status \"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e\": rpc error: code = NotFound desc = could not find container \"208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e\": container with ID starting with 208a8c6a55c06aa7b84a249cceb77e9a570bb23d2b471245a9bf0866245ac13e not found: ID does not exist" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.160193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data\") pod \"205b16d0-0928-430b-b228-3e4dc2be7163\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.160730 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66xf5\" (UniqueName: \"kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5\") pod \"205b16d0-0928-430b-b228-3e4dc2be7163\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.160765 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle\") pod \"205b16d0-0928-430b-b228-3e4dc2be7163\" (UID: \"205b16d0-0928-430b-b228-3e4dc2be7163\") " Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.172095 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5" (OuterVolumeSpecName: "kube-api-access-66xf5") pod "205b16d0-0928-430b-b228-3e4dc2be7163" (UID: "205b16d0-0928-430b-b228-3e4dc2be7163"). InnerVolumeSpecName "kube-api-access-66xf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.185776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data" (OuterVolumeSpecName: "config-data") pod "205b16d0-0928-430b-b228-3e4dc2be7163" (UID: "205b16d0-0928-430b-b228-3e4dc2be7163"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.186445 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "205b16d0-0928-430b-b228-3e4dc2be7163" (UID: "205b16d0-0928-430b-b228-3e4dc2be7163"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.264615 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66xf5\" (UniqueName: \"kubernetes.io/projected/205b16d0-0928-430b-b228-3e4dc2be7163-kube-api-access-66xf5\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.264654 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.264665 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/205b16d0-0928-430b-b228-3e4dc2be7163-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.343241 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.350151 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.366339 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.367792 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.367815 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.368202 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" containerName="nova-cell0-conductor-conductor" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.374344 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.374516 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.381965 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-nova-dockercfg-684ml\"" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.382206 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-conductor-config-data\"" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.470611 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.470692 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.470900 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdkk5\" (UniqueName: \"kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.574252 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.574321 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.574414 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdkk5\" (UniqueName: \"kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.583212 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.583291 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.593901 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdkk5\" (UniqueName: \"kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5\") pod \"nova-cell0-conductor-0\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.693656 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:03 crc kubenswrapper[5030]: I0316 13:48:03.956202 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="205b16d0-0928-430b-b228-3e4dc2be7163" path="/var/lib/kubelet/pods/205b16d0-0928-430b-b228-3e4dc2be7163/volumes" Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.130691 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:48:04 crc kubenswrapper[5030]: W0316 13:48:04.133389 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dbca707_c128_4a20_9bf3_534401a1130b.slice/crio-78c176cef487f9129a1bd48e5129e2be4293feb40e00c323a4fa59c1fba6d616 WatchSource:0}: Error finding container 78c176cef487f9129a1bd48e5129e2be4293feb40e00c323a4fa59c1fba6d616: Status 404 returned error can't find the container with id 78c176cef487f9129a1bd48e5129e2be4293feb40e00c323a4fa59c1fba6d616 Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.137003 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.285968 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.391900 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbn8n\" (UniqueName: \"kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n\") pod \"9c3eb07d-6762-49d5-8e23-20531ec885eb\" (UID: \"9c3eb07d-6762-49d5-8e23-20531ec885eb\") " Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.398118 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n" (OuterVolumeSpecName: "kube-api-access-wbn8n") pod "9c3eb07d-6762-49d5-8e23-20531ec885eb" (UID: "9c3eb07d-6762-49d5-8e23-20531ec885eb"). InnerVolumeSpecName "kube-api-access-wbn8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:04 crc kubenswrapper[5030]: I0316 13:48:04.494772 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbn8n\" (UniqueName: \"kubernetes.io/projected/9c3eb07d-6762-49d5-8e23-20531ec885eb-kube-api-access-wbn8n\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.027841 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6dbca707-c128-4a20-9bf3-534401a1130b","Type":"ContainerStarted","Data":"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80"} Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.027900 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6dbca707-c128-4a20-9bf3-534401a1130b","Type":"ContainerStarted","Data":"78c176cef487f9129a1bd48e5129e2be4293feb40e00c323a4fa59c1fba6d616"} Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.028906 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.030654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" event={"ID":"9c3eb07d-6762-49d5-8e23-20531ec885eb","Type":"ContainerDied","Data":"d35a4d2ba9a66bf5934286a4ce46d1c9b3d25b864271f69e9aff1e2292657aae"} Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.030692 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d35a4d2ba9a66bf5934286a4ce46d1c9b3d25b864271f69e9aff1e2292657aae" Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.030748 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561148-tlpbz" Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.059051 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podStartSLOduration=2.059027405 podStartE2EDuration="2.059027405s" podCreationTimestamp="2026-03-16 13:48:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:05.049715581 +0000 UTC m=+2529.449028128" watchObservedRunningTime="2026-03-16 13:48:05.059027405 +0000 UTC m=+2529.458339951" Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.359410 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561142-qkxmz"] Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.367034 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561142-qkxmz"] Mar 16 13:48:05 crc kubenswrapper[5030]: I0316 13:48:05.955948 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb374918-459d-4d20-b778-c1744386d86f" path="/var/lib/kubelet/pods/cb374918-459d-4d20-b778-c1744386d86f/volumes" Mar 16 13:48:06 crc kubenswrapper[5030]: I0316 13:48:06.945434 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:48:06 crc kubenswrapper[5030]: E0316 13:48:06.946196 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.079002 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.501880 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.502982 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3eb07d-6762-49d5-8e23-20531ec885eb" containerName="oc" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.503006 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3eb07d-6762-49d5-8e23-20531ec885eb" containerName="oc" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.503244 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c3eb07d-6762-49d5-8e23-20531ec885eb" containerName="oc" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.506682 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.508916 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-scripts\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.509891 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-manage-config-data\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.510777 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.612291 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.616671 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.618889 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.629978 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.675224 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58wj\" (UniqueName: \"kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.675278 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.675836 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.675911 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.680404 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.724230 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.729825 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.750877 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.778642 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d58wj\" (UniqueName: \"kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.778709 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.778744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.778790 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.778839 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.779353 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqd6n\" (UniqueName: \"kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.779435 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.779506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.787919 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.808619 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.809096 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.816238 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.818375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58wj\" (UniqueName: \"kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj\") pod \"nova-cell0-cell-mapping-pp56p\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.827042 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.846188 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.853918 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.866260 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.882655 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.882717 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.882926 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqd6n\" (UniqueName: \"kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.882985 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.883117 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npk4z\" (UniqueName: \"kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.883221 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.883278 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.889536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.917117 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.928251 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqd6n\" (UniqueName: \"kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.934020 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.935030 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.943038 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.948038 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.960959 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995131 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npk4z\" (UniqueName: \"kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995302 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995374 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plbn\" (UniqueName: \"kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995473 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995656 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995738 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.995769 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:12 crc kubenswrapper[5030]: I0316 13:48:12.996508 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.018244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.024028 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.035194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npk4z\" (UniqueName: \"kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z\") pod \"nova-cell1-novncproxy-0\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.064124 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099080 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099157 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099186 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099207 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099267 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzqbp\" (UniqueName: \"kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099383 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2plbn\" (UniqueName: \"kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.099465 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.103234 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.117349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.144855 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plbn\" (UniqueName: \"kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.147142 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.203506 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.203722 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.203833 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzqbp\" (UniqueName: \"kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.207306 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.207703 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.223223 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzqbp\" (UniqueName: \"kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp\") pod \"nova-scheduler-0\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.271076 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.302543 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.468051 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p"] Mar 16 13:48:13 crc kubenswrapper[5030]: W0316 13:48:13.477412 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42ffc91e_98d6_4678_8e70_6bab4e0f19e1.slice/crio-ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9 WatchSource:0}: Error finding container ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9: Status 404 returned error can't find the container with id ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9 Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.564288 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:13 crc kubenswrapper[5030]: W0316 13:48:13.570541 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50dcc347_0718_415a_b9c5_7d4bcab7219f.slice/crio-78a0640ae40b249722f8af8c7165d36019131a7825718fb590c48371d5f0184f WatchSource:0}: Error finding container 78a0640ae40b249722f8af8c7165d36019131a7825718fb590c48371d5f0184f: Status 404 returned error can't find the container with id 78a0640ae40b249722f8af8c7165d36019131a7825718fb590c48371d5f0184f Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.571479 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:13 crc kubenswrapper[5030]: W0316 13:48:13.573076 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1c670a1_89a1_4c8c_8eed_d43784012466.slice/crio-efd9e23752e2ad09a6524545dda29ec62e24274e685667f74048b3681116e3b0 WatchSource:0}: Error finding container efd9e23752e2ad09a6524545dda29ec62e24274e685667f74048b3681116e3b0: Status 404 returned error can't find the container with id efd9e23752e2ad09a6524545dda29ec62e24274e685667f74048b3681116e3b0 Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.688131 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4"] Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.693445 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.696329 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-scripts\"" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.696480 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-conductor-config-data\"" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.701197 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4"] Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.728014 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.818963 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rkzq\" (UniqueName: \"kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.819028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.819052 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.819198 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.820731 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.920881 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.921287 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rkzq\" (UniqueName: \"kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.921336 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.921360 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.928194 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.931984 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.932316 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:13 crc kubenswrapper[5030]: I0316 13:48:13.936943 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rkzq\" (UniqueName: \"kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq\") pod \"nova-cell1-conductor-db-sync-vvzc4\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.012904 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.196145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c65620ef-8372-4422-89fe-043b0aec3069","Type":"ContainerStarted","Data":"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.196337 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c65620ef-8372-4422-89fe-043b0aec3069","Type":"ContainerStarted","Data":"c7bdcf08ea665b8f742b369286e1a71055f516028596e049d15546a604dca859"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.212607 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" event={"ID":"42ffc91e-98d6-4678-8e70-6bab4e0f19e1","Type":"ContainerStarted","Data":"b2f55106d03fd6042e366fd63355a77de34e8ed5ba96d2eb429b1ebfb256ab59"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.212679 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" event={"ID":"42ffc91e-98d6-4678-8e70-6bab4e0f19e1","Type":"ContainerStarted","Data":"ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.213882 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.213865227 podStartE2EDuration="2.213865227s" podCreationTimestamp="2026-03-16 13:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:14.210266028 +0000 UTC m=+2538.609578565" watchObservedRunningTime="2026-03-16 13:48:14.213865227 +0000 UTC m=+2538.613177774" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.241463 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" podStartSLOduration=2.241449758 podStartE2EDuration="2.241449758s" podCreationTimestamp="2026-03-16 13:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:14.231506938 +0000 UTC m=+2538.630819485" watchObservedRunningTime="2026-03-16 13:48:14.241449758 +0000 UTC m=+2538.640762304" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.242907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerStarted","Data":"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.242962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerStarted","Data":"9569dd2cb1f11dbffc7dcd9099dadc9068c0fad2dc2f71c5d3556827581b6422"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.250680 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"50dcc347-0718-415a-b9c5-7d4bcab7219f","Type":"ContainerStarted","Data":"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.250728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"50dcc347-0718-415a-b9c5-7d4bcab7219f","Type":"ContainerStarted","Data":"78a0640ae40b249722f8af8c7165d36019131a7825718fb590c48371d5f0184f"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.261880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerStarted","Data":"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.261938 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerStarted","Data":"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.261950 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerStarted","Data":"efd9e23752e2ad09a6524545dda29ec62e24274e685667f74048b3681116e3b0"} Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.284089 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.284059708 podStartE2EDuration="2.284059708s" podCreationTimestamp="2026-03-16 13:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:14.270857548 +0000 UTC m=+2538.670170095" watchObservedRunningTime="2026-03-16 13:48:14.284059708 +0000 UTC m=+2538.683372255" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.291360 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.291347835 podStartE2EDuration="2.291347835s" podCreationTimestamp="2026-03-16 13:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:14.288363432 +0000 UTC m=+2538.687675979" watchObservedRunningTime="2026-03-16 13:48:14.291347835 +0000 UTC m=+2538.690660382" Mar 16 13:48:14 crc kubenswrapper[5030]: I0316 13:48:14.443939 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4"] Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.200315 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.211068 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.271946 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" event={"ID":"96e353b3-21bc-411e-8209-fc3fbbdbe51d","Type":"ContainerStarted","Data":"34f72a381ce4055013f0a19a825e9a271a487584b4d93e75e6893589d320c613"} Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.271994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" event={"ID":"96e353b3-21bc-411e-8209-fc3fbbdbe51d","Type":"ContainerStarted","Data":"3630fb2804e0f27d263e30a16d5c0747d3bae6ef5d9ff9bd8731cbd559d5d9d2"} Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.275373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerStarted","Data":"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079"} Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.292722 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" podStartSLOduration=2.292704451 podStartE2EDuration="2.292704451s" podCreationTimestamp="2026-03-16 13:48:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:15.284281008 +0000 UTC m=+2539.683593555" watchObservedRunningTime="2026-03-16 13:48:15.292704451 +0000 UTC m=+2539.692016988" Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.311180 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=3.311163338 podStartE2EDuration="3.311163338s" podCreationTimestamp="2026-03-16 13:48:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:15.302412098 +0000 UTC m=+2539.701724646" watchObservedRunningTime="2026-03-16 13:48:15.311163338 +0000 UTC m=+2539.710475885" Mar 16 13:48:15 crc kubenswrapper[5030]: I0316 13:48:15.823579 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.286870 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-log" containerID="cri-o://d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" gracePeriod=30 Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.287244 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-metadata" containerID="cri-o://c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" gracePeriod=30 Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.291746 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="50dcc347-0718-415a-b9c5-7d4bcab7219f" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9" gracePeriod=30 Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.804992 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.908812 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs\") pod \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.909090 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2plbn\" (UniqueName: \"kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn\") pod \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.909131 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data\") pod \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.909255 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle\") pod \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\" (UID: \"93e5771a-2ccd-4580-aca3-aa5f44e10b0a\") " Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.909390 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs" (OuterVolumeSpecName: "logs") pod "93e5771a-2ccd-4580-aca3-aa5f44e10b0a" (UID: "93e5771a-2ccd-4580-aca3-aa5f44e10b0a"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.910180 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.915144 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn" (OuterVolumeSpecName: "kube-api-access-2plbn") pod "93e5771a-2ccd-4580-aca3-aa5f44e10b0a" (UID: "93e5771a-2ccd-4580-aca3-aa5f44e10b0a"). InnerVolumeSpecName "kube-api-access-2plbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.919403 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.935884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93e5771a-2ccd-4580-aca3-aa5f44e10b0a" (UID: "93e5771a-2ccd-4580-aca3-aa5f44e10b0a"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:16 crc kubenswrapper[5030]: I0316 13:48:16.939774 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data" (OuterVolumeSpecName: "config-data") pod "93e5771a-2ccd-4580-aca3-aa5f44e10b0a" (UID: "93e5771a-2ccd-4580-aca3-aa5f44e10b0a"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.010761 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npk4z\" (UniqueName: \"kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z\") pod \"50dcc347-0718-415a-b9c5-7d4bcab7219f\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.010849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle\") pod \"50dcc347-0718-415a-b9c5-7d4bcab7219f\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.011380 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data\") pod \"50dcc347-0718-415a-b9c5-7d4bcab7219f\" (UID: \"50dcc347-0718-415a-b9c5-7d4bcab7219f\") " Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.011967 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2plbn\" (UniqueName: \"kubernetes.io/projected/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-kube-api-access-2plbn\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.011986 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.011995 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5771a-2ccd-4580-aca3-aa5f44e10b0a-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.014051 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z" (OuterVolumeSpecName: "kube-api-access-npk4z") pod "50dcc347-0718-415a-b9c5-7d4bcab7219f" (UID: "50dcc347-0718-415a-b9c5-7d4bcab7219f"). InnerVolumeSpecName "kube-api-access-npk4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.030733 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "50dcc347-0718-415a-b9c5-7d4bcab7219f" (UID: "50dcc347-0718-415a-b9c5-7d4bcab7219f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.031544 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data" (OuterVolumeSpecName: "config-data") pod "50dcc347-0718-415a-b9c5-7d4bcab7219f" (UID: "50dcc347-0718-415a-b9c5-7d4bcab7219f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.115317 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.115599 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npk4z\" (UniqueName: \"kubernetes.io/projected/50dcc347-0718-415a-b9c5-7d4bcab7219f-kube-api-access-npk4z\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.115616 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/50dcc347-0718-415a-b9c5-7d4bcab7219f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300069 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerID="c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" exitCode=0 Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300108 5030 generic.go:358] "Generic (PLEG): container finished" podID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerID="d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" exitCode=143 Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300145 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerDied","Data":"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079"} Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300220 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300232 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerDied","Data":"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf"} Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300253 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"93e5771a-2ccd-4580-aca3-aa5f44e10b0a","Type":"ContainerDied","Data":"9569dd2cb1f11dbffc7dcd9099dadc9068c0fad2dc2f71c5d3556827581b6422"} Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.300280 5030 scope.go:117] "RemoveContainer" containerID="c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.302743 5030 generic.go:358] "Generic (PLEG): container finished" podID="50dcc347-0718-415a-b9c5-7d4bcab7219f" containerID="bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9" exitCode=0 Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.302852 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"50dcc347-0718-415a-b9c5-7d4bcab7219f","Type":"ContainerDied","Data":"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9"} Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.302874 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"50dcc347-0718-415a-b9c5-7d4bcab7219f","Type":"ContainerDied","Data":"78a0640ae40b249722f8af8c7165d36019131a7825718fb590c48371d5f0184f"} Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.302970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.323368 5030 scope.go:117] "RemoveContainer" containerID="d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.346600 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.352172 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.359708 5030 scope.go:117] "RemoveContainer" containerID="c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" Mar 16 13:48:17 crc kubenswrapper[5030]: E0316 13:48:17.360165 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079\": container with ID starting with c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079 not found: ID does not exist" containerID="c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360196 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079"} err="failed to get container status \"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079\": rpc error: code = NotFound desc = could not find container \"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079\": container with ID starting with c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079 not found: ID does not exist" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360213 5030 scope.go:117] "RemoveContainer" containerID="d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" Mar 16 13:48:17 crc kubenswrapper[5030]: E0316 13:48:17.360419 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf\": container with ID starting with d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf not found: ID does not exist" containerID="d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360440 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf"} err="failed to get container status \"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf\": rpc error: code = NotFound desc = could not find container \"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf\": container with ID starting with d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf not found: ID does not exist" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360454 5030 scope.go:117] "RemoveContainer" containerID="c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360864 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079"} err="failed to get container status \"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079\": rpc error: code = NotFound desc = could not find container \"c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079\": container with ID starting with c9e81ed30dd0c5553f8ee8738efef7b5e85af39818a4d8c322a0f5cbfe324079 not found: ID does not exist" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.360887 5030 scope.go:117] "RemoveContainer" containerID="d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.361017 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.361232 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf"} err="failed to get container status \"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf\": rpc error: code = NotFound desc = could not find container \"d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf\": container with ID starting with d2b75552ea5d519301f45f08966c8a9dc0e4c9d1438357e2d636308a1c07a6bf not found: ID does not exist" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.361251 5030 scope.go:117] "RemoveContainer" containerID="bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.370325 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371401 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50dcc347-0718-415a-b9c5-7d4bcab7219f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371422 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="50dcc347-0718-415a-b9c5-7d4bcab7219f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371440 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-log" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371447 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-log" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371476 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-metadata" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371481 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-metadata" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371733 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-log" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371759 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" containerName="nova-metadata-metadata" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.371772 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="50dcc347-0718-415a-b9c5-7d4bcab7219f" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.374829 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.375030 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.385373 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.385254 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.425745 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.425856 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.426022 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.426330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.426373 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24xpw\" (UniqueName: \"kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.423215 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.431261 5030 scope.go:117] "RemoveContainer" containerID="bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9" Mar 16 13:48:17 crc kubenswrapper[5030]: E0316 13:48:17.436606 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9\": container with ID starting with bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9 not found: ID does not exist" containerID="bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.436659 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9"} err="failed to get container status \"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9\": rpc error: code = NotFound desc = could not find container \"bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9\": container with ID starting with bd12b152e346d1dfdff061c934a3eb863c70d5255b3cac82d76b4e909cf8ccd9 not found: ID does not exist" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.443713 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.468400 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.468557 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.474487 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-public-svc\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.474598 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-novncproxy-cell1-vencrypt\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.475972 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-novncproxy-config-data\"" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529382 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvzvv\" (UniqueName: \"kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529480 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529529 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529603 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24xpw\" (UniqueName: \"kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529837 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529904 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.529942 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.530168 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.530275 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.530281 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.530470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.535447 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.535453 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.535686 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.550986 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24xpw\" (UniqueName: \"kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw\") pod \"nova-metadata-0\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.632348 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.632490 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.632611 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.633062 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.633309 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvzvv\" (UniqueName: \"kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.636957 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.637226 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.640270 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.640537 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.654166 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvzvv\" (UniqueName: \"kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv\") pod \"nova-cell1-novncproxy-0\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.759154 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.787877 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.946467 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:48:17 crc kubenswrapper[5030]: E0316 13:48:17.947103 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.958572 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50dcc347-0718-415a-b9c5-7d4bcab7219f" path="/var/lib/kubelet/pods/50dcc347-0718-415a-b9c5-7d4bcab7219f/volumes" Mar 16 13:48:17 crc kubenswrapper[5030]: I0316 13:48:17.959092 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e5771a-2ccd-4580-aca3-aa5f44e10b0a" path="/var/lib/kubelet/pods/93e5771a-2ccd-4580-aca3-aa5f44e10b0a/volumes" Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.178359 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:18 crc kubenswrapper[5030]: W0316 13:48:18.179294 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb007ac08_8120_4dc8_a410_da3fa2d01018.slice/crio-dc3ed5228037e3fd66c0ed6866ac141b65ecf466c2ab2794a34dd418464246c0 WatchSource:0}: Error finding container dc3ed5228037e3fd66c0ed6866ac141b65ecf466c2ab2794a34dd418464246c0: Status 404 returned error can't find the container with id dc3ed5228037e3fd66c0ed6866ac141b65ecf466c2ab2794a34dd418464246c0 Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.259240 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:48:18 crc kubenswrapper[5030]: W0316 13:48:18.283517 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c89be7e_2fd4_4e65_8397_c57b95782453.slice/crio-c4716ca37fef07671d1572b0b24f015356c7a851c437c294d3fa4f8a44437dcd WatchSource:0}: Error finding container c4716ca37fef07671d1572b0b24f015356c7a851c437c294d3fa4f8a44437dcd: Status 404 returned error can't find the container with id c4716ca37fef07671d1572b0b24f015356c7a851c437c294d3fa4f8a44437dcd Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.303464 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.317604 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerStarted","Data":"dc3ed5228037e3fd66c0ed6866ac141b65ecf466c2ab2794a34dd418464246c0"} Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.319597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8c89be7e-2fd4-4e65-8397-c57b95782453","Type":"ContainerStarted","Data":"c4716ca37fef07671d1572b0b24f015356c7a851c437c294d3fa4f8a44437dcd"} Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.334518 5030 generic.go:358] "Generic (PLEG): container finished" podID="96e353b3-21bc-411e-8209-fc3fbbdbe51d" containerID="34f72a381ce4055013f0a19a825e9a271a487584b4d93e75e6893589d320c613" exitCode=0 Mar 16 13:48:18 crc kubenswrapper[5030]: I0316 13:48:18.334866 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" event={"ID":"96e353b3-21bc-411e-8209-fc3fbbdbe51d","Type":"ContainerDied","Data":"34f72a381ce4055013f0a19a825e9a271a487584b4d93e75e6893589d320c613"} Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.302451 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.302961 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" containerName="kube-state-metrics" containerID="cri-o://e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad" gracePeriod=30 Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.361968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerStarted","Data":"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9"} Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.362019 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerStarted","Data":"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32"} Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.365344 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8c89be7e-2fd4-4e65-8397-c57b95782453","Type":"ContainerStarted","Data":"d0385aff86fd3b7e84fd33318cdf13a98e2ed953753efadd078d9c0193b83484"} Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.383988 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.38397114 podStartE2EDuration="2.38397114s" podCreationTimestamp="2026-03-16 13:48:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:19.379244921 +0000 UTC m=+2543.778557538" watchObservedRunningTime="2026-03-16 13:48:19.38397114 +0000 UTC m=+2543.783283677" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.395806 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podStartSLOduration=2.395771704 podStartE2EDuration="2.395771704s" podCreationTimestamp="2026-03-16 13:48:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:19.394935633 +0000 UTC m=+2543.794248179" watchObservedRunningTime="2026-03-16 13:48:19.395771704 +0000 UTC m=+2543.795084251" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.702195 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.781804 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.786269 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts\") pod \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.786445 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rkzq\" (UniqueName: \"kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq\") pod \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.786532 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") pod \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.787171 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data\") pod \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.795707 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts" (OuterVolumeSpecName: "scripts") pod "96e353b3-21bc-411e-8209-fc3fbbdbe51d" (UID: "96e353b3-21bc-411e-8209-fc3fbbdbe51d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.795734 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq" (OuterVolumeSpecName: "kube-api-access-7rkzq") pod "96e353b3-21bc-411e-8209-fc3fbbdbe51d" (UID: "96e353b3-21bc-411e-8209-fc3fbbdbe51d"). InnerVolumeSpecName "kube-api-access-7rkzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:19 crc kubenswrapper[5030]: E0316 13:48:19.815941 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle podName:96e353b3-21bc-411e-8209-fc3fbbdbe51d nodeName:}" failed. No retries permitted until 2026-03-16 13:48:20.315911416 +0000 UTC m=+2544.715223963 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "combined-ca-bundle" (UniqueName: "kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle") pod "96e353b3-21bc-411e-8209-fc3fbbdbe51d" (UID: "96e353b3-21bc-411e-8209-fc3fbbdbe51d") : error deleting /var/lib/kubelet/pods/96e353b3-21bc-411e-8209-fc3fbbdbe51d/volume-subpaths: remove /var/lib/kubelet/pods/96e353b3-21bc-411e-8209-fc3fbbdbe51d/volume-subpaths: no such file or directory Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.819773 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data" (OuterVolumeSpecName: "config-data") pod "96e353b3-21bc-411e-8209-fc3fbbdbe51d" (UID: "96e353b3-21bc-411e-8209-fc3fbbdbe51d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.889713 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv8nv\" (UniqueName: \"kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv\") pod \"b85e4267-3e18-4dcc-8b88-bd30e5acc693\" (UID: \"b85e4267-3e18-4dcc-8b88-bd30e5acc693\") " Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.890627 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.890646 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.890657 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rkzq\" (UniqueName: \"kubernetes.io/projected/96e353b3-21bc-411e-8209-fc3fbbdbe51d-kube-api-access-7rkzq\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.892301 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv" (OuterVolumeSpecName: "kube-api-access-nv8nv") pod "b85e4267-3e18-4dcc-8b88-bd30e5acc693" (UID: "b85e4267-3e18-4dcc-8b88-bd30e5acc693"). InnerVolumeSpecName "kube-api-access-nv8nv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:19 crc kubenswrapper[5030]: I0316 13:48:19.994610 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv8nv\" (UniqueName: \"kubernetes.io/projected/b85e4267-3e18-4dcc-8b88-bd30e5acc693-kube-api-access-nv8nv\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.383686 5030 generic.go:358] "Generic (PLEG): container finished" podID="42ffc91e-98d6-4678-8e70-6bab4e0f19e1" containerID="b2f55106d03fd6042e366fd63355a77de34e8ed5ba96d2eb429b1ebfb256ab59" exitCode=0 Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.383911 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" event={"ID":"42ffc91e-98d6-4678-8e70-6bab4e0f19e1","Type":"ContainerDied","Data":"b2f55106d03fd6042e366fd63355a77de34e8ed5ba96d2eb429b1ebfb256ab59"} Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.392398 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" event={"ID":"96e353b3-21bc-411e-8209-fc3fbbdbe51d","Type":"ContainerDied","Data":"3630fb2804e0f27d263e30a16d5c0747d3bae6ef5d9ff9bd8731cbd559d5d9d2"} Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.392463 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3630fb2804e0f27d263e30a16d5c0747d3bae6ef5d9ff9bd8731cbd559d5d9d2" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.392642 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401414 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") pod \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\" (UID: \"96e353b3-21bc-411e-8209-fc3fbbdbe51d\") " Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401435 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b85e4267-3e18-4dcc-8b88-bd30e5acc693","Type":"ContainerDied","Data":"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad"} Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401472 5030 scope.go:117] "RemoveContainer" containerID="e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401599 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401414 5030 generic.go:358] "Generic (PLEG): container finished" podID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" containerID="e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad" exitCode=2 Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.401896 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"b85e4267-3e18-4dcc-8b88-bd30e5acc693","Type":"ContainerDied","Data":"74eb02ca24ffd8da1be68999efb1507fd5b33828e1a79d0e72c025f46c086a03"} Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.408198 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96e353b3-21bc-411e-8209-fc3fbbdbe51d" (UID: "96e353b3-21bc-411e-8209-fc3fbbdbe51d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.437896 5030 scope.go:117] "RemoveContainer" containerID="e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad" Mar 16 13:48:20 crc kubenswrapper[5030]: E0316 13:48:20.438261 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad\": container with ID starting with e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad not found: ID does not exist" containerID="e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.438354 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad"} err="failed to get container status \"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad\": rpc error: code = NotFound desc = could not find container \"e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad\": container with ID starting with e8f1a6632f3c6aa0b08196e65d47bfbc549005ec7ed3695c9cc1726d465818ad not found: ID does not exist" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.443102 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.457021 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.465163 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.466666 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e353b3-21bc-411e-8209-fc3fbbdbe51d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.466739 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e353b3-21bc-411e-8209-fc3fbbdbe51d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.466812 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" containerName="kube-state-metrics" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.466864 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" containerName="kube-state-metrics" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.467061 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="96e353b3-21bc-411e-8209-fc3fbbdbe51d" containerName="nova-cell1-conductor-db-sync" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.467118 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" containerName="kube-state-metrics" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.470861 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.473457 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.506891 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4f8\" (UniqueName: \"kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.507164 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.507175 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.507278 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.508297 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96e353b3-21bc-411e-8209-fc3fbbdbe51d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.513929 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.515758 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-kube-state-metrics-svc\"" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.515774 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"kube-state-metrics-tls-config\"" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.516164 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.611262 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.611326 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhp8k\" (UniqueName: \"kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.611691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4f8\" (UniqueName: \"kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.611900 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.612124 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.612184 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.612255 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.617541 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.618690 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.627784 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4f8\" (UniqueName: \"kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8\") pod \"nova-cell1-conductor-0\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.715234 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.715299 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhp8k\" (UniqueName: \"kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.715420 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.715510 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.720536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.720838 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.720884 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.734209 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhp8k\" (UniqueName: \"kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k\") pod \"kube-state-metrics-0\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.791711 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.829688 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.898244 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.898751 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-central-agent" containerID="cri-o://7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9" gracePeriod=30 Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.898817 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="proxy-httpd" containerID="cri-o://0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e" gracePeriod=30 Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.898902 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="sg-core" containerID="cri-o://c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90" gracePeriod=30 Mar 16 13:48:20 crc kubenswrapper[5030]: I0316 13:48:20.898946 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-notification-agent" containerID="cri-o://50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524" gracePeriod=30 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.214503 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:48:21 crc kubenswrapper[5030]: W0316 13:48:21.225664 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a57a6e_d01f_4242_8296_14247847d0b7.slice/crio-f986da30de647107b6fbbd4410a9fffacda3c61071bb9b8fd07307ae427b43a7 WatchSource:0}: Error finding container f986da30de647107b6fbbd4410a9fffacda3c61071bb9b8fd07307ae427b43a7: Status 404 returned error can't find the container with id f986da30de647107b6fbbd4410a9fffacda3c61071bb9b8fd07307ae427b43a7 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.298362 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:48:21 crc kubenswrapper[5030]: W0316 13:48:21.301339 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd56176b_b7dd_4d48_bb44_19dfffcb0066.slice/crio-e5eda09a576ca911810f04811bd9b3f30507b000c77d00590d906692dc41ac09 WatchSource:0}: Error finding container e5eda09a576ca911810f04811bd9b3f30507b000c77d00590d906692dc41ac09: Status 404 returned error can't find the container with id e5eda09a576ca911810f04811bd9b3f30507b000c77d00590d906692dc41ac09 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.419326 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd56176b-b7dd-4d48-bb44-19dfffcb0066","Type":"ContainerStarted","Data":"e5eda09a576ca911810f04811bd9b3f30507b000c77d00590d906692dc41ac09"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423843 5030 generic.go:358] "Generic (PLEG): container finished" podID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerID="0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e" exitCode=0 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423869 5030 generic.go:358] "Generic (PLEG): container finished" podID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerID="c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90" exitCode=2 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423877 5030 generic.go:358] "Generic (PLEG): container finished" podID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerID="7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9" exitCode=0 Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423888 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerDied","Data":"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423960 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerDied","Data":"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.423973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerDied","Data":"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.426913 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f7a57a6e-d01f-4242-8296-14247847d0b7","Type":"ContainerStarted","Data":"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.426940 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f7a57a6e-d01f-4242-8296-14247847d0b7","Type":"ContainerStarted","Data":"f986da30de647107b6fbbd4410a9fffacda3c61071bb9b8fd07307ae427b43a7"} Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.426999 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.452022 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podStartSLOduration=1.45200254 podStartE2EDuration="1.45200254s" podCreationTimestamp="2026-03-16 13:48:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:21.444995872 +0000 UTC m=+2545.844308419" watchObservedRunningTime="2026-03-16 13:48:21.45200254 +0000 UTC m=+2545.851315088" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.777586 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.850744 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts\") pod \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.850835 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle\") pod \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.850891 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d58wj\" (UniqueName: \"kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj\") pod \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.850971 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data\") pod \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\" (UID: \"42ffc91e-98d6-4678-8e70-6bab4e0f19e1\") " Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.858810 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj" (OuterVolumeSpecName: "kube-api-access-d58wj") pod "42ffc91e-98d6-4678-8e70-6bab4e0f19e1" (UID: "42ffc91e-98d6-4678-8e70-6bab4e0f19e1"). InnerVolumeSpecName "kube-api-access-d58wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.861036 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts" (OuterVolumeSpecName: "scripts") pod "42ffc91e-98d6-4678-8e70-6bab4e0f19e1" (UID: "42ffc91e-98d6-4678-8e70-6bab4e0f19e1"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.881940 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "42ffc91e-98d6-4678-8e70-6bab4e0f19e1" (UID: "42ffc91e-98d6-4678-8e70-6bab4e0f19e1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.884641 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data" (OuterVolumeSpecName: "config-data") pod "42ffc91e-98d6-4678-8e70-6bab4e0f19e1" (UID: "42ffc91e-98d6-4678-8e70-6bab4e0f19e1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.955258 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.955397 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.955463 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d58wj\" (UniqueName: \"kubernetes.io/projected/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-kube-api-access-d58wj\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.955522 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/42ffc91e-98d6-4678-8e70-6bab4e0f19e1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:21 crc kubenswrapper[5030]: I0316 13:48:21.956818 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85e4267-3e18-4dcc-8b88-bd30e5acc693" path="/var/lib/kubelet/pods/b85e4267-3e18-4dcc-8b88-bd30e5acc693/volumes" Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.450734 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd56176b-b7dd-4d48-bb44-19dfffcb0066","Type":"ContainerStarted","Data":"4801579ba25be57a9a80192d4f3f5350cf1edc93d016de2f7d3a28983e6b2634"} Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.450828 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.453895 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" event={"ID":"42ffc91e-98d6-4678-8e70-6bab4e0f19e1","Type":"ContainerDied","Data":"ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9"} Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.454329 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc51e3588dba27820c75c72457c36524cc51aae9f059cbde31c44b826bcc6c9" Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.454041 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p" Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.476797 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/kube-state-metrics-0" podStartSLOduration=2.189097085 podStartE2EDuration="2.476778903s" podCreationTimestamp="2026-03-16 13:48:20 +0000 UTC" firstStartedPulling="2026-03-16 13:48:21.303169077 +0000 UTC m=+2545.702481624" lastFinishedPulling="2026-03-16 13:48:21.590850894 +0000 UTC m=+2545.990163442" observedRunningTime="2026-03-16 13:48:22.465868383 +0000 UTC m=+2546.865180930" watchObservedRunningTime="2026-03-16 13:48:22.476778903 +0000 UTC m=+2546.876091450" Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.586787 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.587104 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-log" containerID="cri-o://932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" gracePeriod=30 Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.587182 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-api" containerID="cri-o://fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" gracePeriod=30 Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.600094 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.600330 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="c65620ef-8372-4422-89fe-043b0aec3069" containerName="nova-scheduler-scheduler" containerID="cri-o://eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37" gracePeriod=30 Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.677033 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.677444 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-log" containerID="cri-o://d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" gracePeriod=30 Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.677760 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-metadata" containerID="cri-o://b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" gracePeriod=30 Mar 16 13:48:22 crc kubenswrapper[5030]: I0316 13:48:22.789083 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.186890 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.235339 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.291925 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs\") pod \"a1c670a1-89a1-4c8c-8eed-d43784012466\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.292096 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle\") pod \"a1c670a1-89a1-4c8c-8eed-d43784012466\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.292344 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqd6n\" (UniqueName: \"kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n\") pod \"a1c670a1-89a1-4c8c-8eed-d43784012466\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.292469 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs" (OuterVolumeSpecName: "logs") pod "a1c670a1-89a1-4c8c-8eed-d43784012466" (UID: "a1c670a1-89a1-4c8c-8eed-d43784012466"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.292531 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data\") pod \"a1c670a1-89a1-4c8c-8eed-d43784012466\" (UID: \"a1c670a1-89a1-4c8c-8eed-d43784012466\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.293213 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/a1c670a1-89a1-4c8c-8eed-d43784012466-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.299822 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n" (OuterVolumeSpecName: "kube-api-access-wqd6n") pod "a1c670a1-89a1-4c8c-8eed-d43784012466" (UID: "a1c670a1-89a1-4c8c-8eed-d43784012466"). InnerVolumeSpecName "kube-api-access-wqd6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.322749 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "a1c670a1-89a1-4c8c-8eed-d43784012466" (UID: "a1c670a1-89a1-4c8c-8eed-d43784012466"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.329866 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data" (OuterVolumeSpecName: "config-data") pod "a1c670a1-89a1-4c8c-8eed-d43784012466" (UID: "a1c670a1-89a1-4c8c-8eed-d43784012466"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.394629 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data\") pod \"b007ac08-8120-4dc8-a410-da3fa2d01018\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.394686 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24xpw\" (UniqueName: \"kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw\") pod \"b007ac08-8120-4dc8-a410-da3fa2d01018\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.394798 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs\") pod \"b007ac08-8120-4dc8-a410-da3fa2d01018\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.395137 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs" (OuterVolumeSpecName: "logs") pod "b007ac08-8120-4dc8-a410-da3fa2d01018" (UID: "b007ac08-8120-4dc8-a410-da3fa2d01018"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.395583 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs\") pod \"b007ac08-8120-4dc8-a410-da3fa2d01018\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.395714 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle\") pod \"b007ac08-8120-4dc8-a410-da3fa2d01018\" (UID: \"b007ac08-8120-4dc8-a410-da3fa2d01018\") " Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.396838 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b007ac08-8120-4dc8-a410-da3fa2d01018-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.396861 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.396873 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqd6n\" (UniqueName: \"kubernetes.io/projected/a1c670a1-89a1-4c8c-8eed-d43784012466-kube-api-access-wqd6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.396887 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/a1c670a1-89a1-4c8c-8eed-d43784012466-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.399578 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw" (OuterVolumeSpecName: "kube-api-access-24xpw") pod "b007ac08-8120-4dc8-a410-da3fa2d01018" (UID: "b007ac08-8120-4dc8-a410-da3fa2d01018"). InnerVolumeSpecName "kube-api-access-24xpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.426045 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "b007ac08-8120-4dc8-a410-da3fa2d01018" (UID: "b007ac08-8120-4dc8-a410-da3fa2d01018"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.428907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data" (OuterVolumeSpecName: "config-data") pod "b007ac08-8120-4dc8-a410-da3fa2d01018" (UID: "b007ac08-8120-4dc8-a410-da3fa2d01018"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.457778 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "b007ac08-8120-4dc8-a410-da3fa2d01018" (UID: "b007ac08-8120-4dc8-a410-da3fa2d01018"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489709 5030 generic.go:358] "Generic (PLEG): container finished" podID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerID="b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" exitCode=0 Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489746 5030 generic.go:358] "Generic (PLEG): container finished" podID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerID="d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" exitCode=143 Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489755 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerDied","Data":"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489793 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerDied","Data":"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489838 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"b007ac08-8120-4dc8-a410-da3fa2d01018","Type":"ContainerDied","Data":"dc3ed5228037e3fd66c0ed6866ac141b65ecf466c2ab2794a34dd418464246c0"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.489858 5030 scope.go:117] "RemoveContainer" containerID="b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496371 5030 generic.go:358] "Generic (PLEG): container finished" podID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerID="fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" exitCode=0 Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496392 5030 generic.go:358] "Generic (PLEG): container finished" podID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerID="932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" exitCode=143 Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496485 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496587 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerDied","Data":"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496722 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerDied","Data":"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.496791 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"a1c670a1-89a1-4c8c-8eed-d43784012466","Type":"ContainerDied","Data":"efd9e23752e2ad09a6524545dda29ec62e24274e685667f74048b3681116e3b0"} Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.502168 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.502208 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.502229 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b007ac08-8120-4dc8-a410-da3fa2d01018-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.502239 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24xpw\" (UniqueName: \"kubernetes.io/projected/b007ac08-8120-4dc8-a410-da3fa2d01018-kube-api-access-24xpw\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.539910 5030 scope.go:117] "RemoveContainer" containerID="d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.549316 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.564686 5030 scope.go:117] "RemoveContainer" containerID="b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" Mar 16 13:48:23 crc kubenswrapper[5030]: E0316 13:48:23.568905 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9\": container with ID starting with b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9 not found: ID does not exist" containerID="b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.568946 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9"} err="failed to get container status \"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9\": rpc error: code = NotFound desc = could not find container \"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9\": container with ID starting with b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.568972 5030 scope.go:117] "RemoveContainer" containerID="d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" Mar 16 13:48:23 crc kubenswrapper[5030]: E0316 13:48:23.569385 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32\": container with ID starting with d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32 not found: ID does not exist" containerID="d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569412 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32"} err="failed to get container status \"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32\": rpc error: code = NotFound desc = could not find container \"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32\": container with ID starting with d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569428 5030 scope.go:117] "RemoveContainer" containerID="b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569733 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9"} err="failed to get container status \"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9\": rpc error: code = NotFound desc = could not find container \"b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9\": container with ID starting with b98402dff9882556b1f1d342b2031f94854dae57e48f5076d9c71261d740cdb9 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569761 5030 scope.go:117] "RemoveContainer" containerID="d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569955 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32"} err="failed to get container status \"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32\": rpc error: code = NotFound desc = could not find container \"d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32\": container with ID starting with d74e3583b7bbe14c83c7a493d9f324520b48a92df8be0caab56130cd72b5ed32 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.569975 5030 scope.go:117] "RemoveContainer" containerID="fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.588298 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.612590 5030 scope.go:117] "RemoveContainer" containerID="932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.615910 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617143 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617161 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617186 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ffc91e-98d6-4678-8e70-6bab4e0f19e1" containerName="nova-manage" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617193 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ffc91e-98d6-4678-8e70-6bab4e0f19e1" containerName="nova-manage" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617241 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-metadata" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617246 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-metadata" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617262 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617268 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617280 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-api" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617286 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-api" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617459 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="42ffc91e-98d6-4678-8e70-6bab4e0f19e1" containerName="nova-manage" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617473 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-metadata" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617483 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-api" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617498 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" containerName="nova-api-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.617506 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" containerName="nova-metadata-log" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.622349 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.624274 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.624456 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.624771 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.648816 5030 scope.go:117] "RemoveContainer" containerID="fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" Mar 16 13:48:23 crc kubenswrapper[5030]: E0316 13:48:23.650132 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6\": container with ID starting with fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6 not found: ID does not exist" containerID="fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.650188 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6"} err="failed to get container status \"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6\": rpc error: code = NotFound desc = could not find container \"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6\": container with ID starting with fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.650222 5030 scope.go:117] "RemoveContainer" containerID="932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" Mar 16 13:48:23 crc kubenswrapper[5030]: E0316 13:48:23.650684 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee\": container with ID starting with 932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee not found: ID does not exist" containerID="932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.650732 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee"} err="failed to get container status \"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee\": rpc error: code = NotFound desc = could not find container \"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee\": container with ID starting with 932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.650750 5030 scope.go:117] "RemoveContainer" containerID="fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.650833 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.652169 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6"} err="failed to get container status \"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6\": rpc error: code = NotFound desc = could not find container \"fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6\": container with ID starting with fa69f7149a43a9b5a884930eabe9f061ccfb46436891f58c6a2d7f2e327800b6 not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.652217 5030 scope.go:117] "RemoveContainer" containerID="932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.652701 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee"} err="failed to get container status \"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee\": rpc error: code = NotFound desc = could not find container \"932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee\": container with ID starting with 932a0b60b99c2974f0044051663537af71811af6a8a12cdc9f06c944a7ed58ee not found: ID does not exist" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.660368 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.668783 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.673857 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.675622 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.678722 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.711028 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.711069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.711127 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.711421 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbzk\" (UniqueName: \"kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.711775 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.813250 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.813303 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.813397 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.813463 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.813694 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.814137 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.814267 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.814432 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.814481 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plbzk\" (UniqueName: \"kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.814520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpk9\" (UniqueName: \"kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.818338 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.818540 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.819054 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.828223 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbzk\" (UniqueName: \"kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk\") pod \"nova-metadata-0\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.917532 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.917679 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpk9\" (UniqueName: \"kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.918150 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.918773 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.919135 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.922303 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.922532 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.934656 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpk9\" (UniqueName: \"kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9\") pod \"nova-api-0\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.941705 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.960145 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c670a1-89a1-4c8c-8eed-d43784012466" path="/var/lib/kubelet/pods/a1c670a1-89a1-4c8c-8eed-d43784012466/volumes" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.961133 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b007ac08-8120-4dc8-a410-da3fa2d01018" path="/var/lib/kubelet/pods/b007ac08-8120-4dc8-a410-da3fa2d01018/volumes" Mar 16 13:48:23 crc kubenswrapper[5030]: I0316 13:48:23.995921 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:24 crc kubenswrapper[5030]: I0316 13:48:24.367813 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:24 crc kubenswrapper[5030]: I0316 13:48:24.428090 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:24 crc kubenswrapper[5030]: I0316 13:48:24.515661 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerStarted","Data":"a6f4f32bb9868460e4f337cca11321bb715e9d66d044581b99a005efde606390"} Mar 16 13:48:24 crc kubenswrapper[5030]: I0316 13:48:24.519852 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerStarted","Data":"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100"} Mar 16 13:48:24 crc kubenswrapper[5030]: I0316 13:48:24.519880 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerStarted","Data":"4d32f29248689724162140e168d4ad604c584f533a9548ceab10b46d38f4d533"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.230019 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.256944 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle\") pod \"c65620ef-8372-4422-89fe-043b0aec3069\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.257086 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzqbp\" (UniqueName: \"kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp\") pod \"c65620ef-8372-4422-89fe-043b0aec3069\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.257125 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data\") pod \"c65620ef-8372-4422-89fe-043b0aec3069\" (UID: \"c65620ef-8372-4422-89fe-043b0aec3069\") " Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.261385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp" (OuterVolumeSpecName: "kube-api-access-jzqbp") pod "c65620ef-8372-4422-89fe-043b0aec3069" (UID: "c65620ef-8372-4422-89fe-043b0aec3069"). InnerVolumeSpecName "kube-api-access-jzqbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.280934 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c65620ef-8372-4422-89fe-043b0aec3069" (UID: "c65620ef-8372-4422-89fe-043b0aec3069"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.280981 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data" (OuterVolumeSpecName: "config-data") pod "c65620ef-8372-4422-89fe-043b0aec3069" (UID: "c65620ef-8372-4422-89fe-043b0aec3069"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.360518 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.360575 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzqbp\" (UniqueName: \"kubernetes.io/projected/c65620ef-8372-4422-89fe-043b0aec3069-kube-api-access-jzqbp\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.360590 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c65620ef-8372-4422-89fe-043b0aec3069-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.534392 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerStarted","Data":"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.536255 5030 generic.go:358] "Generic (PLEG): container finished" podID="c65620ef-8372-4422-89fe-043b0aec3069" containerID="eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37" exitCode=0 Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.536362 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.536370 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c65620ef-8372-4422-89fe-043b0aec3069","Type":"ContainerDied","Data":"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.536452 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"c65620ef-8372-4422-89fe-043b0aec3069","Type":"ContainerDied","Data":"c7bdcf08ea665b8f742b369286e1a71055f516028596e049d15546a604dca859"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.536479 5030 scope.go:117] "RemoveContainer" containerID="eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.539002 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerStarted","Data":"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.539052 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerStarted","Data":"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041"} Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.566636 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.566622362 podStartE2EDuration="2.566622362s" podCreationTimestamp="2026-03-16 13:48:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:25.557373315 +0000 UTC m=+2549.956685863" watchObservedRunningTime="2026-03-16 13:48:25.566622362 +0000 UTC m=+2549.965934908" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.567965 5030 scope.go:117] "RemoveContainer" containerID="eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37" Mar 16 13:48:25 crc kubenswrapper[5030]: E0316 13:48:25.568339 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37\": container with ID starting with eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37 not found: ID does not exist" containerID="eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.568372 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37"} err="failed to get container status \"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37\": rpc error: code = NotFound desc = could not find container \"eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37\": container with ID starting with eecd4c0c6b2a72aebaed248e7a3bdff8aa47fbcd12c67620825fe1fc523e2f37 not found: ID does not exist" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.575891 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.57587257 podStartE2EDuration="2.57587257s" podCreationTimestamp="2026-03-16 13:48:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:25.575840919 +0000 UTC m=+2549.975153466" watchObservedRunningTime="2026-03-16 13:48:25.57587257 +0000 UTC m=+2549.975185117" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.602343 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.617906 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.643673 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.644863 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65620ef-8372-4422-89fe-043b0aec3069" containerName="nova-scheduler-scheduler" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.644887 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65620ef-8372-4422-89fe-043b0aec3069" containerName="nova-scheduler-scheduler" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.645147 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c65620ef-8372-4422-89fe-043b0aec3069" containerName="nova-scheduler-scheduler" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.649027 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.650802 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.652782 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.668057 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.668171 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.668476 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pdqr\" (UniqueName: \"kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.770503 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.770610 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.770779 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pdqr\" (UniqueName: \"kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.775673 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.775978 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.787805 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pdqr\" (UniqueName: \"kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr\") pod \"nova-scheduler-0\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.962680 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65620ef-8372-4422-89fe-043b0aec3069" path="/var/lib/kubelet/pods/c65620ef-8372-4422-89fe-043b0aec3069/volumes" Mar 16 13:48:25 crc kubenswrapper[5030]: I0316 13:48:25.964890 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.372715 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.384075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.384194 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.384708 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.384866 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njr5z\" (UniqueName: \"kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.385009 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.385175 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.385320 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml\") pod \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\" (UID: \"ecc041a5-06de-4c6b-847b-382d6ff2c83d\") " Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.388604 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.393848 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.395847 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.405681 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts" (OuterVolumeSpecName: "scripts") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.405818 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z" (OuterVolumeSpecName: "kube-api-access-njr5z") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "kube-api-access-njr5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.428165 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.467038 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.483673 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data" (OuterVolumeSpecName: "config-data") pod "ecc041a5-06de-4c6b-847b-382d6ff2c83d" (UID: "ecc041a5-06de-4c6b-847b-382d6ff2c83d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493779 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493818 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njr5z\" (UniqueName: \"kubernetes.io/projected/ecc041a5-06de-4c6b-847b-382d6ff2c83d-kube-api-access-njr5z\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493829 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493840 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/ecc041a5-06de-4c6b-847b-382d6ff2c83d-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493852 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493861 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.493873 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/ecc041a5-06de-4c6b-847b-382d6ff2c83d-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.558139 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bb5b80fb-f37e-4ba6-924f-e28493a3dd25","Type":"ContainerStarted","Data":"d29bfcf3c2eeea585c64d7e42672d7b30d0c5079fea6718cb86cb2fc31149734"} Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.561988 5030 generic.go:358] "Generic (PLEG): container finished" podID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerID="50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524" exitCode=0 Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.562081 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerDied","Data":"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524"} Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.562154 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.562432 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"ecc041a5-06de-4c6b-847b-382d6ff2c83d","Type":"ContainerDied","Data":"c84d90094c08be27adc07dcad12c07a6eeff05951b6d64a77b0b12d1e0d01407"} Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.562470 5030 scope.go:117] "RemoveContainer" containerID="0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.587172 5030 scope.go:117] "RemoveContainer" containerID="c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.601888 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.608187 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.617532 5030 scope.go:117] "RemoveContainer" containerID="50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.626512 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627533 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-notification-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627581 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-notification-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627594 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-central-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627600 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-central-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627658 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="proxy-httpd" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627664 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="proxy-httpd" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627676 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="sg-core" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627681 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="sg-core" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627860 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-central-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627878 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="sg-core" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627888 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="proxy-httpd" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.627905 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" containerName="ceilometer-notification-agent" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.633146 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.644162 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.645134 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.645412 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.650185 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.677695 5030 scope.go:117] "RemoveContainer" containerID="7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.699771 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.699825 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.699910 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnvd\" (UniqueName: \"kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.699937 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.700150 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.700177 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.700293 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.700334 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.776851 5030 scope.go:117] "RemoveContainer" containerID="0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e" Mar 16 13:48:26 crc kubenswrapper[5030]: E0316 13:48:26.787881 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e\": container with ID starting with 0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e not found: ID does not exist" containerID="0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.787933 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e"} err="failed to get container status \"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e\": rpc error: code = NotFound desc = could not find container \"0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e\": container with ID starting with 0aebe5775c3cc95381c6766da2f95d5f401754bcddbfd79e658dac16715bb10e not found: ID does not exist" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.787965 5030 scope.go:117] "RemoveContainer" containerID="c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90" Mar 16 13:48:26 crc kubenswrapper[5030]: E0316 13:48:26.789705 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90\": container with ID starting with c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90 not found: ID does not exist" containerID="c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.789735 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90"} err="failed to get container status \"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90\": rpc error: code = NotFound desc = could not find container \"c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90\": container with ID starting with c05660e8c7e86ef1d04a83bf6b94a579c6e774b5359ed1fb47263a6f4a578c90 not found: ID does not exist" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.789756 5030 scope.go:117] "RemoveContainer" containerID="50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524" Mar 16 13:48:26 crc kubenswrapper[5030]: E0316 13:48:26.791995 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524\": container with ID starting with 50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524 not found: ID does not exist" containerID="50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.792031 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524"} err="failed to get container status \"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524\": rpc error: code = NotFound desc = could not find container \"50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524\": container with ID starting with 50d2ebde8f2de24409792d82d16272b7e902745d870b08ee310553ba6e618524 not found: ID does not exist" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.792049 5030 scope.go:117] "RemoveContainer" containerID="7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9" Mar 16 13:48:26 crc kubenswrapper[5030]: E0316 13:48:26.796734 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9\": container with ID starting with 7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9 not found: ID does not exist" containerID="7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.796772 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9"} err="failed to get container status \"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9\": rpc error: code = NotFound desc = could not find container \"7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9\": container with ID starting with 7a44993516176b1c6aac9b8952171934459bc7c79c3c69f4ed4cb4aaca9e16c9 not found: ID does not exist" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.801955 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802033 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802179 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnvd\" (UniqueName: \"kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802211 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802245 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802288 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.802481 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.803028 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.805003 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.816121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.824101 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.832337 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.832589 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.832986 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.835028 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnvd\" (UniqueName: \"kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd\") pod \"ceilometer-0\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:26 crc kubenswrapper[5030]: I0316 13:48:26.998021 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.413172 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:48:27 crc kubenswrapper[5030]: W0316 13:48:27.420715 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde6e171c_6358_4d9f_808b_ea76a6088efe.slice/crio-76f3e1e14ce6c82b65bb00ef2b35554e6e6819c7ba7935862a9981b3eef8a419 WatchSource:0}: Error finding container 76f3e1e14ce6c82b65bb00ef2b35554e6e6819c7ba7935862a9981b3eef8a419: Status 404 returned error can't find the container with id 76f3e1e14ce6c82b65bb00ef2b35554e6e6819c7ba7935862a9981b3eef8a419 Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.485821 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.573981 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerStarted","Data":"76f3e1e14ce6c82b65bb00ef2b35554e6e6819c7ba7935862a9981b3eef8a419"} Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.577138 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bb5b80fb-f37e-4ba6-924f-e28493a3dd25","Type":"ContainerStarted","Data":"96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a"} Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.594049 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=2.594037481 podStartE2EDuration="2.594037481s" podCreationTimestamp="2026-03-16 13:48:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:27.589325098 +0000 UTC m=+2551.988637645" watchObservedRunningTime="2026-03-16 13:48:27.594037481 +0000 UTC m=+2551.993350029" Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.788620 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.817674 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:27 crc kubenswrapper[5030]: I0316 13:48:27.957612 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc041a5-06de-4c6b-847b-382d6ff2c83d" path="/var/lib/kubelet/pods/ecc041a5-06de-4c6b-847b-382d6ff2c83d/volumes" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.596964 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerStarted","Data":"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde"} Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.633779 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.870520 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76"] Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.879519 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.881892 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-scripts\"" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.883214 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-manage-config-data\"" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.904342 5030 scope.go:117] "RemoveContainer" containerID="d90dffc5d783fc6f673a5126c2657459ae109383f1ecf978eeafb1b9e410294d" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.904412 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76"] Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.945851 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:48:28 crc kubenswrapper[5030]: E0316 13:48:28.946601 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.954395 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.954448 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxgrw\" (UniqueName: \"kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.954486 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.955044 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:28 crc kubenswrapper[5030]: I0316 13:48:28.967205 5030 scope.go:117] "RemoveContainer" containerID="fb6e3b56880d136108da18abb6d3dfece6c608d840d09ae54190f7bc35bf7801" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.026439 5030 scope.go:117] "RemoveContainer" containerID="30c159d27976f159e43a676a397cb7153648cd97ce18ca623ff05a7d74bd2f49" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.057967 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxgrw\" (UniqueName: \"kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.058379 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.058828 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.059112 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.064297 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.064393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.065773 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.078130 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxgrw\" (UniqueName: \"kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw\") pod \"nova-cell1-cell-mapping-2wk76\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.141642 5030 scope.go:117] "RemoveContainer" containerID="25d4d552e6dcf52423705906ef532e5a2cc367ee50e9b3b20b7e987d00d8a649" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.204209 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.610127 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerStarted","Data":"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2"} Mar 16 13:48:29 crc kubenswrapper[5030]: I0316 13:48:29.648415 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76"] Mar 16 13:48:30 crc kubenswrapper[5030]: I0316 13:48:30.622015 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" event={"ID":"5452c3e3-51bd-42e9-9258-84d824a1879f","Type":"ContainerStarted","Data":"4d2f3cd2333dff953d3e52b56df86fb0f69241ebd82fd7217caeaa3a6c19bac8"} Mar 16 13:48:30 crc kubenswrapper[5030]: I0316 13:48:30.622441 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" event={"ID":"5452c3e3-51bd-42e9-9258-84d824a1879f","Type":"ContainerStarted","Data":"6e21017165764ba0d46a05570debb4f3f16d36fe0e47ab6bf429da57865d1c6c"} Mar 16 13:48:30 crc kubenswrapper[5030]: I0316 13:48:30.625390 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerStarted","Data":"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458"} Mar 16 13:48:30 crc kubenswrapper[5030]: I0316 13:48:30.643524 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" podStartSLOduration=2.643497006 podStartE2EDuration="2.643497006s" podCreationTimestamp="2026-03-16 13:48:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:30.634214377 +0000 UTC m=+2555.033526925" watchObservedRunningTime="2026-03-16 13:48:30.643497006 +0000 UTC m=+2555.042809553" Mar 16 13:48:30 crc kubenswrapper[5030]: I0316 13:48:30.965458 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:32 crc kubenswrapper[5030]: I0316 13:48:32.651718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerStarted","Data":"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c"} Mar 16 13:48:32 crc kubenswrapper[5030]: I0316 13:48:32.653769 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:48:32 crc kubenswrapper[5030]: I0316 13:48:32.676705 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.929749505 podStartE2EDuration="6.676692869s" podCreationTimestamp="2026-03-16 13:48:26 +0000 UTC" firstStartedPulling="2026-03-16 13:48:27.423468758 +0000 UTC m=+2551.822781306" lastFinishedPulling="2026-03-16 13:48:32.170412123 +0000 UTC m=+2556.569724670" observedRunningTime="2026-03-16 13:48:32.673693718 +0000 UTC m=+2557.073006265" watchObservedRunningTime="2026-03-16 13:48:32.676692869 +0000 UTC m=+2557.076005415" Mar 16 13:48:33 crc kubenswrapper[5030]: I0316 13:48:33.504179 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:48:33 crc kubenswrapper[5030]: I0316 13:48:33.942202 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:33 crc kubenswrapper[5030]: I0316 13:48:33.942259 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:33 crc kubenswrapper[5030]: I0316 13:48:33.996449 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:33 crc kubenswrapper[5030]: I0316 13:48:33.996511 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:34 crc kubenswrapper[5030]: I0316 13:48:34.673011 5030 generic.go:358] "Generic (PLEG): container finished" podID="5452c3e3-51bd-42e9-9258-84d824a1879f" containerID="4d2f3cd2333dff953d3e52b56df86fb0f69241ebd82fd7217caeaa3a6c19bac8" exitCode=0 Mar 16 13:48:34 crc kubenswrapper[5030]: I0316 13:48:34.673098 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" event={"ID":"5452c3e3-51bd-42e9-9258-84d824a1879f","Type":"ContainerDied","Data":"4d2f3cd2333dff953d3e52b56df86fb0f69241ebd82fd7217caeaa3a6c19bac8"} Mar 16 13:48:34 crc kubenswrapper[5030]: I0316 13:48:34.949729 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.13:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:34 crc kubenswrapper[5030]: I0316 13:48:34.950689 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.13:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:35 crc kubenswrapper[5030]: I0316 13:48:35.038793 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.14:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:35 crc kubenswrapper[5030]: I0316 13:48:35.038863 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.14:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:35 crc kubenswrapper[5030]: I0316 13:48:35.965583 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:35 crc kubenswrapper[5030]: I0316 13:48:35.992948 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.016902 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.025919 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxgrw\" (UniqueName: \"kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw\") pod \"5452c3e3-51bd-42e9-9258-84d824a1879f\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.026151 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data\") pod \"5452c3e3-51bd-42e9-9258-84d824a1879f\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.026310 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle\") pod \"5452c3e3-51bd-42e9-9258-84d824a1879f\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.026339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts\") pod \"5452c3e3-51bd-42e9-9258-84d824a1879f\" (UID: \"5452c3e3-51bd-42e9-9258-84d824a1879f\") " Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.034858 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw" (OuterVolumeSpecName: "kube-api-access-mxgrw") pod "5452c3e3-51bd-42e9-9258-84d824a1879f" (UID: "5452c3e3-51bd-42e9-9258-84d824a1879f"). InnerVolumeSpecName "kube-api-access-mxgrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.035017 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts" (OuterVolumeSpecName: "scripts") pod "5452c3e3-51bd-42e9-9258-84d824a1879f" (UID: "5452c3e3-51bd-42e9-9258-84d824a1879f"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.052998 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5452c3e3-51bd-42e9-9258-84d824a1879f" (UID: "5452c3e3-51bd-42e9-9258-84d824a1879f"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.055778 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data" (OuterVolumeSpecName: "config-data") pod "5452c3e3-51bd-42e9-9258-84d824a1879f" (UID: "5452c3e3-51bd-42e9-9258-84d824a1879f"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.129826 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.129869 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.129883 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/5452c3e3-51bd-42e9-9258-84d824a1879f-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.129893 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxgrw\" (UniqueName: \"kubernetes.io/projected/5452c3e3-51bd-42e9-9258-84d824a1879f-kube-api-access-mxgrw\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.699618 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" event={"ID":"5452c3e3-51bd-42e9-9258-84d824a1879f","Type":"ContainerDied","Data":"6e21017165764ba0d46a05570debb4f3f16d36fe0e47ab6bf429da57865d1c6c"} Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.699866 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e21017165764ba0d46a05570debb4f3f16d36fe0e47ab6bf429da57865d1c6c" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.699931 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.732728 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.873300 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.874127 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-log" containerID="cri-o://4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041" gracePeriod=30 Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.874184 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-api" containerID="cri-o://3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6" gracePeriod=30 Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.902929 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.903368 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-log" containerID="cri-o://c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100" gracePeriod=30 Mar 16 13:48:36 crc kubenswrapper[5030]: I0316 13:48:36.903856 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-metadata" containerID="cri-o://0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a" gracePeriod=30 Mar 16 13:48:37 crc kubenswrapper[5030]: I0316 13:48:37.163266 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:37 crc kubenswrapper[5030]: I0316 13:48:37.714813 5030 generic.go:358] "Generic (PLEG): container finished" podID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerID="c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100" exitCode=143 Mar 16 13:48:37 crc kubenswrapper[5030]: I0316 13:48:37.714907 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerDied","Data":"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100"} Mar 16 13:48:37 crc kubenswrapper[5030]: I0316 13:48:37.718404 5030 generic.go:358] "Generic (PLEG): container finished" podID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerID="4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041" exitCode=143 Mar 16 13:48:37 crc kubenswrapper[5030]: I0316 13:48:37.718512 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerDied","Data":"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041"} Mar 16 13:48:38 crc kubenswrapper[5030]: I0316 13:48:38.730048 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerName="nova-scheduler-scheduler" containerID="cri-o://96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" gracePeriod=30 Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.458914 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.462881 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546007 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plbzk\" (UniqueName: \"kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk\") pod \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546075 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data\") pod \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546187 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzpk9\" (UniqueName: \"kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9\") pod \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546279 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle\") pod \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546437 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs\") pod \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546473 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data\") pod \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546685 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs\") pod \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\" (UID: \"7f686663-6ee6-4ce8-be4c-69ae33a7ae67\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546764 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs\") pod \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546884 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs" (OuterVolumeSpecName: "logs") pod "7f686663-6ee6-4ce8-be4c-69ae33a7ae67" (UID: "7f686663-6ee6-4ce8-be4c-69ae33a7ae67"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.546933 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle\") pod \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\" (UID: \"8800b58a-f72d-437b-8b5d-6e27510fd0c4\") " Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.547373 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs" (OuterVolumeSpecName: "logs") pod "8800b58a-f72d-437b-8b5d-6e27510fd0c4" (UID: "8800b58a-f72d-437b-8b5d-6e27510fd0c4"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.547660 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/8800b58a-f72d-437b-8b5d-6e27510fd0c4-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.547675 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.556759 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk" (OuterVolumeSpecName: "kube-api-access-plbzk") pod "7f686663-6ee6-4ce8-be4c-69ae33a7ae67" (UID: "7f686663-6ee6-4ce8-be4c-69ae33a7ae67"). InnerVolumeSpecName "kube-api-access-plbzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.556853 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9" (OuterVolumeSpecName: "kube-api-access-jzpk9") pod "8800b58a-f72d-437b-8b5d-6e27510fd0c4" (UID: "8800b58a-f72d-437b-8b5d-6e27510fd0c4"). InnerVolumeSpecName "kube-api-access-jzpk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.568812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data" (OuterVolumeSpecName: "config-data") pod "7f686663-6ee6-4ce8-be4c-69ae33a7ae67" (UID: "7f686663-6ee6-4ce8-be4c-69ae33a7ae67"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.569708 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8800b58a-f72d-437b-8b5d-6e27510fd0c4" (UID: "8800b58a-f72d-437b-8b5d-6e27510fd0c4"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.570176 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data" (OuterVolumeSpecName: "config-data") pod "8800b58a-f72d-437b-8b5d-6e27510fd0c4" (UID: "8800b58a-f72d-437b-8b5d-6e27510fd0c4"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.572983 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7f686663-6ee6-4ce8-be4c-69ae33a7ae67" (UID: "7f686663-6ee6-4ce8-be4c-69ae33a7ae67"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.583991 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "7f686663-6ee6-4ce8-be4c-69ae33a7ae67" (UID: "7f686663-6ee6-4ce8-be4c-69ae33a7ae67"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649823 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649863 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649875 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plbzk\" (UniqueName: \"kubernetes.io/projected/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-kube-api-access-plbzk\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649888 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649899 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzpk9\" (UniqueName: \"kubernetes.io/projected/8800b58a-f72d-437b-8b5d-6e27510fd0c4-kube-api-access-jzpk9\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649909 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7f686663-6ee6-4ce8-be4c-69ae33a7ae67-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.649918 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8800b58a-f72d-437b-8b5d-6e27510fd0c4-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.756121 5030 generic.go:358] "Generic (PLEG): container finished" podID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerID="3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6" exitCode=0 Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.756671 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerDied","Data":"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6"} Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.756715 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"8800b58a-f72d-437b-8b5d-6e27510fd0c4","Type":"ContainerDied","Data":"a6f4f32bb9868460e4f337cca11321bb715e9d66d044581b99a005efde606390"} Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.756740 5030 scope.go:117] "RemoveContainer" containerID="3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.756968 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.760086 5030 generic.go:358] "Generic (PLEG): container finished" podID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerID="0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a" exitCode=0 Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.760401 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerDied","Data":"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a"} Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.760433 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"7f686663-6ee6-4ce8-be4c-69ae33a7ae67","Type":"ContainerDied","Data":"4d32f29248689724162140e168d4ad604c584f533a9548ceab10b46d38f4d533"} Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.760505 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.787538 5030 scope.go:117] "RemoveContainer" containerID="4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.793979 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.811802 5030 scope.go:117] "RemoveContainer" containerID="3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.818254 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: E0316 13:48:40.818837 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6\": container with ID starting with 3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6 not found: ID does not exist" containerID="3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.818892 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6"} err="failed to get container status \"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6\": rpc error: code = NotFound desc = could not find container \"3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6\": container with ID starting with 3af03263024668c5da69e5a8d6d0648cde9c8c13e3afbfcb9098281632a54ce6 not found: ID does not exist" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.818918 5030 scope.go:117] "RemoveContainer" containerID="4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041" Mar 16 13:48:40 crc kubenswrapper[5030]: E0316 13:48:40.820064 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041\": container with ID starting with 4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041 not found: ID does not exist" containerID="4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.820111 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041"} err="failed to get container status \"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041\": rpc error: code = NotFound desc = could not find container \"4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041\": container with ID starting with 4a7b853e048f5a4a4b0754647cd6cbd1597cfbf0293612e0028827ad00022041 not found: ID does not exist" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.820139 5030 scope.go:117] "RemoveContainer" containerID="0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.852302 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.856802 5030 scope.go:117] "RemoveContainer" containerID="c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.867096 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.874507 5030 scope.go:117] "RemoveContainer" containerID="0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a" Mar 16 13:48:40 crc kubenswrapper[5030]: E0316 13:48:40.876182 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a\": container with ID starting with 0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a not found: ID does not exist" containerID="0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.876242 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a"} err="failed to get container status \"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a\": rpc error: code = NotFound desc = could not find container \"0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a\": container with ID starting with 0526dca43b8c73854cfec388eacdf78e5d9fc086a49574fd2d41a439551c1f2a not found: ID does not exist" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.876275 5030 scope.go:117] "RemoveContainer" containerID="c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100" Mar 16 13:48:40 crc kubenswrapper[5030]: E0316 13:48:40.876685 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100\": container with ID starting with c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100 not found: ID does not exist" containerID="c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.876775 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100"} err="failed to get container status \"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100\": rpc error: code = NotFound desc = could not find container \"c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100\": container with ID starting with c27aaa6d8fb3dbb439b219addd531a905a6af87121d849c0b10855410f132100 not found: ID does not exist" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.880762 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.881968 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-metadata" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.881993 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-metadata" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882006 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-api" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882012 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-api" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882041 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5452c3e3-51bd-42e9-9258-84d824a1879f" containerName="nova-manage" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882047 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5452c3e3-51bd-42e9-9258-84d824a1879f" containerName="nova-manage" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882074 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882080 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882102 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882108 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882377 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882408 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5452c3e3-51bd-42e9-9258-84d824a1879f" containerName="nova-manage" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882417 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-api" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882429 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" containerName="nova-api-log" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.882438 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" containerName="nova-metadata-metadata" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.888295 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.889416 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.893697 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.897574 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.905353 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.905464 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.907102 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-metadata-config-data\"" Mar 16 13:48:40 crc kubenswrapper[5030]: I0316 13:48:40.907774 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-metadata-internal-svc\"" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.059930 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060081 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060106 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvjd\" (UniqueName: \"kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060251 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q4nw\" (UniqueName: \"kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060417 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060654 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060703 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060837 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.060951 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163494 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q4nw\" (UniqueName: \"kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163600 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163664 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163696 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163740 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163783 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163875 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163956 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.163978 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvjd\" (UniqueName: \"kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.164300 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.164737 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.169934 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.170260 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.170473 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.170893 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.171695 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.180503 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q4nw\" (UniqueName: \"kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw\") pod \"nova-metadata-0\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.180905 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvjd\" (UniqueName: \"kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd\") pod \"nova-api-0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.205976 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.225426 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.618659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.672721 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:48:41 crc kubenswrapper[5030]: E0316 13:48:41.703848 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:48:41 crc kubenswrapper[5030]: E0316 13:48:41.705472 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:48:41 crc kubenswrapper[5030]: E0316 13:48:41.706912 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:48:41 crc kubenswrapper[5030]: E0316 13:48:41.706956 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.777081 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerStarted","Data":"b2530559621c513e6f66a4238572719f15479a1584f8e0061d1e10630384e18b"} Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.782836 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerStarted","Data":"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455"} Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.782878 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerStarted","Data":"f7dc6ee3fbc023629a0f1ae69bd8e7a753573a82eb6592869b30872fddd33ca5"} Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.963068 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f686663-6ee6-4ce8-be4c-69ae33a7ae67" path="/var/lib/kubelet/pods/7f686663-6ee6-4ce8-be4c-69ae33a7ae67/volumes" Mar 16 13:48:41 crc kubenswrapper[5030]: I0316 13:48:41.963869 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8800b58a-f72d-437b-8b5d-6e27510fd0c4" path="/var/lib/kubelet/pods/8800b58a-f72d-437b-8b5d-6e27510fd0c4/volumes" Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.797669 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerStarted","Data":"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766"} Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.797883 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerStarted","Data":"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56"} Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.800861 5030 generic.go:358] "Generic (PLEG): container finished" podID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerID="96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" exitCode=0 Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.801127 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bb5b80fb-f37e-4ba6-924f-e28493a3dd25","Type":"ContainerDied","Data":"96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a"} Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.805391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerStarted","Data":"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287"} Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.815667 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-metadata-0" podStartSLOduration=2.815609871 podStartE2EDuration="2.815609871s" podCreationTimestamp="2026-03-16 13:48:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:42.812730346 +0000 UTC m=+2567.212042893" watchObservedRunningTime="2026-03-16 13:48:42.815609871 +0000 UTC m=+2567.214922408" Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.828650 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.828632715 podStartE2EDuration="2.828632715s" podCreationTimestamp="2026-03-16 13:48:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:42.827791202 +0000 UTC m=+2567.227103759" watchObservedRunningTime="2026-03-16 13:48:42.828632715 +0000 UTC m=+2567.227945261" Mar 16 13:48:42 crc kubenswrapper[5030]: I0316 13:48:42.989261 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.027062 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pdqr\" (UniqueName: \"kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr\") pod \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.027155 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data\") pod \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.027236 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle\") pod \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\" (UID: \"bb5b80fb-f37e-4ba6-924f-e28493a3dd25\") " Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.039453 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr" (OuterVolumeSpecName: "kube-api-access-4pdqr") pod "bb5b80fb-f37e-4ba6-924f-e28493a3dd25" (UID: "bb5b80fb-f37e-4ba6-924f-e28493a3dd25"). InnerVolumeSpecName "kube-api-access-4pdqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.061345 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data" (OuterVolumeSpecName: "config-data") pod "bb5b80fb-f37e-4ba6-924f-e28493a3dd25" (UID: "bb5b80fb-f37e-4ba6-924f-e28493a3dd25"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.063858 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bb5b80fb-f37e-4ba6-924f-e28493a3dd25" (UID: "bb5b80fb-f37e-4ba6-924f-e28493a3dd25"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.131686 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pdqr\" (UniqueName: \"kubernetes.io/projected/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-kube-api-access-4pdqr\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.131729 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.131742 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5b80fb-f37e-4ba6-924f-e28493a3dd25-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.815858 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.815859 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"bb5b80fb-f37e-4ba6-924f-e28493a3dd25","Type":"ContainerDied","Data":"d29bfcf3c2eeea585c64d7e42672d7b30d0c5079fea6718cb86cb2fc31149734"} Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.816031 5030 scope.go:117] "RemoveContainer" containerID="96759f4b9623972325982667f23dc7d474f45b2375746a116f464a6a100a770a" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.851806 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.865838 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.877121 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.878365 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerName="nova-scheduler-scheduler" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.878386 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerName="nova-scheduler-scheduler" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.878621 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" containerName="nova-scheduler-scheduler" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.883032 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.885089 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-scheduler-config-data\"" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.886260 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.953542 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:48:43 crc kubenswrapper[5030]: E0316 13:48:43.954500 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.957088 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.957155 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw6js\" (UniqueName: \"kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.957214 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:43 crc kubenswrapper[5030]: E0316 13:48:43.966612 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb5b80fb_f37e_4ba6_924f_e28493a3dd25.slice/crio-d29bfcf3c2eeea585c64d7e42672d7b30d0c5079fea6718cb86cb2fc31149734\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb5b80fb_f37e_4ba6_924f_e28493a3dd25.slice\": RecentStats: unable to find data in memory cache]" Mar 16 13:48:43 crc kubenswrapper[5030]: I0316 13:48:43.968119 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb5b80fb-f37e-4ba6-924f-e28493a3dd25" path="/var/lib/kubelet/pods/bb5b80fb-f37e-4ba6-924f-e28493a3dd25/volumes" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.060587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.060819 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw6js\" (UniqueName: \"kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.060917 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.067874 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.068200 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.078868 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw6js\" (UniqueName: \"kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js\") pod \"nova-scheduler-0\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.203452 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.615869 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.831825 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"75d1095d-2898-4bc9-b9cf-585dcd96afe1","Type":"ContainerStarted","Data":"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081"} Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.831911 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"75d1095d-2898-4bc9-b9cf-585dcd96afe1","Type":"ContainerStarted","Data":"7ad2a76088274465e7795a5c8a7f24c1046af4014e9cb4e7f160d5c05b948340"} Mar 16 13:48:44 crc kubenswrapper[5030]: I0316 13:48:44.855827 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-scheduler-0" podStartSLOduration=1.8558081739999999 podStartE2EDuration="1.855808174s" podCreationTimestamp="2026-03-16 13:48:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:48:44.849228389 +0000 UTC m=+2569.248540937" watchObservedRunningTime="2026-03-16 13:48:44.855808174 +0000 UTC m=+2569.255120721" Mar 16 13:48:49 crc kubenswrapper[5030]: I0316 13:48:49.203654 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:51 crc kubenswrapper[5030]: I0316 13:48:51.207053 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:51 crc kubenswrapper[5030]: I0316 13:48:51.207131 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:51 crc kubenswrapper[5030]: I0316 13:48:51.225976 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:51 crc kubenswrapper[5030]: I0316 13:48:51.226018 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:52 crc kubenswrapper[5030]: I0316 13:48:52.232722 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.217.1.19:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:52 crc kubenswrapper[5030]: I0316 13:48:52.232740 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-metadata-0" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.217.1.19:8775/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:52 crc kubenswrapper[5030]: I0316 13:48:52.249737 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.217.1.18:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:52 crc kubenswrapper[5030]: I0316 13:48:52.249795 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.217.1.18:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:48:54 crc kubenswrapper[5030]: E0316 13:48:54.006297 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1763104 actualBytes=10240 Mar 16 13:48:54 crc kubenswrapper[5030]: I0316 13:48:54.205054 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:54 crc kubenswrapper[5030]: I0316 13:48:54.232837 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:54 crc kubenswrapper[5030]: I0316 13:48:54.974859 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:48:57 crc kubenswrapper[5030]: I0316 13:48:57.946287 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:48:59 crc kubenswrapper[5030]: I0316 13:48:59.002692 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92"} Mar 16 13:48:59 crc kubenswrapper[5030]: I0316 13:48:59.206160 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:59 crc kubenswrapper[5030]: I0316 13:48:59.206224 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:48:59 crc kubenswrapper[5030]: I0316 13:48:59.225939 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:48:59 crc kubenswrapper[5030]: I0316 13:48:59.226002 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.210402 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.210994 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.213707 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.213977 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.233025 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.235635 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:49:01 crc kubenswrapper[5030]: I0316 13:49:01.236504 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.036114 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.824678 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.825257 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-central-agent" containerID="cri-o://c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" gracePeriod=30 Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.825340 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="sg-core" containerID="cri-o://3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" gracePeriod=30 Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.825406 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="proxy-httpd" containerID="cri-o://2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" gracePeriod=30 Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.825345 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-notification-agent" containerID="cri-o://eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" gracePeriod=30 Mar 16 13:49:02 crc kubenswrapper[5030]: I0316 13:49:02.835525 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.043326 5030 generic.go:358] "Generic (PLEG): container finished" podID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" exitCode=2 Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.043527 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerDied","Data":"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458"} Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.336788 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.861104 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.958785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.958869 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959130 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959182 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959245 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959373 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959409 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mnvd\" (UniqueName: \"kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd\") pod \"de6e171c-6358-4d9f-808b-ea76a6088efe\" (UID: \"de6e171c-6358-4d9f-808b-ea76a6088efe\") " Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959790 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.959872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.961214 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.961237 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/de6e171c-6358-4d9f-808b-ea76a6088efe-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.965508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd" (OuterVolumeSpecName: "kube-api-access-9mnvd") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "kube-api-access-9mnvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.972625 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts" (OuterVolumeSpecName: "scripts") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:03 crc kubenswrapper[5030]: I0316 13:49:03.992047 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.002516 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.017465 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.030455 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data" (OuterVolumeSpecName: "config-data") pod "de6e171c-6358-4d9f-808b-ea76a6088efe" (UID: "de6e171c-6358-4d9f-808b-ea76a6088efe"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.056978 5030 generic.go:358] "Generic (PLEG): container finished" podID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" exitCode=0 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.057005 5030 generic.go:358] "Generic (PLEG): container finished" podID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" exitCode=0 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.057014 5030 generic.go:358] "Generic (PLEG): container finished" podID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" exitCode=0 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.057146 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.057723 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-log" containerID="cri-o://c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455" gracePeriod=30 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.057757 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-api" containerID="cri-o://0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287" gracePeriod=30 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064460 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064484 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064511 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064522 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064532 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/de6e171c-6358-4d9f-808b-ea76a6088efe-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.064541 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mnvd\" (UniqueName: \"kubernetes.io/projected/de6e171c-6358-4d9f-808b-ea76a6088efe-kube-api-access-9mnvd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.086988 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerDied","Data":"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c"} Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.087032 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerDied","Data":"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2"} Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.087045 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerDied","Data":"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde"} Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.087054 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"de6e171c-6358-4d9f-808b-ea76a6088efe","Type":"ContainerDied","Data":"76f3e1e14ce6c82b65bb00ef2b35554e6e6819c7ba7935862a9981b3eef8a419"} Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.087079 5030 scope.go:117] "RemoveContainer" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.110459 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.114484 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.126481 5030 scope.go:117] "RemoveContainer" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.130196 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131603 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="sg-core" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131625 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="sg-core" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131645 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-central-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131652 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-central-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131664 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-notification-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131669 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-notification-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131701 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="proxy-httpd" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131708 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="proxy-httpd" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131868 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-notification-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131885 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="sg-core" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131896 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="proxy-httpd" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.131907 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" containerName="ceilometer-central-agent" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.142330 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.145110 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.145426 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.145608 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.157574 5030 scope.go:117] "RemoveContainer" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.161570 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.187312 5030 scope.go:117] "RemoveContainer" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.206923 5030 scope.go:117] "RemoveContainer" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" Mar 16 13:49:04 crc kubenswrapper[5030]: E0316 13:49:04.207835 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": container with ID starting with 2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c not found: ID does not exist" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.207874 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c"} err="failed to get container status \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": rpc error: code = NotFound desc = could not find container \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": container with ID starting with 2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.207901 5030 scope.go:117] "RemoveContainer" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" Mar 16 13:49:04 crc kubenswrapper[5030]: E0316 13:49:04.209045 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": container with ID starting with 3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458 not found: ID does not exist" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209070 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458"} err="failed to get container status \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": rpc error: code = NotFound desc = could not find container \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": container with ID starting with 3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209084 5030 scope.go:117] "RemoveContainer" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" Mar 16 13:49:04 crc kubenswrapper[5030]: E0316 13:49:04.209377 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": container with ID starting with eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2 not found: ID does not exist" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209394 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2"} err="failed to get container status \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": rpc error: code = NotFound desc = could not find container \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": container with ID starting with eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209406 5030 scope.go:117] "RemoveContainer" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" Mar 16 13:49:04 crc kubenswrapper[5030]: E0316 13:49:04.209814 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": container with ID starting with c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde not found: ID does not exist" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209834 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde"} err="failed to get container status \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": rpc error: code = NotFound desc = could not find container \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": container with ID starting with c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.209849 5030 scope.go:117] "RemoveContainer" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210108 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c"} err="failed to get container status \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": rpc error: code = NotFound desc = could not find container \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": container with ID starting with 2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210121 5030 scope.go:117] "RemoveContainer" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210406 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458"} err="failed to get container status \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": rpc error: code = NotFound desc = could not find container \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": container with ID starting with 3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210420 5030 scope.go:117] "RemoveContainer" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210726 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2"} err="failed to get container status \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": rpc error: code = NotFound desc = could not find container \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": container with ID starting with eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.210765 5030 scope.go:117] "RemoveContainer" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.211006 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde"} err="failed to get container status \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": rpc error: code = NotFound desc = could not find container \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": container with ID starting with c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.211019 5030 scope.go:117] "RemoveContainer" containerID="2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.211652 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c"} err="failed to get container status \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": rpc error: code = NotFound desc = could not find container \"2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c\": container with ID starting with 2887ad0fa03c5bbc05c4cadf6e8c0acde6785c0a4a0ff2797a8869aec52f0b5c not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.211687 5030 scope.go:117] "RemoveContainer" containerID="3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.212452 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458"} err="failed to get container status \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": rpc error: code = NotFound desc = could not find container \"3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458\": container with ID starting with 3a8a8ee269c3852f6501d5b5376564cd76a6d6fb935e4f3f14e833fe2e356458 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.212474 5030 scope.go:117] "RemoveContainer" containerID="eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.212815 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2"} err="failed to get container status \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": rpc error: code = NotFound desc = could not find container \"eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2\": container with ID starting with eba816d6bc6c3c3d615e7fcdfcaf12421a7b0653f0349842e0f685c9a529aae2 not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.212836 5030 scope.go:117] "RemoveContainer" containerID="c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.213278 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde"} err="failed to get container status \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": rpc error: code = NotFound desc = could not find container \"c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde\": container with ID starting with c32c4ac76a137e6df957bab06685a2e41985c08608879d39faccc94870828cde not found: ID does not exist" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271070 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlfp\" (UniqueName: \"kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271152 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271228 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271452 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271616 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271746 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271770 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.271808 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.374967 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlfp\" (UniqueName: \"kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375031 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375066 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375233 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375349 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375431 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375457 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.375634 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.376347 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.381735 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.381806 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.382055 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.382070 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.384123 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.391543 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlfp\" (UniqueName: \"kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp\") pod \"ceilometer-0\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.459291 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.570148 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:04 crc kubenswrapper[5030]: W0316 13:49:04.911180 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fe65967_289c_4d86_8e4a_4d1c15031865.slice/crio-5dcbf8396fe3e26074a42945285e87a833593c71fcc99e27a8dda1ab1f1bf430 WatchSource:0}: Error finding container 5dcbf8396fe3e26074a42945285e87a833593c71fcc99e27a8dda1ab1f1bf430: Status 404 returned error can't find the container with id 5dcbf8396fe3e26074a42945285e87a833593c71fcc99e27a8dda1ab1f1bf430 Mar 16 13:49:04 crc kubenswrapper[5030]: I0316 13:49:04.912794 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:05 crc kubenswrapper[5030]: I0316 13:49:05.070445 5030 generic.go:358] "Generic (PLEG): container finished" podID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerID="c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455" exitCode=143 Mar 16 13:49:05 crc kubenswrapper[5030]: I0316 13:49:05.071043 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerDied","Data":"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455"} Mar 16 13:49:05 crc kubenswrapper[5030]: I0316 13:49:05.072847 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerStarted","Data":"5dcbf8396fe3e26074a42945285e87a833593c71fcc99e27a8dda1ab1f1bf430"} Mar 16 13:49:05 crc kubenswrapper[5030]: I0316 13:49:05.960852 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de6e171c-6358-4d9f-808b-ea76a6088efe" path="/var/lib/kubelet/pods/de6e171c-6358-4d9f-808b-ea76a6088efe/volumes" Mar 16 13:49:06 crc kubenswrapper[5030]: I0316 13:49:06.084029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerStarted","Data":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.097259 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerStarted","Data":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.097936 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerStarted","Data":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.603540 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.770704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle\") pod \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.770845 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data\") pod \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.770898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs\") pod \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.771003 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhvjd\" (UniqueName: \"kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd\") pod \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\" (UID: \"26a882d6-1ac2-4d0a-8bf1-37c269c96af0\") " Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.772804 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs" (OuterVolumeSpecName: "logs") pod "26a882d6-1ac2-4d0a-8bf1-37c269c96af0" (UID: "26a882d6-1ac2-4d0a-8bf1-37c269c96af0"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.779059 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd" (OuterVolumeSpecName: "kube-api-access-qhvjd") pod "26a882d6-1ac2-4d0a-8bf1-37c269c96af0" (UID: "26a882d6-1ac2-4d0a-8bf1-37c269c96af0"). InnerVolumeSpecName "kube-api-access-qhvjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.800479 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26a882d6-1ac2-4d0a-8bf1-37c269c96af0" (UID: "26a882d6-1ac2-4d0a-8bf1-37c269c96af0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.803744 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data" (OuterVolumeSpecName: "config-data") pod "26a882d6-1ac2-4d0a-8bf1-37c269c96af0" (UID: "26a882d6-1ac2-4d0a-8bf1-37c269c96af0"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.875326 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.875367 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.875378 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:07 crc kubenswrapper[5030]: I0316 13:49:07.875393 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhvjd\" (UniqueName: \"kubernetes.io/projected/26a882d6-1ac2-4d0a-8bf1-37c269c96af0-kube-api-access-qhvjd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.109269 5030 generic.go:358] "Generic (PLEG): container finished" podID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerID="0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287" exitCode=0 Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.109334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerDied","Data":"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287"} Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.109393 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.109433 5030 scope.go:117] "RemoveContainer" containerID="0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.109414 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"26a882d6-1ac2-4d0a-8bf1-37c269c96af0","Type":"ContainerDied","Data":"f7dc6ee3fbc023629a0f1ae69bd8e7a753573a82eb6592869b30872fddd33ca5"} Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.136813 5030 scope.go:117] "RemoveContainer" containerID="c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.141531 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.149956 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.160410 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161484 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-log" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161505 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-log" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161535 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-api" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161543 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-api" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161759 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-log" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.161780 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" containerName="nova-api-api" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.165603 5030 scope.go:117] "RemoveContainer" containerID="0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287" Mar 16 13:49:08 crc kubenswrapper[5030]: E0316 13:49:08.166439 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287\": container with ID starting with 0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287 not found: ID does not exist" containerID="0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.166473 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287"} err="failed to get container status \"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287\": rpc error: code = NotFound desc = could not find container \"0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287\": container with ID starting with 0967ae8e6225ecfc9e23b604f1176d66f2dea3084fdc85540bb5909679f1a287 not found: ID does not exist" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.166496 5030 scope.go:117] "RemoveContainer" containerID="c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455" Mar 16 13:49:08 crc kubenswrapper[5030]: E0316 13:49:08.168652 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455\": container with ID starting with c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455 not found: ID does not exist" containerID="c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.168678 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455"} err="failed to get container status \"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455\": rpc error: code = NotFound desc = could not find container \"c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455\": container with ID starting with c98567753c7b022c431e8d3bb594921c668cca07c3e28a1e4cea5b2cd38b3455 not found: ID does not exist" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.179712 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.179764 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.184146 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-internal-svc\"" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.184430 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-config-data\"" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.184584 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-nova-public-svc\"" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287541 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5498s\" (UniqueName: \"kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287747 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287778 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287826 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.287895 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.390586 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.390711 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5498s\" (UniqueName: \"kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.391065 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.391150 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.391290 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.391486 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.391676 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.396850 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.399121 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.399278 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.399602 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.405442 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5498s\" (UniqueName: \"kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s\") pod \"nova-api-0\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.502039 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:08 crc kubenswrapper[5030]: W0316 13:49:08.923530 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded385adc_f2c0_43e8_92ef_d10fe239cdb8.slice/crio-ec5b59a29b1abcfeb343acc5b4d3da095215554fe0aeb773ff2b089090188fef WatchSource:0}: Error finding container ec5b59a29b1abcfeb343acc5b4d3da095215554fe0aeb773ff2b089090188fef: Status 404 returned error can't find the container with id ec5b59a29b1abcfeb343acc5b4d3da095215554fe0aeb773ff2b089090188fef Mar 16 13:49:08 crc kubenswrapper[5030]: I0316 13:49:08.924881 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:49:09 crc kubenswrapper[5030]: I0316 13:49:09.124674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerStarted","Data":"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19"} Mar 16 13:49:09 crc kubenswrapper[5030]: I0316 13:49:09.124736 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerStarted","Data":"ec5b59a29b1abcfeb343acc5b4d3da095215554fe0aeb773ff2b089090188fef"} Mar 16 13:49:09 crc kubenswrapper[5030]: I0316 13:49:09.958928 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a882d6-1ac2-4d0a-8bf1-37c269c96af0" path="/var/lib/kubelet/pods/26a882d6-1ac2-4d0a-8bf1-37c269c96af0/volumes" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.140813 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerStarted","Data":"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97"} Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerStarted","Data":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145339 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-central-agent" containerID="cri-o://b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" gracePeriod=30 Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145657 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145709 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="proxy-httpd" containerID="cri-o://586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" gracePeriod=30 Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145777 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="sg-core" containerID="cri-o://5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" gracePeriod=30 Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.145829 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-notification-agent" containerID="cri-o://63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" gracePeriod=30 Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.189056 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/nova-api-0" podStartSLOduration=2.189042126 podStartE2EDuration="2.189042126s" podCreationTimestamp="2026-03-16 13:49:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:49:10.172066308 +0000 UTC m=+2594.571378855" watchObservedRunningTime="2026-03-16 13:49:10.189042126 +0000 UTC m=+2594.588354673" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.193057 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.987397719 podStartE2EDuration="6.193050824s" podCreationTimestamp="2026-03-16 13:49:04 +0000 UTC" firstStartedPulling="2026-03-16 13:49:04.912637668 +0000 UTC m=+2589.311950216" lastFinishedPulling="2026-03-16 13:49:09.118290774 +0000 UTC m=+2593.517603321" observedRunningTime="2026-03-16 13:49:10.189206325 +0000 UTC m=+2594.588518872" watchObservedRunningTime="2026-03-16 13:49:10.193050824 +0000 UTC m=+2594.592363372" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.882711 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.963618 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.963769 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.963878 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrlfp\" (UniqueName: \"kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964016 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964117 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964170 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964228 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964276 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964422 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs\") pod \"8fe65967-289c-4d86-8e4a-4d1c15031865\" (UID: \"8fe65967-289c-4d86-8e4a-4d1c15031865\") " Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.964913 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.965189 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.965213 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/8fe65967-289c-4d86-8e4a-4d1c15031865-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.969833 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp" (OuterVolumeSpecName: "kube-api-access-rrlfp") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "kube-api-access-rrlfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.969887 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts" (OuterVolumeSpecName: "scripts") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:10 crc kubenswrapper[5030]: I0316 13:49:10.987801 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.001930 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.023484 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.035362 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data" (OuterVolumeSpecName: "config-data") pod "8fe65967-289c-4d86-8e4a-4d1c15031865" (UID: "8fe65967-289c-4d86-8e4a-4d1c15031865"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.067756 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.067911 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrlfp\" (UniqueName: \"kubernetes.io/projected/8fe65967-289c-4d86-8e4a-4d1c15031865-kube-api-access-rrlfp\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.067976 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.068039 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.068101 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.068161 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/8fe65967-289c-4d86-8e4a-4d1c15031865-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161408 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" exitCode=0 Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161444 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" exitCode=2 Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161452 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" exitCode=0 Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161461 5030 generic.go:358] "Generic (PLEG): container finished" podID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" exitCode=0 Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161542 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161576 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerDied","Data":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161638 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerDied","Data":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerDied","Data":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161665 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerDied","Data":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161674 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"8fe65967-289c-4d86-8e4a-4d1c15031865","Type":"ContainerDied","Data":"5dcbf8396fe3e26074a42945285e87a833593c71fcc99e27a8dda1ab1f1bf430"} Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.161694 5030 scope.go:117] "RemoveContainer" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.185045 5030 scope.go:117] "RemoveContainer" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.214620 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.217168 5030 scope.go:117] "RemoveContainer" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.220568 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.228898 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230305 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="proxy-httpd" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230397 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="proxy-httpd" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230479 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="sg-core" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230540 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="sg-core" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230632 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-central-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230679 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-central-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230732 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-notification-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.230780 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-notification-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.231034 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="proxy-httpd" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.231100 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-central-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.231156 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="ceilometer-notification-agent" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.231210 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" containerName="sg-core" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.236937 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.237098 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.239254 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ceilometer-internal-svc\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.239511 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-scripts\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.239705 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ceilometer-config-data\"" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.242216 5030 scope.go:117] "RemoveContainer" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.266960 5030 scope.go:117] "RemoveContainer" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: E0316 13:49:11.267289 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": container with ID starting with 586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034 not found: ID does not exist" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267320 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} err="failed to get container status \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": rpc error: code = NotFound desc = could not find container \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": container with ID starting with 586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267342 5030 scope.go:117] "RemoveContainer" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: E0316 13:49:11.267541 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": container with ID starting with 5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac not found: ID does not exist" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267571 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} err="failed to get container status \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": rpc error: code = NotFound desc = could not find container \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": container with ID starting with 5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267585 5030 scope.go:117] "RemoveContainer" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: E0316 13:49:11.267792 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": container with ID starting with 63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3 not found: ID does not exist" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267810 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} err="failed to get container status \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": rpc error: code = NotFound desc = could not find container \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": container with ID starting with 63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.267822 5030 scope.go:117] "RemoveContainer" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: E0316 13:49:11.268002 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": container with ID starting with b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a not found: ID does not exist" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268016 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} err="failed to get container status \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": rpc error: code = NotFound desc = could not find container \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": container with ID starting with b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268028 5030 scope.go:117] "RemoveContainer" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268169 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} err="failed to get container status \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": rpc error: code = NotFound desc = could not find container \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": container with ID starting with 586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268182 5030 scope.go:117] "RemoveContainer" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268321 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} err="failed to get container status \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": rpc error: code = NotFound desc = could not find container \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": container with ID starting with 5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268333 5030 scope.go:117] "RemoveContainer" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268468 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} err="failed to get container status \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": rpc error: code = NotFound desc = could not find container \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": container with ID starting with 63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268479 5030 scope.go:117] "RemoveContainer" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268723 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} err="failed to get container status \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": rpc error: code = NotFound desc = could not find container \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": container with ID starting with b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.268736 5030 scope.go:117] "RemoveContainer" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269027 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} err="failed to get container status \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": rpc error: code = NotFound desc = could not find container \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": container with ID starting with 586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269078 5030 scope.go:117] "RemoveContainer" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269452 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} err="failed to get container status \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": rpc error: code = NotFound desc = could not find container \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": container with ID starting with 5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269490 5030 scope.go:117] "RemoveContainer" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269850 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} err="failed to get container status \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": rpc error: code = NotFound desc = could not find container \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": container with ID starting with 63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.269875 5030 scope.go:117] "RemoveContainer" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270247 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} err="failed to get container status \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": rpc error: code = NotFound desc = could not find container \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": container with ID starting with b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270287 5030 scope.go:117] "RemoveContainer" containerID="586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270501 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034"} err="failed to get container status \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": rpc error: code = NotFound desc = could not find container \"586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034\": container with ID starting with 586a99d100f97822b2032477e1a39071fd54e84e810528a7cec25498dbef6034 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270525 5030 scope.go:117] "RemoveContainer" containerID="5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270791 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac"} err="failed to get container status \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": rpc error: code = NotFound desc = could not find container \"5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac\": container with ID starting with 5c42a63bb1257bcf70a9efab30c0dc36940b8f7a6522d497efb643a6b722baac not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270815 5030 scope.go:117] "RemoveContainer" containerID="63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.270984 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3"} err="failed to get container status \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": rpc error: code = NotFound desc = could not find container \"63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3\": container with ID starting with 63c881628fd000a4e403d430bb2a09a67ad7619d49550e256082ca21a16373b3 not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.271006 5030 scope.go:117] "RemoveContainer" containerID="b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.271166 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a"} err="failed to get container status \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": rpc error: code = NotFound desc = could not find container \"b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a\": container with ID starting with b52cc42256d861a500b4ad23d046b347acc7f32189a7312d36e598b63c36dd1a not found: ID does not exist" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.376701 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6w6n\" (UniqueName: \"kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.376754 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.376825 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.376972 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.377086 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.377162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.377280 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.377423 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480307 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6w6n\" (UniqueName: \"kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480367 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480387 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480531 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480724 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480764 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480822 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480895 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.480920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.481430 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.486220 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.486288 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.486582 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.486855 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.495727 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.496034 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6w6n\" (UniqueName: \"kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n\") pod \"ceilometer-0\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.559000 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.785114 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:49:11 crc kubenswrapper[5030]: W0316 13:49:11.786499 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ea88cc6_e675_4bfd_86a7_684f821b50ca.slice/crio-d6da3be6b84d48ba26c02ed34cf235b7bb6a5041ad82d7cd4e2cf99dbeb95d72 WatchSource:0}: Error finding container d6da3be6b84d48ba26c02ed34cf235b7bb6a5041ad82d7cd4e2cf99dbeb95d72: Status 404 returned error can't find the container with id d6da3be6b84d48ba26c02ed34cf235b7bb6a5041ad82d7cd4e2cf99dbeb95d72 Mar 16 13:49:11 crc kubenswrapper[5030]: I0316 13:49:11.956908 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe65967-289c-4d86-8e4a-4d1c15031865" path="/var/lib/kubelet/pods/8fe65967-289c-4d86-8e4a-4d1c15031865/volumes" Mar 16 13:49:12 crc kubenswrapper[5030]: I0316 13:49:12.175184 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerStarted","Data":"d6da3be6b84d48ba26c02ed34cf235b7bb6a5041ad82d7cd4e2cf99dbeb95d72"} Mar 16 13:49:13 crc kubenswrapper[5030]: I0316 13:49:13.192226 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerStarted","Data":"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93"} Mar 16 13:49:13 crc kubenswrapper[5030]: I0316 13:49:13.192594 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerStarted","Data":"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66"} Mar 16 13:49:14 crc kubenswrapper[5030]: I0316 13:49:14.205935 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerStarted","Data":"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c"} Mar 16 13:49:16 crc kubenswrapper[5030]: I0316 13:49:16.228686 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerStarted","Data":"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b"} Mar 16 13:49:16 crc kubenswrapper[5030]: I0316 13:49:16.229271 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:16 crc kubenswrapper[5030]: I0316 13:49:16.257108 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ceilometer-0" podStartSLOduration=1.614658696 podStartE2EDuration="5.257089149s" podCreationTimestamp="2026-03-16 13:49:11 +0000 UTC" firstStartedPulling="2026-03-16 13:49:11.790425191 +0000 UTC m=+2596.189737738" lastFinishedPulling="2026-03-16 13:49:15.432855644 +0000 UTC m=+2599.832168191" observedRunningTime="2026-03-16 13:49:16.24915134 +0000 UTC m=+2600.648464048" watchObservedRunningTime="2026-03-16 13:49:16.257089149 +0000 UTC m=+2600.656401697" Mar 16 13:49:18 crc kubenswrapper[5030]: I0316 13:49:18.503230 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:18 crc kubenswrapper[5030]: I0316 13:49:18.503696 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:19 crc kubenswrapper[5030]: I0316 13:49:19.508708 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.22:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:49:19 crc kubenswrapper[5030]: I0316 13:49:19.509702 5030 prober.go:120] "Probe failed" probeType="Startup" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.22:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Mar 16 13:49:26 crc kubenswrapper[5030]: I0316 13:49:26.502787 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:26 crc kubenswrapper[5030]: I0316 13:49:26.503410 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:28 crc kubenswrapper[5030]: I0316 13:49:28.513234 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:28 crc kubenswrapper[5030]: I0316 13:49:28.514971 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:28 crc kubenswrapper[5030]: I0316 13:49:28.520459 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:29 crc kubenswrapper[5030]: I0316 13:49:29.389012 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:49:29 crc kubenswrapper[5030]: I0316 13:49:29.517969 5030 scope.go:117] "RemoveContainer" containerID="f03be0fe0f119f339025ec27b7b4a51796f7a20c267b664eeab52715521fcbc0" Mar 16 13:49:47 crc kubenswrapper[5030]: I0316 13:49:47.247108 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.518676 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.527036 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.532338 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.539403 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-scripts\"" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.539803 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"cert-ovncontroller-ovndbs\"" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.540018 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-ovncontroller-dockercfg-tgxpb\"" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.568880 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.574002 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.587167 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.587350 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.587484 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.587564 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.587888 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6ht\" (UniqueName: \"kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.588201 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.588476 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.593084 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.597883 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.601072 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-metrics-config\"" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.623186 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.632935 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.639661 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.645996 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.646113 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.650079 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openstack-kuttl-tests\"/\"ovncontroller-extra-scripts\"" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.690840 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.690932 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.690971 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691011 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691061 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691143 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6ht\" (UniqueName: \"kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691162 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691163 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691244 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691325 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691385 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691470 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691520 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691648 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86v2h\" (UniqueName: \"kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691706 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691726 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691762 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691791 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z84r7\" (UniqueName: \"kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.691926 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.692034 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.692121 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.692803 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.694184 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.697519 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.703076 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.706725 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6ht\" (UniqueName: \"kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht\") pod \"ovn-controller-l6gjc\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.794961 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795118 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795136 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795259 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795296 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795366 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zr6b\" (UniqueName: \"kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795398 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795410 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795449 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795464 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795500 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795542 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795604 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795629 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795662 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795691 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795763 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86v2h\" (UniqueName: \"kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795806 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795841 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795867 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z84r7\" (UniqueName: \"kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795887 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.795915 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.796346 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.796590 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.796817 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.798012 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.799458 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.800248 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.813017 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86v2h\" (UniqueName: \"kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h\") pod \"ovn-controller-ovs-25j4v\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.814536 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z84r7\" (UniqueName: \"kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7\") pod \"ovn-controller-metrics-68rbl\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.859102 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.892686 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.897502 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.897572 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.897605 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.897729 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.897930 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.898023 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zr6b\" (UniqueName: \"kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.898504 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.898578 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.898579 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.898706 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.900300 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.912838 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zr6b\" (UniqueName: \"kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b\") pod \"ovn-controller-l6gjc-config-w25vz\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.917905 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:51 crc kubenswrapper[5030]: I0316 13:49:51.961849 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.344445 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.441531 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.454313 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:52 crc kubenswrapper[5030]: W0316 13:49:52.457836 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d22649b_a064_4985_9434_e95295c8f0b0.slice/crio-2bc473df1f1c5077b068613b4a47c7049f970a748bc78470cecf6379d9ce5a38 WatchSource:0}: Error finding container 2bc473df1f1c5077b068613b4a47c7049f970a748bc78470cecf6379d9ce5a38: Status 404 returned error can't find the container with id 2bc473df1f1c5077b068613b4a47c7049f970a748bc78470cecf6379d9ce5a38 Mar 16 13:49:52 crc kubenswrapper[5030]: W0316 13:49:52.468914 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40eddeb0_5a29_4515_8367_0c62af828f6b.slice/crio-1441bdca5bc82708cf697591a85ad5a3a9236fae03430cd4cd145a5ed540e8c3 WatchSource:0}: Error finding container 1441bdca5bc82708cf697591a85ad5a3a9236fae03430cd4cd145a5ed540e8c3: Status 404 returned error can't find the container with id 1441bdca5bc82708cf697591a85ad5a3a9236fae03430cd4cd145a5ed540e8c3 Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.522937 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:52 crc kubenswrapper[5030]: W0316 13:49:52.527499 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c819bbc_bda6_4cad_8dd4_41f5ea557816.slice/crio-fe40db525cce24c1ca9256f24b2f6542bc6dcbe8103f41b7d1990b8156c0980c WatchSource:0}: Error finding container fe40db525cce24c1ca9256f24b2f6542bc6dcbe8103f41b7d1990b8156c0980c: Status 404 returned error can't find the container with id fe40db525cce24c1ca9256f24b2f6542bc6dcbe8103f41b7d1990b8156c0980c Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.673660 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" event={"ID":"6d22649b-a064-4985-9434-e95295c8f0b0","Type":"ContainerStarted","Data":"2bc473df1f1c5077b068613b4a47c7049f970a748bc78470cecf6379d9ce5a38"} Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.679644 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc" event={"ID":"61416495-07c4-4b64-8b2d-14fbeafb9916","Type":"ContainerStarted","Data":"9c2f61a25abe8fece812b3be112c27a72cdd079690441ccb729b993bcf718a5c"} Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.681507 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerStarted","Data":"1441bdca5bc82708cf697591a85ad5a3a9236fae03430cd4cd145a5ed540e8c3"} Mar 16 13:49:52 crc kubenswrapper[5030]: I0316 13:49:52.688190 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" event={"ID":"9c819bbc-bda6-4cad-8dd4-41f5ea557816","Type":"ContainerStarted","Data":"fe40db525cce24c1ca9256f24b2f6542bc6dcbe8103f41b7d1990b8156c0980c"} Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.701521 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" event={"ID":"6d22649b-a064-4985-9434-e95295c8f0b0","Type":"ContainerStarted","Data":"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050"} Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.704428 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc" event={"ID":"61416495-07c4-4b64-8b2d-14fbeafb9916","Type":"ContainerStarted","Data":"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24"} Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.704952 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.707190 5030 generic.go:358] "Generic (PLEG): container finished" podID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerID="df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1" exitCode=0 Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.707601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerDied","Data":"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1"} Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.710165 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" event={"ID":"9c819bbc-bda6-4cad-8dd4-41f5ea557816","Type":"ContainerStarted","Data":"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19"} Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.732396 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" podStartSLOduration=2.732381393 podStartE2EDuration="2.732381393s" podCreationTimestamp="2026-03-16 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:49:53.730730859 +0000 UTC m=+2638.130043426" watchObservedRunningTime="2026-03-16 13:49:53.732381393 +0000 UTC m=+2638.131693940" Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.757399 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" podStartSLOduration=2.757373277 podStartE2EDuration="2.757373277s" podCreationTimestamp="2026-03-16 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:49:53.746137876 +0000 UTC m=+2638.145450423" watchObservedRunningTime="2026-03-16 13:49:53.757373277 +0000 UTC m=+2638.156685825" Mar 16 13:49:53 crc kubenswrapper[5030]: I0316 13:49:53.773209 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-l6gjc" podStartSLOduration=2.77318714 podStartE2EDuration="2.77318714s" podCreationTimestamp="2026-03-16 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:49:53.763453643 +0000 UTC m=+2638.162766191" watchObservedRunningTime="2026-03-16 13:49:53.77318714 +0000 UTC m=+2638.172499676" Mar 16 13:49:54 crc kubenswrapper[5030]: E0316 13:49:54.173020 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1865625 actualBytes=10240 Mar 16 13:49:54 crc kubenswrapper[5030]: I0316 13:49:54.724516 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerStarted","Data":"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e"} Mar 16 13:49:54 crc kubenswrapper[5030]: I0316 13:49:54.724779 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerStarted","Data":"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89"} Mar 16 13:49:54 crc kubenswrapper[5030]: I0316 13:49:54.724863 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:54 crc kubenswrapper[5030]: I0316 13:49:54.725990 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:54 crc kubenswrapper[5030]: I0316 13:49:54.750104 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" podStartSLOduration=3.7500842519999997 podStartE2EDuration="3.750084252s" podCreationTimestamp="2026-03-16 13:49:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:49:54.745430529 +0000 UTC m=+2639.144743077" watchObservedRunningTime="2026-03-16 13:49:54.750084252 +0000 UTC m=+2639.149396800" Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.930351 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.931152 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" podUID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" containerName="ovn-config" containerID="cri-o://32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19" gracePeriod=30 Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.981726 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.989481 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.990012 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" podUID="6d22649b-a064-4985-9434-e95295c8f0b0" containerName="openstack-network-exporter" containerID="cri-o://46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050" gracePeriod=30 Mar 16 13:49:55 crc kubenswrapper[5030]: I0316 13:49:55.995066 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.206767 5030 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " execCommand=["/usr/share/ovn/scripts/ovn-ctl","stop_controller"] containerName="ovn-controller" pod="openstack-kuttl-tests/ovn-controller-l6gjc" message="Exiting ovn-controller (1) " Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.206905 5030 kuberuntime_container.go:741] "PreStop hook failed" err="command '/usr/share/ovn/scripts/ovn-ctl stop_controller' exited with 137: " pod="openstack-kuttl-tests/ovn-controller-l6gjc" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerName="ovn-controller" containerID="cri-o://069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.206948 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-l6gjc" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerName="ovn-controller" containerID="cri-o://069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" gracePeriod=30 Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.359702 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.373853 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-68rbl_6d22649b-a064-4985-9434-e95295c8f0b0/openstack-network-exporter/0.log" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.373928 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.436505 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437279 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437437 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437467 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run" (OuterVolumeSpecName: "var-run") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437490 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z84r7\" (UniqueName: \"kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437644 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437718 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437766 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts" (OuterVolumeSpecName: "scripts") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.437857 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zr6b\" (UniqueName: \"kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.438045 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.438131 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.438350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir\") pod \"6d22649b-a064-4985-9434-e95295c8f0b0\" (UID: \"6d22649b-a064-4985-9434-e95295c8f0b0\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.438384 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.438522 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts\") pod \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\" (UID: \"9c819bbc-bda6-4cad-8dd4-41f5ea557816\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439110 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config" (OuterVolumeSpecName: "config") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439170 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir" (OuterVolumeSpecName: "ovs-rundir") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "ovs-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439252 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439286 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439323 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.439342 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440017 5030 reconciler_common.go:299] "Volume detached for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovs-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440037 5030 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440050 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/6d22649b-a064-4985-9434-e95295c8f0b0-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440058 5030 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440068 5030 reconciler_common.go:299] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-additional-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440081 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/9c819bbc-bda6-4cad-8dd4-41f5ea557816-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440093 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/9c819bbc-bda6-4cad-8dd4-41f5ea557816-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.440101 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d22649b-a064-4985-9434-e95295c8f0b0-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.444446 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7" (OuterVolumeSpecName: "kube-api-access-z84r7") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "kube-api-access-z84r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.444725 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b" (OuterVolumeSpecName: "kube-api-access-7zr6b") pod "9c819bbc-bda6-4cad-8dd4-41f5ea557816" (UID: "9c819bbc-bda6-4cad-8dd4-41f5ea557816"). InnerVolumeSpecName "kube-api-access-7zr6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.473151 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.506716 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "6d22649b-a064-4985-9434-e95295c8f0b0" (UID: "6d22649b-a064-4985-9434-e95295c8f0b0"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.542907 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zr6b\" (UniqueName: \"kubernetes.io/projected/9c819bbc-bda6-4cad-8dd4-41f5ea557816-kube-api-access-7zr6b\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.542949 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.542961 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6d22649b-a064-4985-9434-e95295c8f0b0-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.542973 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z84r7\" (UniqueName: \"kubernetes.io/projected/6d22649b-a064-4985-9434-e95295c8f0b0-kube-api-access-z84r7\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.561657 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644248 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644348 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644393 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644460 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run" (OuterVolumeSpecName: "var-run") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644535 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644612 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644675 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck6ht\" (UniqueName: \"kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644774 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644849 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts\") pod \"61416495-07c4-4b64-8b2d-14fbeafb9916\" (UID: \"61416495-07c4-4b64-8b2d-14fbeafb9916\") " Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.644922 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.645895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts" (OuterVolumeSpecName: "scripts") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.646092 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/61416495-07c4-4b64-8b2d-14fbeafb9916-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.646104 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.646112 5030 reconciler_common.go:299] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-log-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.646121 5030 reconciler_common.go:299] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/61416495-07c4-4b64-8b2d-14fbeafb9916-var-run-ovn\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.648255 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht" (OuterVolumeSpecName: "kube-api-access-ck6ht") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "kube-api-access-ck6ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.670220 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.710409 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs" (OuterVolumeSpecName: "ovn-controller-tls-certs") pod "61416495-07c4-4b64-8b2d-14fbeafb9916" (UID: "61416495-07c4-4b64-8b2d-14fbeafb9916"). InnerVolumeSpecName "ovn-controller-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.749076 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.749107 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck6ht\" (UniqueName: \"kubernetes.io/projected/61416495-07c4-4b64-8b2d-14fbeafb9916-kube-api-access-ck6ht\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.749123 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/61416495-07c4-4b64-8b2d-14fbeafb9916-ovn-controller-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768457 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-metrics-68rbl_6d22649b-a064-4985-9434-e95295c8f0b0/openstack-network-exporter/0.log" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768514 5030 generic.go:358] "Generic (PLEG): container finished" podID="6d22649b-a064-4985-9434-e95295c8f0b0" containerID="46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050" exitCode=2 Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768665 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768686 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" event={"ID":"6d22649b-a064-4985-9434-e95295c8f0b0","Type":"ContainerDied","Data":"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768774 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-metrics-68rbl" event={"ID":"6d22649b-a064-4985-9434-e95295c8f0b0","Type":"ContainerDied","Data":"2bc473df1f1c5077b068613b4a47c7049f970a748bc78470cecf6379d9ce5a38"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.768839 5030 scope.go:117] "RemoveContainer" containerID="46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.776618 5030 generic.go:358] "Generic (PLEG): container finished" podID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerID="069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" exitCode=0 Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.776775 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc" event={"ID":"61416495-07c4-4b64-8b2d-14fbeafb9916","Type":"ContainerDied","Data":"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.776837 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc" event={"ID":"61416495-07c4-4b64-8b2d-14fbeafb9916","Type":"ContainerDied","Data":"9c2f61a25abe8fece812b3be112c27a72cdd079690441ccb729b993bcf718a5c"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.776744 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.786295 5030 generic.go:358] "Generic (PLEG): container finished" podID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" containerID="32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19" exitCode=0 Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.787143 5030 kubelet_pods.go:1019] "Unable to retrieve pull secret, the image pull may not succeed." pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" secret="" err="secret \"ovncontroller-ovncontroller-dockercfg-tgxpb\" not found" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.787846 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.788301 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" event={"ID":"9c819bbc-bda6-4cad-8dd4-41f5ea557816","Type":"ContainerDied","Data":"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.788344 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz" event={"ID":"9c819bbc-bda6-4cad-8dd4-41f5ea557816","Type":"ContainerDied","Data":"fe40db525cce24c1ca9256f24b2f6542bc6dcbe8103f41b7d1990b8156c0980c"} Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.806778 5030 scope.go:117] "RemoveContainer" containerID="46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050" Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.808619 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050\": container with ID starting with 46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050 not found: ID does not exist" containerID="46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.808769 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050"} err="failed to get container status \"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050\": rpc error: code = NotFound desc = could not find container \"46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050\": container with ID starting with 46e72fcd9b14c1f73076b784f0ba3574d20a99ceb73acea31d99b7f072492050 not found: ID does not exist" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.808838 5030 scope.go:117] "RemoveContainer" containerID="069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.822024 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.830622 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-metrics-68rbl"] Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.837783 5030 scope.go:117] "RemoveContainer" containerID="069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.838161 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24\": container with ID starting with 069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24 not found: ID does not exist" containerID="069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.838189 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24"} err="failed to get container status \"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24\": rpc error: code = NotFound desc = could not find container \"069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24\": container with ID starting with 069b0ed786c177d016ad45b42952b0e1b18cbab1af4015ba87d25f4742b61e24 not found: ID does not exist" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.838205 5030 scope.go:117] "RemoveContainer" containerID="32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.839195 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.844522 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc"] Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.849641 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.850917 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.850983 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts podName:40eddeb0-5a29-4515-8367-0c62af828f6b nodeName:}" failed. No retries permitted until 2026-03-16 13:49:57.350968362 +0000 UTC m=+2641.750280909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts") pod "ovn-controller-ovs-25j4v" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b") : configmap "ovncontroller-scripts" not found Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.854749 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-l6gjc-config-w25vz"] Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.859256 5030 scope.go:117] "RemoveContainer" containerID="32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19" Mar 16 13:49:56 crc kubenswrapper[5030]: E0316 13:49:56.859642 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19\": container with ID starting with 32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19 not found: ID does not exist" containerID="32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19" Mar 16 13:49:56 crc kubenswrapper[5030]: I0316 13:49:56.859674 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19"} err="failed to get container status \"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19\": rpc error: code = NotFound desc = could not find container \"32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19\": container with ID starting with 32b6bb279f08bb6844076f85cb4b4d4fb2c862c76bf592f8901a368cb5382a19 not found: ID does not exist" Mar 16 13:49:57 crc kubenswrapper[5030]: E0316 13:49:57.364485 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:49:57 crc kubenswrapper[5030]: E0316 13:49:57.365725 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts podName:40eddeb0-5a29-4515-8367-0c62af828f6b nodeName:}" failed. No retries permitted until 2026-03-16 13:49:58.365677258 +0000 UTC m=+2642.764989815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts") pod "ovn-controller-ovs-25j4v" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b") : configmap "ovncontroller-scripts" not found Mar 16 13:49:57 crc kubenswrapper[5030]: I0316 13:49:57.955680 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" path="/var/lib/kubelet/pods/61416495-07c4-4b64-8b2d-14fbeafb9916/volumes" Mar 16 13:49:57 crc kubenswrapper[5030]: I0316 13:49:57.956543 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d22649b-a064-4985-9434-e95295c8f0b0" path="/var/lib/kubelet/pods/6d22649b-a064-4985-9434-e95295c8f0b0/volumes" Mar 16 13:49:57 crc kubenswrapper[5030]: I0316 13:49:57.957166 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" path="/var/lib/kubelet/pods/9c819bbc-bda6-4cad-8dd4-41f5ea557816/volumes" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.152700 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovs-vswitchd" containerID="cri-o://70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" gracePeriod=30 Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.393758 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/ovncontroller-scripts: configmap "ovncontroller-scripts" not found Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.394130 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts podName:40eddeb0-5a29-4515-8367-0c62af828f6b nodeName:}" failed. No retries permitted until 2026-03-16 13:50:00.394105018 +0000 UTC m=+2644.793417565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "scripts" (UniqueName: "kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts") pod "ovn-controller-ovs-25j4v" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b") : configmap "ovncontroller-scripts" not found Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.408783 5030 handlers.go:80] "Exec lifecycle hook for Container in Pod failed" err=< Mar 16 13:49:58 crc kubenswrapper[5030]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:49:58 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:49:58 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:49:58 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:49:58 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:49:58 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:49:58 crc kubenswrapper[5030]: > execCommand=["/usr/local/bin/container-scripts/stop-ovsdb-server.sh"] containerName="ovsdb-server" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" message=< Mar 16 13:49:58 crc kubenswrapper[5030]: Exiting ovsdb-server (5) [ OK ] Mar 16 13:49:58 crc kubenswrapper[5030]: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:49:58 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:49:58 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:49:58 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:49:58 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:49:58 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:49:58 crc kubenswrapper[5030]: > Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.408824 5030 kuberuntime_container.go:741] "PreStop hook failed" err=< Mar 16 13:49:58 crc kubenswrapper[5030]: command '/usr/local/bin/container-scripts/stop-ovsdb-server.sh' exited with 137: ++ dirname /usr/local/bin/container-scripts/stop-ovsdb-server.sh Mar 16 13:49:58 crc kubenswrapper[5030]: + source /usr/local/bin/container-scripts/functions Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNBridge=br-int Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNRemote=tcp:localhost:6642 Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNEncapType=geneve Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNAvailabilityZones= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ EnableChassisAsGateway=true Mar 16 13:49:58 crc kubenswrapper[5030]: ++ PhysicalNetworks= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ OVNHostName= Mar 16 13:49:58 crc kubenswrapper[5030]: ++ DB_FILE=/etc/openvswitch/conf.db Mar 16 13:49:58 crc kubenswrapper[5030]: ++ ovs_dir=/var/lib/openvswitch Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_SCRIPT=/var/lib/openvswitch/flows-script Mar 16 13:49:58 crc kubenswrapper[5030]: ++ FLOWS_RESTORE_DIR=/var/lib/openvswitch/saved-flows Mar 16 13:49:58 crc kubenswrapper[5030]: ++ SAFE_TO_STOP_OVSDB_SERVER_SEMAPHORE=/var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + sleep 0.5 Mar 16 13:49:58 crc kubenswrapper[5030]: + '[' '!' -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server ']' Mar 16 13:49:58 crc kubenswrapper[5030]: + cleanup_ovsdb_server_semaphore Mar 16 13:49:58 crc kubenswrapper[5030]: + rm -f /var/lib/openvswitch/is_safe_to_stop_ovsdb_server Mar 16 13:49:58 crc kubenswrapper[5030]: + /usr/share/openvswitch/scripts/ovs-ctl stop --no-ovs-vswitchd Mar 16 13:49:58 crc kubenswrapper[5030]: > pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server" containerID="cri-o://2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.408865 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server" containerID="cri-o://2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" gracePeriod=30 Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.803589 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-25j4v_40eddeb0-5a29-4515-8367-0c62af828f6b/ovs-vswitchd/0.log" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.804674 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.818843 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-controller-ovs-25j4v_40eddeb0-5a29-4515-8367-0c62af828f6b/ovs-vswitchd/0.log" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.819859 5030 generic.go:358] "Generic (PLEG): container finished" podID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerID="70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" exitCode=143 Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.819898 5030 generic.go:358] "Generic (PLEG): container finished" podID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerID="2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" exitCode=0 Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.819940 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.819973 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerDied","Data":"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e"} Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.820040 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerDied","Data":"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89"} Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.820058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-controller-ovs-25j4v" event={"ID":"40eddeb0-5a29-4515-8367-0c62af828f6b","Type":"ContainerDied","Data":"1441bdca5bc82708cf697591a85ad5a3a9236fae03430cd4cd145a5ed540e8c3"} Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.820082 5030 scope.go:117] "RemoveContainer" containerID="70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.861980 5030 scope.go:117] "RemoveContainer" containerID="2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.882939 5030 scope.go:117] "RemoveContainer" containerID="df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.916860 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.916992 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log" (OuterVolumeSpecName: "var-log") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "var-log". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917320 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917355 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917410 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run" (OuterVolumeSpecName: "var-run") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917444 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs" (OuterVolumeSpecName: "etc-ovs") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "etc-ovs". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917523 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86v2h\" (UniqueName: \"kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917716 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917803 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib\") pod \"40eddeb0-5a29-4515-8367-0c62af828f6b\" (UID: \"40eddeb0-5a29-4515-8367-0c62af828f6b\") " Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.917936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib" (OuterVolumeSpecName: "var-lib") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "var-lib". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918518 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts" (OuterVolumeSpecName: "scripts") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918726 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/40eddeb0-5a29-4515-8367-0c62af828f6b-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918745 5030 reconciler_common.go:299] "Volume detached for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-lib\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918754 5030 reconciler_common.go:299] "Volume detached for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-log\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918762 5030 reconciler_common.go:299] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-var-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.918771 5030 reconciler_common.go:299] "Volume detached for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/40eddeb0-5a29-4515-8367-0c62af828f6b-etc-ovs\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.923260 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h" (OuterVolumeSpecName: "kube-api-access-86v2h") pod "40eddeb0-5a29-4515-8367-0c62af828f6b" (UID: "40eddeb0-5a29-4515-8367-0c62af828f6b"). InnerVolumeSpecName "kube-api-access-86v2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.941634 5030 scope.go:117] "RemoveContainer" containerID="70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.942199 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e\": container with ID starting with 70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e not found: ID does not exist" containerID="70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.942270 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e"} err="failed to get container status \"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e\": rpc error: code = NotFound desc = could not find container \"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e\": container with ID starting with 70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e not found: ID does not exist" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.942300 5030 scope.go:117] "RemoveContainer" containerID="2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.942681 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89\": container with ID starting with 2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89 not found: ID does not exist" containerID="2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.942745 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89"} err="failed to get container status \"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89\": rpc error: code = NotFound desc = could not find container \"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89\": container with ID starting with 2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89 not found: ID does not exist" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.942773 5030 scope.go:117] "RemoveContainer" containerID="df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1" Mar 16 13:49:58 crc kubenswrapper[5030]: E0316 13:49:58.943062 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1\": container with ID starting with df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1 not found: ID does not exist" containerID="df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943089 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1"} err="failed to get container status \"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1\": rpc error: code = NotFound desc = could not find container \"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1\": container with ID starting with df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1 not found: ID does not exist" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943105 5030 scope.go:117] "RemoveContainer" containerID="70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943376 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e"} err="failed to get container status \"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e\": rpc error: code = NotFound desc = could not find container \"70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e\": container with ID starting with 70a2f4c1c885f8fe1c99440d7f61eaea7685ab9e342fade8c3d6b7f5b7bc935e not found: ID does not exist" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943406 5030 scope.go:117] "RemoveContainer" containerID="2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943813 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89"} err="failed to get container status \"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89\": rpc error: code = NotFound desc = could not find container \"2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89\": container with ID starting with 2618f5f8542d0ed5639f37b616ed075f642b1c90a3e0cabab871636a72e80d89 not found: ID does not exist" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.943840 5030 scope.go:117] "RemoveContainer" containerID="df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1" Mar 16 13:49:58 crc kubenswrapper[5030]: I0316 13:49:58.944115 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1"} err="failed to get container status \"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1\": rpc error: code = NotFound desc = could not find container \"df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1\": container with ID starting with df6ed8d5b0778a844a8c6ed057b57aa27839026f6f31cbaffb2df60f6dc3f3b1 not found: ID does not exist" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.033334 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86v2h\" (UniqueName: \"kubernetes.io/projected/40eddeb0-5a29-4515-8367-0c62af828f6b-kube-api-access-86v2h\") on node \"crc\" DevicePath \"\"" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.161292 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.170791 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-controller-ovs-25j4v"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.833568 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.834130 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstackclient" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" containerName="openstackclient" containerID="cri-o://3335e93e1e658911548cee3db03f9ad772154f956acec98edff3ba021dff913e" gracePeriod=2 Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.841590 5030 status_manager.go:895] "Failed to get status for pod" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" pod="openstack-kuttl-tests/openstackclient" err="pods \"openstackclient\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openstack-kuttl-tests\": no relationship found between node 'crc' and this object" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.842352 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstackclient"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.970905 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" path="/var/lib/kubelet/pods/40eddeb0-5a29-4515-8367-0c62af828f6b/volumes" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.972224 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973208 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovs-vswitchd" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973279 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovs-vswitchd" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973351 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server-init" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973401 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server-init" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973472 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerName="ovn-controller" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973514 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerName="ovn-controller" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973579 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" containerName="openstackclient" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973642 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" containerName="openstackclient" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973690 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.973736 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.974483 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" containerName="ovn-config" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.974531 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" containerName="ovn-config" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.974818 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d22649b-a064-4985-9434-e95295c8f0b0" containerName="openstack-network-exporter" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.974873 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d22649b-a064-4985-9434-e95295c8f0b0" containerName="openstack-network-exporter" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975095 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="61416495-07c4-4b64-8b2d-14fbeafb9916" containerName="ovn-controller" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975151 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" containerName="openstackclient" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975208 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovsdb-server" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975262 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="40eddeb0-5a29-4515-8367-0c62af828f6b" containerName="ovs-vswitchd" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975309 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d22649b-a064-4985-9434-e95295c8f0b0" containerName="openstack-network-exporter" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.975354 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c819bbc-bda6-4cad-8dd4-41f5ea557816" containerName="ovn-config" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.984648 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.993472 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:49:59 crc kubenswrapper[5030]: I0316 13:49:59.999026 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"openstack-cell1-mariadb-root-db-secret\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.017003 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-45gq2"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.025199 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-45gq2"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.083315 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.146587 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.151882 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.168167 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pppkk\" (UniqueName: \"kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.168445 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.169601 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.173323 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.178327 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"neutron-db-secret\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.182882 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"barbican-db-secret\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.189361 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.189661 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="ovn-northd" containerID="cri-o://bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" gracePeriod=30 Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.189821 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovn-northd-0" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="openstack-network-exporter" containerID="cri-o://40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a" gracePeriod=30 Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.220939 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.226778 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.237606 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-wmxpc"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.273166 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.273308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnk6b\" (UniqueName: \"kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.273364 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csdr2\" (UniqueName: \"kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.273433 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.273896 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.274081 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pppkk\" (UniqueName: \"kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.274737 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-qz5s8"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.275950 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.298840 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.313294 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.318839 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.356697 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pppkk\" (UniqueName: \"kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk\") pod \"root-account-create-update-w78kb\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.362887 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561150-n99zr"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.364778 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.375161 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"glance-db-secret\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.376062 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.376347 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnk6b\" (UniqueName: \"kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.376394 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-csdr2\" (UniqueName: \"kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.376449 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.382465 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.384787 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.401608 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.401659 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561150-n99zr"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.401776 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.406929 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.407229 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.407404 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.422068 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnk6b\" (UniqueName: \"kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b\") pod \"barbican-f18e-account-create-update-2wd6j\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.463699 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csdr2\" (UniqueName: \"kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2\") pod \"neutron-6528-account-create-update-lghs2\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.483610 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9b56\" (UniqueName: \"kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.483843 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.484026 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw85w\" (UniqueName: \"kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w\") pod \"auto-csr-approver-29561150-n99zr\" (UID: \"95eedf89-5260-4150-88a1-eb6ca5eab829\") " pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.499623 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.513806 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.589487 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9b56\" (UniqueName: \"kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.589707 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.589842 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw85w\" (UniqueName: \"kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w\") pod \"auto-csr-approver-29561150-n99zr\" (UID: \"95eedf89-5260-4150-88a1-eb6ca5eab829\") " pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.603141 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.603309 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.621069 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.637459 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9b56\" (UniqueName: \"kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56\") pod \"glance-ee2c-account-create-update-cffgj\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.657481 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw85w\" (UniqueName: \"kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w\") pod \"auto-csr-approver-29561150-n99zr\" (UID: \"95eedf89-5260-4150-88a1-eb6ca5eab829\") " pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.693805 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-878g8"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.755926 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-slkxb"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.809898 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-sync-878g8"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.815461 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.821300 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.864676 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.865814 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="openstack-network-exporter" containerID="cri-o://026cb6c1982f6523c4904526089b228b9695141373d6e9981af0e54eac6ea449" gracePeriod=300 Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.926301 5030 generic.go:358] "Generic (PLEG): container finished" podID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerID="40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a" exitCode=2 Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.928874 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerDied","Data":"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a"} Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.928923 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.979902 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.981497 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-api-db-secret\"" Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.985154 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.985625 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="openstack-network-exporter" containerID="cri-o://3ebe995bdaf85be1f8006a4e9927f55ec6e2849e3dcf60d7c31f588b2d3cc449" gracePeriod=300 Mar 16 13:50:00 crc kubenswrapper[5030]: I0316 13:50:00.993927 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="ovsdbserver-sb" containerID="cri-o://3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" gracePeriod=300 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.023971 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.053308 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4lc2\" (UniqueName: \"kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.053352 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.063737 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-22qdg"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.086677 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-sync-22qdg"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.094138 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="ovsdbserver-nb" containerID="cri-o://97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" gracePeriod=300 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.110220 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.127593 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.132797 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell1-db-secret\"" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.166110 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4lc2\" (UniqueName: \"kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.166141 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.167175 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.169665 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.192446 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.199478 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"nova-cell0-db-secret\"" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.200241 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mkrb2"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.212798 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4lc2\" (UniqueName: \"kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2\") pod \"nova-api-9af0-account-create-update-tzbrd\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.221361 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-sync-mkrb2"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.241130 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.268729 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.271387 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.271761 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.274811 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.274924 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2l6\" (UniqueName: \"kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.283604 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.296107 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.296885 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-r5vgh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.339300 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-sync-r5vgh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.378471 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.378534 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.378690 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.378744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.378851 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.378939 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data podName:919191a9-6df8-4a0b-a04d-0c60c6a01b69 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:01.87891488 +0000 UTC m=+2646.278227428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data") pod "rabbitmq-server-0" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69") : configmap "rabbitmq-config-data" not found Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.383428 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2l6\" (UniqueName: \"kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.387728 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-glcbb"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.389169 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.390196 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.392478 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqdxv"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.399134 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-sync-cqdxv"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.402091 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.404401 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8\") pod \"nova-cell0-9b48-account-create-update-lw7g9\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.404988 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.408900 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.409466 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2l6\" (UniqueName: \"kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6\") pod \"nova-cell1-82b1-account-create-update-s74qh\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.409519 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-r2788"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.416589 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.416913 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-log" containerID="cri-o://89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.417352 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-api" containerID="cri-o://7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.420377 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.429862 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-ggvrl"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.434875 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" cmd=["/usr/local/bin/container-scripts/status_check.sh"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.434917 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/ovn-northd-0" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="ovn-northd" probeResult="unknown" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.463498 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.470031 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btngw"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.490170 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-ring-rebalance-btngw"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.524823 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68 is running failed: container process not found" containerID="97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.524966 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.525504 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-server" containerID="cri-o://38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.525969 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="swift-recon-cron" containerID="cri-o://0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526016 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="rsync" containerID="cri-o://959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526056 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-expirer" containerID="cri-o://c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526096 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-updater" containerID="cri-o://1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526149 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-auditor" containerID="cri-o://f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526184 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-replicator" containerID="cri-o://f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526220 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-server" containerID="cri-o://380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526256 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-updater" containerID="cri-o://e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526291 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-auditor" containerID="cri-o://f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526330 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-replicator" containerID="cri-o://c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526365 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-server" containerID="cri-o://2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526395 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-reaper" containerID="cri-o://be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.526394 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68 is running failed: container process not found" containerID="97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526441 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-replicator" containerID="cri-o://ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.526429 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-storage-0" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-auditor" containerID="cri-o://a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.535833 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p9dl6"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.546834 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-db-create-p9dl6"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.548810 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68 is running failed: container process not found" containerID="97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.548882 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-nb-0" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="ovsdbserver-nb" probeResult="unknown" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.581979 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.582276 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-api" containerID="cri-o://e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.585010 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-httpd" containerID="cri-o://d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815" gracePeriod=30 Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.627639 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-3285-account-create-update-qbb57"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.719795 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.838618 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-3285-account-create-update-qbb57"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.910149 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bdns7"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.910974 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:01 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: if [ -n "neutron" ]; then Mar 16 13:50:01 crc kubenswrapper[5030]: GRANT_DATABASE="neutron" Mar 16 13:50:01 crc kubenswrapper[5030]: else Mar 16 13:50:01 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:01 crc kubenswrapper[5030]: fi Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:01 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:01 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:01 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:01 crc kubenswrapper[5030]: # support updates Mar 16 13:50:01 crc kubenswrapper[5030]: Mar 16 13:50:01 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.912123 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" podUID="462c19bb-6652-42bd-9ac1-5333d77cb00b" Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.926524 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-db-create-bdns7"] Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.945147 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m"] Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.964798 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:50:01 crc kubenswrapper[5030]: E0316 13:50:01.964891 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data podName:919191a9-6df8-4a0b-a04d-0c60c6a01b69 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:02.964870317 +0000 UTC m=+2647.364182863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data") pod "rabbitmq-server-0" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69") : configmap "rabbitmq-config-data" not found Mar 16 13:50:01 crc kubenswrapper[5030]: I0316 13:50:01.967386 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.059095 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a14e681-873c-445c-81bc-554e16743823" path="/var/lib/kubelet/pods/0a14e681-873c-445c-81bc-554e16743823/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: E0316 13:50:02.063359 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:02 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: if [ -n "neutron" ]; then Mar 16 13:50:02 crc kubenswrapper[5030]: GRANT_DATABASE="neutron" Mar 16 13:50:02 crc kubenswrapper[5030]: else Mar 16 13:50:02 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:02 crc kubenswrapper[5030]: fi Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:02 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:02 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:02 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:02 crc kubenswrapper[5030]: # support updates Mar 16 13:50:02 crc kubenswrapper[5030]: Mar 16 13:50:02 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:02 crc kubenswrapper[5030]: E0316 13:50:02.064467 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" podUID="462c19bb-6652-42bd-9ac1-5333d77cb00b" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.066488 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.066533 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrgc7\" (UniqueName: \"kubernetes.io/projected/1dcde069-3377-48ed-a6bf-fdf25e80f78d-kube-api-access-jrgc7\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.066621 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.069812 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a55e3ee-2333-465c-93e6-f4beb09d6b3f" path="/var/lib/kubelet/pods/1a55e3ee-2333-465c-93e6-f4beb09d6b3f/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.095761 5030 generic.go:358] "Generic (PLEG): container finished" podID="cb834cf0-6581-470e-a411-b5282d7ea2ac" containerID="3335e93e1e658911548cee3db03f9ad772154f956acec98edff3ba021dff913e" exitCode=137 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.100103 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3289dace-a0cb-484f-824a-beb050021e38" path="/var/lib/kubelet/pods/3289dace-a0cb-484f-824a-beb050021e38/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.101259 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfffea9-2963-4342-8370-75a75b0c18d9" path="/var/lib/kubelet/pods/9bfffea9-2963-4342-8370-75a75b0c18d9/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.101881 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e83fd8e-6323-44d0-82e9-1cedf5e8509e" path="/var/lib/kubelet/pods/9e83fd8e-6323-44d0-82e9-1cedf5e8509e/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.102412 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61bd70b-b7a0-4d05-abec-84dd341f7130" path="/var/lib/kubelet/pods/a61bd70b-b7a0-4d05-abec-84dd341f7130/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.102954 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7004b6c-61a4-446c-bbe1-fb964134ec49" path="/var/lib/kubelet/pods/a7004b6c-61a4-446c-bbe1-fb964134ec49/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.108873 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4" path="/var/lib/kubelet/pods/b3fadb83-4ebe-41f0-90a6-b09a7fb0aad4/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.109405 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4067d79-8bb0-4cac-b216-943b6e8bf29e" path="/var/lib/kubelet/pods/c4067d79-8bb0-4cac-b216-943b6e8bf29e/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.127097 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0d156d48-d663-4128-905b-428afb256015/ovsdbserver-sb/0.log" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.127145 5030 generic.go:358] "Generic (PLEG): container finished" podID="0d156d48-d663-4128-905b-428afb256015" containerID="026cb6c1982f6523c4904526089b228b9695141373d6e9981af0e54eac6ea449" exitCode=2 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.127160 5030 generic.go:358] "Generic (PLEG): container finished" podID="0d156d48-d663-4128-905b-428afb256015" containerID="3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" exitCode=143 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.130121 5030 generic.go:358] "Generic (PLEG): container finished" podID="47704920-9f8b-43b2-b573-737ba9deeea8" containerID="89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817" exitCode=143 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.140216 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8771434-e9f7-4da1-add8-6c9ccef64ea9" path="/var/lib/kubelet/pods/c8771434-e9f7-4da1-add8-6c9ccef64ea9/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.140811 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d80ea153-6106-465b-98fc-cf8c8c6f3ec3" path="/var/lib/kubelet/pods/d80ea153-6106-465b-98fc-cf8c8c6f3ec3/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.141313 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7a4a11-683c-45f9-b43b-9939e548c6d8" path="/var/lib/kubelet/pods/dc7a4a11-683c-45f9-b43b-9939e548c6d8/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.142334 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e456a925-fab1-441b-a24b-78f1625e2c6d" path="/var/lib/kubelet/pods/e456a925-fab1-441b-a24b-78f1625e2c6d/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.142875 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faccda56-3b06-407e-8265-dcd18d9b8283" path="/var/lib/kubelet/pods/faccda56-3b06-407e-8265-dcd18d9b8283/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.143541 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb3fe588-6a14-46b5-a78a-776dec80e5eb" path="/var/lib/kubelet/pods/fb3fe588-6a14-46b5-a78a-776dec80e5eb/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.156461 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5b63f362-f6ba-48ac-bcba-dcb3a6c3f529/ovsdbserver-nb/0.log" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.156517 5030 generic.go:358] "Generic (PLEG): container finished" podID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerID="3ebe995bdaf85be1f8006a4e9927f55ec6e2849e3dcf60d7c31f588b2d3cc449" exitCode=2 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.156533 5030 generic.go:358] "Generic (PLEG): container finished" podID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerID="97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" exitCode=143 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.164325 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcba89fa-970e-49c4-887a-2b253d4c535a" path="/var/lib/kubelet/pods/fcba89fa-970e-49c4-887a-2b253d4c535a/volumes" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165003 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165031 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" event={"ID":"462c19bb-6652-42bd-9ac1-5333d77cb00b","Type":"ContainerStarted","Data":"5dacce8160dbc9603f1e944ae5c8e6a3e680e4e85709d9f173696bfeb23d938d"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165094 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerDied","Data":"026cb6c1982f6523c4904526089b228b9695141373d6e9981af0e54eac6ea449"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165124 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165141 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165166 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-f3e7-account-create-update-88mb9"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165187 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerDied","Data":"3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165198 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerDied","Data":"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165213 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerDied","Data":"3ebe995bdaf85be1f8006a4e9927f55ec6e2849e3dcf60d7c31f588b2d3cc449"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165227 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerDied","Data":"97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165238 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165250 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165262 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-9rf58"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165272 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-db-create-9rf58"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165283 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165293 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165302 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165312 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-cell-mapping-2wk76"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165323 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165594 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-log" containerID="cri-o://9956dea0f45533038136c04cedce98249a5779dd925ca83e504eb5e140e8df73" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.165864 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="cinder-scheduler" containerID="cri-o://6099679102d083b474c9ddfd661c9831f56d26793167606899cdbc4988425712" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166013 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api-log" containerID="cri-o://884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166150 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-log" containerID="cri-o://e25341c45b6c41e75570a09f5a607a9b7da3a21b641e7b03efc2fe4b45ba594f" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166304 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-internal-api-0" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-httpd" containerID="cri-o://59482e3f943fc36862143276cbb748e4c432f023b1654ed34ff92f0cb3cd2ae9" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166506 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-scheduler-0" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="probe" containerID="cri-o://0afa20db4ecbcb36232ca7614fe3c74b15da50f67a1bd02fa80881b9803dc867" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166719 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/cinder-api-0" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api" containerID="cri-o://a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.166822 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/glance-default-external-api-0" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-httpd" containerID="cri-o://4bad9050af1bf8cf77ac8fc0ab764eeff8232492b2b32f9b959560206834d9f3" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.176710 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.182896 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.182958 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrgc7\" (UniqueName: \"kubernetes.io/projected/1dcde069-3377-48ed-a6bf-fdf25e80f78d-kube-api-access-jrgc7\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.183072 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.188005 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-dnsmasq-svc\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.188845 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-cell-mapping-pp56p"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.189485 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dcde069-3377-48ed-a6bf-fdf25e80f78d-config\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.216603 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.221979 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rzhmd"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.227787 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-db-create-rzhmd"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.241767 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.241812 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-d9wp5"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.243374 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrgc7\" (UniqueName: \"kubernetes.io/projected/1dcde069-3377-48ed-a6bf-fdf25e80f78d-kube-api-access-jrgc7\") pod \"dnsmasq-dnsmasq-79dcd846c5-8rw6m\" (UID: \"1dcde069-3377-48ed-a6bf-fdf25e80f78d\") " pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.249338 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-db-create-d9wp5"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.257617 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.261101 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.261358 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener-log" containerID="cri-o://d4674cd5ba101972c2a362d9349a3482c4ca936a1086985a257627f70085e93c" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.262036 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener" containerID="cri-o://62038ccaff50077bb6c604f695759dfc7d5f1bf6e310a2110e12a86087abc5c1" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.275263 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.275480 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker-log" containerID="cri-o://d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.275617 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker" containerID="cri-o://b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.288275 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.288517 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api-log" containerID="cri-o://3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.288655 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api" containerID="cri-o://c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.298599 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.302005 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r7cdg"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.309080 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-db-create-r7cdg"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.313338 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.326711 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.361592 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.361916 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-log" containerID="cri-o://d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.362470 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-metadata-0" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-metadata" containerID="cri-o://068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407079 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7kslm"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407845 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407958 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407966 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407972 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407978 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407984 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407990 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407995 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408000 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408005 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd" exitCode=0 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.407937 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408069 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408078 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408087 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408096 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408103 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408111 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408122 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.408130 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd"} Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.416600 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.420717 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="rabbitmq" containerID="cri-o://11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f" gracePeriod=604800 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.423724 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-db-create-7kslm"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.447971 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.448519 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" containerID="cri-o://bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.574637 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jdpcp"] Mar 16 13:50:02 crc kubenswrapper[5030]: W0316 13:50:02.662433 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod257d1043_b495_48e7_8766_71285e2314bb.slice/crio-19109d30444b1b05a6f7e99e81edb990fe36e4a93c6d50282624510f789b98cd WatchSource:0}: Error finding container 19109d30444b1b05a6f7e99e81edb990fe36e4a93c6d50282624510f789b98cd: Status 404 returned error can't find the container with id 19109d30444b1b05a6f7e99e81edb990fe36e4a93c6d50282624510f789b98cd Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.703073 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-db-create-jdpcp"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.720610 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.788006 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.788468 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" containerID="cri-o://31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.789267 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" containerID="cri-o://c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.818782 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.825587 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.838945 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-db-sync-p5cj5"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.845676 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.850526 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.851013 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" containerID="cri-o://d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.854091 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.858495 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.865641 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-db-sync-vvzc4"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.869750 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.870004 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" containerID="cri-o://a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.870767 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.870983 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerName="kube-state-metrics" containerID="cri-o://4801579ba25be57a9a80192d4f3f5350cf1edc93d016de2f7d3a28983e6b2634" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.881442 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.881738 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerName="nova-cell1-novncproxy-novncproxy" containerID="cri-o://d0385aff86fd3b7e84fd33318cdf13a98e2ed953753efadd078d9c0193b83484" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.887721 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.895300 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.897844 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561150-n99zr"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.901040 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.901290 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-central-agent" containerID="cri-o://d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.901739 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="proxy-httpd" containerID="cri-o://5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.901870 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-notification-agent" containerID="cri-o://9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.901940 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="sg-core" containerID="cri-o://1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c" gracePeriod=30 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.904735 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.927611 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="rabbitmq" containerID="cri-o://80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432" gracePeriod=604800 Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.944016 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:02 crc kubenswrapper[5030]: I0316 13:50:02.947781 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-cell1-galera-0" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="galera" containerID="cri-o://ae4faffab9b35ffbb273cdf593d94c7c7746bd8ca2af26429ab866bf3061b4d6" gracePeriod=30 Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.024916 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.025019 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data podName:919191a9-6df8-4a0b-a04d-0c60c6a01b69 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:05.02499929 +0000 UTC m=+2649.424311837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data") pod "rabbitmq-server-0" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69") : configmap "rabbitmq-config-data" not found Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.128062 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.230454 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.230781 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-httpd" containerID="cri-o://1590ccd5da4da63792efdbad28f04eefecd1ab244abfd42491bb986dacb402d5" gracePeriod=30 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.231334 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-server" containerID="cri-o://7d745b62fc387b53a6b083f78854e5cd4dadc9e3979efd7633da39dba293e5f9" gracePeriod=30 Mar 16 13:50:03 crc kubenswrapper[5030]: W0316 13:50:03.271658 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95eedf89_5260_4150_88a1_eb6ca5eab829.slice/crio-abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac WatchSource:0}: Error finding container abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac: Status 404 returned error can't find the container with id abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac Mar 16 13:50:03 crc kubenswrapper[5030]: W0316 13:50:03.273776 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode76ea975_fa99_432e_9899_5ed703585605.slice/crio-1cb912de7c1af0d9a84450231c155aa8c1b31f53786932b6190a20533e6474ca WatchSource:0}: Error finding container 1cb912de7c1af0d9a84450231c155aa8c1b31f53786932b6190a20533e6474ca: Status 404 returned error can't find the container with id 1cb912de7c1af0d9a84450231c155aa8c1b31f53786932b6190a20533e6474ca Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.281239 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "barbican" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="barbican" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.282443 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"barbican-db-secret\\\" not found\"" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" podUID="257d1043-b495-48e7-8766-71285e2314bb" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.327155 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628 is running failed: container process not found" containerID="3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.327737 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628 is running failed: container process not found" containerID="3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.328022 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628 is running failed: container process not found" containerID="3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" cmd=["/usr/bin/pidof","ovsdb-server"] Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.328083 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628 is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/ovsdbserver-sb-0" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="ovsdbserver-sb" probeResult="unknown" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427168 5030 generic.go:358] "Generic (PLEG): container finished" podID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerID="5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427199 5030 generic.go:358] "Generic (PLEG): container finished" podID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerID="1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c" exitCode=2 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427205 5030 generic.go:358] "Generic (PLEG): container finished" podID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerID="d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427294 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerDied","Data":"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427324 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerDied","Data":"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.427334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerDied","Data":"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.439654 5030 generic.go:358] "Generic (PLEG): container finished" podID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerID="d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.439750 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerDied","Data":"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.442259 5030 generic.go:358] "Generic (PLEG): container finished" podID="4e008037-e33a-4410-9894-2a476e8d0900" containerID="884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.442345 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerDied","Data":"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.444365 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerID="9956dea0f45533038136c04cedce98249a5779dd925ca83e504eb5e140e8df73" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.444421 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerDied","Data":"9956dea0f45533038136c04cedce98249a5779dd925ca83e504eb5e140e8df73"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.445882 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerID="31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.445994 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerDied","Data":"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.447838 5030 generic.go:358] "Generic (PLEG): container finished" podID="d926eedb-a8a8-4f39-8641-b097342d1969" containerID="3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.447944 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerDied","Data":"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.453833 5030 generic.go:358] "Generic (PLEG): container finished" podID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerID="d0385aff86fd3b7e84fd33318cdf13a98e2ed953753efadd078d9c0193b83484" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.453914 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8c89be7e-2fd4-4e65-8397-c57b95782453","Type":"ContainerDied","Data":"d0385aff86fd3b7e84fd33318cdf13a98e2ed953753efadd078d9c0193b83484"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.458797 5030 generic.go:358] "Generic (PLEG): container finished" podID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerID="d4674cd5ba101972c2a362d9349a3482c4ca936a1086985a257627f70085e93c" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.458930 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerDied","Data":"d4674cd5ba101972c2a362d9349a3482c4ca936a1086985a257627f70085e93c"} Mar 16 13:50:03 crc kubenswrapper[5030]: W0316 13:50:03.460074 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22c7e3d4_0f4a_4ba5_ace1_80810980d53b.slice/crio-226843ac8f78c41de4adff181aa04135da9f187c26e63e0f6d732b44a9a0f3d0 WatchSource:0}: Error finding container 226843ac8f78c41de4adff181aa04135da9f187c26e63e0f6d732b44a9a0f3d0: Status 404 returned error can't find the container with id 226843ac8f78c41de4adff181aa04135da9f187c26e63e0f6d732b44a9a0f3d0 Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.461240 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.461301 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "nova_api" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="nova_api" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.461391 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "glance" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="glance" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.462347 5030 generic.go:358] "Generic (PLEG): container finished" podID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerID="ae4faffab9b35ffbb273cdf593d94c7c7746bd8ca2af26429ab866bf3061b4d6" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.462391 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerDied","Data":"ae4faffab9b35ffbb273cdf593d94c7c7746bd8ca2af26429ab866bf3061b4d6"} Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.462440 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-api-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" podUID="e76ea975-fa99-432e-9899-5ed703585605" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.462448 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"glance-db-secret\\\" not found\"" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" podUID="45833b6e-9ff4-4b47-beae-df00b94c66bb" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.462475 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"openstack-cell1-mariadb-root-db-secret\\\" not found\"" pod="openstack-kuttl-tests/root-account-create-update-w78kb" podUID="5696e940-300b-410e-a2c0-f1748d4fb540" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.465766 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0d156d48-d663-4128-905b-428afb256015/ovsdbserver-sb/0.log" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.466146 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-sb-0" event={"ID":"0d156d48-d663-4128-905b-428afb256015","Type":"ContainerDied","Data":"4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.466180 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bc2ca3dad16c18e5e718125ccff83b1e5682e2fd7f0d31d34da32a37653393b" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.467570 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561150-n99zr" event={"ID":"95eedf89-5260-4150-88a1-eb6ca5eab829","Type":"ContainerStarted","Data":"abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.471475 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5b63f362-f6ba-48ac-bcba-dcb3a6c3f529/ovsdbserver-nb/0.log" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.471667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovsdbserver-nb-0" event={"ID":"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529","Type":"ContainerDied","Data":"c268ca4dad34d49ce054e6fae3d330ab144a8e98e54ae2e8775123e8b67a17f4"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.471691 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c268ca4dad34d49ce054e6fae3d330ab144a8e98e54ae2e8775123e8b67a17f4" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.473930 5030 generic.go:358] "Generic (PLEG): container finished" podID="07969d90-48f5-40c7-83df-10f59ad41589" containerID="0afa20db4ecbcb36232ca7614fe3c74b15da50f67a1bd02fa80881b9803dc867" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.473984 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerDied","Data":"0afa20db4ecbcb36232ca7614fe3c74b15da50f67a1bd02fa80881b9803dc867"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.475237 5030 generic.go:358] "Generic (PLEG): container finished" podID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerID="d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.475281 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerDied","Data":"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.476496 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" event={"ID":"45833b6e-9ff4-4b47-beae-df00b94c66bb","Type":"ContainerStarted","Data":"86d8418b0cedbb96b59fcbc726a4a15da0407dd2588fa6dda312a0f64c808896"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496679 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496709 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496716 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496722 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496788 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496860 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496875 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.496887 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.497081 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/kube-state-metrics-0" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerName="kube-state-metrics" probeResult="failure" output="Get \"https://10.217.1.12:8081/readyz\": dial tcp 10.217.1.12:8081: connect: connection refused" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.499474 5030 generic.go:358] "Generic (PLEG): container finished" podID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerID="d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.499578 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerDied","Data":"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.501379 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-w78kb" event={"ID":"5696e940-300b-410e-a2c0-f1748d4fb540","Type":"ContainerStarted","Data":"7e684a53d17aa25ac83b1c171c4eeea2ecd37fc67a233bcc9bf5dc987b36ff1a"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.503516 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" event={"ID":"e76ea975-fa99-432e-9899-5ed703585605","Type":"ContainerStarted","Data":"1cb912de7c1af0d9a84450231c155aa8c1b31f53786932b6190a20533e6474ca"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.525858 5030 generic.go:358] "Generic (PLEG): container finished" podID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerID="1590ccd5da4da63792efdbad28f04eefecd1ab244abfd42491bb986dacb402d5" exitCode=0 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.525901 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerDied","Data":"1590ccd5da4da63792efdbad28f04eefecd1ab244abfd42491bb986dacb402d5"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.548666 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-nb-0_5b63f362-f6ba-48ac-bcba-dcb3a6c3f529/ovsdbserver-nb/0.log" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.548753 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.549362 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerID="e25341c45b6c41e75570a09f5a607a9b7da3a21b641e7b03efc2fe4b45ba594f" exitCode=143 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.549471 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerDied","Data":"e25341c45b6c41e75570a09f5a607a9b7da3a21b641e7b03efc2fe4b45ba594f"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.551364 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovsdbserver-sb-0_0d156d48-d663-4128-905b-428afb256015/ovsdbserver-sb/0.log" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.551408 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.551683 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.552829 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" event={"ID":"257d1043-b495-48e7-8766-71285e2314bb","Type":"ContainerStarted","Data":"19109d30444b1b05a6f7e99e81edb990fe36e4a93c6d50282624510f789b98cd"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.564305 5030 generic.go:358] "Generic (PLEG): container finished" podID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerID="4801579ba25be57a9a80192d4f3f5350cf1edc93d016de2f7d3a28983e6b2634" exitCode=2 Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.565728 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd56176b-b7dd-4d48-bb44-19dfffcb0066","Type":"ContainerDied","Data":"4801579ba25be57a9a80192d4f3f5350cf1edc93d016de2f7d3a28983e6b2634"} Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.598072 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerName="nova-cell1-novncproxy-novncproxy" probeResult="failure" output="Get \"https://10.217.1.10:6080/vnc_lite.html\": dial tcp 10.217.1.10:6080: connect: connection refused" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.623746 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "nova_cell0" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="nova_cell0" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.624413 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "nova_cell1" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="nova_cell1" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.624892 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell0-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" podUID="75b16fbf-e33d-4d0b-917d-9994b99d38b3" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.626066 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"nova-cell1-db-secret\\\" not found\"" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" podUID="22c7e3d4-0f4a-4ba5-ace1-80810980d53b" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.630808 5030 kuberuntime_manager.go:1358] "Unhandled Error" err=< Mar 16 13:50:03 crc kubenswrapper[5030]: container &Container{Name:mariadb-account-create-update,Image:quay.io/podified-antelope-centos9/openstack-mariadb@sha256:4caef2b55e01b9a7ee88a22bc69db1893521a91d95c7ad4c8e593f14f17a5f95,Command:[/bin/sh -c #!/bin/bash Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_REMOTE_HOST="" source /var/lib/operator-scripts/mysql_root_auth.sh Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: export DatabasePassword=${DatabasePassword:?"Please specify a DatabasePassword variable."} Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: MYSQL_CMD="mysql -h -u root -P 3306" Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: if [ -n "neutron" ]; then Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="neutron" Mar 16 13:50:03 crc kubenswrapper[5030]: else Mar 16 13:50:03 crc kubenswrapper[5030]: GRANT_DATABASE="*" Mar 16 13:50:03 crc kubenswrapper[5030]: fi Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: # going for maximum compatibility here: Mar 16 13:50:03 crc kubenswrapper[5030]: # 1. MySQL 8 no longer allows implicit create user when GRANT is used Mar 16 13:50:03 crc kubenswrapper[5030]: # 2. MariaDB has "CREATE OR REPLACE", but MySQL does not Mar 16 13:50:03 crc kubenswrapper[5030]: # 3. create user with CREATE but then do all password and TLS with ALTER to Mar 16 13:50:03 crc kubenswrapper[5030]: # support updates Mar 16 13:50:03 crc kubenswrapper[5030]: Mar 16 13:50:03 crc kubenswrapper[5030]: $MYSQL_CMD < logger="UnhandledError" Mar 16 13:50:03 crc kubenswrapper[5030]: E0316 13:50:03.631886 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"mariadb-account-create-update\" with CreateContainerConfigError: \"secret \\\"neutron-db-secret\\\" not found\"" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" podUID="462c19bb-6652-42bd-9ac1-5333d77cb00b" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643161 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle\") pod \"cb834cf0-6581-470e-a411-b5282d7ea2ac\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643210 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config\") pod \"cb834cf0-6581-470e-a411-b5282d7ea2ac\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643247 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzks2\" (UniqueName: \"kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643269 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643303 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643320 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-sb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643400 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643427 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643447 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvhkn\" (UniqueName: \"kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643467 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndbcluster-nb-etc-ovn\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643514 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643537 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643669 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret\") pod \"cb834cf0-6581-470e-a411-b5282d7ea2ac\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643704 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643729 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m72kk\" (UniqueName: \"kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk\") pod \"cb834cf0-6581-470e-a411-b5282d7ea2ac\" (UID: \"cb834cf0-6581-470e-a411-b5282d7ea2ac\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643751 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643825 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643841 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs\") pod \"0d156d48-d663-4128-905b-428afb256015\" (UID: \"0d156d48-d663-4128-905b-428afb256015\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643964 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.643993 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle\") pod \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\" (UID: \"5b63f362-f6ba-48ac-bcba-dcb3a6c3f529\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.647467 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts" (OuterVolumeSpecName: "scripts") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.652485 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts" (OuterVolumeSpecName: "scripts") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.653069 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.653162 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config" (OuterVolumeSpecName: "config") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.654075 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config" (OuterVolumeSpecName: "config") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.655701 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir" (OuterVolumeSpecName: "ovsdb-rundir") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "ovsdb-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.658385 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage09-crc" (OuterVolumeSpecName: "ovndbcluster-nb-etc-ovn") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "local-storage09-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.662054 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk" (OuterVolumeSpecName: "kube-api-access-m72kk") pod "cb834cf0-6581-470e-a411-b5282d7ea2ac" (UID: "cb834cf0-6581-470e-a411-b5282d7ea2ac"). InnerVolumeSpecName "kube-api-access-m72kk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.665475 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn" (OuterVolumeSpecName: "kube-api-access-mvhkn") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "kube-api-access-mvhkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.673464 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2" (OuterVolumeSpecName: "kube-api-access-hzks2") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "kube-api-access-hzks2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.674083 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage05-crc" (OuterVolumeSpecName: "ovndbcluster-sb-etc-ovn") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "local-storage05-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.684751 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "cb834cf0-6581-470e-a411-b5282d7ea2ac" (UID: "cb834cf0-6581-470e-a411-b5282d7ea2ac"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.691069 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config" (OuterVolumeSpecName: "openstack-config") pod "cb834cf0-6581-470e-a411-b5282d7ea2ac" (UID: "cb834cf0-6581-470e-a411-b5282d7ea2ac"). InnerVolumeSpecName "openstack-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.726038 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749539 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749613 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749637 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config\" (UniqueName: \"kubernetes.io/configmap/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749646 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzks2\" (UniqueName: \"kubernetes.io/projected/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-kube-api-access-hzks2\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749656 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749684 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.749694 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751595 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/0d156d48-d663-4128-905b-428afb256015-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751617 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvhkn\" (UniqueName: \"kubernetes.io/projected/0d156d48-d663-4128-905b-428afb256015-kube-api-access-mvhkn\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751647 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751656 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdb-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751664 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/0d156d48-d663-4128-905b-428afb256015-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751672 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m72kk\" (UniqueName: \"kubernetes.io/projected/cb834cf0-6581-470e-a411-b5282d7ea2ac-kube-api-access-m72kk\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.751684 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.758895 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-sb-tls-certs") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "ovsdbserver-sb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.784134 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage09-crc" (UniqueName: "kubernetes.io/local-volume/local-storage09-crc") on node "crc" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.789696 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage05-crc" (UniqueName: "kubernetes.io/local-volume/local-storage05-crc") on node "crc" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.794988 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.801644 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.843684 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.854432 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs\") pod \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.854572 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs" (OuterVolumeSpecName: "ovsdbserver-nb-tls-certs") pod "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" (UID: "5b63f362-f6ba-48ac-bcba-dcb3a6c3f529"). InnerVolumeSpecName "ovsdbserver-nb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.854689 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config\") pod \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.854824 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle\") pod \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.855065 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhp8k\" (UniqueName: \"kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k\") pod \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\" (UID: \"bd56176b-b7dd-4d48-bb44-19dfffcb0066\") " Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.856736 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-ovsdbserver-nb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.856767 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage05-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage05-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.856779 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage09-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage09-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.856790 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.857046 5030 reconciler_common.go:299] "Volume detached for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-ovsdbserver-sb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.857061 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.859822 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k" (OuterVolumeSpecName: "kube-api-access-hhp8k") pod "bd56176b-b7dd-4d48-bb44-19dfffcb0066" (UID: "bd56176b-b7dd-4d48-bb44-19dfffcb0066"). InnerVolumeSpecName "kube-api-access-hhp8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.885781 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret" (OuterVolumeSpecName: "openstack-config-secret") pod "cb834cf0-6581-470e-a411-b5282d7ea2ac" (UID: "cb834cf0-6581-470e-a411-b5282d7ea2ac"). InnerVolumeSpecName "openstack-config-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.896510 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "0d156d48-d663-4128-905b-428afb256015" (UID: "0d156d48-d663-4128-905b-428afb256015"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.915254 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config" (OuterVolumeSpecName: "kube-state-metrics-tls-config") pod "bd56176b-b7dd-4d48-bb44-19dfffcb0066" (UID: "bd56176b-b7dd-4d48-bb44-19dfffcb0066"). InnerVolumeSpecName "kube-state-metrics-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.928253 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "bd56176b-b7dd-4d48-bb44-19dfffcb0066" (UID: "bd56176b-b7dd-4d48-bb44-19dfffcb0066"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.962268 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-config\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.962298 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.962309 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhp8k\" (UniqueName: \"kubernetes.io/projected/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-api-access-hhp8k\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.962322 5030 reconciler_common.go:299] "Volume detached for volume \"openstack-config-secret\" (UniqueName: \"kubernetes.io/secret/cb834cf0-6581-470e-a411-b5282d7ea2ac-openstack-config-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.962331 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/0d156d48-d663-4128-905b-428afb256015-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.968758 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245c2333-5b26-4154-b9bf-315faff25601" path="/var/lib/kubelet/pods/245c2333-5b26-4154-b9bf-315faff25601/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.970038 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311e6755-5d51-4fd5-8c7b-fa7793a2e7b7" path="/var/lib/kubelet/pods/311e6755-5d51-4fd5-8c7b-fa7793a2e7b7/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.971140 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ffc91e-98d6-4678-8e70-6bab4e0f19e1" path="/var/lib/kubelet/pods/42ffc91e-98d6-4678-8e70-6bab4e0f19e1/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.972568 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51430a79-d9c7-4738-8de8-a381007a813d" path="/var/lib/kubelet/pods/51430a79-d9c7-4738-8de8-a381007a813d/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.974054 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5452c3e3-51bd-42e9-9258-84d824a1879f" path="/var/lib/kubelet/pods/5452c3e3-51bd-42e9-9258-84d824a1879f/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.974649 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="569578b7-bd00-4113-8252-c22cfec99a30" path="/var/lib/kubelet/pods/569578b7-bd00-4113-8252-c22cfec99a30/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.975711 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785604e1-c89a-461b-9d6c-acb054a9d884" path="/var/lib/kubelet/pods/785604e1-c89a-461b-9d6c-acb054a9d884/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.976745 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd6ae34-5864-4e58-919f-2baa460ad648" path="/var/lib/kubelet/pods/8cd6ae34-5864-4e58-919f-2baa460ad648/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.977259 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e353b3-21bc-411e-8209-fc3fbbdbe51d" path="/var/lib/kubelet/pods/96e353b3-21bc-411e-8209-fc3fbbdbe51d/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.977914 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb834cf0-6581-470e-a411-b5282d7ea2ac" path="/var/lib/kubelet/pods/cb834cf0-6581-470e-a411-b5282d7ea2ac/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.978933 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce65a30-3a10-4db3-be16-21137c576520" path="/var/lib/kubelet/pods/cce65a30-3a10-4db3-be16-21137c576520/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.979491 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0610696-b8aa-423b-8b74-76b4c0f841a4" path="/var/lib/kubelet/pods/f0610696-b8aa-423b-8b74-76b4c0f841a4/volumes" Mar 16 13:50:03 crc kubenswrapper[5030]: I0316 13:50:03.990259 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs" (OuterVolumeSpecName: "kube-state-metrics-tls-certs") pod "bd56176b-b7dd-4d48-bb44-19dfffcb0066" (UID: "bd56176b-b7dd-4d48-bb44-19dfffcb0066"). InnerVolumeSpecName "kube-state-metrics-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.063865 5030 reconciler_common.go:299] "Volume detached for volume \"kube-state-metrics-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd56176b-b7dd-4d48-bb44-19dfffcb0066-kube-state-metrics-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.127061 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.153933 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.169012 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4lc2\" (UniqueName: \"kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2\") pod \"e76ea975-fa99-432e-9899-5ed703585605\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.169142 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts\") pod \"e76ea975-fa99-432e-9899-5ed703585605\" (UID: \"e76ea975-fa99-432e-9899-5ed703585605\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.169915 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "e76ea975-fa99-432e-9899-5ed703585605" (UID: "e76ea975-fa99-432e-9899-5ed703585605"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.173134 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.173320 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/e76ea975-fa99-432e-9899-5ed703585605-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.174204 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2" (OuterVolumeSpecName: "kube-api-access-x4lc2") pod "e76ea975-fa99-432e-9899-5ed703585605" (UID: "e76ea975-fa99-432e-9899-5ed703585605"). InnerVolumeSpecName "kube-api-access-x4lc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.186508 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.219697 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.274765 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs\") pod \"8c89be7e-2fd4-4e65-8397-c57b95782453\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.274841 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnk6b\" (UniqueName: \"kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b\") pod \"257d1043-b495-48e7-8766-71285e2314bb\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.274862 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9b56\" (UniqueName: \"kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56\") pod \"45833b6e-9ff4-4b47-beae-df00b94c66bb\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.274882 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts\") pod \"257d1043-b495-48e7-8766-71285e2314bb\" (UID: \"257d1043-b495-48e7-8766-71285e2314bb\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.274901 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data\") pod \"8c89be7e-2fd4-4e65-8397-c57b95782453\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275076 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts\") pod \"5696e940-300b-410e-a2c0-f1748d4fb540\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275236 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts\") pod \"45833b6e-9ff4-4b47-beae-df00b94c66bb\" (UID: \"45833b6e-9ff4-4b47-beae-df00b94c66bb\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275298 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvzvv\" (UniqueName: \"kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv\") pod \"8c89be7e-2fd4-4e65-8397-c57b95782453\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275345 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle\") pod \"8c89be7e-2fd4-4e65-8397-c57b95782453\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275387 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs\") pod \"8c89be7e-2fd4-4e65-8397-c57b95782453\" (UID: \"8c89be7e-2fd4-4e65-8397-c57b95782453\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.275432 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pppkk\" (UniqueName: \"kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk\") pod \"5696e940-300b-410e-a2c0-f1748d4fb540\" (UID: \"5696e940-300b-410e-a2c0-f1748d4fb540\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.278157 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4lc2\" (UniqueName: \"kubernetes.io/projected/e76ea975-fa99-432e-9899-5ed703585605-kube-api-access-x4lc2\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.278838 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "45833b6e-9ff4-4b47-beae-df00b94c66bb" (UID: "45833b6e-9ff4-4b47-beae-df00b94c66bb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.279135 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "257d1043-b495-48e7-8766-71285e2314bb" (UID: "257d1043-b495-48e7-8766-71285e2314bb"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.281714 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk" (OuterVolumeSpecName: "kube-api-access-pppkk") pod "5696e940-300b-410e-a2c0-f1748d4fb540" (UID: "5696e940-300b-410e-a2c0-f1748d4fb540"). InnerVolumeSpecName "kube-api-access-pppkk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.286707 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56" (OuterVolumeSpecName: "kube-api-access-j9b56") pod "45833b6e-9ff4-4b47-beae-df00b94c66bb" (UID: "45833b6e-9ff4-4b47-beae-df00b94c66bb"). InnerVolumeSpecName "kube-api-access-j9b56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.289031 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b" (OuterVolumeSpecName: "kube-api-access-qnk6b") pod "257d1043-b495-48e7-8766-71285e2314bb" (UID: "257d1043-b495-48e7-8766-71285e2314bb"). InnerVolumeSpecName "kube-api-access-qnk6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.291433 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv" (OuterVolumeSpecName: "kube-api-access-cvzvv") pod "8c89be7e-2fd4-4e65-8397-c57b95782453" (UID: "8c89be7e-2fd4-4e65-8397-c57b95782453"). InnerVolumeSpecName "kube-api-access-cvzvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.291576 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "5696e940-300b-410e-a2c0-f1748d4fb540" (UID: "5696e940-300b-410e-a2c0-f1748d4fb540"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.327743 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data" (OuterVolumeSpecName: "config-data") pod "8c89be7e-2fd4-4e65-8397-c57b95782453" (UID: "8c89be7e-2fd4-4e65-8397-c57b95782453"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.349314 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8c89be7e-2fd4-4e65-8397-c57b95782453" (UID: "8c89be7e-2fd4-4e65-8397-c57b95782453"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.363704 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs" (OuterVolumeSpecName: "vencrypt-tls-certs") pod "8c89be7e-2fd4-4e65-8397-c57b95782453" (UID: "8c89be7e-2fd4-4e65-8397-c57b95782453"). InnerVolumeSpecName "vencrypt-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381105 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/5696e940-300b-410e-a2c0-f1748d4fb540-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381140 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/45833b6e-9ff4-4b47-beae-df00b94c66bb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381150 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvzvv\" (UniqueName: \"kubernetes.io/projected/8c89be7e-2fd4-4e65-8397-c57b95782453-kube-api-access-cvzvv\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381163 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381173 5030 reconciler_common.go:299] "Volume detached for volume \"vencrypt-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-vencrypt-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381181 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pppkk\" (UniqueName: \"kubernetes.io/projected/5696e940-300b-410e-a2c0-f1748d4fb540-kube-api-access-pppkk\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381190 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnk6b\" (UniqueName: \"kubernetes.io/projected/257d1043-b495-48e7-8766-71285e2314bb-kube-api-access-qnk6b\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381198 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9b56\" (UniqueName: \"kubernetes.io/projected/45833b6e-9ff4-4b47-beae-df00b94c66bb-kube-api-access-j9b56\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381210 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/257d1043-b495-48e7-8766-71285e2314bb-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.381219 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.412713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs" (OuterVolumeSpecName: "nova-novncproxy-tls-certs") pod "8c89be7e-2fd4-4e65-8397-c57b95782453" (UID: "8c89be7e-2fd4-4e65-8397-c57b95782453"). InnerVolumeSpecName "nova-novncproxy-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.456024 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.456297 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/memcached-0" podUID="134ba5b6-d1b8-43ef-8d86-f929c7885553" containerName="memcached" containerID="cri-o://1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0" gracePeriod=30 Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.483926 5030 reconciler_common.go:299] "Volume detached for volume \"nova-novncproxy-tls-certs\" (UniqueName: \"kubernetes.io/secret/8c89be7e-2fd4-4e65-8397-c57b95782453-nova-novncproxy-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.498781 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.538108 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.553814 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-pnx7t"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.585337 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.585432 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.585491 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586190 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586221 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvpvr\" (UniqueName: \"kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586512 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586593 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.586635 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle\") pod \"f369c62c-2f08-4130-93f6-a8cc423b1af9\" (UID: \"f369c62c-2f08-4130-93f6-a8cc423b1af9\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.587779 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.588386 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.589894 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.596250 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.596316 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.596326 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/f369c62c-2f08-4130-93f6-a8cc423b1af9-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.596338 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/f369c62c-2f08-4130-93f6-a8cc423b1af9-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.598989 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage03-crc" (OuterVolumeSpecName: "mysql-db") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "local-storage03-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.601973 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603160 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603183 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603193 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="ovsdbserver-nb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603199 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="ovsdbserver-nb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603209 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="mysql-bootstrap" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603216 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="mysql-bootstrap" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603234 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603239 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603252 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603257 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603280 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="galera" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603286 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="galera" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603307 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerName="kube-state-metrics" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603314 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerName="kube-state-metrics" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603324 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="ovsdbserver-sb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603330 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="ovsdbserver-sb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603506 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" containerName="nova-cell1-novncproxy-novncproxy" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603515 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" containerName="kube-state-metrics" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603526 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="ovsdbserver-nb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603538 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="ovsdbserver-sb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603574 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d156d48-d663-4128-905b-428afb256015" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603584 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" containerName="galera" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.603598 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" containerName="openstack-network-exporter" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.608034 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.611585 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openstack-kuttl-tests\"/\"keystone-db-secret\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.614907 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr" (OuterVolumeSpecName: "kube-api-access-nvpvr") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "kube-api-access-nvpvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.615029 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/kube-state-metrics-0" event={"ID":"bd56176b-b7dd-4d48-bb44-19dfffcb0066","Type":"ContainerDied","Data":"e5eda09a576ca911810f04811bd9b3f30507b000c77d00590d906692dc41ac09"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.615074 5030 scope.go:117] "RemoveContainer" containerID="4801579ba25be57a9a80192d4f3f5350cf1edc93d016de2f7d3a28983e6b2634" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.615197 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/kube-state-metrics-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.621237 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" event={"ID":"75b16fbf-e33d-4d0b-917d-9994b99d38b3","Type":"ContainerStarted","Data":"ed700660d75bbe12d3390484cdaf401f62b79daa4ecef65340692ae568160e5a"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.634396 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstackclient" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.637746 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" event={"ID":"8c89be7e-2fd4-4e65-8397-c57b95782453","Type":"ContainerDied","Data":"c4716ca37fef07671d1572b0b24f015356c7a851c437c294d3fa4f8a44437dcd"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.637772 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-novncproxy-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.649972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.657029 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f369c62c-2f08-4130-93f6-a8cc423b1af9" (UID: "f369c62c-2f08-4130-93f6-a8cc423b1af9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.661422 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-cell1-galera-0" event={"ID":"f369c62c-2f08-4130-93f6-a8cc423b1af9","Type":"ContainerDied","Data":"54d1dc087c1e26cf07d3af64ac83a252a1221a857f4e889b8c0cc3638623a098"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.661509 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-cell1-galera-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.669355 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.670426 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.672978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj" event={"ID":"45833b6e-9ff4-4b47-beae-df00b94c66bb","Type":"ContainerDied","Data":"86d8418b0cedbb96b59fcbc726a4a15da0407dd2588fa6dda312a0f64c808896"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.674594 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/root-account-create-update-w78kb" event={"ID":"5696e940-300b-410e-a2c0-f1748d4fb540","Type":"ContainerDied","Data":"7e684a53d17aa25ac83b1c171c4eeea2ecd37fc67a233bcc9bf5dc987b36ff1a"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.674709 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/root-account-create-update-w78kb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.681375 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" event={"ID":"1dcde069-3377-48ed-a6bf-fdf25e80f78d","Type":"ContainerStarted","Data":"8eb12a828479d3c8d3d044557070fb1cbfcb431719dbc03b6d3387d73b72c556"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.683971 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" event={"ID":"e76ea975-fa99-432e-9899-5ed703585605","Type":"ContainerDied","Data":"1cb912de7c1af0d9a84450231c155aa8c1b31f53786932b6190a20533e6474ca"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.684171 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.686316 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.690178 5030 generic.go:358] "Generic (PLEG): container finished" podID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerID="7d745b62fc387b53a6b083f78854e5cd4dadc9e3979efd7633da39dba293e5f9" exitCode=0 Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.690351 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerDied","Data":"7d745b62fc387b53a6b083f78854e5cd4dadc9e3979efd7633da39dba293e5f9"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.691756 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" event={"ID":"22c7e3d4-0f4a-4ba5-ace1-80810980d53b","Type":"ContainerStarted","Data":"226843ac8f78c41de4adff181aa04135da9f187c26e63e0f6d732b44a9a0f3d0"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.695623 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-j2clz"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697605 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697694 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkr8m\" (UniqueName: \"kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697907 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvpvr\" (UniqueName: \"kubernetes.io/projected/f369c62c-2f08-4130-93f6-a8cc423b1af9-kube-api-access-nvpvr\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697935 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697946 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.697954 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/f369c62c-2f08-4130-93f6-a8cc423b1af9-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.699691 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-sync-j2clz"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.704447 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.704748 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" podUID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" containerName="keystone-api" containerID="cri-o://a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c" gracePeriod=30 Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.705918 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-sb-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.706374 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.711531 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovsdbserver-nb-0" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.712128 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j" event={"ID":"257d1043-b495-48e7-8766-71285e2314bb","Type":"ContainerDied","Data":"19109d30444b1b05a6f7e99e81edb990fe36e4a93c6d50282624510f789b98cd"} Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.714052 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.717847 5030 scope.go:117] "RemoveContainer" containerID="3335e93e1e658911548cee3db03f9ad772154f956acec98edff3ba021dff913e" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.720899 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-2qlll"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.735070 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage03-crc" (UniqueName: "kubernetes.io/local-volume/local-storage03-crc") on node "crc" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.745287 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bootstrap-2qlll"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.758674 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.765027 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx"] Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.765942 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xkr8m operator-scripts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" podUID="c1cb25c5-0bc8-451b-8524-c326d77a0cb9" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.781611 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tk6xr"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.786801 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-db-create-tk6xr"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.800425 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807247 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807333 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807435 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807526 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk7bk\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807826 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.807987 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.808059 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.808211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs\") pod \"f04e629b-393c-4687-a1fb-7c0be4a08d38\" (UID: \"f04e629b-393c-4687-a1fb-7c0be4a08d38\") " Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.808738 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.808869 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkr8m\" (UniqueName: \"kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.808970 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage03-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage03-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.809574 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.810713 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.810854 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-api" probeResult="failure" output="Get \"https://10.217.0.239:8778/\": read tcp 10.217.0.2:47932->10.217.0.239:8778: read: connection reset by peer" Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.811773 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.811863 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:05.311840052 +0000 UTC m=+2649.711152599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : configmap "openstack-scripts" not found Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.816224 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/kube-state-metrics-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.816753 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk" (OuterVolumeSpecName: "kube-api-access-jk7bk") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "kube-api-access-jk7bk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.817952 5030 projected.go:194] Error preparing data for projected volume kube-api-access-xkr8m for pod openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.818010 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:05.317995218 +0000 UTC m=+2649.717307765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xkr8m" (UniqueName: "kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.822761 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.844132 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.849092 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-novncproxy-0"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.877800 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.888192 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.895614 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data" (OuterVolumeSpecName: "config-data") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.902640 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f04e629b-393c-4687-a1fb-7c0be4a08d38" (UID: "f04e629b-393c-4687-a1fb-7c0be4a08d38"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.911270 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.911409 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.911492 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.911584 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk7bk\" (UniqueName: \"kubernetes.io/projected/f04e629b-393c-4687-a1fb-7c0be4a08d38-kube-api-access-jk7bk\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.912101 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.912116 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/f04e629b-393c-4687-a1fb-7c0be4a08d38-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.912128 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.912326 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f04e629b-393c-4687-a1fb-7c0be4a08d38-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.929109 5030 scope.go:117] "RemoveContainer" containerID="d0385aff86fd3b7e84fd33318cdf13a98e2ed953753efadd078d9c0193b83484" Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.942862 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.945050 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-ee2c-account-create-update-cffgj"] Mar 16 13:50:04 crc kubenswrapper[5030]: I0316 13:50:04.971858 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:04 crc kubenswrapper[5030]: E0316 13:50:04.982998 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.001937 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.005770 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-f18e-account-create-update-2wd6j"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.019170 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.019333 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.038369 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/openstack-galera-0" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="galera" containerID="cri-o://938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" gracePeriod=30 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.048658 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.049583 5030 scope.go:117] "RemoveContainer" containerID="ae4faffab9b35ffbb273cdf593d94c7c7746bd8ca2af26429ab866bf3061b4d6" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.058297 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-sb-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.075763 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.079650 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/root-account-create-update-w78kb"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.085873 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.092115 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovsdbserver-nb-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.098042 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.101542 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-9af0-account-create-update-tzbrd"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.103979 5030 scope.go:117] "RemoveContainer" containerID="e0bfb7aae5bdc7eac38ee8673af4c85029e5773c8b8d08fa7e901787a2a7c1f9" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.105613 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.120192 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.120267 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data podName:919191a9-6df8-4a0b-a04d-0c60c6a01b69 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:09.120247529 +0000 UTC m=+2653.519560076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data") pod "rabbitmq-server-0" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69") : configmap "rabbitmq-config-data" not found Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.121901 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-cell1-galera-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.127453 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.145862 5030 scope.go:117] "RemoveContainer" containerID="7d745b62fc387b53a6b083f78854e5cd4dadc9e3979efd7633da39dba293e5f9" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.208204 5030 scope.go:117] "RemoveContainer" containerID="1590ccd5da4da63792efdbad28f04eefecd1ab244abfd42491bb986dacb402d5" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.222286 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts\") pod \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.222981 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8\") pod \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\" (UID: \"75b16fbf-e33d-4d0b-917d-9994b99d38b3\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.224626 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "75b16fbf-e33d-4d0b-917d-9994b99d38b3" (UID: "75b16fbf-e33d-4d0b-917d-9994b99d38b3"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.229595 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8" (OuterVolumeSpecName: "kube-api-access-kc8l8") pod "75b16fbf-e33d-4d0b-917d-9994b99d38b3" (UID: "75b16fbf-e33d-4d0b-917d-9994b99d38b3"). InnerVolumeSpecName "kube-api-access-kc8l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.271161 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.298647 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.303643 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.324747 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts\") pod \"462c19bb-6652-42bd-9ac1-5333d77cb00b\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.325054 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts\") pod \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.325167 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csdr2\" (UniqueName: \"kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2\") pod \"462c19bb-6652-42bd-9ac1-5333d77cb00b\" (UID: \"462c19bb-6652-42bd-9ac1-5333d77cb00b\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.325104 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "462c19bb-6652-42bd-9ac1-5333d77cb00b" (UID: "462c19bb-6652-42bd-9ac1-5333d77cb00b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.325452 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "22c7e3d4-0f4a-4ba5-ace1-80810980d53b" (UID: "22c7e3d4-0f4a-4ba5-ace1-80810980d53b"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.325645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg2l6\" (UniqueName: \"kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6\") pod \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\" (UID: \"22c7e3d4-0f4a-4ba5-ace1-80810980d53b\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.326445 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.326609 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkr8m\" (UniqueName: \"kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.326786 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/75b16fbf-e33d-4d0b-917d-9994b99d38b3-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.326890 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.326941 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc8l8\" (UniqueName: \"kubernetes.io/projected/75b16fbf-e33d-4d0b-917d-9994b99d38b3-kube-api-access-kc8l8\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.327021 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/462c19bb-6652-42bd-9ac1-5333d77cb00b-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.326676 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.327221 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:06.327204851 +0000 UTC m=+2650.726517388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : configmap "openstack-scripts" not found Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.329127 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2" (OuterVolumeSpecName: "kube-api-access-csdr2") pod "462c19bb-6652-42bd-9ac1-5333d77cb00b" (UID: "462c19bb-6652-42bd-9ac1-5333d77cb00b"). InnerVolumeSpecName "kube-api-access-csdr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.329486 5030 projected.go:194] Error preparing data for projected volume kube-api-access-xkr8m for pod openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.329569 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:06.329535114 +0000 UTC m=+2650.728847661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkr8m" (UniqueName: "kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.338327 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6" (OuterVolumeSpecName: "kube-api-access-pg2l6") pod "22c7e3d4-0f4a-4ba5-ace1-80810980d53b" (UID: "22c7e3d4-0f4a-4ba5-ace1-80810980d53b"). InnerVolumeSpecName "kube-api-access-pg2l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.429015 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data\") pod \"134ba5b6-d1b8-43ef-8d86-f929c7885553\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.429085 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs\") pod \"134ba5b6-d1b8-43ef-8d86-f929c7885553\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.429419 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config\") pod \"134ba5b6-d1b8-43ef-8d86-f929c7885553\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.429583 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle\") pod \"134ba5b6-d1b8-43ef-8d86-f929c7885553\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.429668 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6699\" (UniqueName: \"kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699\") pod \"134ba5b6-d1b8-43ef-8d86-f929c7885553\" (UID: \"134ba5b6-d1b8-43ef-8d86-f929c7885553\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.430096 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "134ba5b6-d1b8-43ef-8d86-f929c7885553" (UID: "134ba5b6-d1b8-43ef-8d86-f929c7885553"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.430638 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csdr2\" (UniqueName: \"kubernetes.io/projected/462c19bb-6652-42bd-9ac1-5333d77cb00b-kube-api-access-csdr2\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.430658 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg2l6\" (UniqueName: \"kubernetes.io/projected/22c7e3d4-0f4a-4ba5-ace1-80810980d53b-kube-api-access-pg2l6\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.430668 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.431206 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data" (OuterVolumeSpecName: "config-data") pod "134ba5b6-d1b8-43ef-8d86-f929c7885553" (UID: "134ba5b6-d1b8-43ef-8d86-f929c7885553"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.437638 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699" (OuterVolumeSpecName: "kube-api-access-n6699") pod "134ba5b6-d1b8-43ef-8d86-f929c7885553" (UID: "134ba5b6-d1b8-43ef-8d86-f929c7885553"). InnerVolumeSpecName "kube-api-access-n6699". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.449099 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "134ba5b6-d1b8-43ef-8d86-f929c7885553" (UID: "134ba5b6-d1b8-43ef-8d86-f929c7885553"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.476367 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs" (OuterVolumeSpecName: "memcached-tls-certs") pod "134ba5b6-d1b8-43ef-8d86-f929c7885553" (UID: "134ba5b6-d1b8-43ef-8d86-f929c7885553"). InnerVolumeSpecName "memcached-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.533915 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/134ba5b6-d1b8-43ef-8d86-f929c7885553-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.534036 5030 reconciler_common.go:299] "Volume detached for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-memcached-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.534116 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/134ba5b6-d1b8-43ef-8d86-f929c7885553-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.534189 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6699\" (UniqueName: \"kubernetes.io/projected/134ba5b6-d1b8-43ef-8d86-f929c7885553-kube-api-access-n6699\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.543184 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.548723 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_96fd9b41-b680-4b4f-bed0-80e319a15633/ovn-northd/0.log" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.548809 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.634884 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.634931 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.634960 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635024 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635072 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635255 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635308 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config" (OuterVolumeSpecName: "config") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635324 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635393 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9nzw\" (UniqueName: \"kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw\") pod \"47704920-9f8b-43b2-b573-737ba9deeea8\" (UID: \"47704920-9f8b-43b2-b573-737ba9deeea8\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635528 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635587 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4ftz\" (UniqueName: \"kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635719 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.635785 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle\") pod \"96fd9b41-b680-4b4f-bed0-80e319a15633\" (UID: \"96fd9b41-b680-4b4f-bed0-80e319a15633\") " Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.636865 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.638499 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir" (OuterVolumeSpecName: "ovn-rundir") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "ovn-rundir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.638815 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs" (OuterVolumeSpecName: "logs") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.640302 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts" (OuterVolumeSpecName: "scripts") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.640595 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts" (OuterVolumeSpecName: "scripts") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.643528 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz" (OuterVolumeSpecName: "kube-api-access-g4ftz") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "kube-api-access-g4ftz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.643695 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw" (OuterVolumeSpecName: "kube-api-access-c9nzw") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "kube-api-access-c9nzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.665346 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.680313 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data" (OuterVolumeSpecName: "config-data") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.686074 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.705531 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b4281ba_1cb2_4a11_83bc_da2fd41d5e81.slice/crio-938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b4281ba_1cb2_4a11_83bc_da2fd41d5e81.slice/crio-conmon-938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.712034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs" (OuterVolumeSpecName: "ovn-northd-tls-certs") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "ovn-northd-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.728459 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs" (OuterVolumeSpecName: "metrics-certs-tls-certs") pod "96fd9b41-b680-4b4f-bed0-80e319a15633" (UID: "96fd9b41-b680-4b4f-bed0-80e319a15633"). InnerVolumeSpecName "metrics-certs-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.732255 5030 generic.go:358] "Generic (PLEG): container finished" podID="47704920-9f8b-43b2-b573-737ba9deeea8" containerID="7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717" exitCode=0 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.732345 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerDied","Data":"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.732383 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" event={"ID":"47704920-9f8b-43b2-b573-737ba9deeea8","Type":"ContainerDied","Data":"882121b8e890e4b216728330a0f8762948bac0cf898f99d3999e3c28a0056945"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.732403 5030 scope.go:117] "RemoveContainer" containerID="7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.732532 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/placement-798fdd79cd-2b8zn" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738376 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-rundir\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738588 5030 reconciler_common.go:299] "Volume detached for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-ovn-northd-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738600 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738608 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/47704920-9f8b-43b2-b573-737ba9deeea8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738618 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9nzw\" (UniqueName: \"kubernetes.io/projected/47704920-9f8b-43b2-b573-737ba9deeea8-kube-api-access-c9nzw\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738627 5030 reconciler_common.go:299] "Volume detached for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-metrics-certs-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738647 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4ftz\" (UniqueName: \"kubernetes.io/projected/96fd9b41-b680-4b4f-bed0-80e319a15633-kube-api-access-g4ftz\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738658 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/96fd9b41-b680-4b4f-bed0-80e319a15633-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738667 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/96fd9b41-b680-4b4f-bed0-80e319a15633-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738677 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.738685 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.748215 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561150-n99zr" event={"ID":"95eedf89-5260-4150-88a1-eb6ca5eab829","Type":"ContainerStarted","Data":"e7c031a8dbdf6cff58a1aca9ca2956c3d95d6733765c810ca3fd51e5e655bd03"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.750150 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.753677 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "47704920-9f8b-43b2-b573-737ba9deeea8" (UID: "47704920-9f8b-43b2-b573-737ba9deeea8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.753834 5030 generic.go:358] "Generic (PLEG): container finished" podID="134ba5b6-d1b8-43ef-8d86-f929c7885553" containerID="1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0" exitCode=0 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.753926 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"134ba5b6-d1b8-43ef-8d86-f929c7885553","Type":"ContainerDied","Data":"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.753949 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/memcached-0" event={"ID":"134ba5b6-d1b8-43ef-8d86-f929c7885553","Type":"ContainerDied","Data":"34d39bf1f5ea3861aaee0f1552ccfecceae7edf04116ff30ac6668c7c0c7ac2a"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.754012 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/memcached-0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.764170 5030 generic.go:358] "Generic (PLEG): container finished" podID="1dcde069-3377-48ed-a6bf-fdf25e80f78d" containerID="1d2baec967e8d06425cbda9080a7f25b0f7bb354ea2891b60bd46e202d0046b5" exitCode=0 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.764269 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" event={"ID":"1dcde069-3377-48ed-a6bf-fdf25e80f78d","Type":"ContainerDied","Data":"1d2baec967e8d06425cbda9080a7f25b0f7bb354ea2891b60bd46e202d0046b5"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.767242 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561150-n99zr" podStartSLOduration=4.310924217 podStartE2EDuration="5.767224112s" podCreationTimestamp="2026-03-16 13:50:00 +0000 UTC" firstStartedPulling="2026-03-16 13:50:03.273499295 +0000 UTC m=+2647.672811842" lastFinishedPulling="2026-03-16 13:50:04.72979919 +0000 UTC m=+2649.129111737" observedRunningTime="2026-03-16 13:50:05.761761468 +0000 UTC m=+2650.161074015" watchObservedRunningTime="2026-03-16 13:50:05.767224112 +0000 UTC m=+2650.166536659" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.769110 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" event={"ID":"f04e629b-393c-4687-a1fb-7c0be4a08d38","Type":"ContainerDied","Data":"0075fa2dfd3434a2515d07227bc31774bcb774e65657372d85e6739109e6232a"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.769121 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.787353 5030 scope.go:117] "RemoveContainer" containerID="89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.793025 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_ovn-northd-0_96fd9b41-b680-4b4f-bed0-80e319a15633/ovn-northd/0.log" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.793115 5030 generic.go:358] "Generic (PLEG): container finished" podID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" exitCode=139 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.793216 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerDied","Data":"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.793297 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ovn-northd-0" event={"ID":"96fd9b41-b680-4b4f-bed0-80e319a15633","Type":"ContainerDied","Data":"aa371de1ade3f67776fdc0ada94082d60d46c84b594b4f7c966372d7d451cb85"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.793402 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ovn-northd-0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.810488 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" event={"ID":"22c7e3d4-0f4a-4ba5-ace1-80810980d53b","Type":"ContainerDied","Data":"226843ac8f78c41de4adff181aa04135da9f187c26e63e0f6d732b44a9a0f3d0"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.810534 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.815388 5030 scope.go:117] "RemoveContainer" containerID="7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.817978 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717\": container with ID starting with 7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717 not found: ID does not exist" containerID="7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.818019 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717"} err="failed to get container status \"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717\": rpc error: code = NotFound desc = could not find container \"7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717\": container with ID starting with 7e9d6e79e6799a4ead80f33aba2d2e69fc2aebfb46691fdb1a3aa9bc3abb5717 not found: ID does not exist" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.818040 5030 scope.go:117] "RemoveContainer" containerID="89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.820480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" event={"ID":"462c19bb-6652-42bd-9ac1-5333d77cb00b","Type":"ContainerDied","Data":"5dacce8160dbc9603f1e944ae5c8e6a3e680e4e85709d9f173696bfeb23d938d"} Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.820584 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817\": container with ID starting with 89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817 not found: ID does not exist" containerID="89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.820639 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817"} err="failed to get container status \"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817\": rpc error: code = NotFound desc = could not find container \"89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817\": container with ID starting with 89201698a9a4bb03e185aaa9070f09e11960eb47fd1e3f0d4c6f1efe1a7cf817 not found: ID does not exist" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.820660 5030 scope.go:117] "RemoveContainer" containerID="1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.820759 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6528-account-create-update-lghs2" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.838851 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" event={"ID":"75b16fbf-e33d-4d0b-917d-9994b99d38b3","Type":"ContainerDied","Data":"ed700660d75bbe12d3390484cdaf401f62b79daa4ecef65340692ae568160e5a"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.838985 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.843049 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.843074 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/47704920-9f8b-43b2-b573-737ba9deeea8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.848849 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.855301 5030 generic.go:358] "Generic (PLEG): container finished" podID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerID="938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" exitCode=0 Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.855582 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerDied","Data":"938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf"} Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.855728 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/memcached-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.863035 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.880832 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.892412 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.923993 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-proxy-5875978dcd-9x9tb"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.938831 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.941484 5030 scope.go:117] "RemoveContainer" containerID="1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.952861 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0\": container with ID starting with 1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0 not found: ID does not exist" containerID="1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.952918 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0"} err="failed to get container status \"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0\": rpc error: code = NotFound desc = could not find container \"1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0\": container with ID starting with 1df551999c00699fb3ef5c8c2b009364418150e4eaa3c2b841b2bb84a2d592c0 not found: ID does not exist" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.952948 5030 scope.go:117] "RemoveContainer" containerID="40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.972031 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/cinder-api-0" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api" probeResult="failure" output="Get \"https://10.217.0.237:8776/healthcheck\": read tcp 10.217.0.2:48314->10.217.0.237:8776: read: connection reset by peer" Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.973208 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf is running failed: container process not found" containerID="938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.974122 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf is running failed: container process not found" containerID="938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.975815 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf is running failed: container process not found" containerID="938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" cmd=["/bin/bash","/var/lib/operator-scripts/mysql_probe.sh","readiness"] Mar 16 13:50:05 crc kubenswrapper[5030]: E0316 13:50:05.975854 5030 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf is running failed: container process not found" probeType="Readiness" pod="openstack-kuttl-tests/openstack-galera-0" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="galera" probeResult="unknown" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.983713 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d156d48-d663-4128-905b-428afb256015" path="/var/lib/kubelet/pods/0d156d48-d663-4128-905b-428afb256015/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.985186 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="134ba5b6-d1b8-43ef-8d86-f929c7885553" path="/var/lib/kubelet/pods/134ba5b6-d1b8-43ef-8d86-f929c7885553/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.985856 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257d1043-b495-48e7-8766-71285e2314bb" path="/var/lib/kubelet/pods/257d1043-b495-48e7-8766-71285e2314bb/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.986824 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45833b6e-9ff4-4b47-beae-df00b94c66bb" path="/var/lib/kubelet/pods/45833b6e-9ff4-4b47-beae-df00b94c66bb/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.987282 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5696e940-300b-410e-a2c0-f1748d4fb540" path="/var/lib/kubelet/pods/5696e940-300b-410e-a2c0-f1748d4fb540/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.987852 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b63f362-f6ba-48ac-bcba-dcb3a6c3f529" path="/var/lib/kubelet/pods/5b63f362-f6ba-48ac-bcba-dcb3a6c3f529/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.988511 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c89be7e-2fd4-4e65-8397-c57b95782453" path="/var/lib/kubelet/pods/8c89be7e-2fd4-4e65-8397-c57b95782453/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.989574 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ed19e7-208e-4e6f-817f-aab6967f9c76" path="/var/lib/kubelet/pods/97ed19e7-208e-4e6f-817f-aab6967f9c76/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.990174 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa70386-e350-4623-a2b0-1bc46a2077e7" path="/var/lib/kubelet/pods/afa70386-e350-4623-a2b0-1bc46a2077e7/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.990782 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd56176b-b7dd-4d48-bb44-19dfffcb0066" path="/var/lib/kubelet/pods/bd56176b-b7dd-4d48-bb44-19dfffcb0066/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.991839 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e19c60f0-f4d4-4c18-8572-19da4a39607f" path="/var/lib/kubelet/pods/e19c60f0-f4d4-4c18-8572-19da4a39607f/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.992425 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e76ea975-fa99-432e-9899-5ed703585605" path="/var/lib/kubelet/pods/e76ea975-fa99-432e-9899-5ed703585605/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.992931 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" path="/var/lib/kubelet/pods/f04e629b-393c-4687-a1fb-7c0be4a08d38/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.993774 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f369c62c-2f08-4130-93f6-a8cc423b1af9" path="/var/lib/kubelet/pods/f369c62c-2f08-4130-93f6-a8cc423b1af9/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.994823 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f95c43f2-74f9-4cb8-89f9-49b67eab0552" path="/var/lib/kubelet/pods/f95c43f2-74f9-4cb8-89f9-49b67eab0552/volumes" Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.995808 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ovn-northd-0"] Mar 16 13:50:05 crc kubenswrapper[5030]: I0316 13:50:05.995850 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.001055 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api-log" probeResult="failure" output="Get \"https://10.217.0.236:9311/healthcheck\": read tcp 10.217.0.2:39206->10.217.0.236:9311: read: connection reset by peer" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.001111 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api" probeResult="failure" output="Get \"https://10.217.0.236:9311/healthcheck\": read tcp 10.217.0.2:39200->10.217.0.236:9311: read: connection reset by peer" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.008255 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6528-account-create-update-lghs2"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.019807 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.024323 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-9b48-account-create-update-lw7g9"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.032507 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.036049 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-82b1-account-create-update-s74qh"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.196304 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.217.1.22:8774/\": read tcp 10.217.0.2:48928->10.217.1.22:8774: read: connection reset by peer" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.196762 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/nova-api-0" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.217.1.22:8774/\": read tcp 10.217.0.2:48944->10.217.1.22:8774: read: connection reset by peer" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.263244 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.284730 5030 scope.go:117] "RemoveContainer" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.295949 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.305182 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/placement-798fdd79cd-2b8zn"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.313853 5030 scope.go:117] "RemoveContainer" containerID="40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a" Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.316974 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a\": container with ID starting with 40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a not found: ID does not exist" containerID="40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.317019 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a"} err="failed to get container status \"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a\": rpc error: code = NotFound desc = could not find container \"40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a\": container with ID starting with 40b43ac634e72953393a6e06958cd6a6bb46a36ea0f8c7411ee99336b7e7790a not found: ID does not exist" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.317045 5030 scope.go:117] "RemoveContainer" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.317514 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba\": container with ID starting with bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba not found: ID does not exist" containerID="bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.317544 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba"} err="failed to get container status \"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba\": rpc error: code = NotFound desc = could not find container \"bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba\": container with ID starting with bf8cc0e32ba998908d26ac30c3e25f9136bf3f7ec772dbfb816ea3e0f905e6ba not found: ID does not exist" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.369534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.369776 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg94h\" (UniqueName: \"kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.369840 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"mysql-db\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.369938 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370069 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370153 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370280 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370351 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs\") pod \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\" (UID: \"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370791 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370882 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts" (OuterVolumeSpecName: "operator-scripts") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "operator-scripts". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.371494 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default" (OuterVolumeSpecName: "config-data-default") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "config-data-default". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.371594 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config" (OuterVolumeSpecName: "kolla-config") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "kolla-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.370900 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkr8m\" (UniqueName: \"kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m\") pod \"keystone-7db8-account-create-update-ff9fx\" (UID: \"c1cb25c5-0bc8-451b-8524-c326d77a0cb9\") " pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.371738 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/openstack-scripts: configmap "openstack-scripts" not found Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.372001 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated" (OuterVolumeSpecName: "config-data-generated") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "config-data-generated". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.372231 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.372246 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-default\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.372257 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-config-data-generated\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.372268 5030 reconciler_common.go:299] "Volume detached for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kolla-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.373323 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:08.373300702 +0000 UTC m=+2652.772613249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "operator-scripts" (UniqueName: "kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : configmap "openstack-scripts" not found Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.374516 5030 projected.go:194] Error preparing data for projected volume kube-api-access-xkr8m for pod openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx: failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:06 crc kubenswrapper[5030]: E0316 13:50:06.374627 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m podName:c1cb25c5-0bc8-451b-8524-c326d77a0cb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:08.374607129 +0000 UTC m=+2652.773919676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkr8m" (UniqueName: "kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m") pod "keystone-7db8-account-create-update-ff9fx" (UID: "c1cb25c5-0bc8-451b-8524-c326d77a0cb9") : failed to fetch token: serviceaccounts "galera-openstack" not found Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.390508 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h" (OuterVolumeSpecName: "kube-api-access-kg94h") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "kube-api-access-kg94h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.400299 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.400748 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage13-crc" (OuterVolumeSpecName: "mysql-db") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "local-storage13-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.418684 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs" (OuterVolumeSpecName: "galera-tls-certs") pod "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" (UID: "9b4281ba-1cb2-4a11-83bc-da2fd41d5e81"). InnerVolumeSpecName "galera-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.479178 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg94h\" (UniqueName: \"kubernetes.io/projected/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-kube-api-access-kg94h\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.479280 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.479296 5030 reconciler_common.go:299] "Volume detached for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-galera-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.479311 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.509939 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage13-crc" (UniqueName: "kubernetes.io/local-volume/local-storage13-crc") on node "crc" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.530235 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.582082 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage13-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage13-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.608802 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.615955 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.619066 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.683476 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.683818 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684238 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684364 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5498s\" (UniqueName: \"kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684466 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle\") pod \"26294641-9c92-40c2-89b9-fab20b0be5ad\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684564 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684651 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684717 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs" (OuterVolumeSpecName: "logs") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684836 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2dv6\" (UniqueName: \"kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.684936 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs\") pod \"26294641-9c92-40c2-89b9-fab20b0be5ad\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685042 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q4nw\" (UniqueName: \"kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw\") pod \"26294641-9c92-40c2-89b9-fab20b0be5ad\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685109 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685193 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685362 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data\") pod \"26294641-9c92-40c2-89b9-fab20b0be5ad\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685484 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685648 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8rl4\" (UniqueName: \"kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685768 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685828 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.685934 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686005 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686129 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs\") pod \"26294641-9c92-40c2-89b9-fab20b0be5ad\" (UID: \"26294641-9c92-40c2-89b9-fab20b0be5ad\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686208 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686366 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686495 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686576 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs\") pod \"4e008037-e33a-4410-9894-2a476e8d0900\" (UID: \"4e008037-e33a-4410-9894-2a476e8d0900\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686690 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686784 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs\") pod \"d926eedb-a8a8-4f39-8641-b097342d1969\" (UID: \"d926eedb-a8a8-4f39-8641-b097342d1969\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686863 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs\") pod \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\" (UID: \"ed385adc-f2c0-43e8-92ef-d10fe239cdb8\") " Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.687576 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/4e008037-e33a-4410-9894-2a476e8d0900-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.687800 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d926eedb-a8a8-4f39-8641-b097342d1969-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.686812 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs" (OuterVolumeSpecName: "logs") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.688259 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s" (OuterVolumeSpecName: "kube-api-access-5498s") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "kube-api-access-5498s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.688314 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.692878 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs" (OuterVolumeSpecName: "logs") pod "26294641-9c92-40c2-89b9-fab20b0be5ad" (UID: "26294641-9c92-40c2-89b9-fab20b0be5ad"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.693770 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs" (OuterVolumeSpecName: "logs") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.696034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4" (OuterVolumeSpecName: "kube-api-access-c8rl4") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "kube-api-access-c8rl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.700375 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw" (OuterVolumeSpecName: "kube-api-access-2q4nw") pod "26294641-9c92-40c2-89b9-fab20b0be5ad" (UID: "26294641-9c92-40c2-89b9-fab20b0be5ad"). InnerVolumeSpecName "kube-api-access-2q4nw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.701243 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6" (OuterVolumeSpecName: "kube-api-access-q2dv6") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "kube-api-access-q2dv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.702024 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.708368 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts" (OuterVolumeSpecName: "scripts") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.732865 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "26294641-9c92-40c2-89b9-fab20b0be5ad" (UID: "26294641-9c92-40c2-89b9-fab20b0be5ad"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.742388 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.746872 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.751776 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "26294641-9c92-40c2-89b9-fab20b0be5ad" (UID: "26294641-9c92-40c2-89b9-fab20b0be5ad"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.753691 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.755608 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.757184 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.761768 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.767813 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.779256 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data" (OuterVolumeSpecName: "config-data") pod "26294641-9c92-40c2-89b9-fab20b0be5ad" (UID: "26294641-9c92-40c2-89b9-fab20b0be5ad"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.779475 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data" (OuterVolumeSpecName: "config-data") pod "ed385adc-f2c0-43e8-92ef-d10fe239cdb8" (UID: "ed385adc-f2c0-43e8-92ef-d10fe239cdb8"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.779671 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789597 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789623 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8rl4\" (UniqueName: \"kubernetes.io/projected/d926eedb-a8a8-4f39-8641-b097342d1969-kube-api-access-c8rl4\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789643 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789653 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789662 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/26294641-9c92-40c2-89b9-fab20b0be5ad-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789671 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789679 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789689 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789698 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789706 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789714 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789722 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789731 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789741 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5498s\" (UniqueName: \"kubernetes.io/projected/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-kube-api-access-5498s\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789751 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789762 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789770 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2dv6\" (UniqueName: \"kubernetes.io/projected/4e008037-e33a-4410-9894-2a476e8d0900-kube-api-access-q2dv6\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789779 5030 reconciler_common.go:299] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-nova-metadata-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789787 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q4nw\" (UniqueName: \"kubernetes.io/projected/26294641-9c92-40c2-89b9-fab20b0be5ad-kube-api-access-2q4nw\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789796 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ed385adc-f2c0-43e8-92ef-d10fe239cdb8-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789804 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4e008037-e33a-4410-9894-2a476e8d0900-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789812 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/26294641-9c92-40c2-89b9-fab20b0be5ad-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.789985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data" (OuterVolumeSpecName: "config-data") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.790711 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data" (OuterVolumeSpecName: "config-data") pod "d926eedb-a8a8-4f39-8641-b097342d1969" (UID: "d926eedb-a8a8-4f39-8641-b097342d1969"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.791211 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "4e008037-e33a-4410-9894-2a476e8d0900" (UID: "4e008037-e33a-4410-9894-2a476e8d0900"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.892764 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d926eedb-a8a8-4f39-8641-b097342d1969-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.892999 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.893013 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4e008037-e33a-4410-9894-2a476e8d0900-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.897506 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" event={"ID":"1dcde069-3377-48ed-a6bf-fdf25e80f78d","Type":"ContainerStarted","Data":"039f212cc5e9c899fc25e8428d11a95d172e66b5bb46d2d6f344b7cc5bc1caaf"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.897687 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.899604 5030 generic.go:358] "Generic (PLEG): container finished" podID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerID="4bad9050af1bf8cf77ac8fc0ab764eeff8232492b2b32f9b959560206834d9f3" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.899701 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerDied","Data":"4bad9050af1bf8cf77ac8fc0ab764eeff8232492b2b32f9b959560206834d9f3"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.904571 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/openstack-galera-0" event={"ID":"9b4281ba-1cb2-4a11-83bc-da2fd41d5e81","Type":"ContainerDied","Data":"070f8f11b752923cbcc6262acd023f8f80be959092914a57d389835b04c7c4e1"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.904609 5030 scope.go:117] "RemoveContainer" containerID="938c2f0bfedb1829e3a4411743ac5518191faf77dec30280e8d048e81bfbf5cf" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.904754 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/openstack-galera-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.920621 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" podStartSLOduration=5.920607287 podStartE2EDuration="5.920607287s" podCreationTimestamp="2026-03-16 13:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-03-16 13:50:06.918781783 +0000 UTC m=+2651.318094331" watchObservedRunningTime="2026-03-16 13:50:06.920607287 +0000 UTC m=+2651.319919834" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.929311 5030 generic.go:358] "Generic (PLEG): container finished" podID="4e008037-e33a-4410-9894-2a476e8d0900" containerID="a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.929423 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-api-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.929474 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerDied","Data":"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.930373 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-api-0" event={"ID":"4e008037-e33a-4410-9894-2a476e8d0900","Type":"ContainerDied","Data":"3764b8369576aec4bf56d992d662c7363472a66682e9a6fc2abf99199bc37fde"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.953336 5030 generic.go:358] "Generic (PLEG): container finished" podID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerID="59482e3f943fc36862143276cbb748e4c432f023b1654ed34ff92f0cb3cd2ae9" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.953526 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerDied","Data":"59482e3f943fc36862143276cbb748e4c432f023b1654ed34ff92f0cb3cd2ae9"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.955267 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.962545 5030 generic.go:358] "Generic (PLEG): container finished" podID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerID="c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.962777 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerDied","Data":"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.962812 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-api-0" event={"ID":"ed385adc-f2c0-43e8-92ef-d10fe239cdb8","Type":"ContainerDied","Data":"ec5b59a29b1abcfeb343acc5b4d3da095215554fe0aeb773ff2b089090188fef"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.962892 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-api-0" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.967267 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/openstack-galera-0"] Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.976824 5030 generic.go:358] "Generic (PLEG): container finished" podID="d926eedb-a8a8-4f39-8641-b097342d1969" containerID="c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.977027 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerDied","Data":"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.977118 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" event={"ID":"d926eedb-a8a8-4f39-8641-b097342d1969","Type":"ContainerDied","Data":"66b720b1469423d5306629fe3c2d5002464243c0cdf4391494177ac1232c5a8b"} Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.977189 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q" Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.988687 5030 generic.go:358] "Generic (PLEG): container finished" podID="95eedf89-5260-4150-88a1-eb6ca5eab829" containerID="e7c031a8dbdf6cff58a1aca9ca2956c3d95d6733765c810ca3fd51e5e655bd03" exitCode=0 Mar 16 13:50:06 crc kubenswrapper[5030]: I0316 13:50:06.988818 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561150-n99zr" event={"ID":"95eedf89-5260-4150-88a1-eb6ca5eab829","Type":"ContainerDied","Data":"e7c031a8dbdf6cff58a1aca9ca2956c3d95d6733765c810ca3fd51e5e655bd03"} Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.001866 5030 generic.go:358] "Generic (PLEG): container finished" podID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerID="068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766" exitCode=0 Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.002059 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.002695 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-metadata-0" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.003024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerDied","Data":"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766"} Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.003058 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-metadata-0" event={"ID":"26294641-9c92-40c2-89b9-fab20b0be5ad","Type":"ContainerDied","Data":"b2530559621c513e6f66a4238572719f15479a1584f8e0061d1e10630384e18b"} Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.012451 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.024839 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-api-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.027724 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.035897 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-api-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.038838 5030 scope.go:117] "RemoveContainer" containerID="0da97836cea3d42bd6dbf4cc35e11fbc5e30df5a13c9d69423f186d9e6f5637d" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.055784 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.056104 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.059669 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.060960 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.061017 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.062865 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-api-6ff778688b-j9j5q"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.089431 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.102365 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-7db8-account-create-update-ff9fx"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.119414 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.119771 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.119870 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0 podName:596265d5-481b-4e3c-8577-e99f029f8cc2 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:07.619846834 +0000 UTC m=+2652.019159381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0") pod "dnsmasq-dnsmasq-d755c5cb5-hjvjl" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2") : configmap "dns-swift-storage-0" not found Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.123467 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-metadata-0"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.127269 5030 scope.go:117] "RemoveContainer" containerID="a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.166532 5030 scope.go:117] "RemoveContainer" containerID="884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.175282 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.206601 5030 scope.go:117] "RemoveContainer" containerID="a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.206828 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkr8m\" (UniqueName: \"kubernetes.io/projected/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-kube-api-access-xkr8m\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.206858 5030 reconciler_common.go:299] "Volume detached for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/c1cb25c5-0bc8-451b-8524-c326d77a0cb9-operator-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.207078 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e\": container with ID starting with a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e not found: ID does not exist" containerID="a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.207118 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e"} err="failed to get container status \"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e\": rpc error: code = NotFound desc = could not find container \"a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e\": container with ID starting with a30daf445408cfadb1d823139943e9b01fd82cb5d16e786b32090c1c0c74508e not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.207145 5030 scope.go:117] "RemoveContainer" containerID="884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.207364 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f\": container with ID starting with 884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f not found: ID does not exist" containerID="884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.207378 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f"} err="failed to get container status \"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f\": rpc error: code = NotFound desc = could not find container \"884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f\": container with ID starting with 884b3646c67287de03eea30b97e1f61d4f15aad0ba0f85c03eedbff283616f8f not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.207392 5030 scope.go:117] "RemoveContainer" containerID="c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.218993 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220442 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-server" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220467 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-server" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220643 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220660 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220674 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="galera" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220680 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="galera" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220701 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220706 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220713 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220717 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220737 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="openstack-network-exporter" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220742 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="openstack-network-exporter" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220750 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220756 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220766 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220771 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220784 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220789 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220795 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220800 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220808 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-metadata" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220813 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-metadata" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220825 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220830 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220844 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="mysql-bootstrap" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220852 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="mysql-bootstrap" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220863 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="ovn-northd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220867 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="ovn-northd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220880 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="134ba5b6-d1b8-43ef-8d86-f929c7885553" containerName="memcached" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220885 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="134ba5b6-d1b8-43ef-8d86-f929c7885553" containerName="memcached" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220897 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220902 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220909 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220914 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220921 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220928 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220935 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.220939 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221071 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" containerName="galera" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221082 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221090 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-httpd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221106 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f04e629b-393c-4687-a1fb-7c0be4a08d38" containerName="proxy-server" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221112 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221119 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" containerName="nova-metadata-metadata" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221125 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221132 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221140 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" containerName="nova-api-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221146 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" containerName="barbican-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221242 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221263 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" containerName="placement-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221272 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="134ba5b6-d1b8-43ef-8d86-f929c7885553" containerName="memcached" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221281 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="ovn-northd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221288 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221294 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" containerName="glance-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221302 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" containerName="openstack-network-exporter" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.221312 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="4e008037-e33a-4410-9894-2a476e8d0900" containerName="cinder-api-log" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.259779 5030 scope.go:117] "RemoveContainer" containerID="31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.271578 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.271751 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.295058 5030 scope.go:117] "RemoveContainer" containerID="c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.295906 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97\": container with ID starting with c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97 not found: ID does not exist" containerID="c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.295945 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97"} err="failed to get container status \"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97\": rpc error: code = NotFound desc = could not find container \"c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97\": container with ID starting with c4d68c657ef806dc82d3fb229f679ca9d6508416f30fda7147561591952f5e97 not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.298415 5030 scope.go:117] "RemoveContainer" containerID="31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.298866 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19\": container with ID starting with 31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19 not found: ID does not exist" containerID="31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.298904 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19"} err="failed to get container status \"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19\": rpc error: code = NotFound desc = could not find container \"31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19\": container with ID starting with 31020bb4f78b9e3e8f4ad0d08b9e12825fdf7d03d94c54eae66e3664fbc56b19 not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.298997 5030 scope.go:117] "RemoveContainer" containerID="c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308219 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wb75\" (UniqueName: \"kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308294 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308394 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308450 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.308517 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.309767 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs" (OuterVolumeSpecName: "logs") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.309780 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.310128 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.310157 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.311083 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.311095 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.321765 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage11-crc" (OuterVolumeSpecName: "glance") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "local-storage11-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.331321 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts" (OuterVolumeSpecName: "scripts") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.336985 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75" (OuterVolumeSpecName: "kube-api-access-4wb75") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "kube-api-access-4wb75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.337292 5030 scope.go:117] "RemoveContainer" containerID="3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.340523 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.369140 5030 scope.go:117] "RemoveContainer" containerID="c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.369196 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data podName:4ecfb6c9-6c28-474f-8d41-80920bb5ddb9 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:07.869152594 +0000 UTC m=+2652.268465141 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "config-data" (UniqueName: "kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9") : error deleting /var/lib/kubelet/pods/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9/volume-subpaths: remove /var/lib/kubelet/pods/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9/volume-subpaths: no such file or directory Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.371921 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd\": container with ID starting with c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd not found: ID does not exist" containerID="c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.372007 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd"} err="failed to get container status \"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd\": rpc error: code = NotFound desc = could not find container \"c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd\": container with ID starting with c2cbaa3e3775bfc15c0c110751ce45628d772e2c5d769b71531c8d32d92a7fbd not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.372029 5030 scope.go:117] "RemoveContainer" containerID="3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.372652 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992\": container with ID starting with 3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992 not found: ID does not exist" containerID="3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.372683 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992"} err="failed to get container status \"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992\": rpc error: code = NotFound desc = could not find container \"3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992\": container with ID starting with 3a05b849608ead3a768711c16b1125e20fa7e1ea8b6f6bfd7bee294ab1a37992 not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.372705 5030 scope.go:117] "RemoveContainer" containerID="068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.380182 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.383034 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.417362 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.417491 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.417612 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw4nr\" (UniqueName: \"kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.418031 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wb75\" (UniqueName: \"kubernetes.io/projected/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-kube-api-access-4wb75\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.418047 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.418066 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.418076 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.418087 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.444740 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage11-crc" (UniqueName: "kubernetes.io/local-volume/local-storage11-crc") on node "crc" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.456672 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.460517 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.467385 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.467452 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.518719 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lql6s\" (UniqueName: \"kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.518872 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.518898 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.518977 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519157 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519335 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519384 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519423 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs\") pod \"3c343cbc-4e5f-491c-94cd-2009f724dfce\" (UID: \"3c343cbc-4e5f-491c-94cd-2009f724dfce\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519920 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.519959 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.520006 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw4nr\" (UniqueName: \"kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.520123 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage11-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage11-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.520989 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.521027 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs" (OuterVolumeSpecName: "logs") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.522421 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.523483 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.523917 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.524483 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts" (OuterVolumeSpecName: "scripts") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.525140 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s" (OuterVolumeSpecName: "kube-api-access-lql6s") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "kube-api-access-lql6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.526197 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage08-crc" (OuterVolumeSpecName: "glance") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "local-storage08-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.543435 5030 scope.go:117] "RemoveContainer" containerID="d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.551820 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw4nr\" (UniqueName: \"kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr\") pod \"redhat-operators-4jrhf\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.578394 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data" (OuterVolumeSpecName: "config-data") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.588351 5030 scope.go:117] "RemoveContainer" containerID="068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.588730 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766\": container with ID starting with 068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766 not found: ID does not exist" containerID="068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.588765 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766"} err="failed to get container status \"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766\": rpc error: code = NotFound desc = could not find container \"068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766\": container with ID starting with 068595bfdec054c26a59d61999e69bf3172203bae8f7d32ab64567d9ffef6766 not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.588785 5030 scope.go:117] "RemoveContainer" containerID="d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.590673 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.594790 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56\": container with ID starting with d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56 not found: ID does not exist" containerID="d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.594858 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56"} err="failed to get container status \"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56\": rpc error: code = NotFound desc = could not find container \"d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56\": container with ID starting with d7127799cea203b8af79379902348c029871c372ddd66ca13dea1ecd25797d56 not found: ID does not exist" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.607491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "3c343cbc-4e5f-491c-94cd-2009f724dfce" (UID: "3c343cbc-4e5f-491c-94cd-2009f724dfce"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.612732 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.621126 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle\") pod \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.621494 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom\") pod \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.621614 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs\") pod \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.621824 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data\") pod \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.621872 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4lpc\" (UniqueName: \"kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc\") pod \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\" (UID: \"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622131 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs" (OuterVolumeSpecName: "logs") pod "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" (UID: "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622901 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lql6s\" (UniqueName: \"kubernetes.io/projected/3c343cbc-4e5f-491c-94cd-2009f724dfce-kube-api-access-lql6s\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622925 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622934 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-httpd-run\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622943 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622960 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622970 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622978 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3c343cbc-4e5f-491c-94cd-2009f724dfce-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622986 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.622993 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3c343cbc-4e5f-491c-94cd-2009f724dfce-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.623674 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:50:07 crc kubenswrapper[5030]: E0316 13:50:07.623775 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0 podName:596265d5-481b-4e3c-8577-e99f029f8cc2 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:08.623752091 +0000 UTC m=+2653.023064637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0") pod "dnsmasq-dnsmasq-d755c5cb5-hjvjl" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2") : configmap "dns-swift-storage-0" not found Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.638821 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage08-crc" (UniqueName: "kubernetes.io/local-volume/local-storage08-crc") on node "crc" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.641181 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" (UID: "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.650407 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" (UID: "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.653216 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-httpd" probeResult="failure" output="Get \"https://10.217.0.234:9696/\": dial tcp 10.217.0.234:9696: connect: connection refused" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.664093 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc" (OuterVolumeSpecName: "kube-api-access-m4lpc") pod "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" (UID: "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c"). InnerVolumeSpecName "kube-api-access-m4lpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.667847 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data" (OuterVolumeSpecName: "config-data") pod "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" (UID: "92cd8b90-d16f-4a1b-b2c8-0cb160ca548c"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.685492 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.182:5671: connect: connection refused" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.685513 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/rabbitmq-server-0" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="rabbitmq" probeResult="failure" output="dial tcp 10.217.0.181:5671: connect: connection refused" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.729492 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage08-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage08-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.729766 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.729778 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.729788 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4lpc\" (UniqueName: \"kubernetes.io/projected/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-kube-api-access-m4lpc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.729797 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.936705 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") pod \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\" (UID: \"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9\") " Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.941611 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data" (OuterVolumeSpecName: "config-data") pod "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" (UID: "4ecfb6c9-6c28-474f-8d41-80920bb5ddb9"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.961106 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22c7e3d4-0f4a-4ba5-ace1-80810980d53b" path="/var/lib/kubelet/pods/22c7e3d4-0f4a-4ba5-ace1-80810980d53b/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.961566 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26294641-9c92-40c2-89b9-fab20b0be5ad" path="/var/lib/kubelet/pods/26294641-9c92-40c2-89b9-fab20b0be5ad/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.962243 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="462c19bb-6652-42bd-9ac1-5333d77cb00b" path="/var/lib/kubelet/pods/462c19bb-6652-42bd-9ac1-5333d77cb00b/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.963126 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47704920-9f8b-43b2-b573-737ba9deeea8" path="/var/lib/kubelet/pods/47704920-9f8b-43b2-b573-737ba9deeea8/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.964435 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e008037-e33a-4410-9894-2a476e8d0900" path="/var/lib/kubelet/pods/4e008037-e33a-4410-9894-2a476e8d0900/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.965050 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b16fbf-e33d-4d0b-917d-9994b99d38b3" path="/var/lib/kubelet/pods/75b16fbf-e33d-4d0b-917d-9994b99d38b3/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.965485 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96fd9b41-b680-4b4f-bed0-80e319a15633" path="/var/lib/kubelet/pods/96fd9b41-b680-4b4f-bed0-80e319a15633/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.966845 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4281ba-1cb2-4a11-83bc-da2fd41d5e81" path="/var/lib/kubelet/pods/9b4281ba-1cb2-4a11-83bc-da2fd41d5e81/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.969315 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1cb25c5-0bc8-451b-8524-c326d77a0cb9" path="/var/lib/kubelet/pods/c1cb25c5-0bc8-451b-8524-c326d77a0cb9/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.969783 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d926eedb-a8a8-4f39-8641-b097342d1969" path="/var/lib/kubelet/pods/d926eedb-a8a8-4f39-8641-b097342d1969/volumes" Mar 16 13:50:07 crc kubenswrapper[5030]: I0316 13:50:07.970411 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed385adc-f2c0-43e8-92ef-d10fe239cdb8" path="/var/lib/kubelet/pods/ed385adc-f2c0-43e8-92ef-d10fe239cdb8/volumes" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.019978 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-internal-api-0" event={"ID":"4ecfb6c9-6c28-474f-8d41-80920bb5ddb9","Type":"ContainerDied","Data":"f8f882ca047f949dfafda652782984b58bd2be9430a340f91d03b2376546af24"} Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.020100 5030 scope.go:117] "RemoveContainer" containerID="59482e3f943fc36862143276cbb748e4c432f023b1654ed34ff92f0cb3cd2ae9" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.020300 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-internal-api-0" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.033594 5030 generic.go:358] "Generic (PLEG): container finished" podID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerID="62038ccaff50077bb6c604f695759dfc7d5f1bf6e310a2110e12a86087abc5c1" exitCode=0 Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.033824 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerDied","Data":"62038ccaff50077bb6c604f695759dfc7d5f1bf6e310a2110e12a86087abc5c1"} Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.040287 5030 generic.go:358] "Generic (PLEG): container finished" podID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerID="b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3" exitCode=0 Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.040515 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerDied","Data":"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3"} Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.040629 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" event={"ID":"92cd8b90-d16f-4a1b-b2c8-0cb160ca548c","Type":"ContainerDied","Data":"88ae39da0c2ac87adb1d943d4cdf7598271549caea409541649daabcf01cfad0"} Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.040649 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.040812 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.047684 5030 scope.go:117] "RemoveContainer" containerID="9956dea0f45533038136c04cedce98249a5779dd925ca83e504eb5e140e8df73" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.051190 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.054033 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/glance-default-external-api-0" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.054318 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/glance-default-external-api-0" event={"ID":"3c343cbc-4e5f-491c-94cd-2009f724dfce","Type":"ContainerDied","Data":"857737ff16095142914e41498bfe15391595ac1bd823e10b9d93e50595bd6723"} Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.056757 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-internal-api-0"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.065610 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.068411 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:50:08 crc kubenswrapper[5030]: W0316 13:50:08.069097 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7312deb2_9151_455b_898f_ae0403364b7e.slice/crio-628a15c24ec0527c4c1fed7ba3c7cb2dd00d07b397967db644b322cdcbb1473b WatchSource:0}: Error finding container 628a15c24ec0527c4c1fed7ba3c7cb2dd00d07b397967db644b322cdcbb1473b: Status 404 returned error can't find the container with id 628a15c24ec0527c4c1fed7ba3c7cb2dd00d07b397967db644b322cdcbb1473b Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.069623 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.075120 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-worker-56cb6b7d9-b6j8s"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.078884 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.082665 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/glance-default-external-api-0"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.093993 5030 scope.go:117] "RemoveContainer" containerID="b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.144334 5030 scope.go:117] "RemoveContainer" containerID="d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.188530 5030 scope.go:117] "RemoveContainer" containerID="b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3" Mar 16 13:50:08 crc kubenswrapper[5030]: E0316 13:50:08.189002 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3\": container with ID starting with b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3 not found: ID does not exist" containerID="b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.189037 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3"} err="failed to get container status \"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3\": rpc error: code = NotFound desc = could not find container \"b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3\": container with ID starting with b5f9baf412a792c9632136d697d93241976e3d7805bab8d807f95e86a041ecd3 not found: ID does not exist" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.189063 5030 scope.go:117] "RemoveContainer" containerID="d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17" Mar 16 13:50:08 crc kubenswrapper[5030]: E0316 13:50:08.189824 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17\": container with ID starting with d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17 not found: ID does not exist" containerID="d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.189844 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17"} err="failed to get container status \"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17\": rpc error: code = NotFound desc = could not find container \"d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17\": container with ID starting with d36bc1635d65ac4e42a226cd27f36b91716648b45e9580a5ef5dc7bc173cbf17 not found: ID does not exist" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.189856 5030 scope.go:117] "RemoveContainer" containerID="4bad9050af1bf8cf77ac8fc0ab764eeff8232492b2b32f9b959560206834d9f3" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.244262 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data\") pod \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.244623 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t52pb\" (UniqueName: \"kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb\") pod \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.245325 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs\") pod \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.245486 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle\") pod \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.245645 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom\") pod \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\" (UID: \"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.245816 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs" (OuterVolumeSpecName: "logs") pod "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" (UID: "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.247258 5030 reconciler_common.go:299] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-logs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.250264 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" (UID: "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.250399 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb" (OuterVolumeSpecName: "kube-api-access-t52pb") pod "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" (UID: "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475"). InnerVolumeSpecName "kube-api-access-t52pb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.267954 5030 scope.go:117] "RemoveContainer" containerID="e25341c45b6c41e75570a09f5a607a9b7da3a21b641e7b03efc2fe4b45ba594f" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.280535 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" (UID: "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.293236 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data" (OuterVolumeSpecName: "config-data") pod "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" (UID: "3fe4c41b-8e7e-4a5b-8067-b85b9e48c475"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.351738 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.351769 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.351781 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.351790 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t52pb\" (UniqueName: \"kubernetes.io/projected/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475-kube-api-access-t52pb\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.417970 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.554618 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw85w\" (UniqueName: \"kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w\") pod \"95eedf89-5260-4150-88a1-eb6ca5eab829\" (UID: \"95eedf89-5260-4150-88a1-eb6ca5eab829\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.559572 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w" (OuterVolumeSpecName: "kube-api-access-zw85w") pod "95eedf89-5260-4150-88a1-eb6ca5eab829" (UID: "95eedf89-5260-4150-88a1-eb6ca5eab829"). InnerVolumeSpecName "kube-api-access-zw85w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.657896 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw85w\" (UniqueName: \"kubernetes.io/projected/95eedf89-5260-4150-88a1-eb6ca5eab829-kube-api-access-zw85w\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: E0316 13:50:08.657956 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:50:08 crc kubenswrapper[5030]: E0316 13:50:08.658294 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0 podName:596265d5-481b-4e3c-8577-e99f029f8cc2 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:10.658271799 +0000 UTC m=+2655.057584346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0") pod "dnsmasq-dnsmasq-d755c5cb5-hjvjl" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2") : configmap "dns-swift-storage-0" not found Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.675283 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.813269 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561144-kcbl5"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.825867 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561144-kcbl5"] Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.861302 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.861372 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.861516 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.861546 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.861770 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.862409 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrt42\" (UniqueName: \"kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.862517 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.862615 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys\") pod \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\" (UID: \"7840f19b-4f77-48da-b8c3-4e5c3e57b412\") " Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.871966 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys" (OuterVolumeSpecName: "credential-keys") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "credential-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.871952 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys" (OuterVolumeSpecName: "fernet-keys") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "fernet-keys". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.873842 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts" (OuterVolumeSpecName: "scripts") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.875606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42" (OuterVolumeSpecName: "kube-api-access-qrt42") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "kube-api-access-qrt42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.895452 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.917023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data" (OuterVolumeSpecName: "config-data") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.937630 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.953374 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "7840f19b-4f77-48da-b8c3-4e5c3e57b412" (UID: "7840f19b-4f77-48da-b8c3-4e5c3e57b412"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965491 5030 reconciler_common.go:299] "Volume detached for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-fernet-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965519 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965534 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965564 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965575 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965585 5030 reconciler_common.go:299] "Volume detached for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-credential-keys\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965598 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrt42\" (UniqueName: \"kubernetes.io/projected/7840f19b-4f77-48da-b8c3-4e5c3e57b412-kube-api-access-qrt42\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:08 crc kubenswrapper[5030]: I0316 13:50:08.965607 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/7840f19b-4f77-48da-b8c3-4e5c3e57b412-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.021740 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.076607 5030 generic.go:358] "Generic (PLEG): container finished" podID="7312deb2-9151-455b-898f-ae0403364b7e" containerID="7cb8cfc28079d130965dca56b4fffde5286f1bdb5abe3ee8da07d79064803b62" exitCode=0 Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.076735 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerDied","Data":"7cb8cfc28079d130965dca56b4fffde5286f1bdb5abe3ee8da07d79064803b62"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.076790 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerStarted","Data":"628a15c24ec0527c4c1fed7ba3c7cb2dd00d07b397967db644b322cdcbb1473b"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.085089 5030 generic.go:358] "Generic (PLEG): container finished" podID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" containerID="a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c" exitCode=0 Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.085258 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.085955 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" event={"ID":"7840f19b-4f77-48da-b8c3-4e5c3e57b412","Type":"ContainerDied","Data":"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.085990 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/keystone-bff6bf4bc-qg26w" event={"ID":"7840f19b-4f77-48da-b8c3-4e5c3e57b412","Type":"ContainerDied","Data":"ecfde79771710ca0cec19294c60a1e3b314026bb210854d3a80b5839ba2f75f9"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.086009 5030 scope.go:117] "RemoveContainer" containerID="a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.095943 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" event={"ID":"3fe4c41b-8e7e-4a5b-8067-b85b9e48c475","Type":"ContainerDied","Data":"f884f150183c448938566fd9390fae8fe16a52672af9855c7a1d2f81e3448c9f"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.096102 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.106480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561150-n99zr" event={"ID":"95eedf89-5260-4150-88a1-eb6ca5eab829","Type":"ContainerDied","Data":"abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.106527 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abdb90201f24dc5ef1259310ff4d20979f3f9416f733a18b9620897bf6cb35ac" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.106918 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561150-n99zr" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.108624 5030 generic.go:358] "Generic (PLEG): container finished" podID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerID="11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f" exitCode=0 Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.108841 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerDied","Data":"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.108876 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" event={"ID":"8c59eb5b-6079-45f0-828c-d4757cd3ed92","Type":"ContainerDied","Data":"de646043637783c0834d07818cbe781257e1b7566ae734fce6604ee97a829b92"} Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.109007 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-cell1-server-0" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.141571 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.148145 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/keystone-bff6bf4bc-qg26w"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.149139 5030 scope.go:117] "RemoveContainer" containerID="a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.149724 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c\": container with ID starting with a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c not found: ID does not exist" containerID="a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.149756 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c"} err="failed to get container status \"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c\": rpc error: code = NotFound desc = could not find container \"a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c\": container with ID starting with a0511faa862d8528511121c65417d6bd91c16760f10e98ed9cb1a0cabf182e6c not found: ID does not exist" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.149777 5030 scope.go:117] "RemoveContainer" containerID="62038ccaff50077bb6c604f695759dfc7d5f1bf6e310a2110e12a86087abc5c1" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.154481 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.158455 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/barbican-keystone-listener-6f9b49dc46-9r4jg"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.168995 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169168 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169244 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169323 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169350 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169386 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169682 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169763 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzdrq\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169851 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.169947 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.170200 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.170252 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.170490 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") pod \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\" (UID: \"8c59eb5b-6079-45f0-828c-d4757cd3ed92\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.170844 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.171868 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.171890 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.171904 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.171974 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/rabbitmq-config-data: configmap "rabbitmq-config-data" not found Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.172051 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data podName:919191a9-6df8-4a0b-a04d-0c60c6a01b69 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:17.172033113 +0000 UTC m=+2661.571345659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "config-data" (UniqueName: "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data") pod "rabbitmq-server-0" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69") : configmap "rabbitmq-config-data" not found Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.183908 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info" (OuterVolumeSpecName: "pod-info") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.183936 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.184168 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage19-crc" (OuterVolumeSpecName: "persistence") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "local-storage19-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.184437 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq" (OuterVolumeSpecName: "kube-api-access-mzdrq") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "kube-api-access-mzdrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.186766 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.201670 5030 scope.go:117] "RemoveContainer" containerID="d4674cd5ba101972c2a362d9349a3482c4ca936a1086985a257627f70085e93c" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.202349 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data" (OuterVolumeSpecName: "config-data") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.216369 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf" (OuterVolumeSpecName: "server-conf") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.226348 5030 scope.go:117] "RemoveContainer" containerID="11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.252417 5030 scope.go:117] "RemoveContainer" containerID="b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.253524 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "8c59eb5b-6079-45f0-828c-d4757cd3ed92" (UID: "8c59eb5b-6079-45f0-828c-d4757cd3ed92"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274838 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274865 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/8c59eb5b-6079-45f0-828c-d4757cd3ed92-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274894 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/8c59eb5b-6079-45f0-828c-d4757cd3ed92-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274904 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274913 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzdrq\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-kube-api-access-mzdrq\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274921 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/8c59eb5b-6079-45f0-828c-d4757cd3ed92-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274931 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/8c59eb5b-6079-45f0-828c-d4757cd3ed92-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.274973 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.286331 5030 scope.go:117] "RemoveContainer" containerID="11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.286776 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f\": container with ID starting with 11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f not found: ID does not exist" containerID="11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.286817 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f"} err="failed to get container status \"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f\": rpc error: code = NotFound desc = could not find container \"11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f\": container with ID starting with 11eff9cc574b86bf702edb7014ecd117b4193b65a7d39992f0fde8f8bb9e553f not found: ID does not exist" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.286846 5030 scope.go:117] "RemoveContainer" containerID="b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.287268 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage19-crc" (UniqueName: "kubernetes.io/local-volume/local-storage19-crc") on node "crc" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.287277 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501\": container with ID starting with b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501 not found: ID does not exist" containerID="b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.287311 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501"} err="failed to get container status \"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501\": rpc error: code = NotFound desc = could not find container \"b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501\": container with ID starting with b1e8f1e97c1fab0fe8f706d2e859049da00afddb390180c618003365b306a501 not found: ID does not exist" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.383947 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage19-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage19-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.452163 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.457134 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-cell1-server-0"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.483529 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.587534 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.587712 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.587809 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.587912 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8dxc\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.587967 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588032 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588140 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588180 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588250 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588303 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.588380 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"persistence\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") pod \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\" (UID: \"919191a9-6df8-4a0b-a04d-0c60c6a01b69\") " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.589491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins" (OuterVolumeSpecName: "rabbitmq-plugins") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "rabbitmq-plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.589629 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie" (OuterVolumeSpecName: "rabbitmq-erlang-cookie") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "rabbitmq-erlang-cookie". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.593091 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf" (OuterVolumeSpecName: "plugins-conf") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "plugins-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.594949 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc" (OuterVolumeSpecName: "kube-api-access-h8dxc") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "kube-api-access-h8dxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.595580 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8dxc\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-kube-api-access-h8dxc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.595680 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-plugins\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.595692 5030 reconciler_common.go:299] "Volume detached for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-plugins-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.595705 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-erlang-cookie\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.596382 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret" (OuterVolumeSpecName: "erlang-cookie-secret") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "erlang-cookie-secret". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.596641 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage01-crc" (OuterVolumeSpecName: "persistence") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "local-storage01-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.597138 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info" (OuterVolumeSpecName: "pod-info") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "pod-info". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.597610 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls" (OuterVolumeSpecName: "rabbitmq-tls") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "rabbitmq-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.614134 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data" (OuterVolumeSpecName: "config-data") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.627389 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf" (OuterVolumeSpecName: "server-conf") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "server-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.656538 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd" (OuterVolumeSpecName: "rabbitmq-confd") pod "919191a9-6df8-4a0b-a04d-0c60c6a01b69" (UID: "919191a9-6df8-4a0b-a04d-0c60c6a01b69"). InnerVolumeSpecName "rabbitmq-confd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697201 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-tls\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697224 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697234 5030 reconciler_common.go:299] "Volume detached for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/919191a9-6df8-4a0b-a04d-0c60c6a01b69-rabbitmq-confd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697246 5030 reconciler_common.go:299] "Volume detached for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/919191a9-6df8-4a0b-a04d-0c60c6a01b69-server-conf\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697256 5030 reconciler_common.go:299] "Volume detached for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/919191a9-6df8-4a0b-a04d-0c60c6a01b69-pod-info\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697265 5030 reconciler_common.go:299] "Volume detached for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/919191a9-6df8-4a0b-a04d-0c60c6a01b69-erlang-cookie-secret\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.697288 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" " Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.710864 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage01-crc" (UniqueName: "kubernetes.io/local-volume/local-storage01-crc") on node "crc" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.798647 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage01-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage01-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.949851 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.951705 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.957127 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" path="/var/lib/kubelet/pods/3c343cbc-4e5f-491c-94cd-2009f724dfce/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.957920 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" path="/var/lib/kubelet/pods/3fe4c41b-8e7e-4a5b-8067-b85b9e48c475/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.958654 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ecfb6c9-6c28-474f-8d41-80920bb5ddb9" path="/var/lib/kubelet/pods/4ecfb6c9-6c28-474f-8d41-80920bb5ddb9/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.959421 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:09 crc kubenswrapper[5030]: E0316 13:50:09.959454 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.960309 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" path="/var/lib/kubelet/pods/7840f19b-4f77-48da-b8c3-4e5c3e57b412/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.961107 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" path="/var/lib/kubelet/pods/8c59eb5b-6079-45f0-828c-d4757cd3ed92/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.962430 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" path="/var/lib/kubelet/pods/92cd8b90-d16f-4a1b-b2c8-0cb160ca548c/volumes" Mar 16 13:50:09 crc kubenswrapper[5030]: I0316 13:50:09.963017 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbe427e5-4271-420b-8211-71b57749c5ef" path="/var/lib/kubelet/pods/bbe427e5-4271-420b-8211-71b57749c5ef/volumes" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.120648 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerStarted","Data":"8c1819238e381e3bc3683b3fff36ba5988e08fa8fd5555316ec6a47185e5e88c"} Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.123818 5030 generic.go:358] "Generic (PLEG): container finished" podID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerID="80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432" exitCode=0 Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.123910 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerDied","Data":"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432"} Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.123972 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/rabbitmq-server-0" event={"ID":"919191a9-6df8-4a0b-a04d-0c60c6a01b69","Type":"ContainerDied","Data":"253231d193aa902e019ac71e4e1fc445ba41814cec9e70a8820eb87e6d7db67e"} Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.124005 5030 scope.go:117] "RemoveContainer" containerID="80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.123925 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/rabbitmq-server-0" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.159595 5030 scope.go:117] "RemoveContainer" containerID="e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.163373 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.167277 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/rabbitmq-server-0"] Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.181320 5030 scope.go:117] "RemoveContainer" containerID="80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432" Mar 16 13:50:10 crc kubenswrapper[5030]: E0316 13:50:10.181701 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432\": container with ID starting with 80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432 not found: ID does not exist" containerID="80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.181729 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432"} err="failed to get container status \"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432\": rpc error: code = NotFound desc = could not find container \"80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432\": container with ID starting with 80835a655a4b556513aef72ef4cbe315990641804723f1dc7c73c42714b29432 not found: ID does not exist" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.181747 5030 scope.go:117] "RemoveContainer" containerID="e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367" Mar 16 13:50:10 crc kubenswrapper[5030]: E0316 13:50:10.182036 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367\": container with ID starting with e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367 not found: ID does not exist" containerID="e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367" Mar 16 13:50:10 crc kubenswrapper[5030]: I0316 13:50:10.182058 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367"} err="failed to get container status \"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367\": rpc error: code = NotFound desc = could not find container \"e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367\": container with ID starting with e31ad94e40c2ccd3fd1527d67c8fd4859df330e41852b59da5bcda5e449de367 not found: ID does not exist" Mar 16 13:50:10 crc kubenswrapper[5030]: E0316 13:50:10.717189 5030 configmap.go:193] Couldn't get configMap openstack-kuttl-tests/dns-swift-storage-0: configmap "dns-swift-storage-0" not found Mar 16 13:50:10 crc kubenswrapper[5030]: E0316 13:50:10.717337 5030 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0 podName:596265d5-481b-4e3c-8577-e99f029f8cc2 nodeName:}" failed. No retries permitted until 2026-03-16 13:50:14.717312571 +0000 UTC m=+2659.116625117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "dns-swift-storage-0" (UniqueName: "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0") pod "dnsmasq-dnsmasq-d755c5cb5-hjvjl" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2") : configmap "dns-swift-storage-0" not found Mar 16 13:50:11 crc kubenswrapper[5030]: I0316 13:50:11.142264 5030 generic.go:358] "Generic (PLEG): container finished" podID="7312deb2-9151-455b-898f-ae0403364b7e" containerID="8c1819238e381e3bc3683b3fff36ba5988e08fa8fd5555316ec6a47185e5e88c" exitCode=0 Mar 16 13:50:11 crc kubenswrapper[5030]: I0316 13:50:11.142480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerDied","Data":"8c1819238e381e3bc3683b3fff36ba5988e08fa8fd5555316ec6a47185e5e88c"} Mar 16 13:50:11 crc kubenswrapper[5030]: I0316 13:50:11.959281 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" path="/var/lib/kubelet/pods/919191a9-6df8-4a0b-a04d-0c60c6a01b69/volumes" Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.057352 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.062204 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.063654 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.063756 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:12 crc kubenswrapper[5030]: I0316 13:50:12.158484 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerStarted","Data":"5707cbcb7560ef184d1b3937d0bf3cdae83df6fe07910cfec670ae1831906da5"} Mar 16 13:50:12 crc kubenswrapper[5030]: I0316 13:50:12.179026 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-operators-4jrhf" podStartSLOduration=4.4981887799999996 podStartE2EDuration="5.17901684s" podCreationTimestamp="2026-03-16 13:50:07 +0000 UTC" firstStartedPulling="2026-03-16 13:50:09.077706365 +0000 UTC m=+2653.477018912" lastFinishedPulling="2026-03-16 13:50:09.758534425 +0000 UTC m=+2654.157846972" observedRunningTime="2026-03-16 13:50:12.173484985 +0000 UTC m=+2656.572797532" watchObservedRunningTime="2026-03-16 13:50:12.17901684 +0000 UTC m=+2656.578329387" Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.456627 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.459408 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.464716 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:12 crc kubenswrapper[5030]: E0316 13:50:12.464776 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.063723 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-79dcd846c5-8rw6m" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.144529 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.144881 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="dnsmasq-dns" containerID="cri-o://f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614" gracePeriod=10 Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.589471 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.666718 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config\") pod \"596265d5-481b-4e3c-8577-e99f029f8cc2\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.666916 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4567\" (UniqueName: \"kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567\") pod \"596265d5-481b-4e3c-8577-e99f029f8cc2\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.667172 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0\") pod \"596265d5-481b-4e3c-8577-e99f029f8cc2\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.667298 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc\") pod \"596265d5-481b-4e3c-8577-e99f029f8cc2\" (UID: \"596265d5-481b-4e3c-8577-e99f029f8cc2\") " Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.675868 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567" (OuterVolumeSpecName: "kube-api-access-s4567") pod "596265d5-481b-4e3c-8577-e99f029f8cc2" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2"). InnerVolumeSpecName "kube-api-access-s4567". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.749037 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc" (OuterVolumeSpecName: "dnsmasq-svc") pod "596265d5-481b-4e3c-8577-e99f029f8cc2" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2"). InnerVolumeSpecName "dnsmasq-svc". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.751326 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "596265d5-481b-4e3c-8577-e99f029f8cc2" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.756491 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config" (OuterVolumeSpecName: "config") pod "596265d5-481b-4e3c-8577-e99f029f8cc2" (UID: "596265d5-481b-4e3c-8577-e99f029f8cc2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.769738 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.769762 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4567\" (UniqueName: \"kubernetes.io/projected/596265d5-481b-4e3c-8577-e99f029f8cc2-kube-api-access-s4567\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.769775 5030 reconciler_common.go:299] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dns-swift-storage-0\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:13 crc kubenswrapper[5030]: I0316 13:50:13.769784 5030 reconciler_common.go:299] "Volume detached for volume \"dnsmasq-svc\" (UniqueName: \"kubernetes.io/configmap/596265d5-481b-4e3c-8577-e99f029f8cc2-dnsmasq-svc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.195817 5030 generic.go:358] "Generic (PLEG): container finished" podID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerID="f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614" exitCode=0 Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.196024 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" event={"ID":"596265d5-481b-4e3c-8577-e99f029f8cc2","Type":"ContainerDied","Data":"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614"} Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.196060 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" event={"ID":"596265d5-481b-4e3c-8577-e99f029f8cc2","Type":"ContainerDied","Data":"1c351b489d523838424fc2caf6f2498932f9d8b41c43298fe8ff1464291d6482"} Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.196079 5030 scope.go:117] "RemoveContainer" containerID="f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.196435 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.234851 5030 scope.go:117] "RemoveContainer" containerID="84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.235236 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.239183 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/dnsmasq-dnsmasq-d755c5cb5-hjvjl"] Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.257804 5030 scope.go:117] "RemoveContainer" containerID="f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614" Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.258178 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614\": container with ID starting with f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614 not found: ID does not exist" containerID="f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.258224 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614"} err="failed to get container status \"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614\": rpc error: code = NotFound desc = could not find container \"f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614\": container with ID starting with f64ad470f3faaa09cb2999e3cea403d7422bd565c457f6edffffa41456b5f614 not found: ID does not exist" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.258255 5030 scope.go:117] "RemoveContainer" containerID="84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5" Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.258494 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5\": container with ID starting with 84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5 not found: ID does not exist" containerID="84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5" Mar 16 13:50:14 crc kubenswrapper[5030]: I0316 13:50:14.258510 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5"} err="failed to get container status \"84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5\": rpc error: code = NotFound desc = could not find container \"84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5\": container with ID starting with 84c280a9516dc8d283c1de2de8395b98e7c094554f82d09f1454042e92a035c5 not found: ID does not exist" Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.951996 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.954401 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.956133 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:14 crc kubenswrapper[5030]: E0316 13:50:14.956231 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:15 crc kubenswrapper[5030]: I0316 13:50:15.957432 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" path="/var/lib/kubelet/pods/596265d5-481b-4e3c-8577-e99f029f8cc2/volumes" Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.055189 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.056914 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.058177 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.058234 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:17 crc kubenswrapper[5030]: I0316 13:50:17.243877 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openstack-kuttl-tests/ceilometer-0" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="proxy-httpd" probeResult="failure" output="Get \"https://10.217.1.23:3000/\": dial tcp 10.217.1.23:3000: connect: connection refused" Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.456594 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.458571 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.459947 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:17 crc kubenswrapper[5030]: E0316 13:50:17.460062 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:17 crc kubenswrapper[5030]: I0316 13:50:17.613663 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:17 crc kubenswrapper[5030]: I0316 13:50:17.613715 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:17 crc kubenswrapper[5030]: I0316 13:50:17.649501 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:18 crc kubenswrapper[5030]: I0316 13:50:18.273393 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:18 crc kubenswrapper[5030]: I0316 13:50:18.325096 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:19 crc kubenswrapper[5030]: E0316 13:50:19.948084 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:19 crc kubenswrapper[5030]: E0316 13:50:19.950423 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:19 crc kubenswrapper[5030]: E0316 13:50:19.952406 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:19 crc kubenswrapper[5030]: E0316 13:50:19.952484 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:20 crc kubenswrapper[5030]: I0316 13:50:20.263399 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-operators-4jrhf" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="registry-server" containerID="cri-o://5707cbcb7560ef184d1b3937d0bf3cdae83df6fe07910cfec670ae1831906da5" gracePeriod=2 Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.277357 5030 generic.go:358] "Generic (PLEG): container finished" podID="7312deb2-9151-455b-898f-ae0403364b7e" containerID="5707cbcb7560ef184d1b3937d0bf3cdae83df6fe07910cfec670ae1831906da5" exitCode=0 Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.279362 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerDied","Data":"5707cbcb7560ef184d1b3937d0bf3cdae83df6fe07910cfec670ae1831906da5"} Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.808746 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.920285 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content\") pod \"7312deb2-9151-455b-898f-ae0403364b7e\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.920404 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities\") pod \"7312deb2-9151-455b-898f-ae0403364b7e\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.920627 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw4nr\" (UniqueName: \"kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr\") pod \"7312deb2-9151-455b-898f-ae0403364b7e\" (UID: \"7312deb2-9151-455b-898f-ae0403364b7e\") " Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.921635 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities" (OuterVolumeSpecName: "utilities") pod "7312deb2-9151-455b-898f-ae0403364b7e" (UID: "7312deb2-9151-455b-898f-ae0403364b7e"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:21 crc kubenswrapper[5030]: I0316 13:50:21.928419 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr" (OuterVolumeSpecName: "kube-api-access-zw4nr") pod "7312deb2-9151-455b-898f-ae0403364b7e" (UID: "7312deb2-9151-455b-898f-ae0403364b7e"). InnerVolumeSpecName "kube-api-access-zw4nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.024426 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.024457 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw4nr\" (UniqueName: \"kubernetes.io/projected/7312deb2-9151-455b-898f-ae0403364b7e-kube-api-access-zw4nr\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.030817 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "7312deb2-9151-455b-898f-ae0403364b7e" (UID: "7312deb2-9151-455b-898f-ae0403364b7e"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.055899 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.057391 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.059464 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.059542 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.126001 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/7312deb2-9151-455b-898f-ae0403364b7e-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.293311 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-operators-4jrhf" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.293334 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-operators-4jrhf" event={"ID":"7312deb2-9151-455b-898f-ae0403364b7e","Type":"ContainerDied","Data":"628a15c24ec0527c4c1fed7ba3c7cb2dd00d07b397967db644b322cdcbb1473b"} Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.293464 5030 scope.go:117] "RemoveContainer" containerID="5707cbcb7560ef184d1b3937d0bf3cdae83df6fe07910cfec670ae1831906da5" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.327223 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.332624 5030 scope.go:117] "RemoveContainer" containerID="8c1819238e381e3bc3683b3fff36ba5988e08fa8fd5555316ec6a47185e5e88c" Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.338948 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-operators-4jrhf"] Mar 16 13:50:22 crc kubenswrapper[5030]: I0316 13:50:22.361976 5030 scope.go:117] "RemoveContainer" containerID="7cb8cfc28079d130965dca56b4fffde5286f1bdb5abe3ee8da07d79064803b62" Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.458264 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.460227 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.461952 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:22 crc kubenswrapper[5030]: E0316 13:50:22.462014 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:23 crc kubenswrapper[5030]: I0316 13:50:23.959014 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7312deb2-9151-455b-898f-ae0403364b7e" path="/var/lib/kubelet/pods/7312deb2-9151-455b-898f-ae0403364b7e/volumes" Mar 16 13:50:24 crc kubenswrapper[5030]: E0316 13:50:24.949737 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:24 crc kubenswrapper[5030]: E0316 13:50:24.951357 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:24 crc kubenswrapper[5030]: E0316 13:50:24.952851 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:24 crc kubenswrapper[5030]: E0316 13:50:24.952887 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.054990 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.057860 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.059369 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.059415 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.456219 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.458009 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.459861 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:27 crc kubenswrapper[5030]: E0316 13:50:27.459957 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.680692 5030 scope.go:117] "RemoveContainer" containerID="180709938a3b005fe056cb3c32832c1225574c99a170f1a9926109ff84f8f8c9" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.770498 5030 scope.go:117] "RemoveContainer" containerID="16f06f903eb64352f056169bfb9e86a75510e6a5bfc5cc296520028a191e918c" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.787937 5030 scope.go:117] "RemoveContainer" containerID="7e4806648bb39e33b3636a695eee1a2e84af95146d08df6d677984c64adbc0d0" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.806578 5030 scope.go:117] "RemoveContainer" containerID="4302dd707348f58ec092cd96e6f42e6ac3362572c16e9cf685cf10c5f70d2ddd" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.842802 5030 scope.go:117] "RemoveContainer" containerID="f4b8bab8b748083d9e385230e986284b1a71e91cca58d21ee85f8b91510b3dd8" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.858864 5030 scope.go:117] "RemoveContainer" containerID="0562aa7e24c003d1a504f7a47f2a7c9268fd557bf551de5e0643c2a593a728d5" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.878773 5030 scope.go:117] "RemoveContainer" containerID="ab3515d985327396060d5c803e5bd04bb89a796bf4e514752d14b2e51bd1662f" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.894225 5030 scope.go:117] "RemoveContainer" containerID="e13ff8885b326ba542092f5269716a5cc9aed50be25f0ffa805c8c4d13543766" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.910141 5030 scope.go:117] "RemoveContainer" containerID="f9da55917cbf0ab4733a021bc717fcf40db775cd7b8dcab7611a4d41900b5aef" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.927385 5030 scope.go:117] "RemoveContainer" containerID="b1aba8f8b4e2addb25d9ce6ff3cbdad9e6e656092729f8a6106cee5288d47711" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.947303 5030 scope.go:117] "RemoveContainer" containerID="53d0f9b197386d170f93652b6003ebccaf3f55a90671832cbd6f621cea3b038d" Mar 16 13:50:29 crc kubenswrapper[5030]: E0316 13:50:29.948721 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:29 crc kubenswrapper[5030]: E0316 13:50:29.951391 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:29 crc kubenswrapper[5030]: E0316 13:50:29.954057 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Mar 16 13:50:29 crc kubenswrapper[5030]: E0316 13:50:29.954115 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-scheduler-0" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" probeResult="unknown" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.974455 5030 scope.go:117] "RemoveContainer" containerID="33ab4ba5ddc6e00f0235995ac7a380aa7fc85703f8c6e1bed39d09f4eab5f383" Mar 16 13:50:29 crc kubenswrapper[5030]: I0316 13:50:29.997867 5030 scope.go:117] "RemoveContainer" containerID="4c455a4b8b95ca1eba09d8e139eac3253f2ce455e476fe5effc103e57a8c8dcc" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.018628 5030 scope.go:117] "RemoveContainer" containerID="010a464c7510dc0d0f468c5fde1bface35c3e423f0e68104f94908ac19fbe8eb" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.037594 5030 scope.go:117] "RemoveContainer" containerID="6ed0c635656f5dd66d6e4d2db4cb2fb94c5ed8f85831fad8a58570e3f56a7850" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.053940 5030 scope.go:117] "RemoveContainer" containerID="df9b619df61a13f1488cb1e18a265966883cac3d23539d81e7e7098e2f469c5d" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.071915 5030 scope.go:117] "RemoveContainer" containerID="04697bbdcb5d13a8a23f6690c70f4c5f47395db34abeead25501ed08f764dcb1" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.087151 5030 scope.go:117] "RemoveContainer" containerID="0b1e42be70589f3e99bf54158f09bcccdcfc11eef50fea6cb0e9ad7c75e86b93" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.103445 5030 scope.go:117] "RemoveContainer" containerID="7b94deeb0290286e23956570e3b2cc885e7d824111881a35ee53a2c1023ce0f0" Mar 16 13:50:30 crc kubenswrapper[5030]: I0316 13:50:30.119589 5030 scope.go:117] "RemoveContainer" containerID="261f920f417aed1085ab33305627f98da93c33458bfa5394c1b0376b0f50472e" Mar 16 13:50:31 crc kubenswrapper[5030]: I0316 13:50:31.917619 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.009752 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zww42\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.009811 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.009945 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"swift\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.010313 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.010370 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.010459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") pod \"f6be6653-85cb-4980-934b-a4835fed9ec1\" (UID: \"f6be6653-85cb-4980-934b-a4835fed9ec1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.011065 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock" (OuterVolumeSpecName: "lock") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "lock". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.011174 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache" (OuterVolumeSpecName: "cache") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.011577 5030 reconciler_common.go:299] "Volume detached for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-cache\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.011598 5030 reconciler_common.go:299] "Volume detached for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/f6be6653-85cb-4980-934b-a4835fed9ec1-lock\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.015866 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift" (OuterVolumeSpecName: "etc-swift") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "etc-swift". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.015957 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/local-volume/local-storage14-crc" (OuterVolumeSpecName: "swift") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "local-storage14-crc". PluginName "kubernetes.io/local-volume", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.016171 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42" (OuterVolumeSpecName: "kube-api-access-zww42") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "kube-api-access-zww42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.021128 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6bb7556d4d-hp4sg_f13f0eb0-2368-4ac1-8135-61e138b551f2/neutron-api/0.log" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.021221 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.054898 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.056325 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.058169 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.058224 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell0-conductor-0" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" probeResult="unknown" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.112997 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113148 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113268 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113300 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9shg\" (UniqueName: \"kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113379 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113459 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.113488 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle\") pod \"f13f0eb0-2368-4ac1-8135-61e138b551f2\" (UID: \"f13f0eb0-2368-4ac1-8135-61e138b551f2\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.115055 5030 reconciler_common.go:299] "Volume detached for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-etc-swift\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.115128 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zww42\" (UniqueName: \"kubernetes.io/projected/f6be6653-85cb-4980-934b-a4835fed9ec1-kube-api-access-zww42\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.115186 5030 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.117058 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg" (OuterVolumeSpecName: "kube-api-access-k9shg") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "kube-api-access-k9shg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.118773 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.127488 5030 operation_generator.go:895] UnmountDevice succeeded for volume "local-storage14-crc" (UniqueName: "kubernetes.io/local-volume/local-storage14-crc") on node "crc" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.142796 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config" (OuterVolumeSpecName: "config") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.144025 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.146178 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs" (OuterVolumeSpecName: "public-tls-certs") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "public-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.148334 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.155541 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "f13f0eb0-2368-4ac1-8135-61e138b551f2" (UID: "f13f0eb0-2368-4ac1-8135-61e138b551f2"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.204466 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f6be6653-85cb-4980-934b-a4835fed9ec1" (UID: "f6be6653-85cb-4980-934b-a4835fed9ec1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.216968 5030 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217014 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9shg\" (UniqueName: \"kubernetes.io/projected/f13f0eb0-2368-4ac1-8135-61e138b551f2-kube-api-access-k9shg\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217029 5030 reconciler_common.go:299] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-ovndb-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217045 5030 reconciler_common.go:299] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-internal-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217053 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217079 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6be6653-85cb-4980-934b-a4835fed9ec1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217091 5030 reconciler_common.go:299] "Volume detached for volume \"local-storage14-crc\" (UniqueName: \"kubernetes.io/local-volume/local-storage14-crc\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217101 5030 reconciler_common.go:299] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-httpd-config\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.217109 5030 reconciler_common.go:299] "Volume detached for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/f13f0eb0-2368-4ac1-8135-61e138b551f2-public-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.459465 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.461066 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.462756 5030 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" cmd=["/usr/bin/pgrep","-r","DRST","nova-conductor"] Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.462892 5030 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openstack-kuttl-tests/nova-cell1-conductor-0" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" probeResult="unknown" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.465314 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_neutron-6bb7556d4d-hp4sg_f13f0eb0-2368-4ac1-8135-61e138b551f2/neutron-api/0.log" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.465410 5030 generic.go:358] "Generic (PLEG): container finished" podID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerID="e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321" exitCode=137 Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.465873 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerDied","Data":"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321"} Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.465968 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" event={"ID":"f13f0eb0-2368-4ac1-8135-61e138b551f2","Type":"ContainerDied","Data":"f923032b894642c19b84619320c1a3b108481e7a9d28a05c2dadff50da9e7451"} Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.466036 5030 scope.go:117] "RemoveContainer" containerID="d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.466339 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.471343 5030 generic.go:358] "Generic (PLEG): container finished" podID="07969d90-48f5-40c7-83df-10f59ad41589" containerID="6099679102d083b474c9ddfd661c9831f56d26793167606899cdbc4988425712" exitCode=137 Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.471445 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerDied","Data":"6099679102d083b474c9ddfd661c9831f56d26793167606899cdbc4988425712"} Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.483245 5030 generic.go:358] "Generic (PLEG): container finished" podID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerID="0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c" exitCode=137 Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.483504 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/swift-storage-0" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.483374 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c"} Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.483583 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/swift-storage-0" event={"ID":"f6be6653-85cb-4980-934b-a4835fed9ec1","Type":"ContainerDied","Data":"92544a801a8f87e09948f8cacbd43f5db3b6210c5aab5a896988a54d9e45e6c3"} Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.504875 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.509136 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/neutron-6bb7556d4d-hp4sg"] Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.517302 5030 scope.go:117] "RemoveContainer" containerID="e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.592421 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.597216 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/swift-storage-0"] Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.602779 5030 scope.go:117] "RemoveContainer" containerID="d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815" Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.603482 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815\": container with ID starting with d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815 not found: ID does not exist" containerID="d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.603515 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815"} err="failed to get container status \"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815\": rpc error: code = NotFound desc = could not find container \"d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815\": container with ID starting with d0225da7c708e2aefad3fcb2ca99a8c66797ff0037cf942056b4d33a5cb40815 not found: ID does not exist" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.603538 5030 scope.go:117] "RemoveContainer" containerID="e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321" Mar 16 13:50:32 crc kubenswrapper[5030]: E0316 13:50:32.603934 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321\": container with ID starting with e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321 not found: ID does not exist" containerID="e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.603958 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321"} err="failed to get container status \"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321\": rpc error: code = NotFound desc = could not find container \"e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321\": container with ID starting with e9e7f7b27ffa398555ea24707eec54424fcc074d83e3e80b073ad865c2438321 not found: ID does not exist" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.603974 5030 scope.go:117] "RemoveContainer" containerID="0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.620568 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.624151 5030 scope.go:117] "RemoveContainer" containerID="959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.690888 5030 scope.go:117] "RemoveContainer" containerID="c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.709709 5030 scope.go:117] "RemoveContainer" containerID="1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726223 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726315 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgfpg\" (UniqueName: \"kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726339 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726524 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726620 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.726683 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts\") pod \"07969d90-48f5-40c7-83df-10f59ad41589\" (UID: \"07969d90-48f5-40c7-83df-10f59ad41589\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.728307 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.731084 5030 scope.go:117] "RemoveContainer" containerID="f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.735885 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.735942 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg" (OuterVolumeSpecName: "kube-api-access-sgfpg") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "kube-api-access-sgfpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.737394 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts" (OuterVolumeSpecName: "scripts") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.770870 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.813606 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data" (OuterVolumeSpecName: "config-data") pod "07969d90-48f5-40c7-83df-10f59ad41589" (UID: "07969d90-48f5-40c7-83df-10f59ad41589"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.829996 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.830047 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.830062 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgfpg\" (UniqueName: \"kubernetes.io/projected/07969d90-48f5-40c7-83df-10f59ad41589-kube-api-access-sgfpg\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.830076 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.830103 5030 reconciler_common.go:299] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/07969d90-48f5-40c7-83df-10f59ad41589-etc-machine-id\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.830113 5030 reconciler_common.go:299] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/07969d90-48f5-40c7-83df-10f59ad41589-config-data-custom\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.842030 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.850972 5030 scope.go:117] "RemoveContainer" containerID="f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.884568 5030 scope.go:117] "RemoveContainer" containerID="380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.931773 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw6js\" (UniqueName: \"kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js\") pod \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.931851 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data\") pod \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.931886 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle\") pod \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\" (UID: \"75d1095d-2898-4bc9-b9cf-585dcd96afe1\") " Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.934820 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js" (OuterVolumeSpecName: "kube-api-access-rw6js") pod "75d1095d-2898-4bc9-b9cf-585dcd96afe1" (UID: "75d1095d-2898-4bc9-b9cf-585dcd96afe1"). InnerVolumeSpecName "kube-api-access-rw6js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.977247 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data" (OuterVolumeSpecName: "config-data") pod "75d1095d-2898-4bc9-b9cf-585dcd96afe1" (UID: "75d1095d-2898-4bc9-b9cf-585dcd96afe1"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:32 crc kubenswrapper[5030]: I0316 13:50:32.977272 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "75d1095d-2898-4bc9-b9cf-585dcd96afe1" (UID: "75d1095d-2898-4bc9-b9cf-585dcd96afe1"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.033993 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw6js\" (UniqueName: \"kubernetes.io/projected/75d1095d-2898-4bc9-b9cf-585dcd96afe1-kube-api-access-rw6js\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.034023 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.034037 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/75d1095d-2898-4bc9-b9cf-585dcd96afe1-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.079192 5030 scope.go:117] "RemoveContainer" containerID="e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.123098 5030 scope.go:117] "RemoveContainer" containerID="f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.167011 5030 scope.go:117] "RemoveContainer" containerID="c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.179531 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.192107 5030 scope.go:117] "RemoveContainer" containerID="2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.219938 5030 scope.go:117] "RemoveContainer" containerID="be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.244782 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.246715 5030 scope.go:117] "RemoveContainer" containerID="a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.288882 5030 scope.go:117] "RemoveContainer" containerID="ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.316800 5030 scope.go:117] "RemoveContainer" containerID="38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.317049 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.343138 5030 scope.go:117] "RemoveContainer" containerID="0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.343517 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c\": container with ID starting with 0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c not found: ID does not exist" containerID="0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.343570 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c"} err="failed to get container status \"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c\": rpc error: code = NotFound desc = could not find container \"0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c\": container with ID starting with 0443a3c7938a6999d87754c5fd8185701f25b670ede48fad2012519cfd7d5d6c not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.343599 5030 scope.go:117] "RemoveContainer" containerID="959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.343934 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6\": container with ID starting with 959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6 not found: ID does not exist" containerID="959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.343958 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6"} err="failed to get container status \"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6\": rpc error: code = NotFound desc = could not find container \"959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6\": container with ID starting with 959f955a52fcd5abdd1993c0aea41851ac3ce12e23a614ac514f0f7f4a6470e6 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.343977 5030 scope.go:117] "RemoveContainer" containerID="c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.344414 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e\": container with ID starting with c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e not found: ID does not exist" containerID="c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.344448 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e"} err="failed to get container status \"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e\": rpc error: code = NotFound desc = could not find container \"c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e\": container with ID starting with c7821d17955435ae373c7fc3221f71f10425747f525f8cc2d433d99489c4d11e not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.344486 5030 scope.go:117] "RemoveContainer" containerID="1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.344774 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4\": container with ID starting with 1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4 not found: ID does not exist" containerID="1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.344813 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4"} err="failed to get container status \"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4\": rpc error: code = NotFound desc = could not find container \"1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4\": container with ID starting with 1b1404f7932e76698e2377dcbd66b27015abf2e977c73aaf6402b2918a005de4 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.344835 5030 scope.go:117] "RemoveContainer" containerID="f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.345064 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e\": container with ID starting with f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e not found: ID does not exist" containerID="f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345097 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e"} err="failed to get container status \"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e\": rpc error: code = NotFound desc = could not find container \"f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e\": container with ID starting with f975e0ee49c2b724c060e47dea331274049dc3204048e297103a129b8246885e not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345112 5030 scope.go:117] "RemoveContainer" containerID="f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.345332 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2\": container with ID starting with f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2 not found: ID does not exist" containerID="f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345373 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2"} err="failed to get container status \"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2\": rpc error: code = NotFound desc = could not find container \"f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2\": container with ID starting with f99117198bca8ecb6ace98dc94be8e12a48a935c537246b7094d8382a5ed04f2 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345390 5030 scope.go:117] "RemoveContainer" containerID="380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.345611 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3\": container with ID starting with 380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3 not found: ID does not exist" containerID="380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345632 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3"} err="failed to get container status \"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3\": rpc error: code = NotFound desc = could not find container \"380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3\": container with ID starting with 380458a3ce5de8df23eb566cf83af33a295bce45e9b9096bccf15b13d33c9bb3 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345645 5030 scope.go:117] "RemoveContainer" containerID="e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345851 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle\") pod \"6dbca707-c128-4a20-9bf3-534401a1130b\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.345849 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8\": container with ID starting with e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8 not found: ID does not exist" containerID="e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345971 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8"} err="failed to get container status \"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8\": rpc error: code = NotFound desc = could not find container \"e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8\": container with ID starting with e4705078f7305e1a07a725c24891e3316f874e9f284d1073e9090e5cf685bfd8 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.345987 5030 scope.go:117] "RemoveContainer" containerID="f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.346030 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle\") pod \"f7a57a6e-d01f-4242-8296-14247847d0b7\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.346074 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdkk5\" (UniqueName: \"kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5\") pod \"6dbca707-c128-4a20-9bf3-534401a1130b\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.346136 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data\") pod \"6dbca707-c128-4a20-9bf3-534401a1130b\" (UID: \"6dbca707-c128-4a20-9bf3-534401a1130b\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.346372 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data\") pod \"f7a57a6e-d01f-4242-8296-14247847d0b7\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.346415 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p4f8\" (UniqueName: \"kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8\") pod \"f7a57a6e-d01f-4242-8296-14247847d0b7\" (UID: \"f7a57a6e-d01f-4242-8296-14247847d0b7\") " Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.347763 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450\": container with ID starting with f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450 not found: ID does not exist" containerID="f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.347815 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450"} err="failed to get container status \"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450\": rpc error: code = NotFound desc = could not find container \"f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450\": container with ID starting with f35d72a323433789e5f52e68fb017b7e1c4939709f54888adba1ab57a35cd450 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.347853 5030 scope.go:117] "RemoveContainer" containerID="c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.348879 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5" (OuterVolumeSpecName: "kube-api-access-vdkk5") pod "6dbca707-c128-4a20-9bf3-534401a1130b" (UID: "6dbca707-c128-4a20-9bf3-534401a1130b"). InnerVolumeSpecName "kube-api-access-vdkk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.348974 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763\": container with ID starting with c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763 not found: ID does not exist" containerID="c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.348999 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763"} err="failed to get container status \"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763\": rpc error: code = NotFound desc = could not find container \"c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763\": container with ID starting with c8acd6dffe83c71c9d65d98f7c7518f75e39a875ab38a92fe42747fdbaa0c763 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349015 5030 scope.go:117] "RemoveContainer" containerID="2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349495 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8" (OuterVolumeSpecName: "kube-api-access-8p4f8") pod "f7a57a6e-d01f-4242-8296-14247847d0b7" (UID: "f7a57a6e-d01f-4242-8296-14247847d0b7"). InnerVolumeSpecName "kube-api-access-8p4f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.349590 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb\": container with ID starting with 2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb not found: ID does not exist" containerID="2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349612 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb"} err="failed to get container status \"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb\": rpc error: code = NotFound desc = could not find container \"2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb\": container with ID starting with 2954b9515b0f5f5159220c165378806e069bd2b8512dd39721f74b279ecfcfeb not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349628 5030 scope.go:117] "RemoveContainer" containerID="be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.349854 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71\": container with ID starting with be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71 not found: ID does not exist" containerID="be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349868 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71"} err="failed to get container status \"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71\": rpc error: code = NotFound desc = could not find container \"be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71\": container with ID starting with be278edbacc03c9f0cc8791295b5afd7f73f49fdd99241e051089ac5f929db71 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.349882 5030 scope.go:117] "RemoveContainer" containerID="a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.350068 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969\": container with ID starting with a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969 not found: ID does not exist" containerID="a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.350083 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969"} err="failed to get container status \"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969\": rpc error: code = NotFound desc = could not find container \"a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969\": container with ID starting with a7d664da7ea261b410b70fd1c1608f0413b1c87529d079d8c391493d3014b969 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.350094 5030 scope.go:117] "RemoveContainer" containerID="ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.350283 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd\": container with ID starting with ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd not found: ID does not exist" containerID="ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.350298 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd"} err="failed to get container status \"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd\": rpc error: code = NotFound desc = could not find container \"ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd\": container with ID starting with ac5fdbddbb944874dc5f98426b1c38f2a4c99289ebfcd1802a33dbd9f6053edd not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.350309 5030 scope.go:117] "RemoveContainer" containerID="38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.350476 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540\": container with ID starting with 38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540 not found: ID does not exist" containerID="38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.350490 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540"} err="failed to get container status \"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540\": rpc error: code = NotFound desc = could not find container \"38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540\": container with ID starting with 38f19e591d2042c0d4aa2e2085e2e679e8c4c4588d1a78f3f4e0e54a9c9c4540 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.361587 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f7a57a6e-d01f-4242-8296-14247847d0b7" (UID: "f7a57a6e-d01f-4242-8296-14247847d0b7"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.362653 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6dbca707-c128-4a20-9bf3-534401a1130b" (UID: "6dbca707-c128-4a20-9bf3-534401a1130b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.362798 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data" (OuterVolumeSpecName: "config-data") pod "6dbca707-c128-4a20-9bf3-534401a1130b" (UID: "6dbca707-c128-4a20-9bf3-534401a1130b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.364740 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data" (OuterVolumeSpecName: "config-data") pod "f7a57a6e-d01f-4242-8296-14247847d0b7" (UID: "f7a57a6e-d01f-4242-8296-14247847d0b7"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.448658 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.448852 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.448937 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449002 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449211 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449187 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd" (OuterVolumeSpecName: "log-httpd") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "log-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449334 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449332 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd" (OuterVolumeSpecName: "run-httpd") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "run-httpd". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449447 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.449627 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6w6n\" (UniqueName: \"kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n\") pod \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\" (UID: \"6ea88cc6-e675-4bfd-86a7-684f821b50ca\") " Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450889 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450913 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p4f8\" (UniqueName: \"kubernetes.io/projected/f7a57a6e-d01f-4242-8296-14247847d0b7-kube-api-access-8p4f8\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450924 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450934 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f7a57a6e-d01f-4242-8296-14247847d0b7-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450943 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdkk5\" (UniqueName: \"kubernetes.io/projected/6dbca707-c128-4a20-9bf3-534401a1130b-kube-api-access-vdkk5\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450955 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6dbca707-c128-4a20-9bf3-534401a1130b-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450963 5030 reconciler_common.go:299] "Volume detached for volume \"log-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-log-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.450974 5030 reconciler_common.go:299] "Volume detached for volume \"run-httpd\" (UniqueName: \"kubernetes.io/empty-dir/6ea88cc6-e675-4bfd-86a7-684f821b50ca-run-httpd\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.453149 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts" (OuterVolumeSpecName: "scripts") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.453457 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n" (OuterVolumeSpecName: "kube-api-access-w6w6n") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "kube-api-access-w6w6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.467040 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml" (OuterVolumeSpecName: "sg-core-conf-yaml") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "sg-core-conf-yaml". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.478829 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs" (OuterVolumeSpecName: "ceilometer-tls-certs") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "ceilometer-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.489972 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.494175 5030 generic.go:358] "Generic (PLEG): container finished" podID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" exitCode=137 Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.494263 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f7a57a6e-d01f-4242-8296-14247847d0b7","Type":"ContainerDied","Data":"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.494330 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell1-conductor-0" event={"ID":"f7a57a6e-d01f-4242-8296-14247847d0b7","Type":"ContainerDied","Data":"f986da30de647107b6fbbd4410a9fffacda3c61071bb9b8fd07307ae427b43a7"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.494352 5030 scope.go:117] "RemoveContainer" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.494395 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell1-conductor-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.497271 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/cinder-scheduler-0" event={"ID":"07969d90-48f5-40c7-83df-10f59ad41589","Type":"ContainerDied","Data":"a2f1518966b7da306601410263c42183bb5e08dc004942c6ab231190b483b341"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.497399 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/cinder-scheduler-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.500521 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data" (OuterVolumeSpecName: "config-data") pod "6ea88cc6-e675-4bfd-86a7-684f821b50ca" (UID: "6ea88cc6-e675-4bfd-86a7-684f821b50ca"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGIDValue "" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.504096 5030 generic.go:358] "Generic (PLEG): container finished" podID="6dbca707-c128-4a20-9bf3-534401a1130b" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" exitCode=137 Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.504222 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-cell0-conductor-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.504222 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6dbca707-c128-4a20-9bf3-534401a1130b","Type":"ContainerDied","Data":"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.504299 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-cell0-conductor-0" event={"ID":"6dbca707-c128-4a20-9bf3-534401a1130b","Type":"ContainerDied","Data":"78c176cef487f9129a1bd48e5129e2be4293feb40e00c323a4fa59c1fba6d616"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.506288 5030 generic.go:358] "Generic (PLEG): container finished" podID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" exitCode=137 Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.506332 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"75d1095d-2898-4bc9-b9cf-585dcd96afe1","Type":"ContainerDied","Data":"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.506381 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/nova-scheduler-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.506381 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/nova-scheduler-0" event={"ID":"75d1095d-2898-4bc9-b9cf-585dcd96afe1","Type":"ContainerDied","Data":"7ad2a76088274465e7795a5c8a7f24c1046af4014e9cb4e7f160d5c05b948340"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.509850 5030 generic.go:358] "Generic (PLEG): container finished" podID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerID="9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93" exitCode=137 Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.509976 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerDied","Data":"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.510002 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openstack-kuttl-tests/ceilometer-0" event={"ID":"6ea88cc6-e675-4bfd-86a7-684f821b50ca","Type":"ContainerDied","Data":"d6da3be6b84d48ba26c02ed34cf235b7bb6a5041ad82d7cd4e2cf99dbeb95d72"} Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.510012 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-kuttl-tests/ceilometer-0" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.521274 5030 scope.go:117] "RemoveContainer" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.521763 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac\": container with ID starting with a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac not found: ID does not exist" containerID="a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.521805 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac"} err="failed to get container status \"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac\": rpc error: code = NotFound desc = could not find container \"a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac\": container with ID starting with a011ba58224f4cc33c6924de2063b4c29c1bd7abe17152836cc6d2fb47af88ac not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.521824 5030 scope.go:117] "RemoveContainer" containerID="0afa20db4ecbcb36232ca7614fe3c74b15da50f67a1bd02fa80881b9803dc867" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.549249 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552637 5030 reconciler_common.go:299] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-config-data\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552672 5030 reconciler_common.go:299] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-scripts\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552684 5030 reconciler_common.go:299] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-combined-ca-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552697 5030 reconciler_common.go:299] "Volume detached for volume \"sg-core-conf-yaml\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-sg-core-conf-yaml\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552706 5030 reconciler_common.go:299] "Volume detached for volume \"ceilometer-tls-certs\" (UniqueName: \"kubernetes.io/secret/6ea88cc6-e675-4bfd-86a7-684f821b50ca-ceilometer-tls-certs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.552716 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6w6n\" (UniqueName: \"kubernetes.io/projected/6ea88cc6-e675-4bfd-86a7-684f821b50ca-kube-api-access-w6w6n\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.554708 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/cinder-scheduler-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.563419 5030 scope.go:117] "RemoveContainer" containerID="6099679102d083b474c9ddfd661c9831f56d26793167606899cdbc4988425712" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.570156 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.579003 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell0-conductor-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.594825 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.596846 5030 scope.go:117] "RemoveContainer" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.601993 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-cell1-conductor-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.606466 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.610339 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/nova-scheduler-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.614638 5030 scope.go:117] "RemoveContainer" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.614995 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80\": container with ID starting with d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80 not found: ID does not exist" containerID="d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.615038 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80"} err="failed to get container status \"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80\": rpc error: code = NotFound desc = could not find container \"d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80\": container with ID starting with d9d562fdab6d90ec7157503c0b3285f38675dbfb43218edecc1e4505cc263c80 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.615067 5030 scope.go:117] "RemoveContainer" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.616785 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.628333 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openstack-kuttl-tests/ceilometer-0"] Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.629438 5030 scope.go:117] "RemoveContainer" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.629732 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081\": container with ID starting with bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081 not found: ID does not exist" containerID="bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.629757 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081"} err="failed to get container status \"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081\": rpc error: code = NotFound desc = could not find container \"bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081\": container with ID starting with bbad3be43a240d6bb39a383efe85d664e43a021a860524ffe6e5d0e2c7493081 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.629772 5030 scope.go:117] "RemoveContainer" containerID="5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.691099 5030 scope.go:117] "RemoveContainer" containerID="1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.705520 5030 scope.go:117] "RemoveContainer" containerID="9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.721790 5030 scope.go:117] "RemoveContainer" containerID="d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.740281 5030 scope.go:117] "RemoveContainer" containerID="5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.740990 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b\": container with ID starting with 5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b not found: ID does not exist" containerID="5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.741033 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b"} err="failed to get container status \"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b\": rpc error: code = NotFound desc = could not find container \"5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b\": container with ID starting with 5e32b35b51d0a4b1bc0a7d2f412307285d6b8d03a040ac0a51fcd8f2a4c8958b not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.741083 5030 scope.go:117] "RemoveContainer" containerID="1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.741659 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c\": container with ID starting with 1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c not found: ID does not exist" containerID="1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.741723 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c"} err="failed to get container status \"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c\": rpc error: code = NotFound desc = could not find container \"1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c\": container with ID starting with 1f3adb0aa2d49376e9eb9785f0d869e3b625c77bc384554d40a513263aa0fd7c not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.741763 5030 scope.go:117] "RemoveContainer" containerID="9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.742260 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93\": container with ID starting with 9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93 not found: ID does not exist" containerID="9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.742291 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93"} err="failed to get container status \"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93\": rpc error: code = NotFound desc = could not find container \"9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93\": container with ID starting with 9548306cbc7be9ee4b3ccbfa9768d755f2b217847f26feebfa7f74d2c4f53c93 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.742326 5030 scope.go:117] "RemoveContainer" containerID="d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66" Mar 16 13:50:33 crc kubenswrapper[5030]: E0316 13:50:33.742930 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66\": container with ID starting with d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66 not found: ID does not exist" containerID="d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.742971 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66"} err="failed to get container status \"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66\": rpc error: code = NotFound desc = could not find container \"d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66\": container with ID starting with d436db609c6f8e4a33870d35fb5429c3c0ae84b4a91d22d386990e0aae6d6f66 not found: ID does not exist" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.956620 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07969d90-48f5-40c7-83df-10f59ad41589" path="/var/lib/kubelet/pods/07969d90-48f5-40c7-83df-10f59ad41589/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.957269 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" path="/var/lib/kubelet/pods/6dbca707-c128-4a20-9bf3-534401a1130b/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.958285 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" path="/var/lib/kubelet/pods/6ea88cc6-e675-4bfd-86a7-684f821b50ca/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.959563 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" path="/var/lib/kubelet/pods/75d1095d-2898-4bc9-b9cf-585dcd96afe1/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.960090 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" path="/var/lib/kubelet/pods/f13f0eb0-2368-4ac1-8135-61e138b551f2/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.960805 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" path="/var/lib/kubelet/pods/f6be6653-85cb-4980-934b-a4835fed9ec1/volumes" Mar 16 13:50:33 crc kubenswrapper[5030]: I0316 13:50:33.963238 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" path="/var/lib/kubelet/pods/f7a57a6e-d01f-4242-8296-14247847d0b7/volumes" Mar 16 13:50:36 crc kubenswrapper[5030]: I0316 13:50:36.257739 5030 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","besteffort","pod47704920-9f8b-43b2-b573-737ba9deeea8"] err="unable to destroy cgroup paths for cgroup [kubepods besteffort pod47704920-9f8b-43b2-b573-737ba9deeea8] : Timed out while waiting for systemd to remove kubepods-besteffort-pod47704920_9f8b_43b2_b573_737ba9deeea8.slice" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.653331 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-rbb8g"] Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.658144 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-rbb8g"] Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.746814 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-mcvsz"] Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747646 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="cinder-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747675 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="cinder-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747686 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747692 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747708 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747714 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747724 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95eedf89-5260-4150-88a1-eb6ca5eab829" containerName="oc" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747729 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="95eedf89-5260-4150-88a1-eb6ca5eab829" containerName="oc" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747739 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747745 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747755 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="init" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747760 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="init" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747767 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-notification-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747775 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-notification-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747783 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-expirer" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747789 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-expirer" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747797 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="swift-recon-cron" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747802 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="swift-recon-cron" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747811 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="probe" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747815 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="probe" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747822 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747828 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747833 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="registry-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747838 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="registry-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747847 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="setup-container" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747852 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="setup-container" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747860 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747867 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747873 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" containerName="keystone-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747878 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" containerName="keystone-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747885 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747890 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747897 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-central-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747902 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-central-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747910 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747915 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747922 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747927 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747938 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="rsync" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747943 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="rsync" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747949 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747956 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747962 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747967 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747972 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747977 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747983 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747988 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747995 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.747999 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748008 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748013 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748021 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748027 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748033 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748039 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748046 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748050 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748057 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748062 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748072 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748076 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748084 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748090 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748097 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="dnsmasq-dns" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748120 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="dnsmasq-dns" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748130 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748135 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748143 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="setup-container" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748149 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="setup-container" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748160 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="extract-utilities" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748166 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="extract-utilities" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748173 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748178 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748186 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="sg-core" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748191 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="sg-core" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748198 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748203 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748211 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="extract-content" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748216 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="extract-content" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748222 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748227 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748236 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-reaper" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748241 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-reaper" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748249 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="proxy-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748258 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="proxy-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748380 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748389 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-central-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748399 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-expirer" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748406 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748414 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748422 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748432 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748440 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="ceilometer-notification-agent" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748449 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748458 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748465 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f7a57a6e-d01f-4242-8296-14247847d0b7" containerName="nova-cell1-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748473 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7312deb2-9151-455b-898f-ae0403364b7e" containerName="registry-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748480 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="proxy-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748490 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748498 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748506 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="swift-recon-cron" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748512 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-auditor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748518 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="probe" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748526 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="container-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748532 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c59eb5b-6079-45f0-828c-d4757cd3ed92" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748538 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="596265d5-481b-4e3c-8577-e99f029f8cc2" containerName="dnsmasq-dns" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748543 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-httpd" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748565 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-replicator" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748573 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="rsync" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748580 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f13f0eb0-2368-4ac1-8135-61e138b551f2" containerName="neutron-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748587 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-reaper" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748594 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="account-server" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748600 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="95eedf89-5260-4150-88a1-eb6ca5eab829" containerName="oc" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748606 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6be6653-85cb-4980-934b-a4835fed9ec1" containerName="object-updater" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748614 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fe4c41b-8e7e-4a5b-8067-b85b9e48c475" containerName="barbican-keystone-listener-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748622 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="92cd8b90-d16f-4a1b-b2c8-0cb160ca548c" containerName="barbican-worker-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748629 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="7840f19b-4f77-48da-b8c3-4e5c3e57b412" containerName="keystone-api" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748637 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c343cbc-4e5f-491c-94cd-2009f724dfce" containerName="glance-log" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748643 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dbca707-c128-4a20-9bf3-534401a1130b" containerName="nova-cell0-conductor-conductor" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748650 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ea88cc6-e675-4bfd-86a7-684f821b50ca" containerName="sg-core" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748665 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="919191a9-6df8-4a0b-a04d-0c60c6a01b69" containerName="rabbitmq" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748672 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="07969d90-48f5-40c7-83df-10f59ad41589" containerName="cinder-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.748679 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="75d1095d-2898-4bc9-b9cf-585dcd96afe1" containerName="nova-scheduler-scheduler" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.755104 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.757603 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.757831 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.759058 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.759381 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mcvsz"] Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.762045 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.878005 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.878148 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqd8\" (UniqueName: \"kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.878415 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.980565 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.980628 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqd8\" (UniqueName: \"kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.980730 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.981056 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:40 crc kubenswrapper[5030]: I0316 13:50:40.981576 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:41 crc kubenswrapper[5030]: I0316 13:50:41.000487 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqd8\" (UniqueName: \"kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8\") pod \"crc-storage-crc-mcvsz\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:41 crc kubenswrapper[5030]: I0316 13:50:41.076083 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:41 crc kubenswrapper[5030]: I0316 13:50:41.460068 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-mcvsz"] Mar 16 13:50:41 crc kubenswrapper[5030]: I0316 13:50:41.611977 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mcvsz" event={"ID":"f61c821f-7bf0-4a93-beba-38c29f3e2049","Type":"ContainerStarted","Data":"a1071d0849f6ed0b10e3015331d054560851cb6d656411b6f9508bd0ce93ac55"} Mar 16 13:50:41 crc kubenswrapper[5030]: I0316 13:50:41.956113 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a89ee67-c2b5-4b41-9ca0-c5b98e75a234" path="/var/lib/kubelet/pods/5a89ee67-c2b5-4b41-9ca0-c5b98e75a234/volumes" Mar 16 13:50:42 crc kubenswrapper[5030]: I0316 13:50:42.625156 5030 generic.go:358] "Generic (PLEG): container finished" podID="f61c821f-7bf0-4a93-beba-38c29f3e2049" containerID="b7a2ea990f297cfd6e47b54dcdc03b50dabd2f7cf4fa1fd98aa8f23936041110" exitCode=0 Mar 16 13:50:42 crc kubenswrapper[5030]: I0316 13:50:42.625240 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mcvsz" event={"ID":"f61c821f-7bf0-4a93-beba-38c29f3e2049","Type":"ContainerDied","Data":"b7a2ea990f297cfd6e47b54dcdc03b50dabd2f7cf4fa1fd98aa8f23936041110"} Mar 16 13:50:43 crc kubenswrapper[5030]: I0316 13:50:43.882768 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.033738 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsqd8\" (UniqueName: \"kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8\") pod \"f61c821f-7bf0-4a93-beba-38c29f3e2049\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.033967 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage\") pod \"f61c821f-7bf0-4a93-beba-38c29f3e2049\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.034041 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt\") pod \"f61c821f-7bf0-4a93-beba-38c29f3e2049\" (UID: \"f61c821f-7bf0-4a93-beba-38c29f3e2049\") " Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.034137 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "f61c821f-7bf0-4a93-beba-38c29f3e2049" (UID: "f61c821f-7bf0-4a93-beba-38c29f3e2049"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.034783 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/f61c821f-7bf0-4a93-beba-38c29f3e2049-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.041167 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8" (OuterVolumeSpecName: "kube-api-access-bsqd8") pod "f61c821f-7bf0-4a93-beba-38c29f3e2049" (UID: "f61c821f-7bf0-4a93-beba-38c29f3e2049"). InnerVolumeSpecName "kube-api-access-bsqd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.052962 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "f61c821f-7bf0-4a93-beba-38c29f3e2049" (UID: "f61c821f-7bf0-4a93-beba-38c29f3e2049"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.136373 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/f61c821f-7bf0-4a93-beba-38c29f3e2049-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.136407 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsqd8\" (UniqueName: \"kubernetes.io/projected/f61c821f-7bf0-4a93-beba-38c29f3e2049-kube-api-access-bsqd8\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.647563 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-mcvsz" Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.647568 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-mcvsz" event={"ID":"f61c821f-7bf0-4a93-beba-38c29f3e2049","Type":"ContainerDied","Data":"a1071d0849f6ed0b10e3015331d054560851cb6d656411b6f9508bd0ce93ac55"} Mar 16 13:50:44 crc kubenswrapper[5030]: I0316 13:50:44.647626 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1071d0849f6ed0b10e3015331d054560851cb6d656411b6f9508bd0ce93ac55" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.744982 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["crc-storage/crc-storage-crc-mcvsz"] Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.751685 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["crc-storage/crc-storage-crc-mcvsz"] Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.842890 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["crc-storage/crc-storage-crc-v9b5m"] Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.843878 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61c821f-7bf0-4a93-beba-38c29f3e2049" containerName="storage" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.843902 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61c821f-7bf0-4a93-beba-38c29f3e2049" containerName="storage" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.844037 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="f61c821f-7bf0-4a93-beba-38c29f3e2049" containerName="storage" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.847286 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.849153 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-v9b5m"] Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.849700 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"crc-storage\"" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.849971 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"openshift-service-ca.crt\"" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.850136 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"crc-storage\"/\"crc-storage-dockercfg-8qn9n\"" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.852121 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"crc-storage\"/\"kube-root-ca.crt\"" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.884873 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.885052 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.885160 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdkxs\" (UniqueName: \"kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.987803 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.987926 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.987981 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdkxs\" (UniqueName: \"kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.989392 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:46 crc kubenswrapper[5030]: I0316 13:50:46.989730 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:47 crc kubenswrapper[5030]: I0316 13:50:47.011538 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdkxs\" (UniqueName: \"kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs\") pod \"crc-storage-crc-v9b5m\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:47 crc kubenswrapper[5030]: I0316 13:50:47.166623 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:47 crc kubenswrapper[5030]: I0316 13:50:47.537529 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["crc-storage/crc-storage-crc-v9b5m"] Mar 16 13:50:47 crc kubenswrapper[5030]: I0316 13:50:47.680335 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v9b5m" event={"ID":"d044b14d-806d-4e65-a2a3-8194b7ddaa06","Type":"ContainerStarted","Data":"43b727873b6188bdcbd212de4c2c53766fe47d21bcf9f3e2efb890cfcbaa49e3"} Mar 16 13:50:47 crc kubenswrapper[5030]: I0316 13:50:47.957367 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61c821f-7bf0-4a93-beba-38c29f3e2049" path="/var/lib/kubelet/pods/f61c821f-7bf0-4a93-beba-38c29f3e2049/volumes" Mar 16 13:50:48 crc kubenswrapper[5030]: I0316 13:50:48.695982 5030 generic.go:358] "Generic (PLEG): container finished" podID="d044b14d-806d-4e65-a2a3-8194b7ddaa06" containerID="0a0c188d35be04e14c4ee30029e691c151ee38bd82f745673b977ca3030b4c6c" exitCode=0 Mar 16 13:50:48 crc kubenswrapper[5030]: I0316 13:50:48.696066 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v9b5m" event={"ID":"d044b14d-806d-4e65-a2a3-8194b7ddaa06","Type":"ContainerDied","Data":"0a0c188d35be04e14c4ee30029e691c151ee38bd82f745673b977ca3030b4c6c"} Mar 16 13:50:49 crc kubenswrapper[5030]: I0316 13:50:49.968371 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.048418 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdkxs\" (UniqueName: \"kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs\") pod \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.048603 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage\") pod \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.048732 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt\") pod \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\" (UID: \"d044b14d-806d-4e65-a2a3-8194b7ddaa06\") " Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.048873 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt" (OuterVolumeSpecName: "node-mnt") pod "d044b14d-806d-4e65-a2a3-8194b7ddaa06" (UID: "d044b14d-806d-4e65-a2a3-8194b7ddaa06"). InnerVolumeSpecName "node-mnt". PluginName "kubernetes.io/host-path", VolumeGIDValue "" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.049498 5030 reconciler_common.go:299] "Volume detached for volume \"node-mnt\" (UniqueName: \"kubernetes.io/host-path/d044b14d-806d-4e65-a2a3-8194b7ddaa06-node-mnt\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.054033 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs" (OuterVolumeSpecName: "kube-api-access-xdkxs") pod "d044b14d-806d-4e65-a2a3-8194b7ddaa06" (UID: "d044b14d-806d-4e65-a2a3-8194b7ddaa06"). InnerVolumeSpecName "kube-api-access-xdkxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.064023 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage" (OuterVolumeSpecName: "crc-storage") pod "d044b14d-806d-4e65-a2a3-8194b7ddaa06" (UID: "d044b14d-806d-4e65-a2a3-8194b7ddaa06"). InnerVolumeSpecName "crc-storage". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.151197 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdkxs\" (UniqueName: \"kubernetes.io/projected/d044b14d-806d-4e65-a2a3-8194b7ddaa06-kube-api-access-xdkxs\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.151229 5030 reconciler_common.go:299] "Volume detached for volume \"crc-storage\" (UniqueName: \"kubernetes.io/configmap/d044b14d-806d-4e65-a2a3-8194b7ddaa06-crc-storage\") on node \"crc\" DevicePath \"\"" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.719014 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="crc-storage/crc-storage-crc-v9b5m" event={"ID":"d044b14d-806d-4e65-a2a3-8194b7ddaa06","Type":"ContainerDied","Data":"43b727873b6188bdcbd212de4c2c53766fe47d21bcf9f3e2efb890cfcbaa49e3"} Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.719096 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43b727873b6188bdcbd212de4c2c53766fe47d21bcf9f3e2efb890cfcbaa49e3" Mar 16 13:50:50 crc kubenswrapper[5030]: I0316 13:50:50.719042 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="crc-storage/crc-storage-crc-v9b5m" Mar 16 13:50:53 crc kubenswrapper[5030]: E0316 13:50:53.635620 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1176223 actualBytes=10240 Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.864690 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh"] Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.865524 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d044b14d-806d-4e65-a2a3-8194b7ddaa06" containerName="storage" Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.865540 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="d044b14d-806d-4e65-a2a3-8194b7ddaa06" containerName="storage" Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.865692 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="d044b14d-806d-4e65-a2a3-8194b7ddaa06" containerName="storage" Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.879062 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh"] Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.879216 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:54 crc kubenswrapper[5030]: I0316 13:50:54.883745 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b2ccr\"" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.044746 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2d6w\" (UniqueName: \"kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.045243 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.045473 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.146643 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.146758 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.146802 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2d6w\" (UniqueName: \"kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.147535 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.147617 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.167817 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2d6w\" (UniqueName: \"kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w\") pod \"98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.200450 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.614599 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh"] Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.771765 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerStarted","Data":"baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad"} Mar 16 13:50:55 crc kubenswrapper[5030]: I0316 13:50:55.772185 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerStarted","Data":"a9406656eb818e7d90a7f4e42d749e2c8433b65b586f7fdd76ca91ac505dc831"} Mar 16 13:50:56 crc kubenswrapper[5030]: E0316 13:50:56.575350 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:50:56 crc kubenswrapper[5030]: I0316 13:50:56.786040 5030 generic.go:358] "Generic (PLEG): container finished" podID="625cf0ec-73a5-49a0-8736-87f258e50826" containerID="baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad" exitCode=0 Mar 16 13:50:56 crc kubenswrapper[5030]: I0316 13:50:56.786300 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerDied","Data":"baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad"} Mar 16 13:50:57 crc kubenswrapper[5030]: I0316 13:50:57.214878 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:50:57 crc kubenswrapper[5030]: I0316 13:50:57.221245 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:50:57 crc kubenswrapper[5030]: I0316 13:50:57.270188 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:50:57 crc kubenswrapper[5030]: I0316 13:50:57.278172 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:50:58 crc kubenswrapper[5030]: I0316 13:50:58.809191 5030 generic.go:358] "Generic (PLEG): container finished" podID="625cf0ec-73a5-49a0-8736-87f258e50826" containerID="5646e188622c3334d497e2de63c673c24fac8aead98a969f07f5f69e83f028db" exitCode=0 Mar 16 13:50:58 crc kubenswrapper[5030]: I0316 13:50:58.809262 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerDied","Data":"5646e188622c3334d497e2de63c673c24fac8aead98a969f07f5f69e83f028db"} Mar 16 13:50:59 crc kubenswrapper[5030]: I0316 13:50:59.823063 5030 generic.go:358] "Generic (PLEG): container finished" podID="625cf0ec-73a5-49a0-8736-87f258e50826" containerID="7c8e1282aeb07c9088732ccbdd96c10a00fed0b2dc48458731e48959894aac1f" exitCode=0 Mar 16 13:50:59 crc kubenswrapper[5030]: I0316 13:50:59.823114 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerDied","Data":"7c8e1282aeb07c9088732ccbdd96c10a00fed0b2dc48458731e48959894aac1f"} Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.091160 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.186855 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util\") pod \"625cf0ec-73a5-49a0-8736-87f258e50826\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.187129 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2d6w\" (UniqueName: \"kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w\") pod \"625cf0ec-73a5-49a0-8736-87f258e50826\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.187249 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle\") pod \"625cf0ec-73a5-49a0-8736-87f258e50826\" (UID: \"625cf0ec-73a5-49a0-8736-87f258e50826\") " Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.190741 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle" (OuterVolumeSpecName: "bundle") pod "625cf0ec-73a5-49a0-8736-87f258e50826" (UID: "625cf0ec-73a5-49a0-8736-87f258e50826"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.196275 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w" (OuterVolumeSpecName: "kube-api-access-g2d6w") pod "625cf0ec-73a5-49a0-8736-87f258e50826" (UID: "625cf0ec-73a5-49a0-8736-87f258e50826"). InnerVolumeSpecName "kube-api-access-g2d6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.289904 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2d6w\" (UniqueName: \"kubernetes.io/projected/625cf0ec-73a5-49a0-8736-87f258e50826-kube-api-access-g2d6w\") on node \"crc\" DevicePath \"\"" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.290025 5030 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-bundle\") on node \"crc\" DevicePath \"\"" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.311751 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util" (OuterVolumeSpecName: "util") pod "625cf0ec-73a5-49a0-8736-87f258e50826" (UID: "625cf0ec-73a5-49a0-8736-87f258e50826"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.392282 5030 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/625cf0ec-73a5-49a0-8736-87f258e50826-util\") on node \"crc\" DevicePath \"\"" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.845771 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" event={"ID":"625cf0ec-73a5-49a0-8736-87f258e50826","Type":"ContainerDied","Data":"a9406656eb818e7d90a7f4e42d749e2c8433b65b586f7fdd76ca91ac505dc831"} Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.845832 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9406656eb818e7d90a7f4e42d749e2c8433b65b586f7fdd76ca91ac505dc831" Mar 16 13:51:01 crc kubenswrapper[5030]: I0316 13:51:01.845856 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh" Mar 16 13:51:06 crc kubenswrapper[5030]: E0316 13:51:06.750420 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.301713 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303122 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="pull" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303137 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="pull" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303155 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="extract" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303162 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="extract" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303182 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="util" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303188 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="util" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.303313 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="625cf0ec-73a5-49a0-8736-87f258e50826" containerName="extract" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.306747 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.310271 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-dockercfg-gw6mv\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.311375 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.313765 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.333511 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.391859 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx9bc\" (UniqueName: \"kubernetes.io/projected/d6fd85f1-32b0-4570-acb3-7b1fb0867c1b-kube-api-access-tx9bc\") pod \"obo-prometheus-operator-9bc85b4bf-gbd62\" (UID: \"d6fd85f1-32b0-4570-acb3-7b1fb0867c1b\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.443005 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.446890 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.452278 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-admission-webhook-dockercfg-swk8x\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.452476 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"obo-prometheus-operator-admission-webhook-service-cert\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.458448 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.462394 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.462522 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.494500 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tx9bc\" (UniqueName: \"kubernetes.io/projected/d6fd85f1-32b0-4570-acb3-7b1fb0867c1b-kube-api-access-tx9bc\") pod \"obo-prometheus-operator-9bc85b4bf-gbd62\" (UID: \"d6fd85f1-32b0-4570-acb3-7b1fb0867c1b\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.534521 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx9bc\" (UniqueName: \"kubernetes.io/projected/d6fd85f1-32b0-4570-acb3-7b1fb0867c1b-kube-api-access-tx9bc\") pod \"obo-prometheus-operator-9bc85b4bf-gbd62\" (UID: \"d6fd85f1-32b0-4570-acb3-7b1fb0867c1b\") " pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.545293 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.596890 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.597106 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.597209 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.597349 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.625052 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-85c68dddb-tmk4r"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.626632 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.630081 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.638787 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"observability-operator-sa-dockercfg-lwwgn\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.639278 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"observability-operator-tls\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.649595 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-85c68dddb-tmk4r"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698686 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1da25c3-d735-49a7-8b68-6f19f08b22d0-observability-operator-tls\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698824 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2hc\" (UniqueName: \"kubernetes.io/projected/f1da25c3-d735-49a7-8b68-6f19f08b22d0-kube-api-access-pj2hc\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698880 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.698940 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.703541 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.703544 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb2de269-dadc-4a69-b46f-10c88e8eba95-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-r8xwr\" (UID: \"eb2de269-dadc-4a69-b46f-10c88e8eba95\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.713954 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.714064 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc235ee8-3961-47e5-84b5-12e947225302-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-576559b676-6gd9h\" (UID: \"cc235ee8-3961-47e5-84b5-12e947225302\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.760619 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.777860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.801587 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2hc\" (UniqueName: \"kubernetes.io/projected/f1da25c3-d735-49a7-8b68-6f19f08b22d0-kube-api-access-pj2hc\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.802035 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1da25c3-d735-49a7-8b68-6f19f08b22d0-observability-operator-tls\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.807489 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/f1da25c3-d735-49a7-8b68-6f19f08b22d0-observability-operator-tls\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.828442 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2hc\" (UniqueName: \"kubernetes.io/projected/f1da25c3-d735-49a7-8b68-6f19f08b22d0-kube-api-access-pj2hc\") pod \"observability-operator-85c68dddb-tmk4r\" (UID: \"f1da25c3-d735-49a7-8b68-6f19f08b22d0\") " pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.846303 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-b2wm6"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.853922 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.855263 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-b2wm6"] Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.856525 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"perses-operator-dockercfg-h94c9\"" Mar 16 13:51:12 crc kubenswrapper[5030]: I0316 13:51:12.946688 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.006330 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dfb35b-2857-483f-a058-3b267ab01cfd-openshift-service-ca\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.006401 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxf67\" (UniqueName: \"kubernetes.io/projected/a3dfb35b-2857-483f-a058-3b267ab01cfd-kube-api-access-qxf67\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.108160 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dfb35b-2857-483f-a058-3b267ab01cfd-openshift-service-ca\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.108223 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxf67\" (UniqueName: \"kubernetes.io/projected/a3dfb35b-2857-483f-a058-3b267ab01cfd-kube-api-access-qxf67\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.109452 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3dfb35b-2857-483f-a058-3b267ab01cfd-openshift-service-ca\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.118787 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62"] Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.131687 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxf67\" (UniqueName: \"kubernetes.io/projected/a3dfb35b-2857-483f-a058-3b267ab01cfd-kube-api-access-qxf67\") pod \"perses-operator-669c9f96b5-b2wm6\" (UID: \"a3dfb35b-2857-483f-a058-3b267ab01cfd\") " pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.199038 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.310001 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h"] Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.413072 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr"] Mar 16 13:51:13 crc kubenswrapper[5030]: W0316 13:51:13.522435 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1da25c3_d735_49a7_8b68_6f19f08b22d0.slice/crio-62d4460fd522872556de20b13af47eee3853773e3ef38cccd970747f01456807 WatchSource:0}: Error finding container 62d4460fd522872556de20b13af47eee3853773e3ef38cccd970747f01456807: Status 404 returned error can't find the container with id 62d4460fd522872556de20b13af47eee3853773e3ef38cccd970747f01456807 Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.523684 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-85c68dddb-tmk4r"] Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.669747 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-669c9f96b5-b2wm6"] Mar 16 13:51:13 crc kubenswrapper[5030]: W0316 13:51:13.674372 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dfb35b_2857_483f_a058_3b267ab01cfd.slice/crio-26674209ba76d6959745e1e9f9a2a37476f21d762471a839a6285f2ac7795344 WatchSource:0}: Error finding container 26674209ba76d6959745e1e9f9a2a37476f21d762471a839a6285f2ac7795344: Status 404 returned error can't find the container with id 26674209ba76d6959745e1e9f9a2a37476f21d762471a839a6285f2ac7795344 Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.968667 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" event={"ID":"f1da25c3-d735-49a7-8b68-6f19f08b22d0","Type":"ContainerStarted","Data":"62d4460fd522872556de20b13af47eee3853773e3ef38cccd970747f01456807"} Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.969830 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" event={"ID":"d6fd85f1-32b0-4570-acb3-7b1fb0867c1b","Type":"ContainerStarted","Data":"374227dcda1db4e4d20379b448980b754c038340cb37400057782b9d2d8fb725"} Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.971088 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" event={"ID":"eb2de269-dadc-4a69-b46f-10c88e8eba95","Type":"ContainerStarted","Data":"c6cfedd2c546501d894455e1ff98e950c8d68ff974448457132bc09b859a9cd4"} Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.972959 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" event={"ID":"cc235ee8-3961-47e5-84b5-12e947225302","Type":"ContainerStarted","Data":"709888ca7db1873b6a207788f00086069f02e23e9d9709b41654010179725657"} Mar 16 13:51:13 crc kubenswrapper[5030]: I0316 13:51:13.974473 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" event={"ID":"a3dfb35b-2857-483f-a058-3b267ab01cfd","Type":"ContainerStarted","Data":"26674209ba76d6959745e1e9f9a2a37476f21d762471a839a6285f2ac7795344"} Mar 16 13:51:16 crc kubenswrapper[5030]: E0316 13:51:16.943790 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.080003 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" event={"ID":"cc235ee8-3961-47e5-84b5-12e947225302","Type":"ContainerStarted","Data":"b61f9b0f3be790d4f90ef8c81808460629e5f686fe8f46a400d6bc53e3be0474"} Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.081862 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" event={"ID":"a3dfb35b-2857-483f-a058-3b267ab01cfd","Type":"ContainerStarted","Data":"07f51b171594b13cf176a5ae77d849199b529aca605af283b231f2d06e33be81"} Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.081952 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.083562 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" event={"ID":"f1da25c3-d735-49a7-8b68-6f19f08b22d0","Type":"ContainerStarted","Data":"48412cac10fca78a1e47e460eddfac7a523be5275ef7301a7b4853ec30d47ae5"} Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.083810 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.085601 5030 patch_prober.go:28] interesting pod/observability-operator-85c68dddb-tmk4r container/operator namespace/openshift-operators: Readiness probe status=failure output="Get \"http://10.217.1.45:8081/healthz\": dial tcp 10.217.1.45:8081: connect: connection refused" start-of-body= Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.085737 5030 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" podUID="f1da25c3-d735-49a7-8b68-6f19f08b22d0" containerName="operator" probeResult="failure" output="Get \"http://10.217.1.45:8081/healthz\": dial tcp 10.217.1.45:8081: connect: connection refused" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.086516 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" event={"ID":"d6fd85f1-32b0-4570-acb3-7b1fb0867c1b","Type":"ContainerStarted","Data":"6da3c7173109f950a152fd9118c76aa0009df9f3ff9a1a41f685201214a649d9"} Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.090838 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" event={"ID":"eb2de269-dadc-4a69-b46f-10c88e8eba95","Type":"ContainerStarted","Data":"be98e401db0167bade40760f8dd797b79104af794f488594816fc0adcef747a5"} Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.100484 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-6gd9h" podStartSLOduration=1.773587429 podStartE2EDuration="11.10047449s" podCreationTimestamp="2026-03-16 13:51:12 +0000 UTC" firstStartedPulling="2026-03-16 13:51:13.336682747 +0000 UTC m=+2717.735995294" lastFinishedPulling="2026-03-16 13:51:22.663569807 +0000 UTC m=+2727.062882355" observedRunningTime="2026-03-16 13:51:23.096430736 +0000 UTC m=+2727.495743282" watchObservedRunningTime="2026-03-16 13:51:23.10047449 +0000 UTC m=+2727.499787038" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.114200 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-9bc85b4bf-gbd62" podStartSLOduration=1.617590093 podStartE2EDuration="11.114192952s" podCreationTimestamp="2026-03-16 13:51:12 +0000 UTC" firstStartedPulling="2026-03-16 13:51:13.137124642 +0000 UTC m=+2717.536437189" lastFinishedPulling="2026-03-16 13:51:22.633727501 +0000 UTC m=+2727.033040048" observedRunningTime="2026-03-16 13:51:23.112477396 +0000 UTC m=+2727.511789942" watchObservedRunningTime="2026-03-16 13:51:23.114192952 +0000 UTC m=+2727.513505499" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.147147 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" podStartSLOduration=2.030348703 podStartE2EDuration="11.147131663s" podCreationTimestamp="2026-03-16 13:51:12 +0000 UTC" firstStartedPulling="2026-03-16 13:51:13.52451569 +0000 UTC m=+2717.923828237" lastFinishedPulling="2026-03-16 13:51:22.64129865 +0000 UTC m=+2727.040611197" observedRunningTime="2026-03-16 13:51:23.139646114 +0000 UTC m=+2727.538958661" watchObservedRunningTime="2026-03-16 13:51:23.147131663 +0000 UTC m=+2727.546444211" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.170038 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-576559b676-r8xwr" podStartSLOduration=1.942274105 podStartE2EDuration="11.170026403s" podCreationTimestamp="2026-03-16 13:51:12 +0000 UTC" firstStartedPulling="2026-03-16 13:51:13.404966354 +0000 UTC m=+2717.804278902" lastFinishedPulling="2026-03-16 13:51:22.632718653 +0000 UTC m=+2727.032031200" observedRunningTime="2026-03-16 13:51:23.167349668 +0000 UTC m=+2727.566662216" watchObservedRunningTime="2026-03-16 13:51:23.170026403 +0000 UTC m=+2727.569338950" Mar 16 13:51:23 crc kubenswrapper[5030]: I0316 13:51:23.193345 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" podStartSLOduration=2.234004967 podStartE2EDuration="11.193329822s" podCreationTimestamp="2026-03-16 13:51:12 +0000 UTC" firstStartedPulling="2026-03-16 13:51:13.677751935 +0000 UTC m=+2718.077064482" lastFinishedPulling="2026-03-16 13:51:22.63707679 +0000 UTC m=+2727.036389337" observedRunningTime="2026-03-16 13:51:23.192128262 +0000 UTC m=+2727.591440809" watchObservedRunningTime="2026-03-16 13:51:23.193329822 +0000 UTC m=+2727.592642369" Mar 16 13:51:24 crc kubenswrapper[5030]: I0316 13:51:24.100931 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-85c68dddb-tmk4r" Mar 16 13:51:24 crc kubenswrapper[5030]: I0316 13:51:24.286791 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:51:24 crc kubenswrapper[5030]: I0316 13:51:24.286853 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.419649 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-65ppj/must-gather-78j2v"] Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.425016 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.425213 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-65ppj/must-gather-78j2v"] Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.430378 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-65ppj\"/\"openshift-service-ca.crt\"" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.430583 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-65ppj\"/\"kube-root-ca.crt\"" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.522903 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v742b\" (UniqueName: \"kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.523003 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.624751 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v742b\" (UniqueName: \"kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.624843 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.625375 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.647349 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v742b\" (UniqueName: \"kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b\") pod \"must-gather-78j2v\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:26 crc kubenswrapper[5030]: I0316 13:51:26.739918 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:51:27 crc kubenswrapper[5030]: E0316 13:51:27.119287 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:51:27 crc kubenswrapper[5030]: I0316 13:51:27.387500 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-65ppj/must-gather-78j2v"] Mar 16 13:51:28 crc kubenswrapper[5030]: I0316 13:51:28.130962 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65ppj/must-gather-78j2v" event={"ID":"a038e719-8daa-4048-9f52-ed96166f9507","Type":"ContainerStarted","Data":"48ff76df3d102cadcf97e45782a948c72676aed5eeca8498f195432117e850d4"} Mar 16 13:51:30 crc kubenswrapper[5030]: I0316 13:51:30.752937 5030 scope.go:117] "RemoveContainer" containerID="8761f4acce6d39d624c735926d78096cca16bd3d839f8414e302e658e34b825b" Mar 16 13:51:34 crc kubenswrapper[5030]: I0316 13:51:34.101748 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-669c9f96b5-b2wm6" Mar 16 13:51:34 crc kubenswrapper[5030]: I0316 13:51:34.581317 5030 scope.go:117] "RemoveContainer" containerID="2891385bde6f8570d32431b51aaaabd41411ea7a488ac3b7427ec8cd6998a91e" Mar 16 13:51:35 crc kubenswrapper[5030]: I0316 13:51:35.218387 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65ppj/must-gather-78j2v" event={"ID":"a038e719-8daa-4048-9f52-ed96166f9507","Type":"ContainerStarted","Data":"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a"} Mar 16 13:51:36 crc kubenswrapper[5030]: I0316 13:51:36.228014 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65ppj/must-gather-78j2v" event={"ID":"a038e719-8daa-4048-9f52-ed96166f9507","Type":"ContainerStarted","Data":"68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6"} Mar 16 13:51:36 crc kubenswrapper[5030]: I0316 13:51:36.249194 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-65ppj/must-gather-78j2v" podStartSLOduration=2.856274317 podStartE2EDuration="10.249179916s" podCreationTimestamp="2026-03-16 13:51:26 +0000 UTC" firstStartedPulling="2026-03-16 13:51:27.392012506 +0000 UTC m=+2731.791325054" lastFinishedPulling="2026-03-16 13:51:34.784918106 +0000 UTC m=+2739.184230653" observedRunningTime="2026-03-16 13:51:36.246710902 +0000 UTC m=+2740.646023450" watchObservedRunningTime="2026-03-16 13:51:36.249179916 +0000 UTC m=+2740.648492463" Mar 16 13:51:37 crc kubenswrapper[5030]: E0316 13:51:37.279150 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:51:47 crc kubenswrapper[5030]: E0316 13:51:47.452012 5030 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-conmon-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625cf0ec_73a5_49a0_8736_87f258e50826.slice/crio-baf71e8b79203ff87fb38c8a4ba72134c9952c49eec2c44095d16312e8b086ad.scope\": RecentStats: unable to find data in memory cache]" Mar 16 13:51:53 crc kubenswrapper[5030]: E0316 13:51:53.688104 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313161 actualBytes=10240 Mar 16 13:51:54 crc kubenswrapper[5030]: I0316 13:51:54.286652 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:51:54 crc kubenswrapper[5030]: I0316 13:51:54.286759 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.135994 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561152-sv7jn"] Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.141661 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.143524 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.143766 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.143910 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.144038 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561152-sv7jn"] Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.281841 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r889\" (UniqueName: \"kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889\") pod \"auto-csr-approver-29561152-sv7jn\" (UID: \"592249e4-db85-4949-98e7-bf8b75777308\") " pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.383838 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r889\" (UniqueName: \"kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889\") pod \"auto-csr-approver-29561152-sv7jn\" (UID: \"592249e4-db85-4949-98e7-bf8b75777308\") " pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.403318 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r889\" (UniqueName: \"kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889\") pod \"auto-csr-approver-29561152-sv7jn\" (UID: \"592249e4-db85-4949-98e7-bf8b75777308\") " pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.463824 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:00 crc kubenswrapper[5030]: I0316 13:52:00.879000 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561152-sv7jn"] Mar 16 13:52:00 crc kubenswrapper[5030]: W0316 13:52:00.883075 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod592249e4_db85_4949_98e7_bf8b75777308.slice/crio-cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49 WatchSource:0}: Error finding container cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49: Status 404 returned error can't find the container with id cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49 Mar 16 13:52:01 crc kubenswrapper[5030]: I0316 13:52:01.468718 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" event={"ID":"592249e4-db85-4949-98e7-bf8b75777308","Type":"ContainerStarted","Data":"cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49"} Mar 16 13:52:02 crc kubenswrapper[5030]: I0316 13:52:02.479611 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" event={"ID":"592249e4-db85-4949-98e7-bf8b75777308","Type":"ContainerStarted","Data":"9d9e7604566e0b7946817c98478d66e00507b8460154cbb66253e9e2b06b3c7c"} Mar 16 13:52:02 crc kubenswrapper[5030]: I0316 13:52:02.495315 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" podStartSLOduration=1.238160461 podStartE2EDuration="2.49529508s" podCreationTimestamp="2026-03-16 13:52:00 +0000 UTC" firstStartedPulling="2026-03-16 13:52:00.884886649 +0000 UTC m=+2765.284199197" lastFinishedPulling="2026-03-16 13:52:02.142021279 +0000 UTC m=+2766.541333816" observedRunningTime="2026-03-16 13:52:02.489860569 +0000 UTC m=+2766.889173116" watchObservedRunningTime="2026-03-16 13:52:02.49529508 +0000 UTC m=+2766.894607627" Mar 16 13:52:03 crc kubenswrapper[5030]: I0316 13:52:03.491652 5030 generic.go:358] "Generic (PLEG): container finished" podID="592249e4-db85-4949-98e7-bf8b75777308" containerID="9d9e7604566e0b7946817c98478d66e00507b8460154cbb66253e9e2b06b3c7c" exitCode=0 Mar 16 13:52:03 crc kubenswrapper[5030]: I0316 13:52:03.491762 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" event={"ID":"592249e4-db85-4949-98e7-bf8b75777308","Type":"ContainerDied","Data":"9d9e7604566e0b7946817c98478d66e00507b8460154cbb66253e9e2b06b3c7c"} Mar 16 13:52:04 crc kubenswrapper[5030]: I0316 13:52:04.773853 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:04 crc kubenswrapper[5030]: I0316 13:52:04.873392 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r889\" (UniqueName: \"kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889\") pod \"592249e4-db85-4949-98e7-bf8b75777308\" (UID: \"592249e4-db85-4949-98e7-bf8b75777308\") " Mar 16 13:52:04 crc kubenswrapper[5030]: I0316 13:52:04.891644 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889" (OuterVolumeSpecName: "kube-api-access-2r889") pod "592249e4-db85-4949-98e7-bf8b75777308" (UID: "592249e4-db85-4949-98e7-bf8b75777308"). InnerVolumeSpecName "kube-api-access-2r889". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:52:04 crc kubenswrapper[5030]: I0316 13:52:04.976015 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r889\" (UniqueName: \"kubernetes.io/projected/592249e4-db85-4949-98e7-bf8b75777308-kube-api-access-2r889\") on node \"crc\" DevicePath \"\"" Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.514091 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" event={"ID":"592249e4-db85-4949-98e7-bf8b75777308","Type":"ContainerDied","Data":"cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49"} Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.514260 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbf612d82ec472cac08128abd3e647f65cd99068151f83722ff01eca40d74c49" Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.514297 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561152-sv7jn" Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.557539 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561146-vw9mc"] Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.563521 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561146-vw9mc"] Mar 16 13:52:05 crc kubenswrapper[5030]: I0316 13:52:05.955118 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d449f3fd-3527-43e3-9a22-bd0f47c772f4" path="/var/lib/kubelet/pods/d449f3fd-3527-43e3-9a22-bd0f47c772f4/volumes" Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.287259 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.288025 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.288087 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.288736 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.288800 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92" gracePeriod=600 Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.702853 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92" exitCode=0 Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.702956 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92"} Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.703260 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerStarted","Data":"85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c"} Mar 16 13:52:24 crc kubenswrapper[5030]: I0316 13:52:24.703283 5030 scope.go:117] "RemoveContainer" containerID="6e986ea7b1d6f8a9bfb818010475239414e9185ac3fa59d7de88b8a50b3b8785" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.810347 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.812587 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592249e4-db85-4949-98e7-bf8b75777308" containerName="oc" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.812611 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="592249e4-db85-4949-98e7-bf8b75777308" containerName="oc" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.812780 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="592249e4-db85-4949-98e7-bf8b75777308" containerName="oc" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.819231 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.822152 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.920741 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.920922 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:27 crc kubenswrapper[5030]: I0316 13:52:27.921002 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g69j9\" (UniqueName: \"kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.023744 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.024028 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.024145 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g69j9\" (UniqueName: \"kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.024306 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.024528 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.048268 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g69j9\" (UniqueName: \"kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9\") pod \"community-operators-2wtpr\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.137734 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.606249 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:28 crc kubenswrapper[5030]: W0316 13:52:28.615515 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805d668a_ed06_4523_acbf_22dd7f6bf7b8.slice/crio-4cb456306bf9afd633f903ece41b0ac9fcd1afa184231e416b747f79ced2c087 WatchSource:0}: Error finding container 4cb456306bf9afd633f903ece41b0ac9fcd1afa184231e416b747f79ced2c087: Status 404 returned error can't find the container with id 4cb456306bf9afd633f903ece41b0ac9fcd1afa184231e416b747f79ced2c087 Mar 16 13:52:28 crc kubenswrapper[5030]: I0316 13:52:28.745954 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerStarted","Data":"4cb456306bf9afd633f903ece41b0ac9fcd1afa184231e416b747f79ced2c087"} Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.596402 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/util/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.725964 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/util/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.751468 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/pull/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.753355 5030 generic.go:358] "Generic (PLEG): container finished" podID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerID="a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed" exitCode=0 Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.753402 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerDied","Data":"a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed"} Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.782151 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/pull/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.904411 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/util/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.917294 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/extract/0.log" Mar 16 13:52:29 crc kubenswrapper[5030]: I0316 13:52:29.917916 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_607560efed3261fb385ad992f9f23627ac0d364289331c8dba808cbffbqx4q4_c55cc7f7-7b8e-41b5-b85a-048aea828942/pull/0.log" Mar 16 13:52:30 crc kubenswrapper[5030]: I0316 13:52:30.277265 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_designate-operator-controller-manager-7cf89c67bb-dqm94_abb96aea-ef66-4411-8824-3317f9e44a8d/manager/0.log" Mar 16 13:52:30 crc kubenswrapper[5030]: I0316 13:52:30.696150 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_heat-operator-controller-manager-79975d4c95-7vrpq_e3f81986-b429-4bae-bdf6-ab4cff5534f9/manager/0.log" Mar 16 13:52:30 crc kubenswrapper[5030]: I0316 13:52:30.770480 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerStarted","Data":"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63"} Mar 16 13:52:30 crc kubenswrapper[5030]: I0316 13:52:30.935782 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_barbican-operator-controller-manager-848cfb5779-rvhc2_15cd6c2d-0a84-4a8f-a53f-6a71727f3dfe/manager/0.log" Mar 16 13:52:30 crc kubenswrapper[5030]: I0316 13:52:30.979977 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_glance-operator-controller-manager-58d9bbd8cc-24vjm_70f26644-127c-4815-8b72-7d4e18e4a809/manager/0.log" Mar 16 13:52:31 crc kubenswrapper[5030]: I0316 13:52:31.056845 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_horizon-operator-controller-manager-5bf9fb4564-pdshw_c2559c1e-8b4e-40f5-b4fc-d0fd6950b084/manager/0.log" Mar 16 13:52:31 crc kubenswrapper[5030]: I0316 13:52:31.343739 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_ironic-operator-controller-manager-997698bf9-kvdhl_c30b09f1-af80-45c5-a218-2726d37fcc84/manager/0.log" Mar 16 13:52:31 crc kubenswrapper[5030]: I0316 13:52:31.780073 5030 generic.go:358] "Generic (PLEG): container finished" podID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerID="91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63" exitCode=0 Mar 16 13:52:31 crc kubenswrapper[5030]: I0316 13:52:31.780157 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerDied","Data":"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63"} Mar 16 13:52:31 crc kubenswrapper[5030]: I0316 13:52:31.928295 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_manila-operator-controller-manager-7d6d87b867-w2kh9_efb378d9-327b-4064-b4cb-60d7ea01c7e5/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.027736 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_keystone-operator-controller-manager-6f5b9fd59-485fs_7cc12ea5-48ad-4e56-8980-2da1ff87da0b/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.456786 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_infra-operator-controller-manager-76f8b7ddbd-r98lt_7253144c-27eb-4979-a38d-419a993ae47f/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.486298 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_mariadb-operator-controller-manager-5748db694b-2fhf2_d2c78a21-5083-4ded-a44e-6bd51017e613/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.621950 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_neutron-operator-controller-manager-75c6f4bc76-66pvn_16bd7d26-97ce-4773-9866-35d85ed1f978/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.791689 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerStarted","Data":"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224"} Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.808604 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/community-operators-2wtpr" podStartSLOduration=5.025990735 podStartE2EDuration="5.808590245s" podCreationTimestamp="2026-03-16 13:52:27 +0000 UTC" firstStartedPulling="2026-03-16 13:52:29.754375085 +0000 UTC m=+2794.153687632" lastFinishedPulling="2026-03-16 13:52:30.536974595 +0000 UTC m=+2794.936287142" observedRunningTime="2026-03-16 13:52:32.805204458 +0000 UTC m=+2797.204517005" watchObservedRunningTime="2026-03-16 13:52:32.808590245 +0000 UTC m=+2797.207902793" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.847410 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_octavia-operator-controller-manager-7b89675745-w6gzv_cf6ecc43-5300-45aa-9a53-74967162632e/manager/0.log" Mar 16 13:52:32 crc kubenswrapper[5030]: I0316 13:52:32.966091 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_openstack-baremetal-operator-controller-manager-6b6ddbc5995q22v_65a755bb-3a4c-4aaa-a9fd-d69514e1b854/manager/0.log" Mar 16 13:52:33 crc kubenswrapper[5030]: I0316 13:52:33.266973 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_nova-operator-controller-manager-785d77464d-hzfh6_8dd73d63-1019-48db-88da-47a95894a2ae/manager/0.log" Mar 16 13:52:33 crc kubenswrapper[5030]: I0316 13:52:33.292930 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_openstack-operator-controller-init-7b76cc8c59-b48fp_48a14535-29df-430f-be17-4042252cba4a/operator/0.log" Mar 16 13:52:33 crc kubenswrapper[5030]: I0316 13:52:33.524741 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_openstack-operator-index-vj6jm_56e99ffe-e8e4-4e04-a9c0-254ae926dfdc/registry-server/0.log" Mar 16 13:52:33 crc kubenswrapper[5030]: I0316 13:52:33.842647 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_ovn-operator-controller-manager-6fb6cd45c4-hqxj8_d72d8146-effa-4874-bddf-6c525d6b1cda/manager/0.log" Mar 16 13:52:33 crc kubenswrapper[5030]: I0316 13:52:33.886630 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_placement-operator-controller-manager-57fdd4b4cf-2z7l6_0e928026-eaab-4408-a189-5fceb745b232/manager/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.084901 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_rabbitmq-cluster-operator-manager-85d9b55b6-jtjj9_9733ae7a-be03-4a43-a5e8-1e154eb4e91f/operator/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.254560 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_swift-operator-controller-manager-5d89b4d5d5-96l7l_40eebc4f-195d-495e-a989-4fd7684c3624/manager/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.439434 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_test-operator-controller-manager-74d567479f-9gf58_b0bcb6b4-d41a-4576-9768-847372afafcc/manager/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.624834 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_watcher-operator-controller-manager-65d578856c-wknpb_1612f31d-fe0f-4756-b5df-2a95dddfcfa9/manager/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.646620 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_telemetry-operator-controller-manager-f5cf7fcb7-h87bk_767e9b64-7c11-4116-ac41-6b1399f52f93/manager/0.log" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.928837 5030 scope.go:117] "RemoveContainer" containerID="dc17b375819ccb3599f6ea75b11c64b63e907caee28a8f084907caea41263b30" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.952518 5030 scope.go:117] "RemoveContainer" containerID="34f543d18abeb72ac2ada43dcf7a7327e2865225bc87721ee9bf7a6c089c5be6" Mar 16 13:52:34 crc kubenswrapper[5030]: I0316 13:52:34.974851 5030 scope.go:117] "RemoveContainer" containerID="15d6c8c90adae8e902480132895c41bee1da5f889a468b31ce3cfd23c998d43d" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.004457 5030 scope.go:117] "RemoveContainer" containerID="1b149c09d873d033682338884e977ebbfbed549dca169ad32c7298360c93fbd2" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.041850 5030 scope.go:117] "RemoveContainer" containerID="1cc3f77a4586b11d2e14e46782e5fb57ff440e6778fe9a81dc219c2326680988" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.218710 5030 scope.go:117] "RemoveContainer" containerID="185166b155784a9ba495ee2b310dfa73693c2268af5a520b15bdf7ab74d35953" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.248166 5030 scope.go:117] "RemoveContainer" containerID="ba32e3f1fa95c54997db3a7f3722c7cf0585fc888d3bd4a9d2b3c28b2c0aaef3" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.320683 5030 scope.go:117] "RemoveContainer" containerID="b0c10a81f194df8b4b0c7ec5581a4e5d000140c693e168d387b3efbc5b8800fc" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.339128 5030 scope.go:117] "RemoveContainer" containerID="f89966d58fa68ddb3cd258d6f5f811ebc861a6ced57e8b7ed808a6d2e00697eb" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.357174 5030 scope.go:117] "RemoveContainer" containerID="97e6a1dbe2e4735bf12da3d3aeff87a2ee9b8c2467851b01ff93a1553a12bc68" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.372274 5030 scope.go:117] "RemoveContainer" containerID="3ebe995bdaf85be1f8006a4e9927f55ec6e2849e3dcf60d7c31f588b2d3cc449" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.389358 5030 scope.go:117] "RemoveContainer" containerID="b0d122fbb6c976f7fde39ab30ae914b7076aa4f825738d6d3615f339809f591f" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.436408 5030 scope.go:117] "RemoveContainer" containerID="06cf6e0e6e77605851e5d669badc9f365e14f0651549f5fdd1a561e045d94ae2" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.452238 5030 scope.go:117] "RemoveContainer" containerID="9ad9f1b81e4325a4ffaa4200c7f76923e7878225e55e2abe60aaf5f023eb05c6" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.596681 5030 scope.go:117] "RemoveContainer" containerID="4e9834408f3f565f16a08ba4622dc7e533c71403b922de240c7769d242671c6b" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.616904 5030 scope.go:117] "RemoveContainer" containerID="e6baa12be0b98a6230e7c6900cb93a3be034870475c4f6291c0185ade25ac2f1" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.638446 5030 scope.go:117] "RemoveContainer" containerID="1d6b68d87d99bba78f6f6d5239ec45bc9af8d75abcbd57011401915e4f23ea11" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.665051 5030 scope.go:117] "RemoveContainer" containerID="ec1d328c918e092fdf003c485c23cf8144f1c2ccef88ab5f9a30bb365d0395a7" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.710106 5030 scope.go:117] "RemoveContainer" containerID="72496ec6dd12b61aba860304bf8bd0d30f519f5f1ba7600b9a40adc5bf9f0f70" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.733633 5030 scope.go:117] "RemoveContainer" containerID="1f98d6eb4f8e932b423b7ca7a684ff0ddf6fc5feb6bcabfafd0cd1d722776711" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.749643 5030 scope.go:117] "RemoveContainer" containerID="026cb6c1982f6523c4904526089b228b9695141373d6e9981af0e54eac6ea449" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.770036 5030 scope.go:117] "RemoveContainer" containerID="bf17f9db9db3b62f0ab3e6f6e14324676bf53b58825bf1592d97164989f804d2" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.788406 5030 scope.go:117] "RemoveContainer" containerID="d9ae0bfc027c7f6d2e494401276f154ac533aec68bce8f72171aca8fda570793" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.808471 5030 scope.go:117] "RemoveContainer" containerID="7e6dec1a00efa9e3b419c9e35e6a73669aa06c5a072a5af2bd948370e3857cc1" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.847572 5030 scope.go:117] "RemoveContainer" containerID="3670efdb4d162ee1a309a22e117813f02715d30f460d6af30458f4557a4b7628" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.866465 5030 scope.go:117] "RemoveContainer" containerID="4b4ca9717a2a77f7757b200110b8e7eb5335f3246cf8753c3fd2907cadae25a3" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.896446 5030 scope.go:117] "RemoveContainer" containerID="35877326fcabc628d8b7f82c91e5dd8a3bf01a5798854ebdac1c27be6a853cda" Mar 16 13:52:35 crc kubenswrapper[5030]: I0316 13:52:35.916840 5030 scope.go:117] "RemoveContainer" containerID="d31695151d7a95dc118506726c05de013026f795d2351a64880d58900c791872" Mar 16 13:52:36 crc kubenswrapper[5030]: I0316 13:52:36.090643 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_cinder-operator-controller-manager-55bc8cdcc4-xp7rw_c9dea77a-4d1e-4b1a-922d-562ecff4eb24/manager/0.log" Mar 16 13:52:37 crc kubenswrapper[5030]: I0316 13:52:37.396715 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-operators_openstack-operator-controller-manager-5fbcdbcf94-p4bxq_31b27f63-44bb-4f0a-b48e-cce502308c0b/manager/0.log" Mar 16 13:52:38 crc kubenswrapper[5030]: I0316 13:52:38.138335 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:38 crc kubenswrapper[5030]: I0316 13:52:38.138387 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:38 crc kubenswrapper[5030]: I0316 13:52:38.176717 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:38 crc kubenswrapper[5030]: I0316 13:52:38.935269 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:38 crc kubenswrapper[5030]: I0316 13:52:38.980060 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:40 crc kubenswrapper[5030]: I0316 13:52:40.913388 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/community-operators-2wtpr" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="registry-server" containerID="cri-o://54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224" gracePeriod=2 Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.282501 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.353351 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities\") pod \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.353568 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g69j9\" (UniqueName: \"kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9\") pod \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.353868 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content\") pod \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\" (UID: \"805d668a-ed06-4523-acbf-22dd7f6bf7b8\") " Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.354396 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities" (OuterVolumeSpecName: "utilities") pod "805d668a-ed06-4523-acbf-22dd7f6bf7b8" (UID: "805d668a-ed06-4523-acbf-22dd7f6bf7b8"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.359893 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9" (OuterVolumeSpecName: "kube-api-access-g69j9") pod "805d668a-ed06-4523-acbf-22dd7f6bf7b8" (UID: "805d668a-ed06-4523-acbf-22dd7f6bf7b8"). InnerVolumeSpecName "kube-api-access-g69j9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.394910 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "805d668a-ed06-4523-acbf-22dd7f6bf7b8" (UID: "805d668a-ed06-4523-acbf-22dd7f6bf7b8"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.456111 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g69j9\" (UniqueName: \"kubernetes.io/projected/805d668a-ed06-4523-acbf-22dd7f6bf7b8-kube-api-access-g69j9\") on node \"crc\" DevicePath \"\"" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.456142 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.456155 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/805d668a-ed06-4523-acbf-22dd7f6bf7b8-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.926088 5030 generic.go:358] "Generic (PLEG): container finished" podID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerID="54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224" exitCode=0 Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.926192 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerDied","Data":"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224"} Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.926662 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/community-operators-2wtpr" event={"ID":"805d668a-ed06-4523-acbf-22dd7f6bf7b8","Type":"ContainerDied","Data":"4cb456306bf9afd633f903ece41b0ac9fcd1afa184231e416b747f79ced2c087"} Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.926234 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/community-operators-2wtpr" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.926703 5030 scope.go:117] "RemoveContainer" containerID="54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.966182 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.968964 5030 scope.go:117] "RemoveContainer" containerID="91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63" Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.970660 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/community-operators-2wtpr"] Mar 16 13:52:41 crc kubenswrapper[5030]: I0316 13:52:41.987450 5030 scope.go:117] "RemoveContainer" containerID="a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.005288 5030 scope.go:117] "RemoveContainer" containerID="54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224" Mar 16 13:52:42 crc kubenswrapper[5030]: E0316 13:52:42.005686 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224\": container with ID starting with 54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224 not found: ID does not exist" containerID="54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.005739 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224"} err="failed to get container status \"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224\": rpc error: code = NotFound desc = could not find container \"54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224\": container with ID starting with 54cf17b84feb3f4850081c2dad25b043b0c8c72bbc2209c97f0a505df5cfd224 not found: ID does not exist" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.005767 5030 scope.go:117] "RemoveContainer" containerID="91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63" Mar 16 13:52:42 crc kubenswrapper[5030]: E0316 13:52:42.006067 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63\": container with ID starting with 91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63 not found: ID does not exist" containerID="91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.006091 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63"} err="failed to get container status \"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63\": rpc error: code = NotFound desc = could not find container \"91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63\": container with ID starting with 91cd08f090a0a50b680514297b1f5cec6bb6608e97d65b4a534d5d4d8c5cde63 not found: ID does not exist" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.006104 5030 scope.go:117] "RemoveContainer" containerID="a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed" Mar 16 13:52:42 crc kubenswrapper[5030]: E0316 13:52:42.006322 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed\": container with ID starting with a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed not found: ID does not exist" containerID="a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed" Mar 16 13:52:42 crc kubenswrapper[5030]: I0316 13:52:42.006344 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed"} err="failed to get container status \"a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed\": rpc error: code = NotFound desc = could not find container \"a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed\": container with ID starting with a8d47ad1306306a59327f90394791181e29acdc7bd02adb3ec03d8d3599ce3ed not found: ID does not exist" Mar 16 13:52:43 crc kubenswrapper[5030]: I0316 13:52:43.958686 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" path="/var/lib/kubelet/pods/805d668a-ed06-4523-acbf-22dd7f6bf7b8/volumes" Mar 16 13:52:51 crc kubenswrapper[5030]: I0316 13:52:51.151869 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_control-plane-machine-set-operator-75ffdb6fcd-p5pmg_87aa0d49-02c3-402a-942d-d4247fa5e87e/control-plane-machine-set-operator/0.log" Mar 16 13:52:51 crc kubenswrapper[5030]: I0316 13:52:51.320766 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-s5fxv_c9f3be91-73a7-4d14-8d2f-86da802e4900/kube-rbac-proxy/0.log" Mar 16 13:52:51 crc kubenswrapper[5030]: I0316 13:52:51.332401 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-api_machine-api-operator-755bb95488-s5fxv_c9f3be91-73a7-4d14-8d2f-86da802e4900/machine-api-operator/0.log" Mar 16 13:52:53 crc kubenswrapper[5030]: E0316 13:52:53.554682 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314476 actualBytes=10240 Mar 16 13:53:02 crc kubenswrapper[5030]: I0316 13:53:02.345600 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-759f64656b-g2hjp_5f0e674d-c17f-4daa-a37e-8e2b1a4f6dd7/cert-manager-controller/0.log" Mar 16 13:53:02 crc kubenswrapper[5030]: I0316 13:53:02.406631 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-8966b78d4-9lvw8_b3c5b559-3a82-4ffa-802b-7e9ad8e49c52/cert-manager-cainjector/0.log" Mar 16 13:53:02 crc kubenswrapper[5030]: I0316 13:53:02.502602 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-597b96b99b-5xkqn_4ce95a79-bd46-4f73-a233-0d7b869046ba/cert-manager-webhook/0.log" Mar 16 13:53:12 crc kubenswrapper[5030]: I0316 13:53:12.937799 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-console-plugin-74686bb6b4-qh988_7e99427c-ec9d-48f0-a078-aebc933dba2b/nmstate-console-plugin/0.log" Mar 16 13:53:13 crc kubenswrapper[5030]: I0316 13:53:13.101600 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-6f7qf_44977e20-5353-45ed-b2ef-069946a7fedc/nmstate-handler/0.log" Mar 16 13:53:13 crc kubenswrapper[5030]: I0316 13:53:13.130140 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-2gt2d_795a6c5a-054d-497e-963e-faff3ca80086/nmstate-metrics/0.log" Mar 16 13:53:13 crc kubenswrapper[5030]: I0316 13:53:13.143476 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-7f888697b-2gt2d_795a6c5a-054d-497e-963e-faff3ca80086/kube-rbac-proxy/0.log" Mar 16 13:53:13 crc kubenswrapper[5030]: I0316 13:53:13.284456 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-54b58fcbc5-57jgc_60db2621-32fa-4111-9b59-ba60756ca410/nmstate-operator/0.log" Mar 16 13:53:13 crc kubenswrapper[5030]: I0316 13:53:13.308114 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-78fdd78d8b-ljkg4_ab0f671f-c99b-4a1e-a09f-c248dd1c40c3/nmstate-webhook/0.log" Mar 16 13:53:24 crc kubenswrapper[5030]: I0316 13:53:24.283348 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-gbd62_d6fd85f1-32b0-4570-acb3-7b1fb0867c1b/prometheus-operator/0.log" Mar 16 13:53:24 crc kubenswrapper[5030]: I0316 13:53:24.438169 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-576559b676-6gd9h_cc235ee8-3961-47e5-84b5-12e947225302/prometheus-operator-admission-webhook/0.log" Mar 16 13:53:24 crc kubenswrapper[5030]: I0316 13:53:24.454316 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-576559b676-r8xwr_eb2de269-dadc-4a69-b46f-10c88e8eba95/prometheus-operator-admission-webhook/0.log" Mar 16 13:53:24 crc kubenswrapper[5030]: I0316 13:53:24.596508 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-tmk4r_f1da25c3-d735-49a7-8b68-6f19f08b22d0/operator/0.log" Mar 16 13:53:24 crc kubenswrapper[5030]: I0316 13:53:24.619632 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-b2wm6_a3dfb35b-2857-483f-a058-3b267ab01cfd/perses-operator/0.log" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.324737 5030 scope.go:117] "RemoveContainer" containerID="49036d1a512d2271c5d2970c5d34646aad5c69251f9f3a1f8a26f83eb65909e4" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.346589 5030 scope.go:117] "RemoveContainer" containerID="4c733e8827d2bbf6968dbbad0d84ca0ffd44edab5257d4212628d56e940b2d68" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.372609 5030 scope.go:117] "RemoveContainer" containerID="739ded1d773075ddc251ac3860fe5a159f0ba37f68b2070c389d8708b2215b1c" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.407188 5030 scope.go:117] "RemoveContainer" containerID="74809179b6af4eac4d7e98968bdde6e80674a71a265e4d51a40d1410b7890fea" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.417043 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-glmqk_a787c80d-7a29-4fa9-b5e2-335785499ec3/kube-rbac-proxy/0.log" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.432452 5030 scope.go:117] "RemoveContainer" containerID="dfd6a6195f9c40cef75e1c13909aa167ead61e19b783c6a31138b2de93fcd7b3" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.459117 5030 scope.go:117] "RemoveContainer" containerID="4430e7120b5600989f84e88c239f78e55662b8f77e9b8823151d8eed8e9c5c27" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.500522 5030 scope.go:117] "RemoveContainer" containerID="6ddde1f1026c8903839642b3ce29f426cc45819093d67148661da695fc99ee0c" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.572581 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-774d88f846-glmqk_a787c80d-7a29-4fa9-b5e2-335785499ec3/controller/0.log" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.620481 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6cdcb85899-x7t65_5229b811-944b-4010-8df6-f2f54bbaeefe/manager/0.log" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.722098 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-754d499d9c-wvks6_fce107bc-5860-4b8c-b330-ded7dd35c6aa/webhook-server/0.log" Mar 16 13:53:36 crc kubenswrapper[5030]: I0316 13:53:36.761130 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-ccvkx_4e4e2dff-7723-44e9-ac2b-21fcbfc64f43/kube-rbac-proxy/0.log" Mar 16 13:53:37 crc kubenswrapper[5030]: I0316 13:53:37.292835 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-ccvkx_4e4e2dff-7723-44e9-ac2b-21fcbfc64f43/speaker/0.log" Mar 16 13:53:47 crc kubenswrapper[5030]: I0316 13:53:47.902868 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-8rw6m_1dcde069-3377-48ed-a6bf-fdf25e80f78d/init/0.log" Mar 16 13:53:48 crc kubenswrapper[5030]: I0316 13:53:48.039470 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-8rw6m_1dcde069-3377-48ed-a6bf-fdf25e80f78d/init/0.log" Mar 16 13:53:48 crc kubenswrapper[5030]: I0316 13:53:48.065235 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-79dcd846c5-8rw6m_1dcde069-3377-48ed-a6bf-fdf25e80f78d/dnsmasq-dns/0.log" Mar 16 13:53:53 crc kubenswrapper[5030]: E0316 13:53:53.696243 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314468 actualBytes=10240 Mar 16 13:53:58 crc kubenswrapper[5030]: I0316 13:53:58.915824 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.014853 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.067525 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.085294 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.205164 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.225385 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/extract/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.240851 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_5f0d783fea323979717ec4113d968dc42dcfaeaad7ccdc94e6a93c9e91fzhvz_c62f6170-9809-4a7a-a2df-d5c1f11da5e0/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.387931 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.529679 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.558346 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.565816 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.697242 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/util/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.710454 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/extract/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.728031 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_925ad1f05bf386dc21bdfe2f8249c1fbfd04a404dec7a7fb6362d758e5ckkcq_73106cf1-a54e-4ec3-9cfe-51a9ea1219f8/pull/0.log" Mar 16 13:53:59 crc kubenswrapper[5030]: I0316 13:53:59.845470 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/util/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.002186 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/pull/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.005264 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/pull/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.011141 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/util/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.132960 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561154-dmfjf"] Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.133918 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="extract-utilities" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.133939 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="extract-utilities" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.133956 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="registry-server" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.133963 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="registry-server" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.134000 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="extract-content" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.134005 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="extract-content" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.134154 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="805d668a-ed06-4523-acbf-22dd7f6bf7b8" containerName="registry-server" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.137860 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.139637 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.140007 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.141996 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.142044 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561154-dmfjf"] Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.182844 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/util/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.189587 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/pull/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.193304 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_98629960b44b381d1a86cff1d1439a8df43509c9ad24579158c59d0f0876qxh_625cf0ec-73a5-49a0-8736-87f258e50826/extract/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.237316 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbknf\" (UniqueName: \"kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf\") pod \"auto-csr-approver-29561154-dmfjf\" (UID: \"c0158af3-9186-4f81-8c42-3ca81809dcf1\") " pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.324613 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-utilities/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.338792 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbknf\" (UniqueName: \"kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf\") pod \"auto-csr-approver-29561154-dmfjf\" (UID: \"c0158af3-9186-4f81-8c42-3ca81809dcf1\") " pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.356993 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbknf\" (UniqueName: \"kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf\") pod \"auto-csr-approver-29561154-dmfjf\" (UID: \"c0158af3-9186-4f81-8c42-3ca81809dcf1\") " pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.473615 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-content/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.489321 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-content/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.499575 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.512900 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-utilities/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.705726 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-content/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.752050 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/extract-utilities/0.log" Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.905331 5030 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.908875 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561154-dmfjf"] Mar 16 13:54:00 crc kubenswrapper[5030]: I0316 13:54:00.914096 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-utilities/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.003343 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_certified-operators-2qsrs_318ad99c-6c0f-46b0-b626-3e123a81b3d2/registry-server/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.069134 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-content/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.097188 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-content/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.110646 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-utilities/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.220521 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-utilities/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.243440 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/extract-content/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.352033 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/util/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.505062 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/util/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.528794 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/pull/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.550976 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/pull/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.593120 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" event={"ID":"c0158af3-9186-4f81-8c42-3ca81809dcf1","Type":"ContainerStarted","Data":"0bb6ee9c7880254e893fca9924b54c4aa6abdb44980a25850d88efe77d789b2c"} Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.777257 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_community-operators-2vplc_cf8ecd63-98d9-47a8-839f-927a5ca04ec6/registry-server/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.809383 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/pull/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.812225 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/util/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.815243 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_d1f2cf7c6f4ecb15e69cc0ed07a53b6f169b7a9d46d563b1a9827dff83nwv7k_e389f96d-d6e4-4211-86ff-1e439988c87d/extract/0.log" Mar 16 13:54:01 crc kubenswrapper[5030]: I0316 13:54:01.944954 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_marketplace-operator-547dbd544d-pzc7k_2fe4fcbb-95ce-47f4-9483-59d73b9f7b23/marketplace-operator/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.013284 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-utilities/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.123639 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.147863 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-utilities/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.150441 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.323457 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-utilities/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.358405 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.375385 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-utilities/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.432748 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-marketplace-jzsdp_5ab61305-abfd-4a6f-897b-7e82819260f6/registry-server/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.554332 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-utilities/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.569600 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.579755 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.602405 5030 generic.go:358] "Generic (PLEG): container finished" podID="c0158af3-9186-4f81-8c42-3ca81809dcf1" containerID="94684320a75db18bec31787d2ecac8253ddea28bc0900b743fa6165397b9d2f1" exitCode=0 Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.602449 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" event={"ID":"c0158af3-9186-4f81-8c42-3ca81809dcf1","Type":"ContainerDied","Data":"94684320a75db18bec31787d2ecac8253ddea28bc0900b743fa6165397b9d2f1"} Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.733100 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-content/0.log" Mar 16 13:54:02 crc kubenswrapper[5030]: I0316 13:54:02.736983 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/extract-utilities/0.log" Mar 16 13:54:03 crc kubenswrapper[5030]: I0316 13:54:03.110431 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_redhat-operators-4cbxz_cae8ed9c-e60f-4e14-b71c-f57857fb3ce7/registry-server/0.log" Mar 16 13:54:03 crc kubenswrapper[5030]: I0316 13:54:03.878009 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:03 crc kubenswrapper[5030]: I0316 13:54:03.999691 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbknf\" (UniqueName: \"kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf\") pod \"c0158af3-9186-4f81-8c42-3ca81809dcf1\" (UID: \"c0158af3-9186-4f81-8c42-3ca81809dcf1\") " Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.007709 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf" (OuterVolumeSpecName: "kube-api-access-tbknf") pod "c0158af3-9186-4f81-8c42-3ca81809dcf1" (UID: "c0158af3-9186-4f81-8c42-3ca81809dcf1"). InnerVolumeSpecName "kube-api-access-tbknf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.103246 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbknf\" (UniqueName: \"kubernetes.io/projected/c0158af3-9186-4f81-8c42-3ca81809dcf1-kube-api-access-tbknf\") on node \"crc\" DevicePath \"\"" Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.638583 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.638601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561154-dmfjf" event={"ID":"c0158af3-9186-4f81-8c42-3ca81809dcf1","Type":"ContainerDied","Data":"0bb6ee9c7880254e893fca9924b54c4aa6abdb44980a25850d88efe77d789b2c"} Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.638667 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bb6ee9c7880254e893fca9924b54c4aa6abdb44980a25850d88efe77d789b2c" Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.946193 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561148-tlpbz"] Mar 16 13:54:04 crc kubenswrapper[5030]: I0316 13:54:04.950109 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561148-tlpbz"] Mar 16 13:54:05 crc kubenswrapper[5030]: I0316 13:54:05.955598 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3eb07d-6762-49d5-8e23-20531ec885eb" path="/var/lib/kubelet/pods/9c3eb07d-6762-49d5-8e23-20531ec885eb/volumes" Mar 16 13:54:13 crc kubenswrapper[5030]: I0316 13:54:13.466147 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-576559b676-6gd9h_cc235ee8-3961-47e5-84b5-12e947225302/prometheus-operator-admission-webhook/0.log" Mar 16 13:54:13 crc kubenswrapper[5030]: I0316 13:54:13.472919 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-admission-webhook-576559b676-r8xwr_eb2de269-dadc-4a69-b46f-10c88e8eba95/prometheus-operator-admission-webhook/0.log" Mar 16 13:54:13 crc kubenswrapper[5030]: I0316 13:54:13.492136 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_obo-prometheus-operator-9bc85b4bf-gbd62_d6fd85f1-32b0-4570-acb3-7b1fb0867c1b/prometheus-operator/0.log" Mar 16 13:54:13 crc kubenswrapper[5030]: I0316 13:54:13.648636 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_perses-operator-669c9f96b5-b2wm6_a3dfb35b-2857-483f-a058-3b267ab01cfd/perses-operator/0.log" Mar 16 13:54:13 crc kubenswrapper[5030]: I0316 13:54:13.649220 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_observability-operator-85c68dddb-tmk4r_f1da25c3-d735-49a7-8b68-6f19f08b22d0/operator/0.log" Mar 16 13:54:24 crc kubenswrapper[5030]: I0316 13:54:24.287043 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:54:24 crc kubenswrapper[5030]: I0316 13:54:24.289225 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:54:36 crc kubenswrapper[5030]: I0316 13:54:36.626452 5030 scope.go:117] "RemoveContainer" containerID="34f72a381ce4055013f0a19a825e9a271a487584b4d93e75e6893589d320c613" Mar 16 13:54:36 crc kubenswrapper[5030]: I0316 13:54:36.688684 5030 scope.go:117] "RemoveContainer" containerID="a1e0bd76fb71811108735ab94308647424122529d38a4412528691cb08185439" Mar 16 13:54:36 crc kubenswrapper[5030]: I0316 13:54:36.796047 5030 scope.go:117] "RemoveContainer" containerID="4d2f3cd2333dff953d3e52b56df86fb0f69241ebd82fd7217caeaa3a6c19bac8" Mar 16 13:54:36 crc kubenswrapper[5030]: I0316 13:54:36.863860 5030 scope.go:117] "RemoveContainer" containerID="b2f55106d03fd6042e366fd63355a77de34e8ed5ba96d2eb429b1ebfb256ab59" Mar 16 13:54:53 crc kubenswrapper[5030]: E0316 13:54:53.511842 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1314467 actualBytes=10240 Mar 16 13:54:54 crc kubenswrapper[5030]: I0316 13:54:54.286839 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:54:54 crc kubenswrapper[5030]: I0316 13:54:54.287302 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:55:00 crc kubenswrapper[5030]: I0316 13:55:00.117436 5030 generic.go:358] "Generic (PLEG): container finished" podID="a038e719-8daa-4048-9f52-ed96166f9507" containerID="2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a" exitCode=0 Mar 16 13:55:00 crc kubenswrapper[5030]: I0316 13:55:00.117528 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-65ppj/must-gather-78j2v" event={"ID":"a038e719-8daa-4048-9f52-ed96166f9507","Type":"ContainerDied","Data":"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a"} Mar 16 13:55:00 crc kubenswrapper[5030]: I0316 13:55:00.118715 5030 scope.go:117] "RemoveContainer" containerID="2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a" Mar 16 13:55:00 crc kubenswrapper[5030]: I0316 13:55:00.504124 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-65ppj_must-gather-78j2v_a038e719-8daa-4048-9f52-ed96166f9507/gather/0.log" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.076279 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-65ppj/must-gather-78j2v"] Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.077705 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-must-gather-65ppj/must-gather-78j2v" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="copy" containerID="cri-o://68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6" gracePeriod=2 Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.081521 5030 status_manager.go:895] "Failed to get status for pod" podUID="a038e719-8daa-4048-9f52-ed96166f9507" pod="openshift-must-gather-65ppj/must-gather-78j2v" err="pods \"must-gather-78j2v\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-65ppj\": no relationship found between node 'crc' and this object" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.082740 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-65ppj/must-gather-78j2v"] Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.459532 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-65ppj_must-gather-78j2v_a038e719-8daa-4048-9f52-ed96166f9507/copy/0.log" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.462376 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.463832 5030 status_manager.go:895] "Failed to get status for pod" podUID="a038e719-8daa-4048-9f52-ed96166f9507" pod="openshift-must-gather-65ppj/must-gather-78j2v" err="pods \"must-gather-78j2v\" is forbidden: User \"system:node:crc\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-65ppj\": no relationship found between node 'crc' and this object" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.629239 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output\") pod \"a038e719-8daa-4048-9f52-ed96166f9507\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.629340 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v742b\" (UniqueName: \"kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b\") pod \"a038e719-8daa-4048-9f52-ed96166f9507\" (UID: \"a038e719-8daa-4048-9f52-ed96166f9507\") " Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.643671 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b" (OuterVolumeSpecName: "kube-api-access-v742b") pod "a038e719-8daa-4048-9f52-ed96166f9507" (UID: "a038e719-8daa-4048-9f52-ed96166f9507"). InnerVolumeSpecName "kube-api-access-v742b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.726270 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a038e719-8daa-4048-9f52-ed96166f9507" (UID: "a038e719-8daa-4048-9f52-ed96166f9507"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.732395 5030 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a038e719-8daa-4048-9f52-ed96166f9507-must-gather-output\") on node \"crc\" DevicePath \"\"" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.732423 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v742b\" (UniqueName: \"kubernetes.io/projected/a038e719-8daa-4048-9f52-ed96166f9507-kube-api-access-v742b\") on node \"crc\" DevicePath \"\"" Mar 16 13:55:07 crc kubenswrapper[5030]: I0316 13:55:07.957313 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a038e719-8daa-4048-9f52-ed96166f9507" path="/var/lib/kubelet/pods/a038e719-8daa-4048-9f52-ed96166f9507/volumes" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.183628 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-65ppj_must-gather-78j2v_a038e719-8daa-4048-9f52-ed96166f9507/copy/0.log" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.183892 5030 generic.go:358] "Generic (PLEG): container finished" podID="a038e719-8daa-4048-9f52-ed96166f9507" containerID="68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6" exitCode=143 Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.184150 5030 scope.go:117] "RemoveContainer" containerID="68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.184267 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-65ppj/must-gather-78j2v" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.202636 5030 scope.go:117] "RemoveContainer" containerID="2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.288719 5030 scope.go:117] "RemoveContainer" containerID="68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6" Mar 16 13:55:08 crc kubenswrapper[5030]: E0316 13:55:08.289071 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6\": container with ID starting with 68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6 not found: ID does not exist" containerID="68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.289121 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6"} err="failed to get container status \"68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6\": rpc error: code = NotFound desc = could not find container \"68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6\": container with ID starting with 68a009344339e1d775fd1f31891f7dfecfff08d7332594af54f9b5bae7cec7f6 not found: ID does not exist" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.289149 5030 scope.go:117] "RemoveContainer" containerID="2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a" Mar 16 13:55:08 crc kubenswrapper[5030]: E0316 13:55:08.289389 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a\": container with ID starting with 2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a not found: ID does not exist" containerID="2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a" Mar 16 13:55:08 crc kubenswrapper[5030]: I0316 13:55:08.289419 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a"} err="failed to get container status \"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a\": rpc error: code = NotFound desc = could not find container \"2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a\": container with ID starting with 2b6cf259f31d3eb9d38d6c953073598190e7780d8c78f9b8417ebf58242ec04a not found: ID does not exist" Mar 16 13:55:24 crc kubenswrapper[5030]: I0316 13:55:24.287228 5030 patch_prober.go:28] interesting pod/machine-config-daemon-b7rgl container/machine-config-daemon namespace/openshift-machine-config-operator: Liveness probe status=failure output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" start-of-body= Mar 16 13:55:24 crc kubenswrapper[5030]: I0316 13:55:24.287845 5030 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" probeResult="failure" output="Get \"http://127.0.0.1:8798/health\": dial tcp 127.0.0.1:8798: connect: connection refused" Mar 16 13:55:24 crc kubenswrapper[5030]: I0316 13:55:24.287900 5030 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" Mar 16 13:55:24 crc kubenswrapper[5030]: I0316 13:55:24.288561 5030 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="machine-config-daemon" containerStatusID={"Type":"cri-o","ID":"85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c"} pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" containerMessage="Container machine-config-daemon failed liveness probe, will be restarted" Mar 16 13:55:24 crc kubenswrapper[5030]: I0316 13:55:24.288616 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerName="machine-config-daemon" containerID="cri-o://85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" gracePeriod=600 Mar 16 13:55:24 crc kubenswrapper[5030]: E0316 13:55:24.407139 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:55:25 crc kubenswrapper[5030]: I0316 13:55:25.322136 5030 generic.go:358] "Generic (PLEG): container finished" podID="772f09fa-7db8-4626-a5ad-5c9779b8170d" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" exitCode=0 Mar 16 13:55:25 crc kubenswrapper[5030]: I0316 13:55:25.322212 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" event={"ID":"772f09fa-7db8-4626-a5ad-5c9779b8170d","Type":"ContainerDied","Data":"85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c"} Mar 16 13:55:25 crc kubenswrapper[5030]: I0316 13:55:25.322264 5030 scope.go:117] "RemoveContainer" containerID="c2c157204e5774e32efeadae59b98f264b14e90f6aefa5476e81b278ce028b92" Mar 16 13:55:25 crc kubenswrapper[5030]: I0316 13:55:25.322747 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:55:25 crc kubenswrapper[5030]: E0316 13:55:25.323065 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:55:36 crc kubenswrapper[5030]: I0316 13:55:36.946084 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:55:36 crc kubenswrapper[5030]: E0316 13:55:36.947097 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:55:51 crc kubenswrapper[5030]: I0316 13:55:51.946146 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:55:51 crc kubenswrapper[5030]: E0316 13:55:51.947055 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:55:53 crc kubenswrapper[5030]: E0316 13:55:53.577681 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1305125 actualBytes=10240 Mar 16 13:55:57 crc kubenswrapper[5030]: I0316 13:55:57.303426 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:55:57 crc kubenswrapper[5030]: I0316 13:55:57.313746 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:55:57 crc kubenswrapper[5030]: I0316 13:55:57.368733 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wfwbx_9c20ed32-4ad5-4984-9876-39b7b1ee1877/kube-multus/0.log" Mar 16 13:55:57 crc kubenswrapper[5030]: I0316 13:55:57.376365 5030 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_kube-controller-manager-crc_9f0bc7fcb0822a2c13eb2d22cd8c0641/kube-controller-manager/0.log" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.140945 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-infra/auto-csr-approver-29561156-dnrnh"] Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.142887 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="gather" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.142913 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="gather" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.142981 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="copy" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.142991 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="copy" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.143006 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0158af3-9186-4f81-8c42-3ca81809dcf1" containerName="oc" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.143015 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0158af3-9186-4f81-8c42-3ca81809dcf1" containerName="oc" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.143231 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="gather" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.143262 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0158af3-9186-4f81-8c42-3ca81809dcf1" containerName="oc" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.143287 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="a038e719-8daa-4048-9f52-ed96166f9507" containerName="copy" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.154220 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561156-dnrnh"] Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.154433 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.157315 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"kube-root-ca.crt\"" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.157906 5030 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-infra\"/\"csr-approver-sa-dockercfg-sgvbv\"" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.158138 5030 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-infra\"/\"openshift-service-ca.crt\"" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.159112 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgjh\" (UniqueName: \"kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh\") pod \"auto-csr-approver-29561156-dnrnh\" (UID: \"dcb51be6-1016-4f22-ad59-697ce121389c\") " pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.261377 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgjh\" (UniqueName: \"kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh\") pod \"auto-csr-approver-29561156-dnrnh\" (UID: \"dcb51be6-1016-4f22-ad59-697ce121389c\") " pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.281671 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgjh\" (UniqueName: \"kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh\") pod \"auto-csr-approver-29561156-dnrnh\" (UID: \"dcb51be6-1016-4f22-ad59-697ce121389c\") " pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.475285 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:00 crc kubenswrapper[5030]: I0316 13:56:00.879124 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-infra/auto-csr-approver-29561156-dnrnh"] Mar 16 13:56:00 crc kubenswrapper[5030]: W0316 13:56:00.883967 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcb51be6_1016_4f22_ad59_697ce121389c.slice/crio-f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e WatchSource:0}: Error finding container f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e: Status 404 returned error can't find the container with id f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e Mar 16 13:56:01 crc kubenswrapper[5030]: I0316 13:56:01.653405 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" event={"ID":"dcb51be6-1016-4f22-ad59-697ce121389c","Type":"ContainerStarted","Data":"f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e"} Mar 16 13:56:02 crc kubenswrapper[5030]: I0316 13:56:02.664625 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" event={"ID":"dcb51be6-1016-4f22-ad59-697ce121389c","Type":"ContainerStarted","Data":"35bd3fa3b5b744118db367dc63938c41ee4de4b01383c0c3a4005f8306ce2bec"} Mar 16 13:56:02 crc kubenswrapper[5030]: I0316 13:56:02.680250 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" podStartSLOduration=1.238758918 podStartE2EDuration="2.680235813s" podCreationTimestamp="2026-03-16 13:56:00 +0000 UTC" firstStartedPulling="2026-03-16 13:56:00.885272189 +0000 UTC m=+3005.284584726" lastFinishedPulling="2026-03-16 13:56:02.326749074 +0000 UTC m=+3006.726061621" observedRunningTime="2026-03-16 13:56:02.676414176 +0000 UTC m=+3007.075726724" watchObservedRunningTime="2026-03-16 13:56:02.680235813 +0000 UTC m=+3007.079548360" Mar 16 13:56:03 crc kubenswrapper[5030]: I0316 13:56:03.675853 5030 generic.go:358] "Generic (PLEG): container finished" podID="dcb51be6-1016-4f22-ad59-697ce121389c" containerID="35bd3fa3b5b744118db367dc63938c41ee4de4b01383c0c3a4005f8306ce2bec" exitCode=0 Mar 16 13:56:03 crc kubenswrapper[5030]: I0316 13:56:03.676038 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" event={"ID":"dcb51be6-1016-4f22-ad59-697ce121389c","Type":"ContainerDied","Data":"35bd3fa3b5b744118db367dc63938c41ee4de4b01383c0c3a4005f8306ce2bec"} Mar 16 13:56:04 crc kubenswrapper[5030]: I0316 13:56:04.942639 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.043061 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjgjh\" (UniqueName: \"kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh\") pod \"dcb51be6-1016-4f22-ad59-697ce121389c\" (UID: \"dcb51be6-1016-4f22-ad59-697ce121389c\") " Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.049176 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh" (OuterVolumeSpecName: "kube-api-access-jjgjh") pod "dcb51be6-1016-4f22-ad59-697ce121389c" (UID: "dcb51be6-1016-4f22-ad59-697ce121389c"). InnerVolumeSpecName "kube-api-access-jjgjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.146053 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjgjh\" (UniqueName: \"kubernetes.io/projected/dcb51be6-1016-4f22-ad59-697ce121389c-kube-api-access-jjgjh\") on node \"crc\" DevicePath \"\"" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.698031 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.698048 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-infra/auto-csr-approver-29561156-dnrnh" event={"ID":"dcb51be6-1016-4f22-ad59-697ce121389c","Type":"ContainerDied","Data":"f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e"} Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.698481 5030 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1b0ab579f60c6088190ab89cd5b314441b36b5a45ca5da5655bdfd3b592358e" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.731856 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-infra/auto-csr-approver-29561150-n99zr"] Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.737751 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-infra/auto-csr-approver-29561150-n99zr"] Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.955412 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95eedf89-5260-4150-88a1-eb6ca5eab829" path="/var/lib/kubelet/pods/95eedf89-5260-4150-88a1-eb6ca5eab829/volumes" Mar 16 13:56:05 crc kubenswrapper[5030]: I0316 13:56:05.957264 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:56:05 crc kubenswrapper[5030]: E0316 13:56:05.957667 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:56:20 crc kubenswrapper[5030]: I0316 13:56:20.946097 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:56:20 crc kubenswrapper[5030]: E0316 13:56:20.947029 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:56:33 crc kubenswrapper[5030]: I0316 13:56:33.945690 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:56:33 crc kubenswrapper[5030]: E0316 13:56:33.946625 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:56:37 crc kubenswrapper[5030]: I0316 13:56:37.003540 5030 scope.go:117] "RemoveContainer" containerID="e7c031a8dbdf6cff58a1aca9ca2956c3d95d6733765c810ca3fd51e5e655bd03" Mar 16 13:56:47 crc kubenswrapper[5030]: I0316 13:56:47.946400 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:56:47 crc kubenswrapper[5030]: E0316 13:56:47.947290 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.027159 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.028843 5030 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcb51be6-1016-4f22-ad59-697ce121389c" containerName="oc" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.028930 5030 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcb51be6-1016-4f22-ad59-697ce121389c" containerName="oc" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.029158 5030 memory_manager.go:356] "RemoveStaleState removing state" podUID="dcb51be6-1016-4f22-ad59-697ce121389c" containerName="oc" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.034409 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.036174 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.112909 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4b4j\" (UniqueName: \"kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.112980 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.113069 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.214876 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4b4j\" (UniqueName: \"kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.214937 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.214976 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.215432 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.215488 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.234962 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4b4j\" (UniqueName: \"kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j\") pod \"certified-operators-rrtx6\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.350783 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:56:52 crc kubenswrapper[5030]: I0316 13:56:52.547085 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:56:53 crc kubenswrapper[5030]: I0316 13:56:53.108321 5030 generic.go:358] "Generic (PLEG): container finished" podID="8bccbc6a-57a1-451b-9d44-18c47a6c83be" containerID="eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657" exitCode=0 Mar 16 13:56:53 crc kubenswrapper[5030]: I0316 13:56:53.108585 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerDied","Data":"eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657"} Mar 16 13:56:53 crc kubenswrapper[5030]: I0316 13:56:53.108654 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerStarted","Data":"106720aee5b8fbf588cddc20f25b13fe453535c4fc66f8716c310d0ed9a8f592"} Mar 16 13:56:54 crc kubenswrapper[5030]: I0316 13:56:54.123287 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerStarted","Data":"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e"} Mar 16 13:56:54 crc kubenswrapper[5030]: E0316 13:56:54.292973 5030 prober.go:256] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=1313178 actualBytes=10240 Mar 16 13:56:55 crc kubenswrapper[5030]: I0316 13:56:55.132309 5030 generic.go:358] "Generic (PLEG): container finished" podID="8bccbc6a-57a1-451b-9d44-18c47a6c83be" containerID="3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e" exitCode=0 Mar 16 13:56:55 crc kubenswrapper[5030]: I0316 13:56:55.132402 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerDied","Data":"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e"} Mar 16 13:56:56 crc kubenswrapper[5030]: I0316 13:56:56.143601 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerStarted","Data":"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925"} Mar 16 13:56:56 crc kubenswrapper[5030]: I0316 13:56:56.163288 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/certified-operators-rrtx6" podStartSLOduration=3.311351692 podStartE2EDuration="4.163254685s" podCreationTimestamp="2026-03-16 13:56:52 +0000 UTC" firstStartedPulling="2026-03-16 13:56:53.109349205 +0000 UTC m=+3057.508661752" lastFinishedPulling="2026-03-16 13:56:53.961252198 +0000 UTC m=+3058.360564745" observedRunningTime="2026-03-16 13:56:56.160456743 +0000 UTC m=+3060.559769290" watchObservedRunningTime="2026-03-16 13:56:56.163254685 +0000 UTC m=+3060.562567232" Mar 16 13:56:58 crc kubenswrapper[5030]: I0316 13:56:58.946746 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:56:58 crc kubenswrapper[5030]: E0316 13:56:58.947023 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.208400 5030 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.240895 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.248410 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.352516 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2cwv\" (UniqueName: \"kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.352601 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.352627 5030 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.453800 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.453965 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.454188 5030 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2cwv\" (UniqueName: \"kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.454348 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.454393 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.479389 5030 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2cwv\" (UniqueName: \"kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv\") pod \"redhat-marketplace-tlwqq\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.566958 5030 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:56:59 crc kubenswrapper[5030]: I0316 13:56:59.998819 5030 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:57:00 crc kubenswrapper[5030]: W0316 13:57:00.004570 5030 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf6164b_a203_4124_92d0_9ed9c431f8d0.slice/crio-f7ebf4ed5288298c959f49f626bef474540caaa14a37183d55e8b99a4bd3aa8d WatchSource:0}: Error finding container f7ebf4ed5288298c959f49f626bef474540caaa14a37183d55e8b99a4bd3aa8d: Status 404 returned error can't find the container with id f7ebf4ed5288298c959f49f626bef474540caaa14a37183d55e8b99a4bd3aa8d Mar 16 13:57:00 crc kubenswrapper[5030]: I0316 13:57:00.177233 5030 generic.go:358] "Generic (PLEG): container finished" podID="dcf6164b-a203-4124-92d0-9ed9c431f8d0" containerID="fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e" exitCode=0 Mar 16 13:57:00 crc kubenswrapper[5030]: I0316 13:57:00.177303 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerDied","Data":"fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e"} Mar 16 13:57:00 crc kubenswrapper[5030]: I0316 13:57:00.177690 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerStarted","Data":"f7ebf4ed5288298c959f49f626bef474540caaa14a37183d55e8b99a4bd3aa8d"} Mar 16 13:57:01 crc kubenswrapper[5030]: I0316 13:57:01.189527 5030 generic.go:358] "Generic (PLEG): container finished" podID="dcf6164b-a203-4124-92d0-9ed9c431f8d0" containerID="06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3" exitCode=0 Mar 16 13:57:01 crc kubenswrapper[5030]: I0316 13:57:01.189597 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerDied","Data":"06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3"} Mar 16 13:57:02 crc kubenswrapper[5030]: I0316 13:57:02.203591 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerStarted","Data":"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44"} Mar 16 13:57:02 crc kubenswrapper[5030]: I0316 13:57:02.229213 5030 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/redhat-marketplace-tlwqq" podStartSLOduration=2.617133978 podStartE2EDuration="3.229190136s" podCreationTimestamp="2026-03-16 13:56:59 +0000 UTC" firstStartedPulling="2026-03-16 13:57:00.178641445 +0000 UTC m=+3064.577953992" lastFinishedPulling="2026-03-16 13:57:00.790697603 +0000 UTC m=+3065.190010150" observedRunningTime="2026-03-16 13:57:02.220655705 +0000 UTC m=+3066.619968312" watchObservedRunningTime="2026-03-16 13:57:02.229190136 +0000 UTC m=+3066.628502684" Mar 16 13:57:02 crc kubenswrapper[5030]: I0316 13:57:02.351371 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:02 crc kubenswrapper[5030]: I0316 13:57:02.351659 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:02 crc kubenswrapper[5030]: I0316 13:57:02.390280 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:03 crc kubenswrapper[5030]: I0316 13:57:03.258798 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:06 crc kubenswrapper[5030]: I0316 13:57:06.597014 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:57:06 crc kubenswrapper[5030]: I0316 13:57:06.597506 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/certified-operators-rrtx6" podUID="8bccbc6a-57a1-451b-9d44-18c47a6c83be" containerName="registry-server" containerID="cri-o://1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925" gracePeriod=2 Mar 16 13:57:06 crc kubenswrapper[5030]: I0316 13:57:06.951003 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.107949 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4b4j\" (UniqueName: \"kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j\") pod \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.108266 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities\") pod \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.108374 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content\") pod \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\" (UID: \"8bccbc6a-57a1-451b-9d44-18c47a6c83be\") " Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.109292 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities" (OuterVolumeSpecName: "utilities") pod "8bccbc6a-57a1-451b-9d44-18c47a6c83be" (UID: "8bccbc6a-57a1-451b-9d44-18c47a6c83be"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.109676 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.116188 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j" (OuterVolumeSpecName: "kube-api-access-l4b4j") pod "8bccbc6a-57a1-451b-9d44-18c47a6c83be" (UID: "8bccbc6a-57a1-451b-9d44-18c47a6c83be"). InnerVolumeSpecName "kube-api-access-l4b4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.140111 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "8bccbc6a-57a1-451b-9d44-18c47a6c83be" (UID: "8bccbc6a-57a1-451b-9d44-18c47a6c83be"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.212307 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/8bccbc6a-57a1-451b-9d44-18c47a6c83be-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.212345 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4b4j\" (UniqueName: \"kubernetes.io/projected/8bccbc6a-57a1-451b-9d44-18c47a6c83be-kube-api-access-l4b4j\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.254750 5030 generic.go:358] "Generic (PLEG): container finished" podID="8bccbc6a-57a1-451b-9d44-18c47a6c83be" containerID="1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925" exitCode=0 Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.254911 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/certified-operators-rrtx6" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.254912 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerDied","Data":"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925"} Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.255012 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/certified-operators-rrtx6" event={"ID":"8bccbc6a-57a1-451b-9d44-18c47a6c83be","Type":"ContainerDied","Data":"106720aee5b8fbf588cddc20f25b13fe453535c4fc66f8716c310d0ed9a8f592"} Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.255049 5030 scope.go:117] "RemoveContainer" containerID="1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.288380 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.291290 5030 scope.go:117] "RemoveContainer" containerID="3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.296400 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/certified-operators-rrtx6"] Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.307462 5030 scope.go:117] "RemoveContainer" containerID="eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.324952 5030 scope.go:117] "RemoveContainer" containerID="1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925" Mar 16 13:57:07 crc kubenswrapper[5030]: E0316 13:57:07.325274 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925\": container with ID starting with 1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925 not found: ID does not exist" containerID="1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.325332 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925"} err="failed to get container status \"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925\": rpc error: code = NotFound desc = could not find container \"1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925\": container with ID starting with 1a905cc4d477f38a9d9d9314ccea717f138a5f631fc558269d33d6b139078925 not found: ID does not exist" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.325426 5030 scope.go:117] "RemoveContainer" containerID="3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e" Mar 16 13:57:07 crc kubenswrapper[5030]: E0316 13:57:07.325710 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e\": container with ID starting with 3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e not found: ID does not exist" containerID="3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.325756 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e"} err="failed to get container status \"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e\": rpc error: code = NotFound desc = could not find container \"3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e\": container with ID starting with 3fcdcbfce928c54d4a4a51acd64ed3e14f2e13b6e79c44afb174fd09b8d7572e not found: ID does not exist" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.325780 5030 scope.go:117] "RemoveContainer" containerID="eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657" Mar 16 13:57:07 crc kubenswrapper[5030]: E0316 13:57:07.326095 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657\": container with ID starting with eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657 not found: ID does not exist" containerID="eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.326123 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657"} err="failed to get container status \"eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657\": rpc error: code = NotFound desc = could not find container \"eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657\": container with ID starting with eb8cd6e33c5ed75eb5140ad68dd093238d46288103b5c06af6eb20ab24013657 not found: ID does not exist" Mar 16 13:57:07 crc kubenswrapper[5030]: I0316 13:57:07.955996 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bccbc6a-57a1-451b-9d44-18c47a6c83be" path="/var/lib/kubelet/pods/8bccbc6a-57a1-451b-9d44-18c47a6c83be/volumes" Mar 16 13:57:09 crc kubenswrapper[5030]: I0316 13:57:09.567259 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:09 crc kubenswrapper[5030]: I0316 13:57:09.567726 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:09 crc kubenswrapper[5030]: I0316 13:57:09.604716 5030 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:09 crc kubenswrapper[5030]: I0316 13:57:09.955974 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:57:09 crc kubenswrapper[5030]: E0316 13:57:09.956298 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d" Mar 16 13:57:10 crc kubenswrapper[5030]: I0316 13:57:10.319491 5030 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.395848 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.396394 5030 kuberuntime_container.go:858] "Killing container with a grace period" pod="openshift-marketplace/redhat-marketplace-tlwqq" podUID="dcf6164b-a203-4124-92d0-9ed9c431f8d0" containerName="registry-server" containerID="cri-o://421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44" gracePeriod=2 Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.747821 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.815468 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content\") pod \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.815651 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2cwv\" (UniqueName: \"kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv\") pod \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.815737 5030 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities\") pod \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\" (UID: \"dcf6164b-a203-4124-92d0-9ed9c431f8d0\") " Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.816905 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities" (OuterVolumeSpecName: "utilities") pod "dcf6164b-a203-4124-92d0-9ed9c431f8d0" (UID: "dcf6164b-a203-4124-92d0-9ed9c431f8d0"). InnerVolumeSpecName "utilities". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.817981 5030 reconciler_common.go:299] "Volume detached for volume \"utilities\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-utilities\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.823668 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv" (OuterVolumeSpecName: "kube-api-access-t2cwv") pod "dcf6164b-a203-4124-92d0-9ed9c431f8d0" (UID: "dcf6164b-a203-4124-92d0-9ed9c431f8d0"). InnerVolumeSpecName "kube-api-access-t2cwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.834086 5030 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content" (OuterVolumeSpecName: "catalog-content") pod "dcf6164b-a203-4124-92d0-9ed9c431f8d0" (UID: "dcf6164b-a203-4124-92d0-9ed9c431f8d0"). InnerVolumeSpecName "catalog-content". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.919125 5030 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2cwv\" (UniqueName: \"kubernetes.io/projected/dcf6164b-a203-4124-92d0-9ed9c431f8d0-kube-api-access-t2cwv\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:12 crc kubenswrapper[5030]: I0316 13:57:12.919157 5030 reconciler_common.go:299] "Volume detached for volume \"catalog-content\" (UniqueName: \"kubernetes.io/empty-dir/dcf6164b-a203-4124-92d0-9ed9c431f8d0-catalog-content\") on node \"crc\" DevicePath \"\"" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.317145 5030 generic.go:358] "Generic (PLEG): container finished" podID="dcf6164b-a203-4124-92d0-9ed9c431f8d0" containerID="421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44" exitCode=0 Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.317281 5030 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/redhat-marketplace-tlwqq" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.317258 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerDied","Data":"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44"} Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.317348 5030 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/redhat-marketplace-tlwqq" event={"ID":"dcf6164b-a203-4124-92d0-9ed9c431f8d0","Type":"ContainerDied","Data":"f7ebf4ed5288298c959f49f626bef474540caaa14a37183d55e8b99a4bd3aa8d"} Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.317380 5030 scope.go:117] "RemoveContainer" containerID="421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.339529 5030 scope.go:117] "RemoveContainer" containerID="06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.356183 5030 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.361761 5030 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-marketplace/redhat-marketplace-tlwqq"] Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.375152 5030 scope.go:117] "RemoveContainer" containerID="fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.387539 5030 scope.go:117] "RemoveContainer" containerID="421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44" Mar 16 13:57:13 crc kubenswrapper[5030]: E0316 13:57:13.387947 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44\": container with ID starting with 421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44 not found: ID does not exist" containerID="421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.387986 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44"} err="failed to get container status \"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44\": rpc error: code = NotFound desc = could not find container \"421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44\": container with ID starting with 421214ca2ebe6b97e17ba7f3b9f22aaec49113161c5845650f5e383720de9a44 not found: ID does not exist" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.388012 5030 scope.go:117] "RemoveContainer" containerID="06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3" Mar 16 13:57:13 crc kubenswrapper[5030]: E0316 13:57:13.388350 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3\": container with ID starting with 06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3 not found: ID does not exist" containerID="06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.388384 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3"} err="failed to get container status \"06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3\": rpc error: code = NotFound desc = could not find container \"06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3\": container with ID starting with 06fd50ee499921f434756e2d837e485c8a6ef5ef7da31bfc84ac37ee0be99fe3 not found: ID does not exist" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.388411 5030 scope.go:117] "RemoveContainer" containerID="fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e" Mar 16 13:57:13 crc kubenswrapper[5030]: E0316 13:57:13.388772 5030 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e\": container with ID starting with fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e not found: ID does not exist" containerID="fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.388800 5030 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e"} err="failed to get container status \"fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e\": rpc error: code = NotFound desc = could not find container \"fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e\": container with ID starting with fa080da20e7d35b111743fc6d57fb314890a529952ef179ad3a4280287629b9e not found: ID does not exist" Mar 16 13:57:13 crc kubenswrapper[5030]: I0316 13:57:13.955167 5030 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf6164b-a203-4124-92d0-9ed9c431f8d0" path="/var/lib/kubelet/pods/dcf6164b-a203-4124-92d0-9ed9c431f8d0/volumes" Mar 16 13:57:21 crc kubenswrapper[5030]: I0316 13:57:21.946129 5030 scope.go:117] "RemoveContainer" containerID="85b15f577999f3e7d33ab0005b9d2935fe3ef902c8d7d0d236075eb9b0c6ef4c" Mar 16 13:57:21 crc kubenswrapper[5030]: E0316 13:57:21.948071 5030 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"machine-config-daemon\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=machine-config-daemon pod=machine-config-daemon-b7rgl_openshift-machine-config-operator(772f09fa-7db8-4626-a5ad-5c9779b8170d)\"" pod="openshift-machine-config-operator/machine-config-daemon-b7rgl" podUID="772f09fa-7db8-4626-a5ad-5c9779b8170d"